2024-09-16T00:30:46.303 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T00:30:46.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T00:30:46.423 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906414' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMu6ddmw4HXvGYuzH8k0iESluFs1VyupHt9SZ9uzeffjpE6WF3dI14mLafplQZzvqMBJtfrQOkj00IcCexDi7SQ= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGQl1oh/4H4xMXrjvL9qSJII/GXUWK3762tMcwtvEgZ1LoI6NzqPBbflJFSzPycbx0LlUGsLx0WG8iOgOaE32k= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-16T00:30:46.423 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T00:30:46.424 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T00:30:46.424 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T00:30:46.426 INFO:teuthology.task.internal:Checking packages... 2024-09-16T00:30:46.446 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T00:30:46.446 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T00:30:46.446 INFO:teuthology.packaging:ref: None 2024-09-16T00:30:46.446 INFO:teuthology.packaging:tag: None 2024-09-16T00:30:46.446 INFO:teuthology.packaging:branch: squid 2024-09-16T00:30:46.446 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:30:46.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T00:30:46.644 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T00:30:46.646 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T00:30:46.652 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T00:30:46.653 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T00:30:46.660 INFO:teuthology.task.internal:Saving configuration 2024-09-16T00:30:46.679 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T00:30:46.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T00:30:46.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:25:46.879602', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMu6ddmw4HXvGYuzH8k0iESluFs1VyupHt9SZ9uzeffjpE6WF3dI14mLafplQZzvqMBJtfrQOkj00IcCexDi7SQ='} 2024-09-16T00:30:46.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:25:46.881508', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGQl1oh/4H4xMXrjvL9qSJII/GXUWK3762tMcwtvEgZ1LoI6NzqPBbflJFSzPycbx0LlUGsLx0WG8iOgOaE32k='} 2024-09-16T00:30:46.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T00:30:46.739 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-16T00:30:46.740 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-16T00:30:46.740 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T00:30:46.801 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f710431fbe0>, signals=[15]) 2024-09-16T00:30:46.802 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T00:30:46.809 INFO:teuthology.task.internal:Opening connections... 2024-09-16T00:30:46.809 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:30:46.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:30:46.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-16T00:30:46.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:30:46.963 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T00:30:46.971 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-16T00:30:46.989 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-16T00:30:46.990 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-09-16T00:30:47.048 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:30:47.049 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:30:47.049 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:30:47.049 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:30:47.049 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:30:47.049 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:30:47.049 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-16T00:30:47.077 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-16T00:30:47.096 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-16T00:30:47.097 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-16T00:30:47.155 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T00:30:47.156 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T00:30:47.156 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-16T00:30:47.177 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T00:30:47.186 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T00:30:47.197 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T00:30:47.197 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:30:47.199 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-16T00:30:47.216 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T00:30:47.223 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T00:30:47.223 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:30:47.256 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-16T00:30:47.390 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T00:30:47.443 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T00:30:47.461 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T00:30:47.461 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T00:30:47.462 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:30:47.462 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T00:30:47.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:30:47.479 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-16T00:30:47.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:30:47.480 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-16T00:30:47.536 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:30:47.537 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-503.el9.x86_64 2024-09-16T00:30:47.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-09-16T00:30:47.538 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-503.el9.x86_64 2024-09-16T00:30:47.538 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-503.el9.x86_64 2024-09-16T00:30:47.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-09-16T00:30:50.658 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-09-16T00:30:50.860 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-16T00:30:52.492 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-16T00:30:52.968 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-16T00:30:57.685 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-16T00:30:59.119 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-16T00:30:59.344 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-16T00:31:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T00:31:01.345 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-16T00:31:02.324 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-16T00:31:05.729 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-16T00:31:07.705 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T00:31:07.768 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:31:07.769 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:31:07.878 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:31:07.884 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 79 M 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 126 M 2024-09-16T00:31:07.885 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:31:08.005 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 229 kB/s | 23 kB 00:00 2024-09-16T00:31:08.405 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-16T00:31:08.797 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-16T00:31:09.114 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-16T00:31:09.114 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:31:09.115 INFO:teuthology.orchestra.run.smithi053.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-16T00:31:09.670 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T00:31:09.670 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T00:31:09.770 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T00:31:09.776 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:31:09.777 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 79 M 2024-09-16T00:31:09.778 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 126 M 2024-09-16T00:31:09.778 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:31:09.830 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:31:09.915 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 250 kB/s | 23 kB 00:00 2024-09-16T00:31:10.229 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:31:10.229 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:31:11.225 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:31:11.225 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:31:12.114 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-09-16T00:31:13.789 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:31:14.440 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:31:14.531 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:31:14.864 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.8 MB/s | 29 MB 00:04 2024-09-16T00:31:15.623 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.0 MB/s | 35 MB 00:05 2024-09-16T00:31:15.623 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:31:15.623 INFO:teuthology.orchestra.run.smithi152.stdout:Total 13 MB/s | 79 MB 00:05 2024-09-16T00:31:16.310 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:31:16.682 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:31:16.682 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:31:17.306 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:31:17.444 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:31:17.657 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:31:17.657 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:31:20.100 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:31:20.757 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:31:20.858 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:31:22.575 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:31:22.620 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:31:23.652 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:31:23.771 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:31:27.758 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:31:28.591 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:31:28.846 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:31:33.670 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:06.844 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:06.885 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:07.224 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:07.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:32:07.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:32:07.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.105 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.108 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.108 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:32:08.108 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:32:08.445 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:32:08.534 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.534 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:32:08.535 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:32:08.535 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:32:08.535 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:32:08.535 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-16T00:32:08.535 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:32:08.535 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:32:08.594 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:08.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:32:08.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo rpm -qi grub2-tools 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Name : grub2-tools 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Epoch : 1 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Version : 2.06 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Release : 82.el9 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: x86_64 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Group : Unspecified 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:Size : 8274670 2024-09-16T00:32:08.628 INFO:teuthology.orchestra.run.smithi053.stdout:License : GPLv3+ 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Packager : builder@centos.org 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Vendor : CentOS 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Summary : Support tools for GRUB. 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:Description : 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout:hardware devices. 2024-09-16T00:32:08.629 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:32:08.630 INFO:teuthology.orchestra.run.smithi053.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:32:08.630 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:32:08.630 INFO:teuthology.task.kernel:Updating grub on smithi053 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:32:08.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:32:09.268 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-16T00:32:10.527 INFO:teuthology.orchestra.run.smithi053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:32:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-16T00:32:10.572 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-16T00:32:10.587 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.4bx0Yicp6r 2024-09-16T00:32:10.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4bx0Yicp6r 2024-09-16T00:32:10.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.4bx0Yicp6r 2024-09-16T00:32:10.793 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.4bx0Yicp6r is 6KB 2024-09-16T00:32:10.845 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.4bx0Yicp6r 2024-09-16T00:32:10.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:32:10.922 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:32:10.922 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:32:10.922 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:32:10.922 INFO:teuthology.orchestra.run.smithi053.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:32:10.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:32:11.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-16T00:32:11.919 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:12.221 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:12.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T00:32:12.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T00:32:12.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T00:32:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T00:32:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:32:13.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:32:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.035 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.036 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:32:13.036 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:32:13.402 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:32:13.491 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.491 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:32:13.491 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T00:32:13.492 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T00:32:13.492 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T00:32:13.492 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-16T00:32:13.492 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T00:32:13.492 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T00:32:13.551 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T00:32:13.551 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T00:32:13.551 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 82.el9 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8274670 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-09-16T00:32:13.592 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T00:32:13.593 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-09-16T00:32:13.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:32:13.594 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T00:32:13.594 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T00:32:13.595 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-505.el9.x86_64 2024-09-16T00:32:13.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T00:32:14.323 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-09-16T00:32:15.714 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T00:32:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-09-16T00:32:15.766 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-16T00:32:15.782 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.Q6ifoPeSff 2024-09-16T00:32:15.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Q6ifoPeSff 2024-09-16T00:32:15.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.Q6ifoPeSff 2024-09-16T00:32:15.989 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.Q6ifoPeSff is 6KB 2024-09-16T00:32:16.038 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.Q6ifoPeSff 2024-09-16T00:32:16.053 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T00:32:16.118 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T00:32:16.119 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T00:32:16.119 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T00:32:16.119 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T00:32:16.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T00:32:16.282 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-09-16T00:32:41.091 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-16T00:32:41.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-16T00:32:41.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:32:46.289 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-16T00:32:46.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:32:46.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:32:59.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-16T00:33:04.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-16T00:33:08.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-16T00:33:08.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:33:13.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:33:13.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:33:16.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-16T00:33:28.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:33:28.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:33:40.511 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-16T00:33:40.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-16T00:33:40.927 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:33:40.927 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-16T00:33:40.942 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:33:40.942 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:33:40.942 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:33:40.942 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:33:41.944 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-16T00:33:41.944 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T00:33:42.026 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-16T00:33:42.057 DEBUG:teuthology.parallel:result is None 2024-09-16T00:33:47.325 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-16T00:34:02.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:34:02.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:34:02.710 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-16T00:34:03.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:34:03.083 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-16T00:34:03.083 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-16T00:34:03.097 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-505.el9.x86_64 2024-09-16T00:34:03.097 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T00:34:03.097 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T00:34:03.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T00:34:04.098 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-16T00:34:04.098 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T00:34:04.179 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-09-16T00:34:04.203 DEBUG:teuthology.parallel:result is None 2024-09-16T00:34:04.203 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T00:34:04.211 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T00:34:04.211 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:34:04.214 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T00:34:04.232 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T00:34:04.239 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T00:34:04.250 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T00:34:04.250 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:34:04.275 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T00:34:04.308 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T00:34:04.314 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T00:34:04.314 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:34:04.344 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T00:34:04.374 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:34:04.379 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:34:04.386 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:34:04.389 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T00:34:04.391 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T00:34:04.398 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T00:34:04.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:34:04.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T00:34:04.457 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T00:34:04.466 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T00:34:04.466 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:34:04.500 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T00:34:04.515 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:34:04.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:34:04.649 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:34:04.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:34:04.776 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:34:04.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:34:04.843 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:34:04.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T00:34:04.942 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:34:05.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T00:34:05.065 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:34:05.065 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T00:34:05.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-16T00:34:05.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-16T00:34:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:34:05.313 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T00:34:05.741 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T00:34:05.749 INFO:teuthology.task.internal:Starting timer... 2024-09-16T00:34:05.749 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T00:34:05.839 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T00:34:05.849 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T00:34:05.850 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-09-16T00:34:05.903 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-09-16T00:34:05.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-16T00:34:06.018 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-16T00:34:06.023 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T00:34:06.023 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-09-16T00:34:06.051 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-09-16T00:34:06.052 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-16T00:34:06.097 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-16T00:34:06.097 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-09-16T00:34:06.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:34:06.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:34:06.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T00:34:06.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:34:06.235 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T00:34:06.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:34:06.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-16T00:34:06.334 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T00:34:06.343 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T00:34:06.346 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T00:34:06.476 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T00:34:06.487 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T00:34:06.488 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T00:37:56.189 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-09-16T00:37:56.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-16T00:37:56.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:37:56.271 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-16T00:37:56.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-16T00:37:56.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:37:56.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T00:37:56.426 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-16T00:37:56.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-16T00:37:56.508 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T00:37:56.522 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T00:37:56.522 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:37:56.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:37:56.525 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T00:37:56.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T00:37:56.553 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:37:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:37:56.578 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T00:37:56.593 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T00:37:56.595 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-09-16T00:37:56.607 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-09-16T00:37:56.617 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-16T00:37:56.622 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:37:56.628 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-16T00:37:56.637 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:37:56.642 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T00:37:56.656 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T00:37:56.697 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.721 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-16T00:37:56.722 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T00:37:56.722 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-16T00:37:56.722 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.722 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.722 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.723 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T00:37:56.723 INFO:teuthology.run_tasks:Running task install... 2024-09-16T00:37:56.731 DEBUG:teuthology.task.install:project ceph 2024-09-16T00:37:56.732 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T00:37:56.732 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T00:37:56.732 INFO:teuthology.task.install:Using flavor: default 2024-09-16T00:37:56.737 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T00:37:56.738 INFO:teuthology.task.install:extra packages: [] 2024-09-16T00:37:56.738 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-16T00:37:56.738 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:37:56.738 INFO:teuthology.packaging:ref: None 2024-09-16T00:37:56.738 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:37:56.739 INFO:teuthology.packaging:branch: None 2024-09-16T00:37:56.739 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:37:57.292 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-16T00:37:57.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-16T00:37:57.294 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-16T00:37:57.294 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:37:57.295 INFO:teuthology.packaging:ref: None 2024-09-16T00:37:57.295 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:37:57.295 INFO:teuthology.packaging:branch: None 2024-09-16T00:37:57.295 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:37:57.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-16T00:37:57.440 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-16T00:37:57.440 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-16T00:37:57.444 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-16T00:37:57.444 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-16T00:37:57.490 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:37:57.490 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:37:57.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:37:57.497 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T00:37:57.497 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:37:57.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T00:37:57.521 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T00:37:57.522 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:37:57.522 INFO:teuthology.packaging:ref: None 2024-09-16T00:37:57.522 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:37:57.522 INFO:teuthology.packaging:branch: None 2024-09-16T00:37:57.522 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:37:57.522 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:37:57.525 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T00:37:57.525 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:37:57.525 INFO:teuthology.packaging:ref: None 2024-09-16T00:37:57.526 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:37:57.526 INFO:teuthology.packaging:branch: None 2024-09-16T00:37:57.526 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:37:57.526 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T00:37:57.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:37:57.593 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T00:37:57.671 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:37:57.673 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T00:37:57.737 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-16T00:37:57.738 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-16T00:37:57.740 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-09-16T00:37:57.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-09-16T00:37:57.979 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-16T00:37:57.990 INFO:teuthology.orchestra.run.smithi053.stdout:45 files removed 2024-09-16T00:37:58.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2024-09-16T00:37:58.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw 2024-09-16T00:37:58.392 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 1.0 MB/s | 76 kB 00:00 2024-09-16T00:37:58.453 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 487 kB/s | 76 kB 00:00 2024-09-16T00:37:58.510 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 133 kB/s | 9.3 kB 00:00 2024-09-16T00:37:58.579 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 118 kB/s | 9.3 kB 00:00 2024-09-16T00:37:58.619 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 30 kB/s | 2.2 kB 00:00 2024-09-16T00:37:58.696 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 27 kB/s | 2.2 kB 00:00 2024-09-16T00:37:59.145 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-16T00:38:00.286 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-16T00:38:02.320 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-16T00:38:03.088 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-16T00:38:06.862 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-16T00:38:07.888 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.5 MB 00:01 2024-09-16T00:38:08.397 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-16T00:38:09.259 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-16T00:38:09.556 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-16T00:38:10.635 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-16T00:38:15.031 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-16T00:38:16.107 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T00:38:17.502 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:38:17.510 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:17.510 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-16T00:38:17.511 INFO:teuthology.orchestra.run.smithi053.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:38:17.512 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout:Install 28 Packages 2024-09-16T00:38:17.513 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-09-16T00:38:17.514 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:17.514 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 53 M 2024-09-16T00:38:17.514 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:38:17.900 INFO:teuthology.orchestra.run.smithi053.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 42 MB/s | 5.2 MB 00:00 2024-09-16T00:38:17.917 INFO:teuthology.orchestra.run.smithi053.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-09-16T00:38:17.959 INFO:teuthology.orchestra.run.smithi053.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-09-16T00:38:18.001 INFO:teuthology.orchestra.run.smithi053.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-09-16T00:38:18.101 INFO:teuthology.orchestra.run.smithi053.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-16T00:38:18.118 INFO:teuthology.orchestra.run.smithi053.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 2.7 MB/s | 45 kB 00:00 2024-09-16T00:38:18.151 INFO:teuthology.orchestra.run.smithi053.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.5 MB/s | 119 kB 00:00 2024-09-16T00:38:18.177 INFO:teuthology.orchestra.run.smithi053.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-09-16T00:38:18.210 INFO:teuthology.orchestra.run.smithi053.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 9.5 MB/s | 321 kB 00:00 2024-09-16T00:38:18.302 INFO:teuthology.orchestra.run.smithi053.stdout:(10/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 15 MB/s | 7.6 MB 00:00 2024-09-16T00:38:18.328 INFO:teuthology.orchestra.run.smithi053.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 2.5 MB/s | 297 kB 00:00 2024-09-16T00:38:18.353 INFO:teuthology.orchestra.run.smithi053.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-16T00:38:18.475 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:38:18.482 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:18.482 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:38:18.482 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T00:38:18.483 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T00:38:18.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout:Install 28 Packages 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-09-16T00:38:18.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:18.486 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 53 M 2024-09-16T00:38:18.486 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:38:18.586 INFO:teuthology.orchestra.run.smithi053.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-16T00:38:18.611 INFO:teuthology.orchestra.run.smithi053.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 377 kB/s | 107 kB 00:00 2024-09-16T00:38:18.662 INFO:teuthology.orchestra.run.smithi053.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 519 kB/s | 160 kB 00:00 2024-09-16T00:38:18.695 INFO:teuthology.orchestra.run.smithi053.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-16T00:38:18.746 INFO:teuthology.orchestra.run.smithi053.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-16T00:38:18.780 INFO:teuthology.orchestra.run.smithi053.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 506 kB/s | 42 kB 00:00 2024-09-16T00:38:18.814 INFO:teuthology.orchestra.run.smithi053.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-16T00:38:18.855 INFO:teuthology.orchestra.run.smithi053.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-16T00:38:18.882 INFO:teuthology.orchestra.run.smithi053.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.2 MB/s | 26 kB 00:00 2024-09-16T00:38:18.906 INFO:teuthology.orchestra.run.smithi053.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T00:38:18.931 INFO:teuthology.orchestra.run.smithi053.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-16T00:38:18.957 INFO:teuthology.orchestra.run.smithi053.stdout:(24/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.7 MB/s | 308 kB 00:00 2024-09-16T00:38:18.990 INFO:teuthology.orchestra.run.smithi053.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T00:38:19.053 INFO:teuthology.orchestra.run.smithi053.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 839 kB 00:00 2024-09-16T00:38:19.083 INFO:teuthology.orchestra.run.smithi152.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 35 MB/s | 5.2 MB 00:00 2024-09-16T00:38:19.109 INFO:teuthology.orchestra.run.smithi152.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 971 kB/s | 24 kB 00:00 2024-09-16T00:38:19.115 INFO:teuthology.orchestra.run.smithi053.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-16T00:38:19.142 INFO:teuthology.orchestra.run.smithi152.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-09-16T00:38:19.176 INFO:teuthology.orchestra.run.smithi152.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-16T00:38:19.182 INFO:teuthology.orchestra.run.smithi053.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 25 MB/s | 3.3 MB 00:00 2024-09-16T00:38:19.249 INFO:teuthology.orchestra.run.smithi053.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-16T00:38:19.276 INFO:teuthology.orchestra.run.smithi152.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 23 MB/s | 7.6 MB 00:00 2024-09-16T00:38:19.301 INFO:teuthology.orchestra.run.smithi152.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-16T00:38:19.316 INFO:teuthology.orchestra.run.smithi053.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-16T00:38:19.321 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:19.321 INFO:teuthology.orchestra.run.smithi053.stdout:Total 29 MB/s | 53 MB 00:01 2024-09-16T00:38:19.327 INFO:teuthology.orchestra.run.smithi152.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-16T00:38:19.360 INFO:teuthology.orchestra.run.smithi152.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.6 MB/s | 155 kB 00:00 2024-09-16T00:38:19.385 INFO:teuthology.orchestra.run.smithi152.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-16T00:38:19.396 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:38:19.419 INFO:teuthology.orchestra.run.smithi152.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 8.7 MB/s | 297 kB 00:00 2024-09-16T00:38:19.436 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:38:19.436 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:38:19.444 INFO:teuthology.orchestra.run.smithi152.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-09-16T00:38:19.520 INFO:teuthology.orchestra.run.smithi152.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-16T00:38:19.728 INFO:teuthology.orchestra.run.smithi152.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-16T00:38:19.820 INFO:teuthology.orchestra.run.smithi152.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 285 kB/s | 107 kB 00:00 2024-09-16T00:38:19.862 INFO:teuthology.orchestra.run.smithi152.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 340 kB/s | 45 kB 00:00 2024-09-16T00:38:19.895 INFO:teuthology.orchestra.run.smithi152.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 427 kB/s | 160 kB 00:00 2024-09-16T00:38:19.963 INFO:teuthology.orchestra.run.smithi152.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 630 kB/s | 42 kB 00:00 2024-09-16T00:38:20.005 INFO:teuthology.orchestra.run.smithi152.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.6 MB/s | 111 kB 00:00 2024-09-16T00:38:20.038 INFO:teuthology.orchestra.run.smithi152.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-16T00:38:20.063 INFO:teuthology.orchestra.run.smithi152.stdout:(20/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-16T00:38:20.074 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:38:20.074 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:38:20.105 INFO:teuthology.orchestra.run.smithi152.stdout:(21/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-16T00:38:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-16T00:38:20.156 INFO:teuthology.orchestra.run.smithi152.stdout:(23/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 306 kB/s | 26 kB 00:00 2024-09-16T00:38:20.181 INFO:teuthology.orchestra.run.smithi152.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T00:38:20.206 INFO:teuthology.orchestra.run.smithi152.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-16T00:38:20.265 INFO:teuthology.orchestra.run.smithi152.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T00:38:20.307 INFO:teuthology.orchestra.run.smithi152.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T00:38:20.390 INFO:teuthology.orchestra.run.smithi152.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-16T00:38:20.441 INFO:teuthology.orchestra.run.smithi152.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 3.3 MB 00:00 2024-09-16T00:38:20.499 INFO:teuthology.orchestra.run.smithi152.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-16T00:38:20.504 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:20.504 INFO:teuthology.orchestra.run.smithi152.stdout:Total 26 MB/s | 53 MB 00:02 2024-09-16T00:38:20.578 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:38:20.614 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:38:20.614 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:38:21.223 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:38:21.223 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:38:21.508 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:38:21.584 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-16T00:38:21.621 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-16T00:38:21.680 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-16T00:38:22.069 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-16T00:38:22.120 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:22.238 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:22.328 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-16T00:38:22.354 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:22.417 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:22.446 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-16T00:38:22.490 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-16T00:38:22.557 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-16T00:38:22.590 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:22.637 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:38:22.640 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:22.706 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-16T00:38:22.737 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-16T00:38:22.757 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-16T00:38:22.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-16T00:38:22.797 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-16T00:38:22.852 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-16T00:38:22.879 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-16T00:38:22.914 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-16T00:38:22.951 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-16T00:38:22.992 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-16T00:38:23.156 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-16T00:38:23.228 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:23.303 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:23.305 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-16T00:38:23.354 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-16T00:38:23.382 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-16T00:38:23.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:23.445 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-16T00:38:23.475 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:23.484 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-16T00:38:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-16T00:38:23.520 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-16T00:38:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-16T00:38:23.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-16T00:38:23.639 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:23.705 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:23.812 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-16T00:38:23.846 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-16T00:38:23.895 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-16T00:38:23.936 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-16T00:38:23.941 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-16T00:38:23.963 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-16T00:38:23.973 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-16T00:38:23.999 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-16T00:38:24.029 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-16T00:38:24.032 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-16T00:38:24.107 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-16T00:38:24.142 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-16T00:38:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-16T00:38:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-16T00:38:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-16T00:38:24.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-16T00:38:24.535 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-16T00:38:24.930 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-16T00:38:24.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-16T00:38:25.010 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-16T00:38:25.085 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-16T00:38:25.107 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-16T00:38:26.265 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:26.305 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:26.906 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:26.950 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-16T00:38:27.049 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-16T00:38:27.049 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:38:27.049 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:38:27.049 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:27.084 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:27.750 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-16T00:38:27.798 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-16T00:38:27.892 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-16T00:38:27.893 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T00:38:27.893 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T00:38:27.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:27.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-09-16T00:38:37.558 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-09-16T00:38:37.559 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-09-16T00:38:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:37.789 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:37.789 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-16T00:38:37.789 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-16T00:38:37.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-16T00:38:38.357 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-16T00:38:38.357 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:38.357 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:38:38.357 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:38:38.358 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:38:38.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:38.359 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-16T00:38:38.434 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-16T00:38:38.434 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:38.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-16T00:38:38.536 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-16T00:38:38.536 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:38.536 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T00:38:38.537 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:38:38.537 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T00:38:38.537 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:38.538 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-16T00:38:38.621 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-16T00:38:38.622 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-16T00:38:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-16T00:38:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-16T00:38:39.669 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-16T00:38:39.670 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-16T00:38:39.672 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-16T00:38:39.673 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-16T00:38:39.674 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-16T00:38:39.756 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-16T00:38:39.757 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-16T00:38:39.758 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-16T00:38:39.759 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-16T00:38:39.759 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-16T00:38:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:38:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:40.645 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:38:40.808 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-16T00:38:40.809 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T00:38:40.810 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:40.811 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T00:38:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T00:38:40.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:40.812 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:38:41.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-test 2024-09-16T00:38:41.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2024-09-16T00:38:41.632 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:27 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:38:41.702 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:25 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:38:41.778 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-16T00:38:41.779 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout:Install 4 Packages 2024-09-16T00:38:41.780 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:41.781 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 40 M 2024-09-16T00:38:41.781 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 165 M 2024-09-16T00:38:41.781 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:38:41.834 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:38:41.834 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:41.835 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-16T00:38:41.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:41.836 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 40 M 2024-09-16T00:38:41.836 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 165 M 2024-09-16T00:38:41.837 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:38:41.889 INFO:teuthology.orchestra.run.smithi053.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.8 MB/s | 161 kB 00:00 2024-09-16T00:38:42.023 INFO:teuthology.orchestra.run.smithi053.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-16T00:38:42.048 INFO:teuthology.orchestra.run.smithi053.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2024-09-16T00:38:42.144 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 161 kB 00:00 2024-09-16T00:38:42.286 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-16T00:38:42.311 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-16T00:38:42.423 INFO:teuthology.orchestra.run.smithi053.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 64 MB/s | 40 MB 00:00 2024-09-16T00:38:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:42.426 INFO:teuthology.orchestra.run.smithi053.stdout:Total 62 MB/s | 40 MB 00:00 2024-09-16T00:38:42.454 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:38:42.475 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:38:42.475 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:38:42.662 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 69 MB/s | 40 MB 00:00 2024-09-16T00:38:42.664 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:42.664 INFO:teuthology.orchestra.run.smithi152.stdout:Total 48 MB/s | 40 MB 00:00 2024-09-16T00:38:42.692 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:38:42.712 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:38:42.712 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:38:42.841 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:38:42.842 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:38:43.046 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:38:43.047 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:38:43.335 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:38:43.426 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T00:38:43.465 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T00:38:43.500 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-16T00:38:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:38:43.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T00:38:43.661 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T00:38:43.688 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-16T00:38:47.402 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-16T00:38:47.428 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-16T00:38:47.486 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-16T00:38:47.518 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-16T00:38:49.569 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-16T00:38:49.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-16T00:38:49.569 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-16T00:38:49.570 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T00:38:49.590 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-16T00:38:49.590 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-16T00:38:49.590 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-16T00:38:49.590 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T00:38:49.857 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T00:38:49.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:49.857 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:38:49.857 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:49.857 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:38:49.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:49.858 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:38:49.885 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:49.886 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:38:50.145 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2024-09-16T00:38:50.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph 2024-09-16T00:38:50.720 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:34 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:38:50.759 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:36 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:38:50.862 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:38:50.864 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:50.864 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:38:50.865 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:38:50.866 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:38:50.867 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:38:50.868 INFO:teuthology.orchestra.run.smithi152.stdout:Install 33 Packages 2024-09-16T00:38:50.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:50.868 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 30 M 2024-09-16T00:38:50.868 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 109 M 2024-09-16T00:38:50.868 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:38:50.898 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-16T00:38:50.901 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T00:38:50.902 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T00:38:50.903 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout:Install 33 Packages 2024-09-16T00:38:50.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:50.905 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 30 M 2024-09-16T00:38:50.905 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 109 M 2024-09-16T00:38:50.905 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:38:51.173 INFO:teuthology.orchestra.run.smithi053.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 114 kB/s | 6.4 kB 00:00 2024-09-16T00:38:51.224 INFO:teuthology.orchestra.run.smithi053.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-16T00:38:51.282 INFO:teuthology.orchestra.run.smithi053.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2024-09-16T00:38:51.308 INFO:teuthology.orchestra.run.smithi053.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-09-16T00:38:51.352 INFO:teuthology.orchestra.run.smithi152.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 141 kB/s | 6.4 kB 00:00 2024-09-16T00:38:51.400 INFO:teuthology.orchestra.run.smithi053.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-16T00:38:51.402 INFO:teuthology.orchestra.run.smithi152.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-16T00:38:51.469 INFO:teuthology.orchestra.run.smithi152.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2024-09-16T00:38:51.503 INFO:teuthology.orchestra.run.smithi152.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.0 MB/s | 240 kB 00:00 2024-09-16T00:38:51.587 INFO:teuthology.orchestra.run.smithi152.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-16T00:38:51.650 INFO:teuthology.orchestra.run.smithi053.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 41 MB/s | 18 MB 00:00 2024-09-16T00:38:51.675 INFO:teuthology.orchestra.run.smithi053.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 690 kB/s | 253 kB 00:00 2024-09-16T00:38:51.725 INFO:teuthology.orchestra.run.smithi053.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T00:38:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-16T00:38:51.801 INFO:teuthology.orchestra.run.smithi053.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 707 kB/s | 106 kB 00:00 2024-09-16T00:38:51.821 INFO:teuthology.orchestra.run.smithi152.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 42 MB/s | 18 MB 00:00 2024-09-16T00:38:51.860 INFO:teuthology.orchestra.run.smithi053.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-16T00:38:51.921 INFO:teuthology.orchestra.run.smithi053.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 596 kB/s | 35 kB 00:00 2024-09-16T00:38:51.943 INFO:teuthology.orchestra.run.smithi053.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-16T00:38:51.960 INFO:teuthology.orchestra.run.smithi053.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T00:38:51.986 INFO:teuthology.orchestra.run.smithi053.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 994 kB/s | 42 kB 00:00 2024-09-16T00:38:52.028 INFO:teuthology.orchestra.run.smithi053.stdout:(16/33): python3-cryptography-36.0.1-4.el9.x86_ 2.0 MB/s | 1.2 MB 00:00 2024-09-16T00:38:52.053 INFO:teuthology.orchestra.run.smithi053.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-16T00:38:52.078 INFO:teuthology.orchestra.run.smithi053.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 719 kB/s | 11 kB 00:00 2024-09-16T00:38:52.095 INFO:teuthology.orchestra.run.smithi053.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 1.2 MB/s | 18 kB 00:00 2024-09-16T00:38:52.129 INFO:teuthology.orchestra.run.smithi053.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-16T00:38:52.146 INFO:teuthology.orchestra.run.smithi152.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 394 kB/s | 253 kB 00:00 2024-09-16T00:38:52.146 INFO:teuthology.orchestra.run.smithi053.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-16T00:38:52.162 INFO:teuthology.orchestra.run.smithi053.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 582 kB/s | 19 kB 00:00 2024-09-16T00:38:52.183 INFO:teuthology.orchestra.run.smithi053.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 532 kB/s | 20 kB 00:00 2024-09-16T00:38:52.208 INFO:teuthology.orchestra.run.smithi053.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.0 MB/s | 46 kB 00:00 2024-09-16T00:38:52.233 INFO:teuthology.orchestra.run.smithi053.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T00:38:52.259 INFO:teuthology.orchestra.run.smithi053.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 656 kB/s | 16 kB 00:00 2024-09-16T00:38:52.271 INFO:teuthology.orchestra.run.smithi152.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-16T00:38:52.284 INFO:teuthology.orchestra.run.smithi053.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-16T00:38:52.296 INFO:teuthology.orchestra.run.smithi152.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 224 kB/s | 106 kB 00:00 2024-09-16T00:38:52.309 INFO:teuthology.orchestra.run.smithi053.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T00:38:52.335 INFO:teuthology.orchestra.run.smithi053.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-16T00:38:52.360 INFO:teuthology.orchestra.run.smithi053.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-16T00:38:52.385 INFO:teuthology.orchestra.run.smithi053.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-16T00:38:52.388 INFO:teuthology.orchestra.run.smithi152.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.0 MB/s | 125 kB 00:00 2024-09-16T00:38:52.410 INFO:teuthology.orchestra.run.smithi053.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-16T00:38:52.436 INFO:teuthology.orchestra.run.smithi053.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-16T00:38:52.440 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:52.440 INFO:teuthology.orchestra.run.smithi053.stdout:Total 19 MB/s | 30 MB 00:01 2024-09-16T00:38:52.480 INFO:teuthology.orchestra.run.smithi152.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.2 MB 00:00 2024-09-16T00:38:52.505 INFO:teuthology.orchestra.run.smithi152.stdout:(12/33): python3-urllib3-1.26.5-6.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-09-16T00:38:52.547 INFO:teuthology.orchestra.run.smithi152.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-16T00:38:52.561 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:38:52.597 INFO:teuthology.orchestra.run.smithi152.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-16T00:38:52.602 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:38:52.602 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:38:52.622 INFO:teuthology.orchestra.run.smithi152.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-16T00:38:52.648 INFO:teuthology.orchestra.run.smithi152.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-09-16T00:38:52.698 INFO:teuthology.orchestra.run.smithi152.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-16T00:38:52.723 INFO:teuthology.orchestra.run.smithi152.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-16T00:38:52.748 INFO:teuthology.orchestra.run.smithi152.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 713 kB/s | 18 kB 00:00 2024-09-16T00:38:52.774 INFO:teuthology.orchestra.run.smithi152.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-16T00:38:52.799 INFO:teuthology.orchestra.run.smithi152.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-09-16T00:38:52.824 INFO:teuthology.orchestra.run.smithi152.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-16T00:38:52.849 INFO:teuthology.orchestra.run.smithi152.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-16T00:38:52.875 INFO:teuthology.orchestra.run.smithi152.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-16T00:38:52.900 INFO:teuthology.orchestra.run.smithi152.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T00:38:52.925 INFO:teuthology.orchestra.run.smithi152.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-16T00:38:52.959 INFO:teuthology.orchestra.run.smithi152.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-09-16T00:38:52.984 INFO:teuthology.orchestra.run.smithi152.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T00:38:53.009 INFO:teuthology.orchestra.run.smithi152.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-09-16T00:38:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-16T00:38:53.048 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:38:53.048 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:38:53.068 INFO:teuthology.orchestra.run.smithi152.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 809 kB/s | 20 kB 00:00 2024-09-16T00:38:53.093 INFO:teuthology.orchestra.run.smithi152.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-16T00:38:53.127 INFO:teuthology.orchestra.run.smithi152.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-16T00:38:53.131 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:38:53.131 INFO:teuthology.orchestra.run.smithi152.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-16T00:38:53.251 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:38:53.288 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:38:53.288 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:38:53.704 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:38:53.704 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:38:54.477 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:38:54.555 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-16T00:38:54.596 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-16T00:38:54.637 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-16T00:38:54.735 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-16T00:38:54.827 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-16T00:38:54.882 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-16T00:38:54.915 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:38:54.916 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-16T00:38:54.946 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-16T00:38:54.972 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-16T00:38:54.981 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-16T00:38:55.012 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-16T00:38:55.014 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-16T00:38:55.054 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-16T00:38:55.064 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-16T00:38:55.116 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-16T00:38:55.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-16T00:38:55.149 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-16T00:38:55.188 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-16T00:38:55.222 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-16T00:38:55.264 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-16T00:38:55.267 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-16T00:38:55.310 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-16T00:38:55.340 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-16T00:38:55.383 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-16T00:38:55.417 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-16T00:38:55.417 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-16T00:38:55.448 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-16T00:38:55.483 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-16T00:38:55.498 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-16T00:38:55.518 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-16T00:38:55.549 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-16T00:38:55.556 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-16T00:38:55.595 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-16T00:38:55.637 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-16T00:38:55.663 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-16T00:38:55.727 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-16T00:38:55.801 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-16T00:38:55.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-16T00:38:55.929 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-16T00:38:55.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-16T00:38:55.989 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-16T00:38:55.998 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-16T00:38:56.038 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-16T00:38:56.080 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-16T00:38:56.092 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-16T00:38:56.178 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-16T00:38:56.217 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-16T00:38:56.291 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-16T00:38:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-16T00:38:56.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-16T00:38:56.423 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-16T00:38:56.512 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-16T00:38:56.514 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-16T00:38:56.549 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-16T00:38:56.550 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:38:56.576 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:56.669 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-16T00:38:56.852 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-16T00:38:56.878 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-16T00:38:56.904 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-16T00:38:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T00:38:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:38:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T00:38:56.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:58.192 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-16T00:38:58.223 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-16T00:38:58.223 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:58.223 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:38:58.223 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:38:58.223 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:38:58.224 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:58.437 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T00:38:58.464 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:58.701 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:38:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:58.912 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-16T00:38:58.936 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-16T00:38:58.936 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:58.937 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T00:38:58.937 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:38:58.937 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T00:38:58.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:58.952 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-16T00:38:58.977 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-16T00:38:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:38:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:38:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:38:58.978 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:38:59.044 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-16T00:38:59.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-16T00:38:59.169 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-16T00:38:59.170 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:38:59.170 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T00:38:59.170 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:38:59.170 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T00:38:59.170 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:38:59.234 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-16T00:39:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-16T00:39:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-16T00:39:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-16T00:39:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-16T00:39:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-16T00:39:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-16T00:39:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-16T00:39:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-16T00:39:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-16T00:39:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-16T00:39:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-16T00:39:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-16T00:39:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-16T00:39:01.034 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-16T00:39:01.035 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-16T00:39:01.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-16T00:39:01.038 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:39:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:39:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:01.723 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:02.021 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T00:39:02.022 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T00:39:02.023 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:02.024 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:02.040 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-base 2024-09-16T00:39:02.391 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2024-09-16T00:39:02.630 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:48 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:02.724 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:02.769 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:02.770 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:02.770 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:02.843 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install cephadm 2024-09-16T00:39:02.965 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:46 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:03.098 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:03.099 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:03.099 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:03.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2024-09-16T00:39:03.428 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:49 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:03.564 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:03.565 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:03.566 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:03.567 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:03.567 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 209 k 2024-09-16T00:39:03.567 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 200 k 2024-09-16T00:39:03.567 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:03.625 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.5 MB/s | 209 kB 00:00 2024-09-16T00:39:03.626 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:03.626 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.4 MB/s | 209 kB 00:00 2024-09-16T00:39:03.626 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:03.632 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:03.632 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:03.634 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:03.634 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:03.709 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:03.719 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:47 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:03.852 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:03.853 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:03.853 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:03.853 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 209 k 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 200 k 2024-09-16T00:39:03.854 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-18.2.0-0.el9.noarch.rpm 4.2 MB/s | 209 kB 00:00 2024-09-16T00:39:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:03.903 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.1 MB/s | 209 kB 00:00 2024-09-16T00:39:03.904 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:03.909 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:03.909 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:03.911 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:03.912 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:03.980 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:04.171 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.273 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.448 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.539 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.616 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:04.854 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:04.882 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:05.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:05.131 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:05.337 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T00:39:05.673 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:51 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:05.813 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:05.814 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:05.815 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 142 k 2024-09-16T00:39:05.815 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 399 k 2024-09-16T00:39:05.815 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:05.865 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.8 MB/s | 142 kB 00:00 2024-09-16T00:39:05.866 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:05.866 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.7 MB/s | 142 kB 00:00 2024-09-16T00:39:05.866 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:05.874 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:05.874 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:05.920 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:49 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:05.934 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:05.934 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:06.055 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:06.056 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:06.056 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-16T00:39:06.056 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 142 k 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 399 k 2024-09-16T00:39:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:06.110 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.7 MB/s | 142 kB 00:00 2024-09-16T00:39:06.110 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:06.111 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.6 MB/s | 142 kB 00:00 2024-09-16T00:39:06.111 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:06.118 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:06.118 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:06.166 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:06.175 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:06.175 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:06.192 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:06.192 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:39:06.192 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:39:06.192 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:06.326 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:06.433 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:06.433 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:39:06.433 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T00:39:06.433 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:07.149 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:07.150 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:07.150 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:07.150 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:07.150 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:07.150 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:07.349 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:07.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:07.350 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:07.350 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:07.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:07.350 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:07.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr 2024-09-16T00:39:07.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2024-09-16T00:39:07.941 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:08.042 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:08.087 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:08.088 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:08.089 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:08.139 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:52 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:08.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T00:39:08.235 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:08.277 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:08.278 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:08.279 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:08.340 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T00:39:08.742 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:08.884 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:08.884 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-16T00:39:08.885 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:Install 7 Packages 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.0 M 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 8.1 M 2024-09-16T00:39:08.886 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:08.900 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:52 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:09.010 INFO:teuthology.orchestra.run.smithi053.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 368 kB/s | 23 kB 00:00 2024-09-16T00:39:09.034 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:09.034 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T00:39:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout:Install 7 Packages 2024-09-16T00:39:09.036 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:09.037 INFO:teuthology.orchestra.run.smithi053.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 166 kB/s | 15 kB 00:00 2024-09-16T00:39:09.037 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.0 M 2024-09-16T00:39:09.037 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 8.1 M 2024-09-16T00:39:09.037 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:09.078 INFO:teuthology.orchestra.run.smithi053.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 982 kB/s | 41 kB 00:00 2024-09-16T00:39:09.103 INFO:teuthology.orchestra.run.smithi053.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 98 kB/s | 9.0 kB 00:00 2024-09-16T00:39:09.128 INFO:teuthology.orchestra.run.smithi053.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 638 kB/s | 31 kB 00:00 2024-09-16T00:39:09.153 INFO:teuthology.orchestra.run.smithi053.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T00:39:09.177 INFO:teuthology.orchestra.run.smithi152.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 336 kB/s | 23 kB 00:00 2024-09-16T00:39:09.195 INFO:teuthology.orchestra.run.smithi053.stdout:(7/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 6.8 MB/s | 1.7 MB 00:00 2024-09-16T00:39:09.198 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:09.199 INFO:teuthology.orchestra.run.smithi053.stdout:Total 6.4 MB/s | 2.0 MB 00:00 2024-09-16T00:39:09.199 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:09.202 INFO:teuthology.orchestra.run.smithi152.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 155 kB/s | 15 kB 00:00 2024-09-16T00:39:09.207 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:09.208 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:09.244 INFO:teuthology.orchestra.run.smithi152.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-16T00:39:09.270 INFO:teuthology.orchestra.run.smithi152.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-16T00:39:09.293 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:09.293 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:09.311 INFO:teuthology.orchestra.run.smithi152.stdout:(5/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.4 MB/s | 1.7 MB 00:00 2024-09-16T00:39:09.337 INFO:teuthology.orchestra.run.smithi152.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 306 kB/s | 41 kB 00:00 2024-09-16T00:39:09.362 INFO:teuthology.orchestra.run.smithi152.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-09-16T00:39:09.365 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:09.365 INFO:teuthology.orchestra.run.smithi152.stdout:Total 6.1 MB/s | 2.0 MB 00:00 2024-09-16T00:39:09.365 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:09.373 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:09.373 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:09.450 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:09.450 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:09.607 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:09.671 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-16T00:39:09.715 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-16T00:39:09.746 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:09.770 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-16T00:39:09.801 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-16T00:39:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-16T00:39:09.838 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-16T00:39:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-16T00:39:09.893 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-16T00:39:09.925 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-16T00:39:09.954 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-16T00:39:10.082 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-16T00:39:10.115 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-16T00:39:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-16T00:39:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-16T00:39:10.644 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-16T00:39:10.645 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-16T00:39:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-16T00:39:10.915 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-16T00:39:10.915 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:10.915 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:10.916 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:11.030 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:11.031 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:11.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T00:39:11.258 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T00:39:11.723 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:57 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:11.818 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:55 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:11.862 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:11.863 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:11.863 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:39:11.863 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:11.863 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:39:11.864 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 38 M 2024-09-16T00:39:11.865 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 212 M 2024-09-16T00:39:11.866 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:11.950 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T00:39:11.951 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:11.952 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:11.953 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:11.953 INFO:teuthology.orchestra.run.smithi152.stdout:Install 12 Packages 2024-09-16T00:39:11.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:11.953 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 38 M 2024-09-16T00:39:11.953 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 212 M 2024-09-16T00:39:11.954 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:12.110 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 49 MB/s | 7.4 MB 00:00 2024-09-16T00:39:12.168 INFO:teuthology.orchestra.run.smithi152.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 50 MB/s | 7.4 MB 00:00 2024-09-16T00:39:12.211 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 759 kB/s | 191 kB 00:00 2024-09-16T00:39:12.285 INFO:teuthology.orchestra.run.smithi152.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-16T00:39:12.420 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-16T00:39:12.643 INFO:teuthology.orchestra.run.smithi152.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-09-16T00:39:12.693 INFO:teuthology.orchestra.run.smithi152.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-16T00:39:12.694 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 56 kB/s | 33 kB 00:00 2024-09-16T00:39:12.744 INFO:teuthology.orchestra.run.smithi152.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-16T00:39:12.894 INFO:teuthology.orchestra.run.smithi152.stdout:(6/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 33 MB/s | 4.9 MB 00:00 2024-09-16T00:39:12.911 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 37 kB/s | 18 kB 00:00 2024-09-16T00:39:12.919 INFO:teuthology.orchestra.run.smithi152.stdout:(7/12): libquadmath-11.5.0-2.el9.x86_64.rpm 212 kB/s | 191 kB 00:00 2024-09-16T00:39:12.953 INFO:teuthology.orchestra.run.smithi152.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-16T00:39:13.011 INFO:teuthology.orchestra.run.smithi152.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-16T00:39:13.053 INFO:teuthology.orchestra.run.smithi152.stdout:(10/12): libgfortran-11.5.0-2.el9.x86_64.rpm 775 kB/s | 801 kB 00:01 2024-09-16T00:39:13.287 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-16T00:39:13.312 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-09-16T00:39:13.370 INFO:teuthology.orchestra.run.smithi152.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-16T00:39:13.495 INFO:teuthology.orchestra.run.smithi152.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-09-16T00:39:13.496 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:13.496 INFO:teuthology.orchestra.run.smithi152.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-16T00:39:13.851 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:13.878 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:13.878 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:14.045 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-09-16T00:39:14.071 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 313 kB/s | 245 kB 00:00 2024-09-16T00:39:14.385 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:14.386 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:14.571 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-16T00:39:14.863 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 307 kB/s | 250 kB 00:00 2024-09-16T00:39:15.175 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:15.250 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T00:39:15.285 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T00:39:15.401 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T00:39:15.445 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T00:39:15.555 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T00:39:15.556 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:15.556 INFO:teuthology.orchestra.run.smithi053.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-16T00:39:15.631 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T00:39:15.660 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T00:39:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T00:39:15.924 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:15.951 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:15.951 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:16.415 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T00:39:16.472 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:16.472 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:16.531 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T00:39:17.262 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:17.331 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T00:39:17.370 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T00:39:17.474 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T00:39:17.513 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T00:39:17.706 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T00:39:17.737 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T00:39:17.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T00:39:17.824 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T00:39:18.536 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T00:39:18.653 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T00:39:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T00:39:18.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-16T00:39:19.994 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T00:39:21.091 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T00:39:21.126 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-16T00:39:21.336 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T00:39:21.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T00:39:21.732 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T00:39:21.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:21.732 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:39:21.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:21.734 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:22.102 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2024-09-16T00:39:22.674 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:06 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:22.812 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:39:22.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2024-09-16T00:39:22.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:22.815 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.2 M 2024-09-16T00:39:22.815 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 26 M 2024-09-16T00:39:22.815 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:23.315 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T00:39:23.399 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 206 kB/s | 26 kB 00:00 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T00:39:23.413 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T00:39:23.423 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 128 kB/s | 19 kB 00:00 2024-09-16T00:39:23.540 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-16T00:39:23.566 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 887 kB/s | 222 kB 00:00 2024-09-16T00:39:23.591 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-16T00:39:23.616 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 713 kB/s | 54 kB 00:00 2024-09-16T00:39:23.668 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T00:39:23.691 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-16T00:39:23.716 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T00:39:23.742 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-16T00:39:23.767 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T00:39:23.801 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-16T00:39:23.803 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:23.803 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.2 MB/s | 2.2 MB 00:00 2024-09-16T00:39:23.868 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:23.884 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:23.884 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:23.933 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T00:39:23.934 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T00:39:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T00:39:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T00:39:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T00:39:23.935 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:23.935 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:23.971 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:23.971 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:24.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-rook 2024-09-16T00:39:24.476 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:24.648 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T00:39:24.702 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T00:39:24.765 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T00:39:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T00:39:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T00:39:24.856 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:10 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:24.946 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T00:39:24.996 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T00:39:24.997 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:24.998 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:24.999 INFO:teuthology.orchestra.run.smithi053.stdout:Install 13 Packages 2024-09-16T00:39:24.999 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:24.999 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.2 M 2024-09-16T00:39:24.999 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 26 M 2024-09-16T00:39:24.999 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:25.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T00:39:25.103 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T00:39:25.442 INFO:teuthology.orchestra.run.smithi053.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 905 kB/s | 47 kB 00:00 2024-09-16T00:39:25.484 INFO:teuthology.orchestra.run.smithi053.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 272 kB/s | 26 kB 00:00 2024-09-16T00:39:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 172 kB/s | 19 kB 00:00 2024-09-16T00:39:25.593 INFO:teuthology.orchestra.run.smithi053.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-16T00:39:25.618 INFO:teuthology.orchestra.run.smithi053.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-09-16T00:39:25.652 INFO:teuthology.orchestra.run.smithi053.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-16T00:39:25.669 INFO:teuthology.orchestra.run.smithi053.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 709 kB/s | 54 kB 00:00 2024-09-16T00:39:25.694 INFO:teuthology.orchestra.run.smithi053.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 427 kB/s | 32 kB 00:00 2024-09-16T00:39:25.719 INFO:teuthology.orchestra.run.smithi053.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 216 kB/s | 14 kB 00:00 2024-09-16T00:39:25.736 INFO:teuthology.orchestra.run.smithi053.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 4.0 MB/s | 59 kB 00:00 2024-09-16T00:39:25.770 INFO:teuthology.orchestra.run.smithi053.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-16T00:39:25.795 INFO:teuthology.orchestra.run.smithi053.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-16T00:39:25.818 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T00:39:25.829 INFO:teuthology.orchestra.run.smithi053.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.2 MB/s | 1.0 MB 00:00 2024-09-16T00:39:25.831 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:25.832 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-16T00:39:25.867 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T00:39:25.899 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:25.909 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T00:39:25.916 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:25.916 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T00:39:25.979 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-16T00:39:26.012 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:26.013 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:26.650 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:26.818 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T00:39:26.829 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-16T00:39:26.829 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-16T00:39:26.829 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T00:39:26.829 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T00:39:26.829 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T00:39:26.830 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T00:39:26.898 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T00:39:26.954 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T00:39:26.990 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T00:39:27.031 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T00:39:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:39:27.162 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:27.163 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:27.247 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T00:39:27.309 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T00:39:27.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T00:39:27.988 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:11 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:28.069 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T00:39:28.123 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:28.123 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:28.123 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:28.124 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:28.125 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-09-16T00:39:28.125 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:28.125 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 7.0 M 2024-09-16T00:39:28.125 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 33 M 2024-09-16T00:39:28.125 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:28.129 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T00:39:28.172 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T00:39:28.218 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T00:39:28.249 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-16T00:39:28.468 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.1 MB/s | 127 kB 00:00 2024-09-16T00:39:28.518 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-16T00:39:28.543 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T00:39:28.569 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T00:39:28.669 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 956 kB/s | 248 kB 00:00 2024-09-16T00:39:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-16T00:39:29.055 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T00:39:29.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T00:39:29.416 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:29.417 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:29.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T00:39:29.727 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-09-16T00:39:29.729 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:29.729 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-09-16T00:39:29.800 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:29.811 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:29.811 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:29.910 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:29.910 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:30.221 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:30.231 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:16 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:30.373 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:30.373 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:30.373 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-09-16T00:39:30.373 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout:Install 6 Packages 2024-09-16T00:39:30.374 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:30.375 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.0 M 2024-09-16T00:39:30.375 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 33 M 2024-09-16T00:39:30.375 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:30.392 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T00:39:30.445 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T00:39:30.822 INFO:teuthology.orchestra.run.smithi053.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.0 MB/s | 127 kB 00:00 2024-09-16T00:39:30.889 INFO:teuthology.orchestra.run.smithi053.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-16T00:39:30.914 INFO:teuthology.orchestra.run.smithi053.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T00:39:30.939 INFO:teuthology.orchestra.run.smithi053.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T00:39:30.965 INFO:teuthology.orchestra.run.smithi053.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-16T00:39:30.965 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T00:39:31.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T00:39:31.114 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T00:39:31.141 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T00:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T00:39:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T00:39:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:32.211 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:32.212 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:32.348 INFO:teuthology.orchestra.run.smithi053.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-16T00:39:32.350 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:32.350 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.5 MB/s | 7.0 MB 00:01 2024-09-16T00:39:32.427 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:32.440 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:32.440 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:32.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2024-09-16T00:39:32.546 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:32.547 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:32.874 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:33.033 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:17 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:33.056 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T00:39:33.109 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T00:39:33.167 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:39:33.168 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 914 k 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 2.7 M 2024-09-16T00:39:33.169 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:33.512 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 13 MB/s | 835 kB 00:00 2024-09-16T00:39:33.612 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 487 kB/s | 80 kB 00:00 2024-09-16T00:39:33.612 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:33.613 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.0 MB/s | 914 kB 00:00 2024-09-16T00:39:33.625 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:33.648 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:33.648 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:33.671 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T00:39:33.731 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:33.732 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T00:39:33.833 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T00:39:33.853 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-16T00:39:33.917 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:34.054 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T00:39:34.118 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T00:39:34.628 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T00:39:34.765 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-16T00:39:34.765 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T00:39:34.904 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T00:39:34.905 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T00:39:34.905 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:34.905 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:35.036 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T00:39:35.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:35.037 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:35.037 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T00:39:35.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:35.037 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:35.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-fuse 2024-09-16T00:39:35.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2024-09-16T00:39:35.729 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:21 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-16T00:39:35.868 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:35.869 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 914 k 2024-09-16T00:39:35.870 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 2.7 M 2024-09-16T00:39:35.870 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:35.897 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:19 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:36.034 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:36.034 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:36.034 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:36.034 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 126 k 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 456 k 2024-09-16T00:39:36.035 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:36.074 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 11 MB/s | 835 kB 00:00 2024-09-16T00:39:36.090 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.3 MB/s | 126 kB 00:00 2024-09-16T00:39:36.091 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:36.091 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.2 MB/s | 126 kB 00:00 2024-09-16T00:39:36.091 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:36.097 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:36.097 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:36.141 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 564 kB/s | 80 kB 00:00 2024-09-16T00:39:36.142 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:36.142 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.3 MB/s | 914 kB 00:00 2024-09-16T00:39:36.154 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:36.160 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:36.161 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:36.177 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:36.177 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:36.267 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:36.267 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:36.313 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:36.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:36.462 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:36.617 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T00:39:36.694 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-16T00:39:36.861 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:37.100 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:37.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2024-09-16T00:39:37.406 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-16T00:39:37.406 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:37.715 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:37.937 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:21 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:37.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados-devel 2024-09-16T00:39:38.028 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:38.072 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:38.073 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:38.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2024-09-16T00:39:38.597 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:38.702 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:22 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:38.738 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:38.739 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:38.740 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 126 k 2024-09-16T00:39:38.740 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 456 k 2024-09-16T00:39:38.740 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:38.787 INFO:teuthology.orchestra.run.smithi053.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 126 kB 00:00 2024-09-16T00:39:38.787 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:38.788 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.6 MB/s | 126 kB 00:00 2024-09-16T00:39:38.788 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:38.794 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:38.794 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:38.835 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:38.836 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:38.837 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:38.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:38.837 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 30 k 2024-09-16T00:39:38.837 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 137 k 2024-09-16T00:39:38.837 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:38.860 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:38.861 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:38.885 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 637 kB/s | 30 kB 00:00 2024-09-16T00:39:38.885 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:38.886 INFO:teuthology.orchestra.run.smithi152.stdout:Total 620 kB/s | 30 kB 00:00 2024-09-16T00:39:38.886 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:38.889 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:38.889 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:38.905 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:38.905 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:38.993 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:39.013 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.121 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.434 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:39.675 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:39.704 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:39.964 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:40.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs2 2024-09-16T00:39:40.439 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:40.529 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:40.572 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:40.573 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:40.573 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:40.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2024-09-16T00:39:40.799 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:26 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:40.900 INFO:teuthology.orchestra.run.smithi053.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:40.946 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:40.947 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:40.947 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:41.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs-devel 2024-09-16T00:39:41.202 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:41.292 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:41.334 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:41.335 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:41.335 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:41.401 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2024-09-16T00:39:41.598 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:41.738 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:41.739 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:41.739 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:41.739 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:41.739 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:41.739 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 30 k 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 137 k 2024-09-16T00:39:41.740 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:41.803 INFO:teuthology.orchestra.run.smithi053.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 525 kB/s | 30 kB 00:00 2024-09-16T00:39:41.803 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:41.804 INFO:teuthology.orchestra.run.smithi053.stdout:Total 511 kB/s | 30 kB 00:00 2024-09-16T00:39:41.804 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:41.804 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:41.804 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:41.816 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:41.817 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:41.907 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:41.969 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:42.023 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:42.060 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:42.103 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:42.104 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:42.104 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:42.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2024-09-16T00:39:42.538 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:42.733 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:26 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:42.776 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:42.823 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:42.866 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:42.867 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:42.867 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:42.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2024-09-16T00:39:42.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados2 2024-09-16T00:39:43.494 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:43.552 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:29 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:43.585 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:43.629 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:43.630 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:43.630 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:43.646 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:43.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2024-09-16T00:39:43.692 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:43.693 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:43.693 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:43.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librbd1 2024-09-16T00:39:44.253 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:44.343 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:44.348 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:44.386 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:44.387 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-16T00:39:44.387 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:44.441 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:44.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2024-09-16T00:39:44.486 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:44.488 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:44.488 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:44.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rados 2024-09-16T00:39:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:29 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:45.149 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:45.157 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:45.158 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:45.159 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:45.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:45.159 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 86 k 2024-09-16T00:39:45.159 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 230 k 2024-09-16T00:39:45.159 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:45.204 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 86 kB 00:00 2024-09-16T00:39:45.205 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:45.205 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.8 MB/s | 86 kB 00:00 2024-09-16T00:39:45.205 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:45.212 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:45.212 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:45.242 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:45.274 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:45.274 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:45.287 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:45.288 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:45.288 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:45.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rgw 2024-09-16T00:39:45.412 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:45.518 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:45.868 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:45.953 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:46.047 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:46.092 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:46.093 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:46.093 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:46.160 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:46.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-cephfs 2024-09-16T00:39:46.396 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2024-09-16T00:39:46.751 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:46.845 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:46.890 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:46.891 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:46.891 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:46.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rbd 2024-09-16T00:39:46.972 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:47.113 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.0 M 2024-09-16T00:39:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 12 M 2024-09-16T00:39:47.115 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:47.199 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 34 MB/s | 3.0 MB 00:00 2024-09-16T00:39:47.199 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:47.200 INFO:teuthology.orchestra.run.smithi152.stdout:Total 34 MB/s | 3.0 MB 00:00 2024-09-16T00:39:47.200 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:47.209 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:47.209 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:47.287 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:47.288 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:47.553 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:47.647 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-16T00:39:47.693 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:47.694 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-09-16T00:39:47.694 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:47.700 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:47.766 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:47.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-fuse 2024-09-16T00:39:47.791 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:47.792 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:39:47.792 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:39:47.792 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:39:47.792 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:39:47.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:48.359 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:34 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:48.498 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:48.499 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:48.499 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:48.499 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:48.499 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:48.499 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 86 k 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 230 k 2024-09-16T00:39:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:48.551 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2024-09-16T00:39:48.552 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:48.552 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.6 MB/s | 86 kB 00:00 2024-09-16T00:39:48.552 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:48.560 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:48.560 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:48.626 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:48.626 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:48.773 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:48.849 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:48.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:48.849 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:48.849 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:48.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:48.850 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:48.868 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:49.110 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2024-09-16T00:39:49.260 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:49.521 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:49.686 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 12:38:16 AM UTC. 2024-09-16T00:39:49.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-mirror 2024-09-16T00:39:49.820 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-16T00:39:49.821 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:49.821 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-16T00:39:49.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:49.823 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 169 k 2024-09-16T00:39:49.823 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 490 k 2024-09-16T00:39:49.823 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-16T00:39:49.868 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.6 MB/s | 169 kB 00:00 2024-09-16T00:39:49.869 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:49.869 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.5 MB/s | 169 kB 00:00 2024-09-16T00:39:49.869 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-16T00:39:49.876 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-16T00:39:49.876 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-16T00:39:49.939 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-16T00:39:49.939 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-16T00:39:50.097 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-16T00:39:50.199 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:50.346 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:50.488 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:50.489 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:50.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:50.490 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 3.0 M 2024-09-16T00:39:50.490 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 12 M 2024-09-16T00:39:50.490 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:50.583 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2024-09-16T00:39:50.583 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:50.583 INFO:teuthology.orchestra.run.smithi053.stdout:Total 33 MB/s | 3.0 MB 00:00 2024-09-16T00:39:50.584 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:50.590 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:50.590 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:50.606 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:50.675 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:50.675 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:39:50.875 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-16T00:39:51.107 DEBUG:teuthology.parallel:result is None 2024-09-16T00:39:51.111 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:51.171 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:51.198 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:51.198 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T00:39:51.199 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T00:39:51.199 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:39:51.199 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T00:39:51.199 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:52.446 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:52.446 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:52.446 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:52.446 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:52.447 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:52.447 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:52.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-nbd 2024-09-16T00:39:53.273 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:39 ago on Mon 16 Sep 2024 12:38:14 AM UTC. 2024-09-16T00:39:53.411 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-09-16T00:39:53.411 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-09-16T00:39:53.412 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-09-16T00:39:53.413 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-09-16T00:39:53.413 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:53.413 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 169 k 2024-09-16T00:39:53.413 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 490 k 2024-09-16T00:39:53.413 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-09-16T00:39:53.457 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 3.7 MB/s | 169 kB 00:00 2024-09-16T00:39:53.458 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:39:53.458 INFO:teuthology.orchestra.run.smithi053.stdout:Total 3.6 MB/s | 169 kB 00:00 2024-09-16T00:39:53.458 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-09-16T00:39:53.466 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-09-16T00:39:53.466 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-09-16T00:39:53.533 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-09-16T00:39:53.533 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-09-16T00:39:53.689 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-09-16T00:39:53.799 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:54.270 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:39:54.545 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-09-16T00:39:54.797 DEBUG:teuthology.parallel:result is None 2024-09-16T00:39:54.797 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:39:54.797 INFO:teuthology.packaging:ref: None 2024-09-16T00:39:54.798 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:39:54.798 INFO:teuthology.packaging:branch: None 2024-09-16T00:39:54.798 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:39:54.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-16T00:39:54.943 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:39:54.966 INFO:teuthology.orchestra.run.smithi053.stdout:18.2.0-0.el9 2024-09-16T00:39:54.967 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-16T00:39:54.967 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-16T00:39:54.968 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-16T00:39:54.969 INFO:teuthology.packaging:ref: None 2024-09-16T00:39:54.969 INFO:teuthology.packaging:tag: v18.2.0 2024-09-16T00:39:54.969 INFO:teuthology.packaging:branch: None 2024-09-16T00:39:54.969 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:39:54.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-16T00:39:55.111 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T00:39:55.136 INFO:teuthology.orchestra.run.smithi152.stdout:18.2.0-0.el9 2024-09-16T00:39:55.136 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-16T00:39:55.136 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-16T00:39:55.138 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T00:39:55.138 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:39:55.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:39:55.165 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:39:55.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T00:39:55.206 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T00:39:55.206 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:39:55.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:39:55.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:39:55.298 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:39:55.298 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T00:39:55.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T00:39:55.394 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T00:39:55.394 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:39:55.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:39:55.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:39:55.486 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:39:55.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T00:39:55.515 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T00:39:55.583 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T00:39:55.583 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:39:55.584 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:39:55.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:39:55.676 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:39:55.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T00:39:55.703 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T00:39:55.770 INFO:teuthology.run_tasks:Running task print... 2024-09-16T00:39:55.778 INFO:teuthology.task.print:**** done install task... 2024-09-16T00:39:55.779 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T00:39:55.888 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T00:39:55.888 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-16T00:39:55.889 INFO:tasks.cephadm:Cluster fsid is 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:39:55.889 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T00:39:55.889 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-16T00:39:55.889 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi053': '172.21.15.53', 'mon.smithi152': '172.21.15.152'} 2024-09-16T00:39:55.889 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T00:39:55.889 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname $(hostname -s) 2024-09-16T00:39:55.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-09-16T00:39:55.944 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-16T00:39:55.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:39:56.089 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-16T00:39:56.362 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 ae7f37330c1a72493684eb1fcaed6f2a01195bb6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-16T00:39:56.363 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/ae7f37330c1a72493684eb1fcaed6f2a01195bb6/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:39:56.363 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/ae7f37330c1a72493684eb1fcaed6f2a01195bb6/centos/9/x86_64/flavors/default/cephadm 2024-09-16T00:39:56.364 DEBUG:teuthology.orchestra.run.smithi053:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/ae7f37330c1a72493684eb1fcaed6f2a01195bb6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 16 00:39 /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:56.702 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/ae7f37330c1a72493684eb1fcaed6f2a01195bb6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:57.036 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 217225 Sep 16 00:39 /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:57.037 DEBUG:teuthology.orchestra.run.smithi053:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:57.067 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T00:39:57.122 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-16T00:39:57.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-16T00:39:57.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-16T00:39:58.671 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-16T00:39:58.804 INFO:teuthology.orchestra.run.smithi053.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-16T00:40:11.094 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:40:11.094 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-16T00:40:11.094 INFO:teuthology.orchestra.run.smithi053.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-16T00:40:11.095 INFO:teuthology.orchestra.run.smithi053.stdout: "repo_digests": [ 2024-09-16T00:40:11.095 INFO:teuthology.orchestra.run.smithi053.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-16T00:40:11.095 INFO:teuthology.orchestra.run.smithi053.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-16T00:40:11.095 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-16T00:40:11.095 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-16T00:40:11.110 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-16T00:40:11.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph 2024-09-16T00:40:11.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-09-16T00:40:11.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /etc/ceph 2024-09-16T00:40:11.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-09-16T00:40:11.259 INFO:tasks.cephadm:Writing seed config... 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-16T00:40:11.260 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-16T00:40:11.261 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T00:40:11.262 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T00:40:11.263 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T00:40:11.263 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T00:40:11.263 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-16T00:40:11.263 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-16T00:40:11.263 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:40:11.264 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T00:40:11.290 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 31d96aac-73c4-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-16T00:40:11.290 DEBUG:teuthology.orchestra.run.smithi053:mon.smithi053> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service 2024-09-16T00:40:11.333 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T00:40:11.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.53 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:40:11.490 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-16T00:40:11.491 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '31d96aac-73c4-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.53', '--skip-admin-label'] 2024-09-16T00:40:11.515 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:40:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T00:40:11.516 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying podman|docker is present... 2024-09-16T00:40:11.539 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:40:11.539 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying lvm2 is present... 2024-09-16T00:40:11.539 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying time synchronization is in place... 2024-09-16T00:40:11.547 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:40:11.547 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:40:11.554 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:40:11.554 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:40:11.560 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-09-16T00:40:11.567 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-09-16T00:40:11.567 INFO:teuthology.orchestra.run.smithi053.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:40:11.567 INFO:teuthology.orchestra.run.smithi053.stdout:Repeating the final host check... 2024-09-16T00:40:11.589 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout 5.2.2 2024-09-16T00:40:11.589 INFO:teuthology.orchestra.run.smithi053.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T00:40:11.589 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl is present 2024-09-16T00:40:11.589 INFO:teuthology.orchestra.run.smithi053.stdout:lvcreate is present 2024-09-16T00:40:11.596 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T00:40:11.596 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T00:40:11.602 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T00:40:11.602 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:40:11.609 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-09-16T00:40:11.615 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-09-16T00:40:11.615 INFO:teuthology.orchestra.run.smithi053.stdout:Unit chronyd.service is enabled and running 2024-09-16T00:40:11.615 INFO:teuthology.orchestra.run.smithi053.stdout:Host looks OK 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Cluster fsid: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Acquiring lock 139869555471696 on /run/cephadm/31d96aac-73c4-11ef-bceb-c7b262605968.lock 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Lock 139869555471696 acquired on /run/cephadm/31d96aac-73c4-11ef-bceb-c7b262605968.lock 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 3300 ... 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 6789 ... 2024-09-16T00:40:11.616 INFO:teuthology.orchestra.run.smithi053.stdout:Base mon IP(s) is [172.21.15.53:3300, 172.21.15.53:6789], mon addrv is [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-09-16T00:40:11.620 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.53 metric 100 2024-09-16T00:40:11.620 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.53 metric 100 2024-09-16T00:40:11.622 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T00:40:11.623 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-16T00:40:11.623 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1786sec hoplimit 64 pref medium 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-16T00:40:11.625 INFO:teuthology.orchestra.run.smithi053.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T00:40:11.626 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-09-16T00:40:11.626 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-09-16T00:40:11.626 INFO:teuthology.orchestra.run.smithi053.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T00:40:11.626 INFO:teuthology.orchestra.run.smithi053.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T00:40:11.627 INFO:teuthology.orchestra.run.smithi053.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-16T00:40:12.414 INFO:teuthology.orchestra.run.smithi053.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T00:40:13.426 INFO:teuthology.orchestra.run.smithi053.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-16T00:40:13.426 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-16T00:40:13.426 INFO:teuthology.orchestra.run.smithi053.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T00:40:14.316 INFO:teuthology.orchestra.run.smithi053.stdout:stat: stdout 167 167 2024-09-16T00:40:14.316 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial keys... 2024-09-16T00:40:22.941 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQBwfudmCrUSDRAAUrYDdXvoe5/qNbQSxcLgTQ== 2024-09-16T00:40:25.708 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQB5fudmg0NRAxAA+UGbA0JfayrCVY1+xk5JyA== 2024-09-16T00:40:26.572 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQB6fudmBJSyABAAAWDw1/x3XjNjr+96f5RkwA== 2024-09-16T00:40:26.573 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial monmap... 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool for smithi053 [v2:172.21.15.53:3300,v1:172.21.15.53:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T00:40:27.454 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = pacific 2024-09-16T00:40:27.455 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: set fsid to 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:27.455 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T00:40:27.455 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:40:27.455 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mon... 2024-09-16T00:40:28.902 INFO:teuthology.orchestra.run.smithi053.stdout:create mon.smithi053 on 2024-09-16T00:40:29.127 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T00:40:29.303 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T00:40:29.496 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target. 2024-09-16T00:40:29.496 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target. 2024-09-16T00:40:29.731 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053 2024-09-16T00:40:29.731 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Unit ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service not loaded. 2024-09-16T00:40:29.920 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target.wants/ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service → /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968@.service. 2024-09-16T00:40:30.610 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:30 smithi053 podman[27558]: 2024-09-16 00:40:30.566808446 +0000 UTC m=+0.508778186 container start 4e0635cd38386990c121d0dcd3b9dafbf93b98e78d8f7d4f9b28110ad1e13796 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, ceph=True, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1) 2024-09-16T00:40:30.610 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:30 smithi053 ceph-mon[27578]: mkfs 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:30.659 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:40:30.660 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon to start... 2024-09-16T00:40:30.667 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon... 2024-09-16T00:40:30.896 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:30 smithi053 ceph-mon[27578]: mon.smithi053 is new leader, mons smithi053 in quorum (ranks 0) 2024-09-16T00:40:30.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:30 smithi053 bash[27558]: 4e0635cd38386990c121d0dcd3b9dafbf93b98e78d8f7d4f9b28110ad1e13796 2024-09-16T00:40:30.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:30 smithi053 systemd[1]: Started Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:40:31.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: mon.smithi053 is new leader, mons smithi053 in quorum (ranks 0) 2024-09-16T00:40:31.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: monmap e1: 1 mons at {smithi053=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0]} removed_ranks: {} 2024-09-16T00:40:31.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: fsmap 2024-09-16T00:40:31.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T00:40:31.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: mgrmap e1: no daemons active 2024-09-16T00:40:31.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:31 smithi053 ceph-mon[27578]: from='client.? 172.21.15.53:0/3969221540' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T00:40:31.830 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout id: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout services: 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi053 (age 0.594972s) 2024-09-16T00:40:31.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout data: 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.118+0000 7f00a8682700 1 Processor -- start 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.118+0000 7f00a8682700 1 -- start start 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.118+0000 7f00a8682700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.119+0000 7f00a8682700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a007a880 con 0x7f00a007be40 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.119+0000 7f00a641e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:31.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.119+0000 7f00a641e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36618/0 (socket says 172.21.15.53:36618) 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.119+0000 7f00a641e700 1 -- 172.21.15.53:0/1543957623 learned_addr learned my addr 172.21.15.53:0/1543957623 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.119+0000 7f00a641e700 1 -- 172.21.15.53:0/1543957623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a007a9c0 con 0x7f00a007be40 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a641e700 1 --2- 172.21.15.53:0/1543957623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f009c009e80 tx=0x7f009c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9712098e661d1532 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a541c700 1 -- 172.21.15.53:0/1543957623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f009c00e070 con 0x7f00a007be40 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a541c700 1 -- 172.21.15.53:0/1543957623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c003a20 con 0x7f00a007be40 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a541c700 1 -- 172.21.15.53:0/1543957623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f009c003bd0 con 0x7f00a007be40 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 -- 172.21.15.53:0/1543957623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 msgr2=0x7f00a007a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 --2- 172.21.15.53:0/1543957623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f009c009e80 tx=0x7f009c00b330 comp rx=0 tx=0).stop 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 -- 172.21.15.53:0/1543957623 shutdown_connections 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 --2- 172.21.15.53:0/1543957623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a007a340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 -- 172.21.15.53:0/1543957623 >> 172.21.15.53:0/1543957623 conn(0x7f00a01012b0 msgr2=0x7f00a01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 -- 172.21.15.53:0/1543957623 shutdown_connections 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.120+0000 7f00a8682700 1 -- 172.21.15.53:0/1543957623 wait complete. 2024-09-16T00:40:31.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a8682700 1 Processor -- start 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a8682700 1 -- start start 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a8682700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a8682700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019b890 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a641e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a641e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36632/0 (socket says 172.21.15.53:36632) 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.121+0000 7f00a641e700 1 -- 172.21.15.53:0/3969221540 learned_addr learned my addr 172.21.15.53:0/3969221540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00a641e700 1 -- 172.21.15.53:0/3969221540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c009b30 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00a641e700 1 --2- 172.21.15.53:0/3969221540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f009c015040 tx=0x7f009c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f009c004240 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c0043a0 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f009c004680 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a019ba90 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a019beb0 con 0x7f00a007be40 2024-09-16T00:40:31.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f009c019050 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.122+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f009c025750 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.123+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a00623f0 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.125+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f00a00623f0 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.200+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f00a0195110 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.200+0000 7f00977fe700 1 -- 172.21.15.53:0/3969221540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f009c02a060 con 0x7f00a007be40 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 msgr2=0x7f00a019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 --2- 172.21.15.53:0/3969221540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f009c015040 tx=0x7f009c004ad0 comp rx=0 tx=0).stop 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 shutdown_connections 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 --2- 172.21.15.53:0/3969221540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00a007be40 0x7f00a019b350 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 >> 172.21.15.53:0/3969221540 conn(0x7f00a01012b0 msgr2=0x7f00a0102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 shutdown_connections 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:31.201+0000 7f00a8682700 1 -- 172.21.15.53:0/3969221540 wait complete. 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:mon is available 2024-09-16T00:40:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T00:40:32.951 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:32 smithi053 ceph-mon[27578]: from='client.? 172.21.15.53:0/2134310434' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:40:32.951 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:32 smithi053 ceph-mon[27578]: from='client.? 172.21.15.53:0/2134310434' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T00:40:32.965 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:32.965 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:40:32.965 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:32.965 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:32.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:40:32.967 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:40:32.968 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:40:32.968 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:40:32.968 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3f0ce700 1 Processor -- start 2024-09-16T00:40:32.968 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3f0ce700 1 -- start start 2024-09-16T00:40:32.968 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3f0ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3f0ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3807a860 con 0x7f9f3807be20 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3ce6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3ce6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36642/0 (socket says 172.21.15.53:36642) 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.295+0000 7f9f3ce6a700 1 -- 172.21.15.53:0/1476253257 learned_addr learned my addr 172.21.15.53:0/1476253257 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.296+0000 7f9f3ce6a700 1 -- 172.21.15.53:0/1476253257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3807a9a0 con 0x7f9f3807be20 2024-09-16T00:40:32.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.296+0000 7f9f3ce6a700 1 --2- 172.21.15.53:0/1476253257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009e80 tx=0x7f9f2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19525dc67802eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.296+0000 7f9f377fe700 1 -- 172.21.15.53:0/1476253257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2800e070 con 0x7f9f3807be20 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.296+0000 7f9f377fe700 1 -- 172.21.15.53:0/1476253257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28003a20 con 0x7f9f3807be20 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.296+0000 7f9f377fe700 1 -- 172.21.15.53:0/1476253257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f28003bd0 con 0x7f9f3807be20 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/1476253257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 msgr2=0x7f9f3807a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 --2- 172.21.15.53:0/1476253257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009e80 tx=0x7f9f2800b330 comp rx=0 tx=0).stop 2024-09-16T00:40:32.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/1476253257 shutdown_connections 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 --2- 172.21.15.53:0/1476253257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3807a320 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/1476253257 >> 172.21.15.53:0/1476253257 conn(0x7f9f38101220 msgr2=0x7f9f38103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/1476253257 shutdown_connections 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/1476253257 wait complete. 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 Processor -- start 2024-09-16T00:40:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.297+0000 7f9f3f0ce700 1 -- start start 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3f0ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3f0ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3819b870 con 0x7f9f3807be20 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3ce6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3ce6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36644/0 (socket says 172.21.15.53:36644) 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3ce6a700 1 -- 172.21.15.53:0/2134310434 learned_addr learned my addr 172.21.15.53:0/2134310434 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:32.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3ce6a700 1 -- 172.21.15.53:0/2134310434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009b30 con 0x7f9f3807be20 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3ce6a700 1 --2- 172.21.15.53:0/2134310434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9f28004000 tx=0x7f9f28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f28004240 con 0x7f9f3807be20 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280043e0 con 0x7f9f3807be20 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3819ba70 con 0x7f9f3807be20 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.298+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f280046e0 con 0x7f9f3807be20 2024-09-16T00:40:32.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.299+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3819be90 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.299+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9f28019050 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.299+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f28025790 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.299+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f381950a0 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.302+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9f2802a060 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.373+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9f3802ceb0 con 0x7f9f3807be20 2024-09-16T00:40:32.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.377+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9f28012d30 con 0x7f9f3807be20 2024-09-16T00:40:32.975 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.377+0000 7f9f35ffb700 1 -- 172.21.15.53:0/2134310434 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f9f28020030 con 0x7f9f3807be20 2024-09-16T00:40:32.975 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 msgr2=0x7f9f3819b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:32.975 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 --2- 172.21.15.53:0/2134310434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9f28004000 tx=0x7f9f28004ad0 comp rx=0 tx=0).stop 2024-09-16T00:40:32.975 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 shutdown_connections 2024-09-16T00:40:32.975 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 --2- 172.21.15.53:0/2134310434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f3807be20 0x7f9f3819b330 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:32.976 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 >> 172.21.15.53:0/2134310434 conn(0x7f9f38101220 msgr2=0x7f9f38102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:32.976 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 shutdown_connections 2024-09-16T00:40:32.976 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:32.378+0000 7f9f3f0ce700 1 -- 172.21.15.53:0/2134310434 wait complete. 2024-09-16T00:40:32.976 INFO:teuthology.orchestra.run.smithi053.stdout:Generating new minimal ceph.conf... 2024-09-16T00:40:34.040 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:33 smithi053 ceph-mon[27578]: from='client.? 172.21.15.53:0/1811610289' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:40:34.051 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eb524f700 1 Processor -- start 2024-09-16T00:40:34.051 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eb524f700 1 -- start start 2024-09-16T00:40:34.051 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eb524f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eb524f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0079730 con 0x7f7eb007acf0 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eaed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.387+0000 7f7eaed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37960/0 (socket says 172.21.15.53:37960) 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eaed9d700 1 -- 172.21.15.53:0/674945667 learned_addr learned my addr 172.21.15.53:0/674945667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eaed9d700 1 -- 172.21.15.53:0/674945667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0079870 con 0x7f7eb007acf0 2024-09-16T00:40:34.052 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eaed9d700 1 --2- 172.21.15.53:0/674945667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00098a0 tx=0x7f7ea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eb9778429dd424 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eadd9b700 1 -- 172.21.15.53:0/674945667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ea0004180 con 0x7f7eb007acf0 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eadd9b700 1 -- 172.21.15.53:0/674945667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ea00042e0 con 0x7f7eb007acf0 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.388+0000 7f7eadd9b700 1 -- 172.21.15.53:0/674945667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ea0011a50 con 0x7f7eb007acf0 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 -- 172.21.15.53:0/674945667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 msgr2=0x7f7eb00791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 --2- 172.21.15.53:0/674945667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00098a0 tx=0x7f7ea0009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:34.053 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 -- 172.21.15.53:0/674945667 shutdown_connections 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 --2- 172.21.15.53:0/674945667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb00791f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 -- 172.21.15.53:0/674945667 >> 172.21.15.53:0/674945667 conn(0x7f7eb01011f0 msgr2=0x7f7eb0103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 -- 172.21.15.53:0/674945667 shutdown_connections 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.389+0000 7f7eb524f700 1 -- 172.21.15.53:0/674945667 wait complete. 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eb524f700 1 Processor -- start 2024-09-16T00:40:34.054 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eb524f700 1 -- start start 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eb524f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eb524f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb019c080 con 0x7f7eb007acf0 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eaed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eaed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37976/0 (socket says 172.21.15.53:37976) 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eaed9d700 1 -- 172.21.15.53:0/1811610289 learned_addr learned my addr 172.21.15.53:0/1811610289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eaed9d700 1 -- 172.21.15.53:0/1811610289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0009550 con 0x7f7eb007acf0 2024-09-16T00:40:34.055 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.390+0000 7f7eaed9d700 1 --2- 172.21.15.53:0/1811610289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0006af0 tx=0x7f7ea00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ea0003a00 con 0x7f7eb007acf0 2024-09-16T00:40:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ea0003b60 con 0x7f7eb007acf0 2024-09-16T00:40:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb019c280 con 0x7f7eb007acf0 2024-09-16T00:40:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ea0019710 con 0x7f7eb007acf0 2024-09-16T00:40:34.056 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb019c6a0 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ea0019cf0 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.391+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ea0024730 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.392+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb0062380 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.394+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7ea001abc0 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.466+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7eb019f1d0 con 0x7f7eb007acf0 2024-09-16T00:40:34.057 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.466+0000 7f7ea7fff700 1 -- 172.21.15.53:0/1811610289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f7ea00248f0 con 0x7f7eb007acf0 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 msgr2=0x7f7eb019bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 --2- 172.21.15.53:0/1811610289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0006af0 tx=0x7f7ea00047c0 comp rx=0 tx=0).stop 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 shutdown_connections 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 --2- 172.21.15.53:0/1811610289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb007acf0 0x7f7eb019bb40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 >> 172.21.15.53:0/1811610289 conn(0x7f7eb01011f0 msgr2=0x7f7eb0102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 shutdown_connections 2024-09-16T00:40:34.058 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:33.467+0000 7f7eb524f700 1 -- 172.21.15.53:0/1811610289 wait complete. 2024-09-16T00:40:34.059 INFO:teuthology.orchestra.run.smithi053.stdout:Restarting the monitor... 2024-09-16T00:40:34.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 systemd[1]: Stopping Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:40:34.752 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[27573]: 2024-09-16T00:40:34.334+0000 7f8ee4852700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi053 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:40:34.753 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[27573]: 2024-09-16T00:40:34.334+0000 7f8ee4852700 -1 mon.smithi053@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T00:40:34.753 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 podman[27825]: 2024-09-16 00:40:34.489556537 +0000 UTC m=+0.277550479 container died 4e0635cd38386990c121d0dcd3b9dafbf93b98e78d8f7d4f9b28110ad1e13796 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-09-16T00:40:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 podman[27825]: 2024-09-16 00:40:34.860421421 +0000 UTC m=+0.648415364 container cleanup 4e0635cd38386990c121d0dcd3b9dafbf93b98e78d8f7d4f9b28110ad1e13796 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-16T00:40:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:34 smithi053 bash[27825]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053 2024-09-16T00:40:35.456 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 podman[27837]: 2024-09-16 00:40:35.111314096 +0000 UTC m=+0.617531279 container remove 4e0635cd38386990c121d0dcd3b9dafbf93b98e78d8f7d4f9b28110ad1e13796 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-16T00:40:35.457 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Deactivated successfully. 2024-09-16T00:40:35.457 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 systemd[1]: Stopped Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:40:35.457 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 systemd[1]: Starting Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:40:35.724 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 podman[27931]: 2024-09-16 00:40:35.359693258 +0000 UTC m=+0.016073248 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-16T00:40:35.724 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 podman[27931]: 2024-09-16 00:40:35.487217012 +0000 UTC m=+0.143596992 container create c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-09-16T00:40:35.725 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 podman[27931]: 2024-09-16 00:40:35.698155208 +0000 UTC m=+0.354535189 container init c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, RELEASE=HEAD, ceph=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T00:40:35.725 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 podman[27931]: 2024-09-16 00:40:35.701258792 +0000 UTC m=+0.357638775 container start c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, RELEASE=HEAD, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T00:40:35.785 INFO:teuthology.orchestra.run.smithi053.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: pidfile_write: ignore empty --pid-file 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: load: jerasure load: lrc 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Git sha 0 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: DB SUMMARY 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: DB Session ID: 240JH6VNRAJ6B3AJR78U 2024-09-16T00:40:35.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi053/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi053/store.db: 000009.log size: 98771 ; 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.env: 0x555c8420b720 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:40:36.000 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.info_log: 0x555c868292c0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.statistics: (nil) 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.use_fsync: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:40:36.001 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:40:36.002 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:40:36.002 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.db_log_dir: 2024-09-16T00:40:36.002 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.wal_dir: 2024-09-16T00:40:36.002 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:40:36.003 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:40:36.003 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:40:36.003 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:40:36.003 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:40:36.003 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.write_buffer_manager: 0x555c85ab85a0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.unordered_write: 0 2024-09-16T00:40:36.004 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.row_cache: None 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.wal_filter: None 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.wal_compression: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:40:36.005 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:40:36.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_open_files: -1 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:40:36.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Compression algorithms supported: 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kZSTD supported: 0 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:40:36.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi053/store.db/MANIFEST-000010 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.merge_operator: 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_filter: None 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:40:36.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c868293c0) 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_type: 0 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: data_block_index_type: 0 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_shortening: 1 2024-09-16T00:40:36.010 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: checksum: 4 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: no_block_cache: 0 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache: 0x555c85b3b350 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_options: 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: capacity : 536870912 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: num_shard_bits : 4 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: strict_capacity_limit : 0 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_compressed: (nil) 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: persistent_cache: (nil) 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_size: 4096 2024-09-16T00:40:36.011 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_size_deviation: 10 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_restart_interval: 16 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_block_restart_interval: 1 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: metadata_block_size: 4096 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: partition_filters: 0 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: use_delta_encoding: 1 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: filter_policy: bloomfilter 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: whole_key_filtering: 1 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: verify_compression: 0 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: format_version: 5 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: enable_index_compression: 1 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_align: 0 2024-09-16T00:40:36.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: max_auto_readahead_size: 262144 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: prepopulate_block_cache: 0 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression: NoCompression 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.num_levels: 7 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:40:36.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:40:36.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:40:36.015 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:40:36.016 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.table_properties_collectors: 2024-09-16T00:40:36.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.ttl: 2592000 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:40:36.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi053/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 240ad471-4529-42cf-864a-0db4e26b2ab2 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447235731014, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T00:40:36.019 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447235732084, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94017, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92023, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84531, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447235, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "240ad471-4529-42cf-864a-0db4e26b2ab2", "db_session_id": "240JH6VNRAJ6B3AJR78U", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447235732168, "job": 1, "event": "recovery_finished"} 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi053/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c85bd8000 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: DB pointer 0x555c85bc4000 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** DB Stats ** 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:40:36.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** Compaction Stats [default] ** 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: L0 2/0 93.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Sum 2/0 93.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** Compaction Stats [default] ** 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:40:36.021 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative compaction: 0.00 GB write, 28.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval compaction: 0.00 GB write, 28.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Block cache BinnedLRUCache@0x555c85b3b350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-16T00:40:36.022 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: starting mon.smithi053 rank 0 at public addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] at bind addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi053 fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???) e1 preinit fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).mds e1 new map 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).mds e1 print_map 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: e1 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: legacy client fscid: -1 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: No filesystems configured 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T00:40:36.023 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 bash[27931]: c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 systemd[1]: Started Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mon.smithi053 is new leader, mons smithi053 in quorum (ranks 0) 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: monmap e1: 1 mons at {smithi053=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0]} removed_ranks: {} 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: fsmap 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T00:40:36.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:35 smithi053 ceph-mon[27950]: mgrmap e1: no daemons active 2024-09-16T00:40:36.832 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a30f0700 1 Processor -- start 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a30f0700 1 -- start start 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a30f0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a30f0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1064c0 con 0x7f909c105b70 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a0e8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a0e8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37978/0 (socket says 172.21.15.53:37978) 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.207+0000 7f90a0e8c700 1 -- 172.21.15.53:0/1479459886 learned_addr learned my addr 172.21.15.53:0/1479459886 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:36.836 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.208+0000 7f90a0e8c700 1 -- 172.21.15.53:0/1479459886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c106600 con 0x7f909c105b70 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.208+0000 7f90a0e8c700 1 --2- 172.21.15.53:0/1479459886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f90900098a0 tx=0x7f9090009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346e79bcb03ba0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.208+0000 7f909b7fe700 1 -- 172.21.15.53:0/1479459886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090004180 con 0x7f909c105b70 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.208+0000 7f909b7fe700 1 -- 172.21.15.53:0/1479459886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90900042e0 con 0x7f909c105b70 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.208+0000 7f909b7fe700 1 -- 172.21.15.53:0/1479459886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090011a50 con 0x7f909c105b70 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- 172.21.15.53:0/1479459886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 msgr2=0x7f909c105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 --2- 172.21.15.53:0/1479459886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f90900098a0 tx=0x7f9090009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- 172.21.15.53:0/1479459886 shutdown_connections 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 --2- 172.21.15.53:0/1479459886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c105f80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- 172.21.15.53:0/1479459886 >> 172.21.15.53:0/1479459886 conn(0x7f909c101220 msgr2=0x7f909c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- 172.21.15.53:0/1479459886 shutdown_connections 2024-09-16T00:40:36.837 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- 172.21.15.53:0/1479459886 wait complete. 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 Processor -- start 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.209+0000 7f90a30f0700 1 -- start start 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a30f0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a30f0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c199df0 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a0e8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a0e8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37994/0 (socket says 172.21.15.53:37994) 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a0e8c700 1 -- 172.21.15.53:0/2844227179 learned_addr learned my addr 172.21.15.53:0/2844227179 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a0e8c700 1 -- 172.21.15.53:0/2844227179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009550 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a0e8c700 1 --2- 172.21.15.53:0/2844227179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9090000c00 tx=0x7f9090011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090003b90 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90900248b0 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c199ff0 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.210+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909001a8e0 con 0x7f909c105b70 2024-09-16T00:40:36.838 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.211+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c19a410 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.211+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f909002d3f0 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.211+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f90900194a0 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.212+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c062380 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.214+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9090024db0 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.285+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f909c19d580 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.288+0000 7f9099ffb700 1 -- 172.21.15.53:0/2844227179 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9090024a20 con 0x7f909c105b70 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 msgr2=0x7f909c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 --2- 172.21.15.53:0/2844227179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9090000c00 tx=0x7f9090011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 shutdown_connections 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 --2- 172.21.15.53:0/2844227179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f909c105b70 0x7f909c1998b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 >> 172.21.15.53:0/2844227179 conn(0x7f909c101220 msgr2=0x7f909c101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 shutdown_connections 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:36.289+0000 7f90a30f0700 1 -- 172.21.15.53:0/2844227179 wait complete. 2024-09-16T00:40:36.839 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T00:40:36.854 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:40:36.854 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mgr... 2024-09-16T00:40:36.854 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T00:40:36.855 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T00:40:36.855 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-16T00:40:37.114 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mgr.smithi053.cjiiek 2024-09-16T00:40:37.114 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mgr.smithi053.cjiiek.service: Unit ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mgr.smithi053.cjiiek.service not loaded. 2024-09-16T00:40:37.275 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968.target.wants/ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mgr.smithi053.cjiiek.service → /etc/systemd/system/ceph-31d96aac-73c4-11ef-bceb-c7b262605968@.service. 2024-09-16T00:40:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:37 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2844227179' entity='client.admin' 2024-09-16T00:40:37.842 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:40:37.842 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-09-16T00:40:37.851 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:40:37.851 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:40:37.851 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-09-16T00:40:37.851 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T00:40:37.862 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:40:37.862 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-09-16T00:40:37.870 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:40:37.871 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:40:37.871 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-09-16T00:40:37.871 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-16T00:40:37.871 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr to start... 2024-09-16T00:40:37.871 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr... 2024-09-16T00:40:38.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:38 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1548991585' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "31d96aac-73c4-11ef-bceb-c7b262605968", 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:40:39.096 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "smithi053" 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:39.097 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:40:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:40:39.105 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:40:39.106 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:40:30.607991+0000", 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:40:39.107 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.317+0000 7fa4d9260700 1 Processor -- start 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.317+0000 7fa4d9260700 1 -- start start 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d9260700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d9260700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d407a860 con 0x7fa4d407be20 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38018/0 (socket says 172.21.15.53:38018) 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d2d9d700 1 -- 172.21.15.53:0/2761197526 learned_addr learned my addr 172.21.15.53:0/2761197526 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d2d9d700 1 -- 172.21.15.53:0/2761197526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d407a9a0 con 0x7fa4d407be20 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.318+0000 7fa4d2d9d700 1 --2- 172.21.15.53:0/2761197526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098a0 tx=0x7fa4c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8c13552e6525cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d1d9b700 1 -- 172.21.15.53:0/2761197526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c4004180 con 0x7fa4d407be20 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d1d9b700 1 -- 172.21.15.53:0/2761197526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa4c40042e0 con 0x7fa4d407be20 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d1d9b700 1 -- 172.21.15.53:0/2761197526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c4011a50 con 0x7fa4d407be20 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 -- 172.21.15.53:0/2761197526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 msgr2=0x7fa4d407a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:39.108 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 --2- 172.21.15.53:0/2761197526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40098a0 tx=0x7fa4c4009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 -- 172.21.15.53:0/2761197526 shutdown_connections 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 --2- 172.21.15.53:0/2761197526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d407a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 -- 172.21.15.53:0/2761197526 >> 172.21.15.53:0/2761197526 conn(0x7fa4d41012b0 msgr2=0x7fa4d41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 -- 172.21.15.53:0/2761197526 shutdown_connections 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.319+0000 7fa4d9260700 1 -- 172.21.15.53:0/2761197526 wait complete. 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d9260700 1 Processor -- start 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d9260700 1 -- start start 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d9260700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d9260700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d419c0a0 con 0x7fa4d407be20 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38028/0 (socket says 172.21.15.53:38028) 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.321+0000 7fa4d2d9d700 1 -- 172.21.15.53:0/1548991585 learned_addr learned my addr 172.21.15.53:0/1548991585 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4d2d9d700 1 -- 172.21.15.53:0/1548991585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4009550 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4d2d9d700 1 --2- 172.21.15.53:0/1548991585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4003de0 tx=0x7fa4c4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c4003930 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa4c4003a90 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa4c40196c0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d419c2a0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d419c6c0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa4c4019c80 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.322+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa4c402c3a0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.323+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d410bf10 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.325+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa4c401abc0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.401+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa4d419f7d0 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.401+0000 7fa4bbfff700 1 -- 172.21.15.53:0/1548991585 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fa4c401a430 con 0x7fa4d407be20 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 msgr2=0x7fa4d419bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:39.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 --2- 172.21.15.53:0/1548991585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4003de0 tx=0x7fa4c4011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 shutdown_connections 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 --2- 172.21.15.53:0/1548991585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4d407be20 0x7fa4d419bb60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 >> 172.21.15.53:0/1548991585 conn(0x7fa4d41012b0 msgr2=0x7fa4d4102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 shutdown_connections 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:38.402+0000 7fa4d9260700 1 -- 172.21.15.53:0/1548991585 wait complete. 2024-09-16T00:40:39.111 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (1/15)... 2024-09-16T00:40:42.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:41 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2657297436' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:40:42.481 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:42.481 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "31d96aac-73c4-11ef-bceb-c7b262605968", 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "smithi053" 2024-09-16T00:40:42.482 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.483 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:40:42.490 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:42.491 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:40:30.607991+0000", 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf5850b700 1 Processor -- start 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf5850b700 1 -- start start 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf5850b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf5850b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50105430 con 0x7fdf50104ae0 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf562a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf562a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38030/0 (socket says 172.21.15.53:38030) 2024-09-16T00:40:42.492 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf562a7700 1 -- 172.21.15.53:0/1355541582 learned_addr learned my addr 172.21.15.53:0/1355541582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.786+0000 7fdf562a7700 1 -- 172.21.15.53:0/1355541582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50105570 con 0x7fdf50104ae0 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.787+0000 7fdf562a7700 1 --2- 172.21.15.53:0/1355541582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0098a0 tx=0x7fdf4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe13e8cfa1fa4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.787+0000 7fdf552a5700 1 -- 172.21.15.53:0/1355541582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf4c004180 con 0x7fdf50104ae0 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.787+0000 7fdf552a5700 1 -- 172.21.15.53:0/1355541582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf4c0042e0 con 0x7fdf50104ae0 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.787+0000 7fdf552a5700 1 -- 172.21.15.53:0/1355541582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf4c011a50 con 0x7fdf50104ae0 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 -- 172.21.15.53:0/1355541582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 msgr2=0x7fdf50104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 --2- 172.21.15.53:0/1355541582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0098a0 tx=0x7fdf4c009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 -- 172.21.15.53:0/1355541582 shutdown_connections 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 --2- 172.21.15.53:0/1355541582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50104ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 -- 172.21.15.53:0/1355541582 >> 172.21.15.53:0/1355541582 conn(0x7fdf50100130 msgr2=0x7fdf50102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 -- 172.21.15.53:0/1355541582 shutdown_connections 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.788+0000 7fdf5850b700 1 -- 172.21.15.53:0/1355541582 wait complete. 2024-09-16T00:40:42.493 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf5850b700 1 Processor -- start 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf5850b700 1 -- start start 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf5850b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf5850b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50199e40 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf562a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf562a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38034/0 (socket says 172.21.15.53:38034) 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf562a7700 1 -- 172.21.15.53:0/2657297436 learned_addr learned my addr 172.21.15.53:0/2657297436 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf562a7700 1 -- 172.21.15.53:0/2657297436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009550 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.789+0000 7fdf562a7700 1 --2- 172.21.15.53:0/2657297436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf4c003b90 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5019a040 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf4c0248b0 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf4c01a8e0 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5019a460 con 0x7fdf50104ae0 2024-09-16T00:40:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf4c02d3f0 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.790+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdf4c0194d0 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.791+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf50062380 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.793+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fdf4c024db0 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.868+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdf50106950 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.869+0000 7fdf477fe700 1 -- 172.21.15.53:0/2657297436 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fdf4c024ad0 con 0x7fdf50104ae0 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 msgr2=0x7fdf50199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 --2- 172.21.15.53:0/2657297436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 shutdown_connections 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 --2- 172.21.15.53:0/2657297436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50104ae0 0x7fdf50199900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 >> 172.21.15.53:0/2657297436 conn(0x7fdf50100130 msgr2=0x7fdf50079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 shutdown_connections 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:41.870+0000 7fdf5850b700 1 -- 172.21.15.53:0/2657297436 wait complete. 2024-09-16T00:40:42.495 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (2/15)... 2024-09-16T00:40:44.896 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:40:44.896 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: mgrmap e2: smithi053.cjiiek(active, starting, since 0.00303813s) 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:40:44.897 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:44 smithi053 ceph-mon[27950]: from='mgr.14100 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "31d96aac-73c4-11ef-bceb-c7b262605968", 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:40:45.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "smithi053" 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:40:45.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:40:45.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:40:45.655 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:40:45.656 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:45.657 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:40:30.607991+0000", 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6ff68da700 1 Processor -- start 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6ff68da700 1 -- start start 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6ff68da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6ff68da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0079d60 con 0x7f6ff01066d0 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6feffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6feffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55738/0 (socket says 172.21.15.53:55738) 2024-09-16T00:40:45.658 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.929+0000 7f6feffff700 1 -- 172.21.15.53:0/101563662 learned_addr learned my addr 172.21.15.53:0/101563662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.930+0000 7f6feffff700 1 -- 172.21.15.53:0/101563662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0079ea0 con 0x7f6ff01066d0 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.930+0000 7f6feffff700 1 --2- 172.21.15.53:0/101563662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00098a0 tx=0x7f6fe0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394171b20a19b17b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.930+0000 7f6feeffd700 1 -- 172.21.15.53:0/101563662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fe0004180 con 0x7f6ff01066d0 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.930+0000 7f6feeffd700 1 -- 172.21.15.53:0/101563662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6fe00042e0 con 0x7f6ff01066d0 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.930+0000 7f6feeffd700 1 -- 172.21.15.53:0/101563662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fe0011a50 con 0x7f6ff01066d0 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- 172.21.15.53:0/101563662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 msgr2=0x7f6ff0108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 --2- 172.21.15.53:0/101563662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00098a0 tx=0x7f6fe0009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- 172.21.15.53:0/101563662 shutdown_connections 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 --2- 172.21.15.53:0/101563662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff0108ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- 172.21.15.53:0/101563662 >> 172.21.15.53:0/101563662 conn(0x7f6ff01000f0 msgr2=0x7f6ff0102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- 172.21.15.53:0/101563662 shutdown_connections 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- 172.21.15.53:0/101563662 wait complete. 2024-09-16T00:40:45.659 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 Processor -- start 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.931+0000 7f6ff68da700 1 -- start start 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6ff68da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6ff68da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0199e10 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6feffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6feffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55752/0 (socket says 172.21.15.53:55752) 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6feffff700 1 -- 172.21.15.53:0/32610660 learned_addr learned my addr 172.21.15.53:0/32610660 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6feffff700 1 -- 172.21.15.53:0/32610660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009550 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6feffff700 1 --2- 172.21.15.53:0/32610660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000c00 tx=0x7f6fe0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fe0003b90 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6fe00248b0 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff019a070 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.932+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fe001a8e0 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.933+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff019a4f0 con 0x7f6ff01066d0 2024-09-16T00:40:45.660 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.933+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7f6fe001ab50 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.934+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0109bb0 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.934+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6fe004bdc0 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:44.936+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6fe001ae00 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.010+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6ff0109da0 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.011+0000 7f6fed7fa700 1 -- 172.21.15.53:0/32610660 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f6fe0018350 con 0x7f6ff01066d0 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.011+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 msgr2=0x7f6ff01998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.011+0000 7f6ff68da700 1 --2- 172.21.15.53:0/32610660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0000c00 tx=0x7f6fe0011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.012+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 shutdown_connections 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.012+0000 7f6ff68da700 1 --2- 172.21.15.53:0/32610660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ff01066d0 0x7f6ff01998d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.012+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 >> 172.21.15.53:0/32610660 conn(0x7f6ff01000f0 msgr2=0x7f6ff0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.012+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 shutdown_connections 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:45.012+0000 7f6ff68da700 1 -- 172.21.15.53:0/32610660 wait complete. 2024-09-16T00:40:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (3/15)... 2024-09-16T00:40:46.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:45 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/32610660' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:40:46.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:45 smithi053 ceph-mon[27950]: mgrmap e3: smithi053.cjiiek(active, since 1.00644s) 2024-09-16T00:40:48.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:47 smithi053 ceph-mon[27950]: mgrmap e4: smithi053.cjiiek(active, since 2s) 2024-09-16T00:40:49.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:48 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2158248759' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "31d96aac-73c4-11ef-bceb-c7b262605968", 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T00:40:49.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "smithi053" 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-16T00:40:49.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T00:40:49.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T00:40:49.356 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T00:40:49.356 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T00:40:49.356 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T00:40:49.357 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.358 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T00:40:30.607991+0000", 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.090+0000 7f470346f700 1 Processor -- start 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.090+0000 7f470346f700 1 -- start start 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.090+0000 7f470346f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.090+0000 7f470346f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1053d0 con 0x7f46fc104a80 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.090+0000 7f470120b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f470120b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55766/0 (socket says 172.21.15.53:55766) 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f470120b700 1 -- 172.21.15.53:0/508184351 learned_addr learned my addr 172.21.15.53:0/508184351 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:49.359 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f470120b700 1 -- 172.21.15.53:0/508184351 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc105510 con 0x7f46fc104a80 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f470120b700 1 --2- 172.21.15.53:0/508184351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098a0 tx=0x7f46f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e629c20fe66c7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f46f3fff700 1 -- 172.21.15.53:0/508184351 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8004180 con 0x7f46fc104a80 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f46f3fff700 1 -- 172.21.15.53:0/508184351 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f46f80042e0 con 0x7f46fc104a80 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.091+0000 7f46f3fff700 1 -- 172.21.15.53:0/508184351 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8011a50 con 0x7f46fc104a80 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 -- 172.21.15.53:0/508184351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 msgr2=0x7f46fc104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 --2- 172.21.15.53:0/508184351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f80098a0 tx=0x7f46f8009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 -- 172.21.15.53:0/508184351 shutdown_connections 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 --2- 172.21.15.53:0/508184351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc104e90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 -- 172.21.15.53:0/508184351 >> 172.21.15.53:0/508184351 conn(0x7f46fc1000f0 msgr2=0x7f46fc102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:49.360 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 -- 172.21.15.53:0/508184351 shutdown_connections 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 -- 172.21.15.53:0/508184351 wait complete. 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.092+0000 7f470346f700 1 Processor -- start 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470346f700 1 -- start start 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470346f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470346f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc197be0 con 0x7f46fc104a80 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470120b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470120b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55772/0 (socket says 172.21.15.53:55772) 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470120b700 1 -- 172.21.15.53:0/2158248759 learned_addr learned my addr 172.21.15.53:0/2158248759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470120b700 1 -- 172.21.15.53:0/2158248759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009550 con 0x7f46fc104a80 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f470120b700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f46f80119e0 tx=0x7f46f8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.093+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8003b90 con 0x7f46fc104a80 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.094+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f46f801a8a0 con 0x7f46fc104a80 2024-09-16T00:40:49.361 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.094+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc197de0 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.094+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46f8019930 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.094+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc198200 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.094+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f46f8019ba0 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.095+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc1913b0 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.095+0000 7f46f27fc700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 0x7f46e803ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.095+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f46f804c820 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.095+0000 7f4700a0a700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 0x7f46e803ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.095+0000 7f4700a0a700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 0x7f46e803ca60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46ec006fd0 tx=0x7f46ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.100+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f46f802b750 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.385+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f46fc02d050 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.385+0000 7f46f27fc700 1 -- 172.21.15.53:0/2158248759 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f46f8023390 con 0x7f46fc104a80 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.387+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 msgr2=0x7f46e803ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.387+0000 7f470346f700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 0x7f46e803ca60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f46ec006fd0 tx=0x7f46ec006e40 comp rx=0 tx=0).stop 2024-09-16T00:40:49.362 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 msgr2=0x7f46fc1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f46f80119e0 tx=0x7f46f8011ac0 comp rx=0 tx=0).stop 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 shutdown_connections 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f46e803a5b0 0x7f46e803ca60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 --2- 172.21.15.53:0/2158248759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc104a80 0x7f46fc1976a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 >> 172.21.15.53:0/2158248759 conn(0x7f46fc1000f0 msgr2=0x7f46fc18e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 shutdown_connections 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:48.388+0000 7f470346f700 1 -- 172.21.15.53:0/2158248759 wait complete. 2024-09-16T00:40:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:mgr is available 2024-09-16T00:40:50.287 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:50 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3755895932' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T00:40:50.573 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:50.573 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T00:40:50.573 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:40:50.573 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.778+0000 7fd3234f6700 1 Processor -- start 2024-09-16T00:40:50.574 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.778+0000 7fd3234f6700 1 -- start start 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd3234f6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd3234f6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c074460 con 0x7fd31c1066d0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd321292700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd321292700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55782/0 (socket says 172.21.15.53:55782) 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd321292700 1 -- 172.21.15.53:0/4135314035 learned_addr learned my addr 172.21.15.53:0/4135314035 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd321292700 1 -- 172.21.15.53:0/4135314035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0745a0 con 0x7fd31c1066d0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd321292700 1 --2- 172.21.15.53:0/4135314035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3180098a0 tx=0x7fd318009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8637988343c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd313fff700 1 -- 172.21.15.53:0/4135314035 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd318004180 con 0x7fd31c1066d0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd313fff700 1 -- 172.21.15.53:0/4135314035 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd3180042e0 con 0x7fd31c1066d0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.779+0000 7fd313fff700 1 -- 172.21.15.53:0/4135314035 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd318011a50 con 0x7fd31c1066d0 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 -- 172.21.15.53:0/4135314035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 msgr2=0x7fd31c108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 --2- 172.21.15.53:0/4135314035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3180098a0 tx=0x7fd318009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 -- 172.21.15.53:0/4135314035 shutdown_connections 2024-09-16T00:40:50.575 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 --2- 172.21.15.53:0/4135314035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c108ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 -- 172.21.15.53:0/4135314035 >> 172.21.15.53:0/4135314035 conn(0x7fd31c100110 msgr2=0x7fd31c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 -- 172.21.15.53:0/4135314035 shutdown_connections 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.780+0000 7fd3234f6700 1 -- 172.21.15.53:0/4135314035 wait complete. 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd3234f6700 1 Processor -- start 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd3234f6700 1 -- start start 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd3234f6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd3234f6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c106570 con 0x7fd31c1066d0 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd321292700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd321292700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55784/0 (socket says 172.21.15.53:55784) 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd321292700 1 -- 172.21.15.53:0/3755895932 learned_addr learned my addr 172.21.15.53:0/3755895932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.781+0000 7fd321292700 1 -- 172.21.15.53:0/3755895932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009550 con 0x7fd31c1066d0 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd321292700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd318003b90 con 0x7fd31c1066d0 2024-09-16T00:40:50.576 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd3180248b0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c1046e0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd31801a8e0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.782+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c104b60 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fd318024440 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd3127fc700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 0x7fd30803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c109bb0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd31804c0a0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd320a91700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 0x7fd30803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.783+0000 7fd320a91700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 0x7fd30803a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006fd0 tx=0x7fd30c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.788+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd3180233a0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.986+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd31c109da0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.988+0000 7fd3127fc700 1 -- 172.21.15.53:0/3755895932 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fd3180233a0 con 0x7fd31c1066d0 2024-09-16T00:40:50.577 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 msgr2=0x7fd30803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 0x7fd30803a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006fd0 tx=0x7fd30c006e40 comp rx=0 tx=0).stop 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 msgr2=0x7fd31c106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 shutdown_connections 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd3080383f0 0x7fd30803a8a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 --2- 172.21.15.53:0/3755895932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd31c1066d0 0x7fd31c106030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 >> 172.21.15.53:0/3755895932 conn(0x7fd31c100110 msgr2=0x7fd31c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 shutdown_connections 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:49.990+0000 7fd3234f6700 1 -- 172.21.15.53:0/3755895932 wait complete. 2024-09-16T00:40:50.578 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling cephadm module... 2024-09-16T00:40:52.007 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:51 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3326375602' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.030+0000 7f9eef86f700 1 Processor -- start 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eef86f700 1 -- start start 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eef86f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eef86f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81053d0 con 0x7f9ee8104a80 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eed60b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eed60b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55786/0 (socket says 172.21.15.53:55786) 2024-09-16T00:40:52.344 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eed60b700 1 -- 172.21.15.53:0/1606636169 learned_addr learned my addr 172.21.15.53:0/1606636169 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eed60b700 1 -- 172.21.15.53:0/1606636169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8105510 con 0x7f9ee8104a80 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.031+0000 7f9eed60b700 1 --2- 172.21.15.53:0/1606636169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40098a0 tx=0x7f9ee4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3505637115755f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9edffff700 1 -- 172.21.15.53:0/1606636169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4004180 con 0x7f9ee8104a80 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9edffff700 1 -- 172.21.15.53:0/1606636169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9ee40042e0 con 0x7f9ee8104a80 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9edffff700 1 -- 172.21.15.53:0/1606636169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4011a50 con 0x7f9ee8104a80 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 -- 172.21.15.53:0/1606636169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 msgr2=0x7f9ee8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 --2- 172.21.15.53:0/1606636169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40098a0 tx=0x7f9ee4009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 -- 172.21.15.53:0/1606636169 shutdown_connections 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 --2- 172.21.15.53:0/1606636169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee8104e90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 -- 172.21.15.53:0/1606636169 >> 172.21.15.53:0/1606636169 conn(0x7f9ee8100110 msgr2=0x7f9ee8102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 -- 172.21.15.53:0/1606636169 shutdown_connections 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.032+0000 7f9eef86f700 1 -- 172.21.15.53:0/1606636169 wait complete. 2024-09-16T00:40:52.345 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eef86f700 1 Processor -- start 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eef86f700 1 -- start start 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eef86f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eef86f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8199e10 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eed60b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eed60b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55794/0 (socket says 172.21.15.53:55794) 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.033+0000 7f9eed60b700 1 -- 172.21.15.53:0/3326375602 learned_addr learned my addr 172.21.15.53:0/3326375602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9eed60b700 1 -- 172.21.15.53:0/3326375602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4009550 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9eed60b700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40119e0 tx=0x7f9ee4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4003b90 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9ee401a8a0 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee819a010 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4019930 con 0x7f9ee8104a80 2024-09-16T00:40:52.346 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.034+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee819a430 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.035+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f9ee401aa10 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.035+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee8062380 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.035+0000 7f9ede7fc700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 0x7f9ed403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.035+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9ee404c620 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.035+0000 7f9eece0a700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 0x7f9ed403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.036+0000 7f9eece0a700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 0x7f9ed403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.040+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9ee4019ba0 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.296+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f9ee819d5d0 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.744+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9ee402d440 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.745+0000 7f9ede7fc700 1 -- 172.21.15.53:0/3326375602 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9ee404c040 con 0x7f9ee8104a80 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 msgr2=0x7f9ed403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 0x7f9ed403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006fd0 tx=0x7f9ed8006e40 comp rx=0 tx=0).stop 2024-09-16T00:40:52.347 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 msgr2=0x7f9ee81998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40119e0 tx=0x7f9ee4011ac0 comp rx=0 tx=0).stop 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 shutdown_connections 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9ed40383b0 0x7f9ed403a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 --2- 172.21.15.53:0/3326375602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ee8104a80 0x7f9ee81998d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 >> 172.21.15.53:0/3326375602 conn(0x7f9ee8100110 msgr2=0x7f9ee8074040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 shutdown_connections 2024-09-16T00:40:52.348 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:51.747+0000 7f9eef86f700 1 -- 172.21.15.53:0/3326375602 wait complete. 2024-09-16T00:40:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:52 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3326375602' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T00:40:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:52 smithi053 ceph-mon[27950]: mgrmap e5: smithi053.cjiiek(active, since 7s) 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "smithi053.cjiiek", 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:40:53.663 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.750+0000 7f9100444700 1 Processor -- start 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.750+0000 7f9100444700 1 -- start start 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.750+0000 7f9100444700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.750+0000 7f9100444700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80744a0 con 0x7f90f8106690 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fe1e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fe1e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47190/0 (socket says 172.21.15.53:47190) 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fe1e0700 1 -- 172.21.15.53:0/679178836 learned_addr learned my addr 172.21.15.53:0/679178836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fe1e0700 1 -- 172.21.15.53:0/679178836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80745e0 con 0x7f90f8106690 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fe1e0700 1 --2- 172.21.15.53:0/679178836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098a0 tx=0x7f90f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c99502238533076 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fd1de700 1 -- 172.21.15.53:0/679178836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f4004180 con 0x7f90f8106690 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fd1de700 1 -- 172.21.15.53:0/679178836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90f40042e0 con 0x7f90f8106690 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.751+0000 7f90fd1de700 1 -- 172.21.15.53:0/679178836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f4011a50 con 0x7f90f8106690 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 -- 172.21.15.53:0/679178836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 msgr2=0x7f90f8108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:53.664 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 --2- 172.21.15.53:0/679178836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90f40098a0 tx=0x7f90f4009bb0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 -- 172.21.15.53:0/679178836 shutdown_connections 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 --2- 172.21.15.53:0/679178836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8108a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 -- 172.21.15.53:0/679178836 >> 172.21.15.53:0/679178836 conn(0x7f90f8100110 msgr2=0x7f90f8102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 -- 172.21.15.53:0/679178836 shutdown_connections 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.752+0000 7f9100444700 1 -- 172.21.15.53:0/679178836 wait complete. 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f9100444700 1 Processor -- start 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f9100444700 1 -- start start 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f9100444700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f9100444700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8199e60 con 0x7f90f8106690 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f90fe1e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f90fe1e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47192/0 (socket says 172.21.15.53:47192) 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.753+0000 7f90fe1e0700 1 -- 172.21.15.53:0/1439234318 learned_addr learned my addr 172.21.15.53:0/1439234318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:40:53.665 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f90fe1e0700 1 -- 172.21.15.53:0/1439234318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4009550 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f90fe1e0700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f4000c00 tx=0x7f90f4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f4003b90 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90f40248b0 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f819a060 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f401a8e0 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.754+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f819a480 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f90f401ab50 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f90ef7fe700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 0x7f90e403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f90f404c0b0 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f90fd9df700 1 -- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 msgr2=0x7f90e403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f90fd9df700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 0x7f90e403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.755+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8062380 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.760+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f90f40233a0 con 0x7f90f8106690 2024-09-16T00:40:53.666 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.956+0000 7f90fd9df700 1 -- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 msgr2=0x7f90e403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:52.956+0000 7f90fd9df700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 0x7f90e403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.072+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f90f819cec0 con 0x7f90f8106690 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.072+0000 7f90ef7fe700 1 -- 172.21.15.53:0/1439234318 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f90f4018b00 con 0x7f90f8106690 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.074+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 msgr2=0x7f90e403a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.074+0000 7f9100444700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 0x7f90e403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.074+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 msgr2=0x7f90f8199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.074+0000 7f9100444700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90f4000c00 tx=0x7f90f4011ab0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.074+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 shutdown_connections 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.075+0000 7f9100444700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f90e4038440 0x7f90e403a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.075+0000 7f9100444700 1 --2- 172.21.15.53:0/1439234318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f8106690 0x7f90f8199920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.075+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 >> 172.21.15.53:0/1439234318 conn(0x7f90f8100110 msgr2=0x7f90f81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.075+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 shutdown_connections 2024-09-16T00:40:53.667 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:53.075+0000 7f9100444700 1 -- 172.21.15.53:0/1439234318 wait complete. 2024-09-16T00:40:53.668 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-09-16T00:40:53.668 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 5... 2024-09-16T00:40:54.020 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:53 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1439234318' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:40:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: Active manager daemon smithi053.cjiiek restarted 2024-09-16T00:40:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:40:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T00:40:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: mgrmap e6: smithi053.cjiiek(active, starting, since 0.00309602s) 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:40:59.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:58 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:41:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:59 smithi053 ceph-mon[27950]: Found migration_current of "None". Setting to last migration. 2024-09-16T00:41:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:59 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:59 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:40:59 smithi053 ceph-mon[27950]: mgrmap e7: smithi053.cjiiek(active, since 1.00577s) 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.124+0000 7fc6e65ce700 1 Processor -- start 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.124+0000 7fc6e65ce700 1 -- start start 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.124+0000 7fc6e65ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.124+0000 7fc6e65ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0106590 con 0x7fc6e0105c40 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:00.426 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47200/0 (socket says 172.21.15.53:47200) 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6dffff700 1 -- 172.21.15.53:0/3138147467 learned_addr learned my addr 172.21.15.53:0/3138147467 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6dffff700 1 -- 172.21.15.53:0/3138147467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e01066d0 con 0x7fc6e0105c40 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6dffff700 1 --2- 172.21.15.53:0/3138147467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80098a0 tx=0x7fc6c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb201b14652714be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6deffd700 1 -- 172.21.15.53:0/3138147467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c8004180 con 0x7fc6e0105c40 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6deffd700 1 -- 172.21.15.53:0/3138147467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc6c80042e0 con 0x7fc6e0105c40 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.125+0000 7fc6deffd700 1 -- 172.21.15.53:0/3138147467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c8011a50 con 0x7fc6e0105c40 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3138147467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 msgr2=0x7fc6e0106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3138147467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80098a0 tx=0x7fc6c8009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3138147467 shutdown_connections 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3138147467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e0106050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3138147467 >> 172.21.15.53:0/3138147467 conn(0x7fc6e01012b0 msgr2=0x7fc6e01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3138147467 shutdown_connections 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.126+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3138147467 wait complete. 2024-09-16T00:41:00.427 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6e65ce700 1 Processor -- start 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6e65ce700 1 -- start start 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6e65ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6e65ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e007c1b0 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47216/0 (socket says 172.21.15.53:47216) 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6dffff700 1 -- 172.21.15.53:0/3358626998 learned_addr learned my addr 172.21.15.53:0/3358626998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.127+0000 7fc6dffff700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009550 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6dffff700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8003f80 tx=0x7fc6c8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c8003a80 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc6c8003be0 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e007a2c0 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c8019820 con 0x7fc6e0105c40 2024-09-16T00:41:00.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.128+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e007a6e0 con 0x7fc6e0105c40 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc6c8019a50 con 0x7fc6e0105c40 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6dd7fa700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6cc03afb0 con 0x7fc6cc0383f0 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc6c804c590 con 0x7fc6e0105c40 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6df7fe700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.129+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.330+0000 7fc6df7fe700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.330+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.731+0000 7fc6df7fe700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:54.731+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:55.532+0000 7fc6df7fe700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:00.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:55.532+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:57.133+0000 7fc6df7fe700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:57.133+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:58.742+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fc6c8019d50 con 0x7fc6e0105c40 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:58.742+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:58.742+0000 7fc6dd7fa700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.743+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fc6c80172b0 con 0x7fc6e0105c40 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.744+0000 7fc6dd7fa700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.744+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6cc03afb0 con 0x7fc6cc0383f0 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.744+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.745+0000 7fc6df7fe700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0003a10 tx=0x7fc6d00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.746+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fc6cc03afb0 con 0x7fc6cc0383f0 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.752+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc6e007b810 con 0x7fc6cc0383f0 2024-09-16T00:41:00.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6dd7fa700 1 -- 172.21.15.53:0/3358626998 <== mgr.14120 v2:172.21.15.53:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc6e007b810 con 0x7fc6cc0383f0 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 msgr2=0x7fc6cc03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0003a10 tx=0x7fc6d00092b0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 msgr2=0x7fc6e007bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8003f80 tx=0x7fc6c8011ab0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 shutdown_connections 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6cc0383f0 0x7fc6cc03a8a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 --2- 172.21.15.53:0/3358626998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e0105c40 0x7fc6e007bc70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 >> 172.21.15.53:0/3358626998 conn(0x7fc6e01012b0 msgr2=0x7fc6e01029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 shutdown_connections 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:40:59.753+0000 7fc6e65ce700 1 -- 172.21.15.53:0/3358626998 wait complete. 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 5 is available 2024-09-16T00:41:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:Setting orchestrator backend to cephadm... 2024-09-16T00:41:01.064 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:00 smithi053 ceph-mon[27950]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T00:41:01.065 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:00 smithi053 ceph-mon[27950]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T00:41:01.065 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:00 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:41:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.835+0000 7f4499a9e700 1 Processor -- start 2024-09-16T00:41:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.835+0000 7f4499a9e700 1 -- start start 2024-09-16T00:41:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.835+0000 7f4499a9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.835+0000 7f4499a9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494079d40 con 0x7f4494104540 2024-09-16T00:41:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47292/0 (socket says 172.21.15.53:47292) 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44937fe700 1 -- 172.21.15.53:0/3636707532 learned_addr learned my addr 172.21.15.53:0/3636707532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44937fe700 1 -- 172.21.15.53:0/3636707532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494079e80 con 0x7f4494104540 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44937fe700 1 --2- 172.21.15.53:0/3636707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4484009e80 tx=0x7f448400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dfb1567869f078 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44927fc700 1 -- 172.21.15.53:0/3636707532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448400e070 con 0x7f4494104540 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44927fc700 1 -- 172.21.15.53:0/3636707532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4484003e90 con 0x7f4494104540 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.836+0000 7f44927fc700 1 -- 172.21.15.53:0/3636707532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4484004380 con 0x7f4494104540 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 -- 172.21.15.53:0/3636707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 msgr2=0x7f4494104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 --2- 172.21.15.53:0/3636707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4484009e80 tx=0x7f448400b330 comp rx=0 tx=0).stop 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 -- 172.21.15.53:0/3636707532 shutdown_connections 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 --2- 172.21.15.53:0/3636707532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f4494104950 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:01.648 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 -- 172.21.15.53:0/3636707532 >> 172.21.15.53:0/3636707532 conn(0x7f4494100130 msgr2=0x7f4494102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 -- 172.21.15.53:0/3636707532 shutdown_connections 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.837+0000 7f4499a9e700 1 -- 172.21.15.53:0/3636707532 wait complete. 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f4499a9e700 1 Processor -- start 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f4499a9e700 1 -- start start 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f4499a9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f4499a9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449419c040 con 0x7f4494104540 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f44937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f44937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47302/0 (socket says 172.21.15.53:47302) 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f44937fe700 1 -- 172.21.15.53:0/2435902665 learned_addr learned my addr 172.21.15.53:0/2435902665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f44937fe700 1 -- 172.21.15.53:0/2435902665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009b30 con 0x7f4494104540 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.838+0000 7f44937fe700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4484009530 tx=0x7f4484004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.839+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448400e040 con 0x7f4494104540 2024-09-16T00:41:01.649 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.839+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4484003c30 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.839+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449419c240 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.839+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448401b740 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.839+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449419c6c0 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f4484019040 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4490ff9700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 0x7f448003a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940623f0 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f448404baa0 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4492ffd700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 0x7f448003a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.840+0000 7f4492ffd700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 0x7f448003a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f447c006fd0 tx=0x7f447c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:00.845+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f44940623f0 con 0x7f4494104540 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.061+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f4494062380 con 0x7f4480038320 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.066+0000 7f4490ff9700 1 -- 172.21.15.53:0/2435902665 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4494062380 con 0x7f4480038320 2024-09-16T00:41:01.650 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.068+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 msgr2=0x7f448003a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.068+0000 7f4499a9e700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 0x7f448003a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f447c006fd0 tx=0x7f447c006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.068+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 msgr2=0x7f449419bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.068+0000 7f4499a9e700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4484009530 tx=0x7f4484004920 comp rx=0 tx=0).stop 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 shutdown_connections 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4480038320 0x7f448003a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 --2- 172.21.15.53:0/2435902665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494104540 0x7f449419bb00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 >> 172.21.15.53:0/2435902665 conn(0x7f4494100130 msgr2=0x7f4494190100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 shutdown_connections 2024-09-16T00:41:01.651 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:01.069+0000 7f4499a9e700 1 -- 172.21.15.53:0/2435902665 wait complete. 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: [16/Sep/2024:00:40:59] ENGINE Bus STARTING 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: [16/Sep/2024:00:40:59] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:00] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:00] ENGINE Bus STARTED 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:41:01.893 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:01 smithi053 ceph-mon[27950]: mgrmap e8: smithi053.cjiiek(active, since 3s) 2024-09-16T00:41:02.880 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:02 smithi053 ceph-mon[27950]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:02.887 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T00:41:02.887 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.098+0000 7f6c4c18d700 1 Processor -- start 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.098+0000 7f6c4c18d700 1 -- start start 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c4c18d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c4c18d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441053d0 con 0x7f6c44104a80 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c49f29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c49f29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47314/0 (socket says 172.21.15.53:47314) 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c49f29700 1 -- 172.21.15.53:0/801806870 learned_addr learned my addr 172.21.15.53:0/801806870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c49f29700 1 -- 172.21.15.53:0/801806870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44105510 con 0x7f6c44104a80 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.099+0000 7f6c49f29700 1 --2- 172.21.15.53:0/801806870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098a0 tx=0x7f6c40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2460d2580fa4153 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c48f27700 1 -- 172.21.15.53:0/801806870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c40004180 con 0x7f6c44104a80 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c48f27700 1 -- 172.21.15.53:0/801806870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6c400042e0 con 0x7f6c44104a80 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c48f27700 1 -- 172.21.15.53:0/801806870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c40011a50 con 0x7f6c44104a80 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 -- 172.21.15.53:0/801806870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 msgr2=0x7f6c44104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:02.888 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/801806870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c400098a0 tx=0x7f6c40009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 -- 172.21.15.53:0/801806870 shutdown_connections 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/801806870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c44104e90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 -- 172.21.15.53:0/801806870 >> 172.21.15.53:0/801806870 conn(0x7f6c44100110 msgr2=0x7f6c44102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 -- 172.21.15.53:0/801806870 shutdown_connections 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.100+0000 7f6c4c18d700 1 -- 172.21.15.53:0/801806870 wait complete. 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c4c18d700 1 Processor -- start 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c4c18d700 1 -- start start 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c4c18d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c4c18d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44190160 con 0x7f6c44104a80 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c49f29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c49f29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47328/0 (socket says 172.21.15.53:47328) 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.101+0000 7f6c49f29700 1 -- 172.21.15.53:0/3315914945 learned_addr learned my addr 172.21.15.53:0/3315914945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c49f29700 1 -- 172.21.15.53:0/3315914945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009550 con 0x7f6c44104a80 2024-09-16T00:41:02.889 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c49f29700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000c00 tx=0x7f6c40011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c40003b90 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6c400248b0 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4418e270 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4001a8e0 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.102+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4418e690 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.103+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44062380 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.103+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6c40024a20 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.103+0000 7f6c3affd700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 0x7f6c3003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.103+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6c4004c580 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.104+0000 7f6c49728700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 0x7f6c3003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.104+0000 7f6c49728700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 0x7f6c3003a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006fd0 tx=0x7f6c34006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.108+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6c40018db0 con 0x7f6c44104a80 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.310+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c441022a0 con 0x7f6c300383f0 2024-09-16T00:41:02.890 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.311+0000 7f6c3affd700 1 -- 172.21.15.53:0/3315914945 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f6c441022a0 con 0x7f6c300383f0 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 msgr2=0x7f6c3003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 0x7f6c3003a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c34006fd0 tx=0x7f6c34006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 msgr2=0x7f6c4418fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000c00 tx=0x7f6c40011ab0 comp rx=0 tx=0).stop 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 shutdown_connections 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6c300383f0 0x7f6c3003a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 --2- 172.21.15.53:0/3315914945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c44104a80 0x7f6c4418fc20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 >> 172.21.15.53:0/3315914945 conn(0x7f6c44100110 msgr2=0x7f6c44074020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 shutdown_connections 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:02.313+0000 7f6c4c18d700 1 -- 172.21.15.53:0/3315914945 wait complete. 2024-09-16T00:41:02.891 INFO:teuthology.orchestra.run.smithi053.stdout:Generating ssh key... 2024-09-16T00:41:03.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:03 smithi053 ceph-mon[27950]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:04.518 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaad1bf700 1 Processor -- start 2024-09-16T00:41:04.518 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaad1bf700 1 -- start start 2024-09-16T00:41:04.518 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaad1bf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaad1bf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81064c0 con 0x7fcaa8105b70 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39604/0 (socket says 172.21.15.53:39604) 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaa6d9d700 1 -- 172.21.15.53:0/3304646284 learned_addr learned my addr 172.21.15.53:0/3304646284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaa6d9d700 1 -- 172.21.15.53:0/3304646284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8106600 con 0x7fcaa8105b70 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.339+0000 7fcaa6d9d700 1 --2- 172.21.15.53:0/3304646284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca980098a0 tx=0x7fca98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6276e4914d8a842 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaa659c700 1 -- 172.21.15.53:0/3304646284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca98004180 con 0x7fcaa8105b70 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaa659c700 1 -- 172.21.15.53:0/3304646284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca980042e0 con 0x7fcaa8105b70 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaa659c700 1 -- 172.21.15.53:0/3304646284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca98011a50 con 0x7fcaa8105b70 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 -- 172.21.15.53:0/3304646284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 msgr2=0x7fcaa8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/3304646284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca980098a0 tx=0x7fca98009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 -- 172.21.15.53:0/3304646284 shutdown_connections 2024-09-16T00:41:04.519 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/3304646284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa8105f80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 -- 172.21.15.53:0/3304646284 >> 172.21.15.53:0/3304646284 conn(0x7fcaa8101220 msgr2=0x7fcaa8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 -- 172.21.15.53:0/3304646284 shutdown_connections 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.340+0000 7fcaad1bf700 1 -- 172.21.15.53:0/3304646284 wait complete. 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.341+0000 7fcaad1bf700 1 Processor -- start 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.341+0000 7fcaad1bf700 1 -- start start 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaad1bf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaad1bf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8199df0 con 0x7fcaa8105b70 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39612/0 (socket says 172.21.15.53:39612) 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa6d9d700 1 -- 172.21.15.53:0/1778888367 learned_addr learned my addr 172.21.15.53:0/1778888367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa6d9d700 1 -- 172.21.15.53:0/1778888367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009550 con 0x7fcaa8105b70 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa6d9d700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca980119e0 tx=0x7fca98011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:04.520 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca98003b90 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa8199ff0 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca9801a8a0 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca98019930 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.342+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa819a410 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.343+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fca98019bf0 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.343+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8062380 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.343+0000 7fcaa4d99700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 0x7fca9403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.344+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fca9804c930 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.344+0000 7fca9ffff700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 0x7fca9403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.344+0000 7fca9ffff700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 0x7fca9403a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.348+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fca9802d440 con 0x7fcaa8105b70 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.552+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaa819d270 con 0x7fca940383b0 2024-09-16T00:41:04.521 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.955+0000 7fcaa4d99700 1 -- 172.21.15.53:0/1778888367 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcaa819d270 con 0x7fca940383b0 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 msgr2=0x7fca9403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 0x7fca9403a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca90006fd0 tx=0x7fca90006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 msgr2=0x7fcaa81998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca980119e0 tx=0x7fca98011ac0 comp rx=0 tx=0).stop 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 shutdown_connections 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fca940383b0 0x7fca9403a860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 --2- 172.21.15.53:0/1778888367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcaa8105b70 0x7fcaa81998b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 >> 172.21.15.53:0/1778888367 conn(0x7fcaa8101220 msgr2=0x7fcaa8101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 shutdown_connections 2024-09-16T00:41:04.522 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:03.957+0000 7fcaad1bf700 1 -- 172.21.15.53:0/1778888367 wait complete. 2024-09-16T00:41:05.064 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:04 smithi053 ceph-mon[27950]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:05.064 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:04 smithi053 ceph-mon[27950]: Generating ssh key... 2024-09-16T00:41:05.064 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:04 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:05.064 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:04 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTpiJgjMKSvbASZqQNJ+d8sw1Uumz++dZbklMh5dwtRSSa1p2cUY4zIyzv5hxG5AyWbiCrrs+xgvr6IwFU3L9XUVnC9g7tB1ue4Eof54i+P+cwAq1Ocj5Xrez2p29pWrqZA6OmPb2m4Q1ISWhD0qsgQ5Wb28Haxr+2Kcz4fo8UCHPeO0HbSDvF1Bqu4pM6qcaHaE20kvel793xW4PJWsKtsIL/NTcGFUtSdHVZnLQIZcyKN+zRa2u3o6FwuG2MP+Z72PWGLjE9WeCRFt06cWjAk4yxMNssLh3SY+6Go4xJUeuRzVeRB25Hkn3IiiV4gQWf1V83AwMRYhSYq41UBVu5QlXys1SWyd9hqqj8wOjA5EAnsIfEJTwiJRT7Ufgj7I8nwaKjDZTTJdAA/Vic+Nh4mQe9apNiXz4yZFRlFOnW7/aw67PJhrKWK7IzMtkDDDSkP4o/cUu84jTKNn5Z76nTGt5zxNHsQHKqFmFz8S+Bq0VYp6RUVzgDMr64h9/9h/k= ceph-31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.093+0000 7efc97ffe700 1 Processor -- start 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc97ffe700 1 -- start start 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc97ffe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc97ffe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90079d40 con 0x7efc901066f0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc95d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc95d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39618/0 (socket says 172.21.15.53:39618) 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc95d9a700 1 -- 172.21.15.53:0/174616150 learned_addr learned my addr 172.21.15.53:0/174616150 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc95d9a700 1 -- 172.21.15.53:0/174616150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90079e80 con 0x7efc901066f0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.094+0000 7efc95d9a700 1 --2- 172.21.15.53:0/174616150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098a0 tx=0x7efc8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d5149a7b256651 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc94d98700 1 -- 172.21.15.53:0/174616150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8c004180 con 0x7efc901066f0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc94d98700 1 -- 172.21.15.53:0/174616150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc8c0042e0 con 0x7efc901066f0 2024-09-16T00:41:05.977 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc94d98700 1 -- 172.21.15.53:0/174616150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8c011a50 con 0x7efc901066f0 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 -- 172.21.15.53:0/174616150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 msgr2=0x7efc90108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 --2- 172.21.15.53:0/174616150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098a0 tx=0x7efc8c009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 -- 172.21.15.53:0/174616150 shutdown_connections 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 --2- 172.21.15.53:0/174616150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc90108ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 -- 172.21.15.53:0/174616150 >> 172.21.15.53:0/174616150 conn(0x7efc901000f0 msgr2=0x7efc90102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 -- 172.21.15.53:0/174616150 shutdown_connections 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.095+0000 7efc97ffe700 1 -- 172.21.15.53:0/174616150 wait complete. 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc97ffe700 1 Processor -- start 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc97ffe700 1 -- start start 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc97ffe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc97ffe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90199e20 con 0x7efc901066f0 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc95d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc95d9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39634/0 (socket says 172.21.15.53:39634) 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.096+0000 7efc95d9a700 1 -- 172.21.15.53:0/3276203057 learned_addr learned my addr 172.21.15.53:0/3276203057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:05.978 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc95d9a700 1 -- 172.21.15.53:0/3276203057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009550 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc95d9a700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc8c006af0 tx=0x7efc8c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8c003b90 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc8c01a8a0 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8c019880 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9019a020 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.097+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9019a440 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.098+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7efc8c019af0 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.098+0000 7efc86ffd700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 0x7efc7c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.098+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efc8c04c890 con 0x7efc901066f0 2024-09-16T00:41:05.979 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.098+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc90062380 con 0x7efc901066f0 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.098+0000 7efc95599700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 0x7efc7c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.099+0000 7efc95599700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 0x7efc7c03a8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc80006fd0 tx=0x7efc80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.103+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efc8c02c3a0 con 0x7efc901066f0 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.306+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7efc901023b0 con 0x7efc7c038400 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.307+0000 7efc86ffd700 1 -- 172.21.15.53:0/3276203057 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7efc901023b0 con 0x7efc7c038400 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 msgr2=0x7efc7c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 0x7efc7c03a8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc80006fd0 tx=0x7efc80006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 msgr2=0x7efc901998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc8c006af0 tx=0x7efc8c011a90 comp rx=0 tx=0).stop 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 shutdown_connections 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efc7c038400 0x7efc7c03a8b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 --2- 172.21.15.53:0/3276203057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901066f0 0x7efc901998e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 >> 172.21.15.53:0/3276203057 conn(0x7efc901000f0 msgr2=0x7efc90101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:05.980 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 shutdown_connections 2024-09-16T00:41:05.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:05.309+0000 7efc97ffe700 1 -- 172.21.15.53:0/3276203057 wait complete. 2024-09-16T00:41:05.981 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T00:41:05.981 INFO:teuthology.orchestra.run.smithi053.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T00:41:05.984 INFO:teuthology.orchestra.run.smithi053.stdout:Adding host smithi053... 2024-09-16T00:41:06.961 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:06 smithi053 ceph-mon[27950]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:07.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:07 smithi053 ceph-mon[27950]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi053", "addr": "172.21.15.53", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:09.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:08 smithi053 ceph-mon[27950]: Deploying cephadm binary to smithi053 2024-09-16T00:41:09.543 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Added host 'smithi053' with addr '172.21.15.53' 2024-09-16T00:41:09.543 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d2f2a700 1 Processor -- start 2024-09-16T00:41:09.543 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d2f2a700 1 -- start start 2024-09-16T00:41:09.543 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d2f2a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:09.543 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d2f2a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1064f0 con 0x7fe9cc105ba0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d0cc6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d0cc6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39644/0 (socket says 172.21.15.53:39644) 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.409+0000 7fe9d0cc6700 1 -- 172.21.15.53:0/1609299619 learned_addr learned my addr 172.21.15.53:0/1609299619 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.410+0000 7fe9d0cc6700 1 -- 172.21.15.53:0/1609299619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc106630 con 0x7fe9cc105ba0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.410+0000 7fe9d0cc6700 1 --2- 172.21.15.53:0/1609299619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0098a0 tx=0x7fe9bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbacfce3656ce5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.410+0000 7fe9cb7fe700 1 -- 172.21.15.53:0/1609299619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9bc004180 con 0x7fe9cc105ba0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.410+0000 7fe9cb7fe700 1 -- 172.21.15.53:0/1609299619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe9bc0042e0 con 0x7fe9cc105ba0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.410+0000 7fe9cb7fe700 1 -- 172.21.15.53:0/1609299619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9bc011a50 con 0x7fe9cc105ba0 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1609299619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 msgr2=0x7fe9cc105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1609299619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0098a0 tx=0x7fe9bc009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1609299619 shutdown_connections 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1609299619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc105fb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:09.544 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1609299619 >> 172.21.15.53:0/1609299619 conn(0x7fe9cc101210 msgr2=0x7fe9cc103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1609299619 shutdown_connections 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1609299619 wait complete. 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.411+0000 7fe9d2f2a700 1 Processor -- start 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d2f2a700 1 -- start start 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d2f2a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d2f2a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc199e50 con 0x7fe9cc105ba0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d0cc6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d0cc6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39648/0 (socket says 172.21.15.53:39648) 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d0cc6700 1 -- 172.21.15.53:0/1265313010 learned_addr learned my addr 172.21.15.53:0/1265313010 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d0cc6700 1 -- 172.21.15.53:0/1265313010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc009550 con 0x7fe9cc105ba0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d0cc6700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc003de0 tx=0x7fe9bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9bc003930 con 0x7fe9cc105ba0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe9bc003a90 con 0x7fe9cc105ba0 2024-09-16T00:41:09.545 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.412+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc19a050 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.413+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9bc019730 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.413+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc19a470 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.414+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe9bc01a430 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.414+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc062380 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.414+0000 7fe9c9ffb700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 0x7fe9b403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.414+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe9bc04c420 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.414+0000 7fe9cbfff700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 0x7fe9b403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.415+0000 7fe9cbfff700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 0x7fe9b403a8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0006fd0 tx=0x7fe9c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.419+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe9bc010560 con 0x7fe9cc105ba0 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:06.623+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi053", "addr": "172.21.15.53", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9cc1034c0 con 0x7fe9b4038440 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.015+0000 7fe9c9ffb700 1 -- 172.21.15.53:0/1265313010 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fe9cc1034c0 con 0x7fe9b4038440 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 msgr2=0x7fe9b403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 0x7fe9b403a8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0006fd0 tx=0x7fe9c0006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:09.546 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 msgr2=0x7fe9cc199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc003de0 tx=0x7fe9bc011ab0 comp rx=0 tx=0).stop 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 shutdown_connections 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe9b4038440 0x7fe9b403a8f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 --2- 172.21.15.53:0/1265313010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc105ba0 0x7fe9cc199910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 >> 172.21.15.53:0/1265313010 conn(0x7fe9cc101210 msgr2=0x7fe9cc102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 shutdown_connections 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.018+0000 7fe9d2f2a700 1 -- 172.21.15.53:0/1265313010 wait complete. 2024-09-16T00:41:09.547 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying mon service with default placement... 2024-09-16T00:41:10.231 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:10 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:10.231 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:10 smithi053 ceph-mon[27950]: Added host smithi053 2024-09-16T00:41:10.231 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:10 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:41:11.438 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T00:41:11.438 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.992+0000 7f92f270e700 1 Processor -- start 2024-09-16T00:41:11.438 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.992+0000 7f92f270e700 1 -- start start 2024-09-16T00:41:11.438 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.992+0000 7f92f270e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:11.438 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.992+0000 7f92f270e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1053d0 con 0x7f92ec104a80 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39654/0 (socket says 172.21.15.53:39654) 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92ebfff700 1 -- 172.21.15.53:0/611499227 learned_addr learned my addr 172.21.15.53:0/611499227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92ebfff700 1 -- 172.21.15.53:0/611499227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec105510 con 0x7f92ec104a80 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92ebfff700 1 --2- 172.21.15.53:0/611499227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098a0 tx=0x7f92dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f0aaedd50cae1f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92eb7fe700 1 -- 172.21.15.53:0/611499227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92dc004180 con 0x7f92ec104a80 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92eb7fe700 1 -- 172.21.15.53:0/611499227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f92dc0042e0 con 0x7f92ec104a80 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.993+0000 7f92eb7fe700 1 -- 172.21.15.53:0/611499227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92dc011a50 con 0x7f92ec104a80 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 -- 172.21.15.53:0/611499227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 msgr2=0x7f92ec104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 --2- 172.21.15.53:0/611499227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098a0 tx=0x7f92dc009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 -- 172.21.15.53:0/611499227 shutdown_connections 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 --2- 172.21.15.53:0/611499227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec104e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:11.439 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 -- 172.21.15.53:0/611499227 >> 172.21.15.53:0/611499227 conn(0x7f92ec1000f0 msgr2=0x7f92ec102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 -- 172.21.15.53:0/611499227 shutdown_connections 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.994+0000 7f92f270e700 1 -- 172.21.15.53:0/611499227 wait complete. 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92f270e700 1 Processor -- start 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92f270e700 1 -- start start 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92f270e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92f270e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec199e10 con 0x7f92ec104a80 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39660/0 (socket says 172.21.15.53:39660) 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92ebfff700 1 -- 172.21.15.53:0/1468327868 learned_addr learned my addr 172.21.15.53:0/1468327868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92ebfff700 1 -- 172.21.15.53:0/1468327868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc009550 con 0x7f92ec104a80 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92ebfff700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0119e0 tx=0x7f92dc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.995+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92dc003b90 con 0x7f92ec104a80 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec19a010 con 0x7f92ec104a80 2024-09-16T00:41:11.440 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f92dc01a8a0 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92dc019930 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec19a430 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f92dc019ba0 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.996+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec108f10 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.997+0000 7f92e9ffb700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 0x7f92d803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.997+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f92dc04c6d0 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.997+0000 7f92e3fff700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 0x7f92d803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:09.997+0000 7f92e3fff700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 0x7f92d803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006fd0 tx=0x7f92d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.001+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f92dc01a430 con 0x7f92ec104a80 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.230+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f92ec102290 con 0x7f92d8038400 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.235+0000 7f92e9ffb700 1 -- 172.21.15.53:0/1468327868 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f92ec102290 con 0x7f92d8038400 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 msgr2=0x7f92d803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 0x7f92d803a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006fd0 tx=0x7f92d4006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:11.441 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 msgr2=0x7f92ec1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0119e0 tx=0x7f92dc011ac0 comp rx=0 tx=0).stop 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 shutdown_connections 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92d8038400 0x7f92d803a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 --2- 172.21.15.53:0/1468327868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92ec104a80 0x7f92ec1998d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.237+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 >> 172.21.15.53:0/1468327868 conn(0x7f92ec1000f0 msgr2=0x7f92ec079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.238+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 shutdown_connections 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:10.238+0000 7f92f270e700 1 -- 172.21.15.53:0/1468327868 wait complete. 2024-09-16T00:41:11.442 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying mgr service with default placement... 2024-09-16T00:41:11.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:11 smithi053 ceph-mon[27950]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:11.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:11 smithi053 ceph-mon[27950]: Saving service mon spec with placement count:5 2024-09-16T00:41:11.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:11 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:12 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:12 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:12 smithi053 ceph-mon[27950]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:12 smithi053 ceph-mon[27950]: Saving service mgr spec with placement count:2 2024-09-16T00:41:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:12 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e72e78700 1 Processor -- start 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e72e78700 1 -- start start 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e72e78700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e72e78700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c074440 con 0x7f8e6c1044e0 2024-09-16T00:41:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e70c14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e70c14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39668/0 (socket says 172.21.15.53:39668) 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.309+0000 7f8e70c14700 1 -- 172.21.15.53:0/2531640124 learned_addr learned my addr 172.21.15.53:0/2531640124 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.310+0000 7f8e70c14700 1 -- 172.21.15.53:0/2531640124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c074580 con 0x7f8e6c1044e0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.310+0000 7f8e70c14700 1 --2- 172.21.15.53:0/2531640124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098a0 tx=0x7f8e60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724891eeaba8f7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.310+0000 7f8e6b7fe700 1 -- 172.21.15.53:0/2531640124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e60004180 con 0x7f8e6c1044e0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.310+0000 7f8e6b7fe700 1 -- 172.21.15.53:0/2531640124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e600042e0 con 0x7f8e6c1044e0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.310+0000 7f8e6b7fe700 1 -- 172.21.15.53:0/2531640124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e60011af0 con 0x7f8e6c1044e0 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 -- 172.21.15.53:0/2531640124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 msgr2=0x7f8e6c1048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 --2- 172.21.15.53:0/2531640124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8e600098a0 tx=0x7f8e60009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 -- 172.21.15.53:0/2531640124 shutdown_connections 2024-09-16T00:41:13.089 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 --2- 172.21.15.53:0/2531640124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c1048f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 -- 172.21.15.53:0/2531640124 >> 172.21.15.53:0/2531640124 conn(0x7f8e6c100110 msgr2=0x7f8e6c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 -- 172.21.15.53:0/2531640124 shutdown_connections 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.311+0000 7f8e72e78700 1 -- 172.21.15.53:0/2531640124 wait complete. 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e72e78700 1 Processor -- start 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e72e78700 1 -- start start 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e72e78700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e72e78700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19c090 con 0x7f8e6c1044e0 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e70c14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e70c14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39672/0 (socket says 172.21.15.53:39672) 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e70c14700 1 -- 172.21.15.53:0/665887235 learned_addr learned my addr 172.21.15.53:0/665887235 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.312+0000 7f8e70c14700 1 -- 172.21.15.53:0/665887235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009550 con 0x7f8e6c1044e0 2024-09-16T00:41:13.090 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e70c14700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006ba0 tx=0x7f8e60011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e60003b00 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e6001a8e0 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c19c290 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e60019990 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.313+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c19c5f0 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.314+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8e60019c00 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.314+0000 7f8e69ffb700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 0x7f8e5c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.314+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e6004c670 con 0x7f8e6c1044e0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.314+0000 7f8e6bfff700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 0x7f8e5c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:13.091 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.315+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c195390 con 0x7f8e6c1044e0 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.315+0000 7f8e6bfff700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 0x7f8e5c03a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006fd0 tx=0x7f8e58006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.320+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e60047080 con 0x7f8e6c1044e0 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.535+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e6c061190 con 0x7f8e5c0383f0 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.540+0000 7f8e69ffb700 1 -- 172.21.15.53:0/665887235 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8e6c061190 con 0x7f8e5c0383f0 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 msgr2=0x7f8e5c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 0x7f8e5c03a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006fd0 tx=0x7f8e58006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 msgr2=0x7f8e6c19bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:13.092 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006ba0 tx=0x7f8e60011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 shutdown_connections 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f8e5c0383f0 0x7f8e5c03a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 --2- 172.21.15.53:0/665887235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e6c1044e0 0x7f8e6c19bb50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 >> 172.21.15.53:0/665887235 conn(0x7f8e6c100110 msgr2=0x7f8e6c1900a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 shutdown_connections 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:12.542+0000 7f8e72e78700 1 -- 172.21.15.53:0/665887235 wait complete. 2024-09-16T00:41:13.093 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying crash service with default placement... 2024-09-16T00:41:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-16T00:41:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f589ddf5700 1 Processor -- start 2024-09-16T00:41:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f589ddf5700 1 -- start start 2024-09-16T00:41:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f589ddf5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:14.497 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f589ddf5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981053d0 con 0x7f5898104a80 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f58977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f58977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34170/0 (socket says 172.21.15.53:34170) 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f58977fe700 1 -- 172.21.15.53:0/3303350871 learned_addr learned my addr 172.21.15.53:0/3303350871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.518+0000 7f58977fe700 1 -- 172.21.15.53:0/3303350871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898105510 con 0x7f5898104a80 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f58977fe700 1 --2- 172.21.15.53:0/3303350871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f58880098a0 tx=0x7f5888009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823a83a5964a0f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f58967fc700 1 -- 172.21.15.53:0/3303350871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5888004180 con 0x7f5898104a80 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f58967fc700 1 -- 172.21.15.53:0/3303350871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58880042e0 con 0x7f5898104a80 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f58967fc700 1 -- 172.21.15.53:0/3303350871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5888011af0 con 0x7f5898104a80 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f589ddf5700 1 -- 172.21.15.53:0/3303350871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 msgr2=0x7f5898104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.519+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3303350871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f58880098a0 tx=0x7f5888009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:14.498 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 -- 172.21.15.53:0/3303350871 shutdown_connections 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3303350871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898104e90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 -- 172.21.15.53:0/3303350871 >> 172.21.15.53:0/3303350871 conn(0x7f58981000f0 msgr2=0x7f5898102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 -- 172.21.15.53:0/3303350871 shutdown_connections 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 -- 172.21.15.53:0/3303350871 wait complete. 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 Processor -- start 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.520+0000 7f589ddf5700 1 -- start start 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f589ddf5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:14.499 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f589ddf5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898199e50 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f58977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f58977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34184/0 (socket says 172.21.15.53:34184) 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f58977fe700 1 -- 172.21.15.53:0/3767211219 learned_addr learned my addr 172.21.15.53:0/3767211219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f58977fe700 1 -- 172.21.15.53:0/3767211219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888009550 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f58977fe700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5888006ba0 tx=0x7f5888011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5888003b00 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589819a050 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f588801a8e0 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58880199c0 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.521+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589819a470 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.522+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5888019c80 con 0x7f5898104a80 2024-09-16T00:41:14.500 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.522+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898062380 con 0x7f5898104a80 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.523+0000 7f5894ff9700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 0x7f588003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.523+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f588804c5c0 con 0x7f5898104a80 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.523+0000 7f5896ffd700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 0x7f588003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.523+0000 7f5896ffd700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 0x7f588003a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.527+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5888018530 con 0x7f5898104a80 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.759+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f589819d2d0 con 0x7f58800383a0 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.763+0000 7f5894ff9700 1 -- 172.21.15.53:0/3767211219 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f589819d2d0 con 0x7f58800383a0 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 msgr2=0x7f588003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 0x7f588003a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f588c006fd0 tx=0x7f588c006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 msgr2=0x7f5898199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:14.501 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5888006ba0 tx=0x7f5888011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 shutdown_connections 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f58800383a0 0x7f588003a850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 --2- 172.21.15.53:0/3767211219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5898104a80 0x7f5898199910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.765+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 >> 172.21.15.53:0/3767211219 conn(0x7f58981000f0 msgr2=0x7f5898079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.766+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 shutdown_connections 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:13.766+0000 7f589ddf5700 1 -- 172.21.15.53:0/3767211219 wait complete. 2024-09-16T00:41:14.502 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying ceph-exporter service with default placement... 2024-09-16T00:41:15.068 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:14 smithi053 ceph-mon[27950]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:15.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:14 smithi053 ceph-mon[27950]: Saving service crash spec with placement * 2024-09-16T00:41:15.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:14 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.941+0000 7fab9481c700 1 Processor -- start 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.941+0000 7fab9481c700 1 -- start start 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab9481c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab9481c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90106520 con 0x7fab90105bd0 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34196/0 (socket says 172.21.15.53:34196) 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8e59c700 1 -- 172.21.15.53:0/884355947 learned_addr learned my addr 172.21.15.53:0/884355947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8e59c700 1 -- 172.21.15.53:0/884355947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90106660 con 0x7fab90105bd0 2024-09-16T00:41:16.029 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8e59c700 1 --2- 172.21.15.53:0/884355947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab800098a0 tx=0x7fab80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81244bd4674db74a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.942+0000 7fab8d59a700 1 -- 172.21.15.53:0/884355947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab80004180 con 0x7fab90105bd0 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab8d59a700 1 -- 172.21.15.53:0/884355947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab800042e0 con 0x7fab90105bd0 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab8d59a700 1 -- 172.21.15.53:0/884355947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab80011af0 con 0x7fab90105bd0 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 -- 172.21.15.53:0/884355947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 msgr2=0x7fab90105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 --2- 172.21.15.53:0/884355947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab800098a0 tx=0x7fab80009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 -- 172.21.15.53:0/884355947 shutdown_connections 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 --2- 172.21.15.53:0/884355947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90105fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 -- 172.21.15.53:0/884355947 >> 172.21.15.53:0/884355947 conn(0x7fab90101220 msgr2=0x7fab90103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 -- 172.21.15.53:0/884355947 shutdown_connections 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.943+0000 7fab9481c700 1 -- 172.21.15.53:0/884355947 wait complete. 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab9481c700 1 Processor -- start 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab9481c700 1 -- start start 2024-09-16T00:41:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab9481c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab9481c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90199eb0 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34202/0 (socket says 172.21.15.53:34202) 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.944+0000 7fab8e59c700 1 -- 172.21.15.53:0/4153123630 learned_addr learned my addr 172.21.15.53:0/4153123630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab8e59c700 1 -- 172.21.15.53:0/4153123630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009550 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab8e59c700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab80011670 tx=0x7fab80011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab80003a40 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab80003ba0 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9019a0b0 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab80024820 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.945+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9019a4d0 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.946+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fab80024ae0 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.946+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90062380 con 0x7fab90105bd0 2024-09-16T00:41:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.946+0000 7fab7f7fe700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 0x7fab7803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.946+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fab8004c330 con 0x7fab90105bd0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.946+0000 7fab8dd9b700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 0x7fab7803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.947+0000 7fab8dd9b700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 0x7fab7803a860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab84006fd0 tx=0x7fab84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:14.951+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fab80022310 con 0x7fab90105bd0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.165+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fab90103500 con 0x7fab780383b0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.169+0000 7fab7f7fe700 1 -- 172.21.15.53:0/4153123630 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fab90103500 con 0x7fab780383b0 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 msgr2=0x7fab7803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 0x7fab7803a860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab84006fd0 tx=0x7fab84006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 msgr2=0x7fab90199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab80011670 tx=0x7fab80011aa0 comp rx=0 tx=0).stop 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 shutdown_connections 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fab780383b0 0x7fab7803a860 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:16.032 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 --2- 172.21.15.53:0/4153123630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab90105bd0 0x7fab90199970 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:16.033 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.171+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 >> 172.21.15.53:0/4153123630 conn(0x7fab90101220 msgr2=0x7fab901028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:16.033 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.172+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 shutdown_connections 2024-09-16T00:41:16.033 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:15.172+0000 7fab9481c700 1 -- 172.21.15.53:0/4153123630 wait complete. 2024-09-16T00:41:16.033 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying prometheus service with default placement... 2024-09-16T00:41:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:16 smithi053 ceph-mon[27950]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:16 smithi053 ceph-mon[27950]: Saving service ceph-exporter spec with placement * 2024-09-16T00:41:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:16 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:16 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.481+0000 7f1f4b0ac700 1 Processor -- start 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.481+0000 7f1f4b0ac700 1 -- start start 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.481+0000 7f1f4b0ac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.481+0000 7f1f4b0ac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441053d0 con 0x7f1f44104a80 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f48e48700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:17.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f48e48700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34216/0 (socket says 172.21.15.53:34216) 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f48e48700 1 -- 172.21.15.53:0/3969922281 learned_addr learned my addr 172.21.15.53:0/3969922281 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f48e48700 1 -- 172.21.15.53:0/3969922281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44105510 con 0x7f1f44104a80 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f48e48700 1 --2- 172.21.15.53:0/3969922281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098a0 tx=0x7f1f40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57a546c6e92a3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.482+0000 7f1f3b7fe700 1 -- 172.21.15.53:0/3969922281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f40004180 con 0x7f1f44104a80 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f3b7fe700 1 -- 172.21.15.53:0/3969922281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f400042e0 con 0x7f1f44104a80 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f3b7fe700 1 -- 172.21.15.53:0/3969922281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f40011af0 con 0x7f1f44104a80 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/3969922281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 msgr2=0x7f1f44104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/3969922281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098a0 tx=0x7f1f40009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/3969922281 shutdown_connections 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/3969922281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44104e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.483+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/3969922281 >> 172.21.15.53:0/3969922281 conn(0x7f1f44100110 msgr2=0x7f1f44102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/3969922281 shutdown_connections 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/3969922281 wait complete. 2024-09-16T00:41:17.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 Processor -- start 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 -- start start 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.484+0000 7f1f4b0ac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4419c650 con 0x7f1f44104a80 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f48e48700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f48e48700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34228/0 (socket says 172.21.15.53:34228) 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f48e48700 1 -- 172.21.15.53:0/1135906674 learned_addr learned my addr 172.21.15.53:0/1135906674 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f48e48700 1 -- 172.21.15.53:0/1135906674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009550 con 0x7f1f44104a80 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f48e48700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006ba0 tx=0x7f1f40011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f40003b00 con 0x7f1f44104a80 2024-09-16T00:41:17.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1f4001a8e0 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f400199c0 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.485+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4419c790 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.486+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4419cbb0 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.486+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1f40019c80 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.487+0000 7f1f39ffb700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 0x7f1f2c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.487+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1f4004c8a0 con 0x7f1f44104a80 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.487+0000 7f1f3bfff700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 0x7f1f2c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:17.281 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.487+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44062380 con 0x7f1f44104a80 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.487+0000 7f1f3bfff700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 0x7f1f2c03a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006fd0 tx=0x7f1f34006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.496+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1f4002b930 con 0x7f1f44104a80 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.718+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f441015c0 con 0x7f1f2c0383a0 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.722+0000 7f1f39ffb700 1 -- 172.21.15.53:0/1135906674 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f1f441015c0 con 0x7f1f2c0383a0 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 msgr2=0x7f1f2c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 0x7f1f2c03a850 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f34006fd0 tx=0x7f1f34006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 msgr2=0x7f1f44074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:17.282 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006ba0 tx=0x7f1f40011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 shutdown_connections 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1f2c0383a0 0x7f1f2c03a850 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 --2- 172.21.15.53:0/1135906674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f44104a80 0x7f1f44074250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.724+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 >> 172.21.15.53:0/1135906674 conn(0x7f1f44100110 msgr2=0x7f1f44100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.725+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 shutdown_connections 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:16.725+0000 7f1f4b0ac700 1 -- 172.21.15.53:0/1135906674 wait complete. 2024-09-16T00:41:17.283 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying grafana service with default placement... 2024-09-16T00:41:17.697 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:17 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:17.697 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:17 smithi053 ceph-mon[27950]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:17.697 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:17 smithi053 ceph-mon[27950]: Saving service prometheus spec with placement count:1 2024-09-16T00:41:17.697 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:17 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:18.594 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-16T00:41:18.594 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.721+0000 7f9b41ad3700 1 Processor -- start 2024-09-16T00:41:18.594 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.721+0000 7f9b41ad3700 1 -- start start 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.721+0000 7f9b41ad3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.721+0000 7f9b41ad3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c07a820 con 0x7f9b3c07bde0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.721+0000 7f9b3b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34242/0 (socket says 172.21.15.53:34242) 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3b7fe700 1 -- 172.21.15.53:0/1493498523 learned_addr learned my addr 172.21.15.53:0/1493498523 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3b7fe700 1 -- 172.21.15.53:0/1493498523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c07a960 con 0x7f9b3c07bde0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3b7fe700 1 --2- 172.21.15.53:0/1493498523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098a0 tx=0x7f9b2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb081e9b38063f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3affd700 1 -- 172.21.15.53:0/1493498523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c004180 con 0x7f9b3c07bde0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3affd700 1 -- 172.21.15.53:0/1493498523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b2c0042e0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.722+0000 7f9b3affd700 1 -- 172.21.15.53:0/1493498523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c011af0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 -- 172.21.15.53:0/1493498523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 msgr2=0x7f9b3c07a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/1493498523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098a0 tx=0x7f9b2c009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:18.595 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 -- 172.21.15.53:0/1493498523 shutdown_connections 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/1493498523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c07a2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 -- 172.21.15.53:0/1493498523 >> 172.21.15.53:0/1493498523 conn(0x7f9b3c101220 msgr2=0x7f9b3c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 -- 172.21.15.53:0/1493498523 shutdown_connections 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.723+0000 7f9b41ad3700 1 -- 172.21.15.53:0/1493498523 wait complete. 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b41ad3700 1 Processor -- start 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b41ad3700 1 -- start start 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b41ad3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b41ad3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c19c0d0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b3b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b3b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34256/0 (socket says 172.21.15.53:34256) 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b3b7fe700 1 -- 172.21.15.53:0/4109458907 learned_addr learned my addr 172.21.15.53:0/4109458907 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.724+0000 7f9b3b7fe700 1 -- 172.21.15.53:0/4109458907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009550 con 0x7f9b3c07bde0 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b3b7fe700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:18.596 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c003a70 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b2c003bd0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c19c2d0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c0238c0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.725+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c19c6f0 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.726+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c10be80 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.726+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9b2c01a430 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.726+0000 7f9b397fa700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 0x7f9b2803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.726+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9b2c04c170 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.726+0000 7f9b32ffd700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 0x7f9b2803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.727+0000 7f9b32ffd700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 0x7f9b2803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b24006fd0 tx=0x7f9b24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.731+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9b2c010560 con 0x7f9b3c07bde0 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.966+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b3c103530 con 0x7f9b28038440 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.970+0000 7f9b397fa700 1 -- 172.21.15.53:0/4109458907 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9b3c103530 con 0x7f9b28038440 2024-09-16T00:41:18.597 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 msgr2=0x7f9b2803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 0x7f9b2803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b24006fd0 tx=0x7f9b24006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 msgr2=0x7f9b3c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 shutdown_connections 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9b28038440 0x7f9b2803a8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 --2- 172.21.15.53:0/4109458907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b3c07bde0 0x7f9b3c19bb90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 >> 172.21.15.53:0/4109458907 conn(0x7f9b3c101220 msgr2=0x7f9b3c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 shutdown_connections 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:17.973+0000 7f9b41ad3700 1 -- 172.21.15.53:0/4109458907 wait complete. 2024-09-16T00:41:18.598 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying node-exporter service with default placement... 2024-09-16T00:41:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:18 smithi053 ceph-mon[27950]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:18 smithi053 ceph-mon[27950]: Saving service grafana spec with placement count:1 2024-09-16T00:41:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:18 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:18 smithi053 ceph-mon[27950]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.900+0000 7ff2ed213700 1 Processor -- start 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2ed213700 1 -- start start 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2ed213700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2ed213700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e807a840 con 0x7ff2e807be00 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34268/0 (socket says 172.21.15.53:34268) 2024-09-16T00:41:20.713 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2e6d9d700 1 -- 172.21.15.53:0/249184937 learned_addr learned my addr 172.21.15.53:0/249184937 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2e6d9d700 1 -- 172.21.15.53:0/249184937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e807a980 con 0x7ff2e807be00 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.901+0000 7ff2e6d9d700 1 --2- 172.21.15.53:0/249184937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098a0 tx=0x7ff2d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9cc36e5154da27 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2e5d9b700 1 -- 172.21.15.53:0/249184937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d8004180 con 0x7ff2e807be00 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2e5d9b700 1 -- 172.21.15.53:0/249184937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2d80042e0 con 0x7ff2e807be00 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2e5d9b700 1 -- 172.21.15.53:0/249184937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d8011af0 con 0x7ff2e807be00 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 -- 172.21.15.53:0/249184937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 msgr2=0x7ff2e807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 --2- 172.21.15.53:0/249184937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098a0 tx=0x7ff2d8009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 -- 172.21.15.53:0/249184937 shutdown_connections 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 --2- 172.21.15.53:0/249184937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e807a300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 -- 172.21.15.53:0/249184937 >> 172.21.15.53:0/249184937 conn(0x7ff2e8101220 msgr2=0x7ff2e8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 -- 172.21.15.53:0/249184937 shutdown_connections 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.902+0000 7ff2ed213700 1 -- 172.21.15.53:0/249184937 wait complete. 2024-09-16T00:41:20.714 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.903+0000 7ff2ed213700 1 Processor -- start 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.903+0000 7ff2ed213700 1 -- start start 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2ed213700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2ed213700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e819c060 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34280/0 (socket says 172.21.15.53:34280) 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2e6d9d700 1 -- 172.21.15.53:0/67590142 learned_addr learned my addr 172.21.15.53:0/67590142 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2e6d9d700 1 -- 172.21.15.53:0/67590142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009550 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2e6d9d700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d8003a70 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2d8003bd0 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e819c260 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.904+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d80238c0 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.905+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e819c680 con 0x7ff2e807be00 2024-09-16T00:41:20.715 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.905+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff2d8023b80 con 0x7ff2e807be00 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.906+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8062380 con 0x7ff2e807be00 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.906+0000 7ff2cffff700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 0x7ff2d003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.906+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff2d804c200 con 0x7ff2e807be00 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.906+0000 7ff2e659c700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 0x7ff2d003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.906+0000 7ff2e659c700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 0x7ff2d003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc006fd0 tx=0x7ff2dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:19.911+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff2d802b300 con 0x7ff2e807be00 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.123+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2e8103520 con 0x7ff2d00383f0 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.127+0000 7ff2cffff700 1 -- 172.21.15.53:0/67590142 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff2e8103520 con 0x7ff2d00383f0 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 msgr2=0x7ff2d003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 0x7ff2d003a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc006fd0 tx=0x7ff2dc006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 msgr2=0x7ff2e819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 shutdown_connections 2024-09-16T00:41:20.716 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff2d00383f0 0x7ff2d003a8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:20.717 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 --2- 172.21.15.53:0/67590142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2e807be00 0x7ff2e819bb20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:20.717 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.129+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 >> 172.21.15.53:0/67590142 conn(0x7ff2e8101220 msgr2=0x7ff2e8102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:20.717 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.130+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 shutdown_connections 2024-09-16T00:41:20.717 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:20.130+0000 7ff2ed213700 1 -- 172.21.15.53:0/67590142 wait complete. 2024-09-16T00:41:20.717 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying alertmanager service with default placement... 2024-09-16T00:41:21.197 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:21 smithi053 ceph-mon[27950]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:21.197 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:21 smithi053 ceph-mon[27950]: Saving service node-exporter spec with placement * 2024-09-16T00:41:21.197 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:21 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:21.198 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:21 smithi053 ceph-mon[27950]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:21.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-16T00:41:21.969 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.195+0000 7f28ed8d1700 1 Processor -- start 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.195+0000 7f28ed8d1700 1 -- start start 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.195+0000 7f28ed8d1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.195+0000 7f28ed8d1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e81064e0 con 0x7f28e8105b90 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34296/0 (socket says 172.21.15.53:34296) 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e6ffd700 1 -- 172.21.15.53:0/749661781 learned_addr learned my addr 172.21.15.53:0/749661781 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e6ffd700 1 -- 172.21.15.53:0/749661781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8106620 con 0x7f28e8105b90 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e6ffd700 1 --2- 172.21.15.53:0/749661781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009e80 tx=0x7f28d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5064a246bc59776 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e5ffb700 1 -- 172.21.15.53:0/749661781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28d800e070 con 0x7f28e8105b90 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e5ffb700 1 -- 172.21.15.53:0/749661781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f28d800b8c0 con 0x7f28e8105b90 2024-09-16T00:41:21.970 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.196+0000 7f28e5ffb700 1 -- 172.21.15.53:0/749661781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28d80044d0 con 0x7f28e8105b90 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 -- 172.21.15.53:0/749661781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 msgr2=0x7f28e8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/749661781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009e80 tx=0x7f28d800b330 comp rx=0 tx=0).stop 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 -- 172.21.15.53:0/749661781 shutdown_connections 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/749661781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8105fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 -- 172.21.15.53:0/749661781 >> 172.21.15.53:0/749661781 conn(0x7f28e8101220 msgr2=0x7f28e8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 -- 172.21.15.53:0/749661781 shutdown_connections 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.197+0000 7f28ed8d1700 1 -- 172.21.15.53:0/749661781 wait complete. 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28ed8d1700 1 Processor -- start 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28ed8d1700 1 -- start start 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28ed8d1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:21.971 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28ed8d1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8199e50 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34302/0 (socket says 172.21.15.53:34302) 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.198+0000 7f28e6ffd700 1 -- 172.21.15.53:0/2128871254 learned_addr learned my addr 172.21.15.53:0/2128871254 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28e6ffd700 1 -- 172.21.15.53:0/2128871254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8009b30 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28e6ffd700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28d8000f80 tx=0x7f28d80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28d800e040 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e819a050 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f28d800bd00 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28d8012770 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.199+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e819a4d0 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.200+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f28d8019040 con 0x7f28e8105b90 2024-09-16T00:41:21.972 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.200+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e8062380 con 0x7f28e8105b90 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.200+0000 7f28ec8cf700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 0x7f28d403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.200+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f28d804bd40 con 0x7f28e8105b90 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.201+0000 7f28e67fc700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 0x7f28d403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.201+0000 7f28e67fc700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 0x7f28d403a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28d0006fd0 tx=0x7f28d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.205+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f28d80129f0 con 0x7f28e8105b90 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.418+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f28e81026d0 con 0x7f28d40383f0 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.422+0000 7f28ec8cf700 1 -- 172.21.15.53:0/2128871254 <== mgr.14120 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f28e81026d0 con 0x7f28d40383f0 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 msgr2=0x7f28d403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 0x7f28d403a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28d0006fd0 tx=0x7f28d0006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 msgr2=0x7f28e8199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:21.973 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28d8000f80 tx=0x7f28d80049f0 comp rx=0 tx=0).stop 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 shutdown_connections 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f28d40383f0 0x7f28d403a8a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 --2- 172.21.15.53:0/2128871254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28e8105b90 0x7f28e8199910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 >> 172.21.15.53:0/2128871254 conn(0x7f28e8101220 msgr2=0x7f28e8101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 shutdown_connections 2024-09-16T00:41:21.974 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:21.424+0000 7f28ed8d1700 1 -- 172.21.15.53:0/2128871254 wait complete. 2024-09-16T00:41:22.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:22 smithi053 ceph-mon[27950]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:22.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:22 smithi053 ceph-mon[27950]: Saving service alertmanager spec with placement count:1 2024-09-16T00:41:22.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:22 smithi053 ceph-mon[27950]: from='mgr.14120 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:23.334 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.500+0000 7f2d21afb700 1 Processor -- start 2024-09-16T00:41:23.334 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.500+0000 7f2d21afb700 1 -- start start 2024-09-16T00:41:23.334 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d21afb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d21afb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c07a860 con 0x7f2d1c07be20 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59516/0 (socket says 172.21.15.53:59516) 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d1b7fe700 1 -- 172.21.15.53:0/823707509 learned_addr learned my addr 172.21.15.53:0/823707509 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d1b7fe700 1 -- 172.21.15.53:0/823707509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c07a9a0 con 0x7f2d1c07be20 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.501+0000 7f2d1b7fe700 1 --2- 172.21.15.53:0/823707509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0098a0 tx=0x7f2d0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe5db3bb7a22a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d1affd700 1 -- 172.21.15.53:0/823707509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d0c004180 con 0x7f2d1c07be20 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d1affd700 1 -- 172.21.15.53:0/823707509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d0c0042e0 con 0x7f2d1c07be20 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d1affd700 1 -- 172.21.15.53:0/823707509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d0c011af0 con 0x7f2d1c07be20 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 -- 172.21.15.53:0/823707509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 msgr2=0x7f2d1c07a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 --2- 172.21.15.53:0/823707509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0098a0 tx=0x7f2d0c009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 -- 172.21.15.53:0/823707509 shutdown_connections 2024-09-16T00:41:23.335 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 --2- 172.21.15.53:0/823707509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c07a320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 -- 172.21.15.53:0/823707509 >> 172.21.15.53:0/823707509 conn(0x7f2d1c1012b0 msgr2=0x7f2d1c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 -- 172.21.15.53:0/823707509 shutdown_connections 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.502+0000 7f2d21afb700 1 -- 172.21.15.53:0/823707509 wait complete. 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.503+0000 7f2d21afb700 1 Processor -- start 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.503+0000 7f2d21afb700 1 -- start start 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.503+0000 7f2d21afb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.503+0000 7f2d21afb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c19c120 con 0x7f2d1c07be20 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59528/0 (socket says 172.21.15.53:59528) 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d1b7fe700 1 -- 172.21.15.53:0/2001380325 learned_addr learned my addr 172.21.15.53:0/2001380325 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d1b7fe700 1 -- 172.21.15.53:0/2001380325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009550 con 0x7f2d1c07be20 2024-09-16T00:41:23.336 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d1b7fe700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c011670 tx=0x7f2d0c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d0c0039c0 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c19c320 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d0c003b20 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d0c0246c0 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.504+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c19c740 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.505+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2d0c024980 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.505+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c10bf70 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.505+0000 7f2d197fa700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 0x7f2d0803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.505+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2d0c04c4d0 con 0x7f2d1c07be20 2024-09-16T00:41:23.337 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.506+0000 7f2d12ffd700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 0x7f2d0803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.506+0000 7f2d12ffd700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 0x7f2d0803a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006fd0 tx=0x7f2d04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.510+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2d0c01a610 con 0x7f2d1c07be20 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.714+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f2d1c19f5a0 con 0x7f2d1c07be20 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.718+0000 7f2d197fa700 1 -- 172.21.15.53:0/2001380325 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f2d0c01a430 con 0x7f2d1c07be20 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 msgr2=0x7f2d0803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 0x7f2d0803a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006fd0 tx=0x7f2d04006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 msgr2=0x7f2d1c19bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c011670 tx=0x7f2d0c011aa0 comp rx=0 tx=0).stop 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 shutdown_connections 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d08038400 0x7f2d0803a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:23.338 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 --2- 172.21.15.53:0/2001380325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d1c07be20 0x7f2d1c19bbe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:23.339 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 >> 172.21.15.53:0/2001380325 conn(0x7f2d1c1012b0 msgr2=0x7f2d1c102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:23.339 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 shutdown_connections 2024-09-16T00:41:23.339 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:22.720+0000 7f2d21afb700 1 -- 172.21.15.53:0/2001380325 wait complete. 2024-09-16T00:41:23.974 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:23 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2001380325' entity='client.admin' 2024-09-16T00:41:23.974 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:23 smithi053 ceph-mon[27950]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:24.607 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c42ec700 1 Processor -- start 2024-09-16T00:41:24.607 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c42ec700 1 -- start start 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c42ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c42ec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc108c60 con 0x7fd1bc079d20 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c2088700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c2088700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59530/0 (socket says 172.21.15.53:59530) 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.760+0000 7fd1c2088700 1 -- 172.21.15.53:0/3777252612 learned_addr learned my addr 172.21.15.53:0/3777252612 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c2088700 1 -- 172.21.15.53:0/3777252612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc108da0 con 0x7fd1bc079d20 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c2088700 1 --2- 172.21.15.53:0/3777252612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098a0 tx=0x7fd1b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501144fffb4e4aba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c1086700 1 -- 172.21.15.53:0/3777252612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1b8004180 con 0x7fd1bc079d20 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c1086700 1 -- 172.21.15.53:0/3777252612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1b80042e0 con 0x7fd1bc079d20 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c1086700 1 -- 172.21.15.53:0/3777252612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1b8011af0 con 0x7fd1bc079d20 2024-09-16T00:41:24.608 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c42ec700 1 -- 172.21.15.53:0/3777252612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 msgr2=0x7fd1bc108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.761+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/3777252612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098a0 tx=0x7fd1b8009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 -- 172.21.15.53:0/3777252612 shutdown_connections 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/3777252612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc079d20 0x7fd1bc108720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 -- 172.21.15.53:0/3777252612 >> 172.21.15.53:0/3777252612 conn(0x7fd1bc1000f0 msgr2=0x7fd1bc102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 -- 172.21.15.53:0/3777252612 shutdown_connections 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 -- 172.21.15.53:0/3777252612 wait complete. 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 Processor -- start 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.762+0000 7fd1c42ec700 1 -- start start 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c42ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c42ec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc19a260 con 0x7fd1bc199910 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c2088700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c2088700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59542/0 (socket says 172.21.15.53:59542) 2024-09-16T00:41:24.609 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c2088700 1 -- 172.21.15.53:0/2668679432 learned_addr learned my addr 172.21.15.53:0/2668679432 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c2088700 1 -- 172.21.15.53:0/2668679432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009550 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c2088700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1b8003a70 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1b8003bd0 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc19a460 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1b80238c0 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.763+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc19d0c0 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.764+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd1b8023b30 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.764+0000 7fd1b37fe700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 0x7fd1a803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.764+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc079d20 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.765+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd1b804c1d0 con 0x7fd1bc199910 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.765+0000 7fd1c1887700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 0x7fd1a803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.765+0000 7fd1c1887700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 0x7fd1a803a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006fd0 tx=0x7fd1ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:24.610 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.769+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd1b8010c20 con 0x7fd1bc199910 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.972+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd1bc079f40 con 0x7fd1bc199910 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.975+0000 7fd1b37fe700 1 -- 172.21.15.53:0/2668679432 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd1b8010830 con 0x7fd1bc199910 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 msgr2=0x7fd1a803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 0x7fd1a803a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006fd0 tx=0x7fd1ac006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 msgr2=0x7fd1bc199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 shutdown_connections 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd1a8038440 0x7fd1a803a8f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 --2- 172.21.15.53:0/2668679432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1bc199910 0x7fd1bc199d20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 >> 172.21.15.53:0/2668679432 conn(0x7fd1bc1000f0 msgr2=0x7fd1bc101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 shutdown_connections 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:23.978+0000 7fd1c42ec700 1 -- 172.21.15.53:0/2668679432 wait complete. 2024-09-16T00:41:24.611 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling the dashboard module... 2024-09-16T00:41:25.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:24 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2668679432' entity='client.admin' 2024-09-16T00:41:25.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:24 smithi053 ceph-mon[27950]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:26.263 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:25 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2205251507' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe5576f1700 1 Processor -- start 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe5576f1700 1 -- start start 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe5576f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe5576f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550079da0 con 0x7fe550106690 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe55548d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe55548d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59554/0 (socket says 172.21.15.53:59554) 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe55548d700 1 -- 172.21.15.53:0/3241928194 learned_addr learned my addr 172.21.15.53:0/3241928194 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe55548d700 1 -- 172.21.15.53:0/3241928194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550079ee0 con 0x7fe550106690 2024-09-16T00:41:26.588 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe55548d700 1 --2- 172.21.15.53:0/3241928194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098a0 tx=0x7fe54c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fc3cb9cbfe1da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe547fff700 1 -- 172.21.15.53:0/3241928194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54c004180 con 0x7fe550106690 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe547fff700 1 -- 172.21.15.53:0/3241928194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe54c0042e0 con 0x7fe550106690 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.081+0000 7fe547fff700 1 -- 172.21.15.53:0/3241928194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54c011af0 con 0x7fe550106690 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- 172.21.15.53:0/3241928194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 msgr2=0x7fe550108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 --2- 172.21.15.53:0/3241928194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098a0 tx=0x7fe54c009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- 172.21.15.53:0/3241928194 shutdown_connections 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 --2- 172.21.15.53:0/3241928194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550108a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- 172.21.15.53:0/3241928194 >> 172.21.15.53:0/3241928194 conn(0x7fe5501000f0 msgr2=0x7fe550102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- 172.21.15.53:0/3241928194 shutdown_connections 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- 172.21.15.53:0/3241928194 wait complete. 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 Processor -- start 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.082+0000 7fe5576f1700 1 -- start start 2024-09-16T00:41:26.589 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5576f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5576f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550106530 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe55548d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe55548d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59568/0 (socket says 172.21.15.53:59568) 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe55548d700 1 -- 172.21.15.53:0/2205251507 learned_addr learned my addr 172.21.15.53:0/2205251507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe55548d700 1 -- 172.21.15.53:0/2205251507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009550 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe55548d700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe54c006ba0 tx=0x7fe54c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54c003b00 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe54c01a8e0 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe550104640 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe54c019990 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.083+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe550104a60 con 0x7fe550106690 2024-09-16T00:41:26.590 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.084+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe54c019c00 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.084+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5500623f0 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.084+0000 7fe5467fc700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 0x7fe53c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.085+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe54c04c570 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.085+0000 7fe554c8c700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 0x7fe53c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.085+0000 7fe554c8c700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 0x7fe53c03a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe540006fd0 tx=0x7fe540006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.089+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe5500623f0 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.350+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fe550104db0 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.981+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe54c02d960 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.983+0000 7fe5467fc700 1 -- 172.21.15.53:0/2205251507 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fe54c017720 con 0x7fe550106690 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 msgr2=0x7fe53c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 0x7fe53c03a8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe540006fd0 tx=0x7fe540006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 msgr2=0x7fe550105ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:26.591 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe54c006ba0 tx=0x7fe54c011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 shutdown_connections 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53c0383f0 0x7fe53c03a8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 --2- 172.21.15.53:0/2205251507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe550106690 0x7fe550105ff0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 >> 172.21.15.53:0/2205251507 conn(0x7fe5501000f0 msgr2=0x7fe550101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.987+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 shutdown_connections 2024-09-16T00:41:26.592 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:25.988+0000 7fe5576f1700 1 -- 172.21.15.53:0/2205251507 wait complete. 2024-09-16T00:41:27.301 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:26 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2205251507' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T00:41:27.301 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:26 smithi053 ceph-mon[27950]: mgrmap e9: smithi053.cjiiek(active, since 27s) 2024-09-16T00:41:28.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "smithi053.cjiiek", 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79e00a9700 1 Processor -- start 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79e00a9700 1 -- start start 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79e00a9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79e00a9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8106590 con 0x7f79d8105c40 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79dde45700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79dde45700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59586/0 (socket says 172.21.15.53:59586) 2024-09-16T00:41:28.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.095+0000 7f79dde45700 1 -- 172.21.15.53:0/714199654 learned_addr learned my addr 172.21.15.53:0/714199654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.096+0000 7f79dde45700 1 -- 172.21.15.53:0/714199654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d81066d0 con 0x7f79d8105c40 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.096+0000 7f79dde45700 1 --2- 172.21.15.53:0/714199654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79d40098a0 tx=0x7f79d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609d80c2869a108 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.096+0000 7f79dce43700 1 -- 172.21.15.53:0/714199654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79d4004180 con 0x7f79d8105c40 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.096+0000 7f79dce43700 1 -- 172.21.15.53:0/714199654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79d40042e0 con 0x7f79d8105c40 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.096+0000 7f79dce43700 1 -- 172.21.15.53:0/714199654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79d4011af0 con 0x7f79d8105c40 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 -- 172.21.15.53:0/714199654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 msgr2=0x7f79d8106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 --2- 172.21.15.53:0/714199654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f79d40098a0 tx=0x7f79d4009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 -- 172.21.15.53:0/714199654 shutdown_connections 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 --2- 172.21.15.53:0/714199654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8106050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 -- 172.21.15.53:0/714199654 >> 172.21.15.53:0/714199654 conn(0x7f79d81012b0 msgr2=0x7f79d81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 -- 172.21.15.53:0/714199654 shutdown_connections 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 -- 172.21.15.53:0/714199654 wait complete. 2024-09-16T00:41:28.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.097+0000 7f79e00a9700 1 Processor -- start 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79e00a9700 1 -- start start 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79e00a9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79e00a9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8199ea0 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79dde45700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79dde45700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59600/0 (socket says 172.21.15.53:59600) 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79dde45700 1 -- 172.21.15.53:0/1968482153 learned_addr learned my addr 172.21.15.53:0/1968482153 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79dde45700 1 -- 172.21.15.53:0/1968482153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4009550 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79dde45700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79d4011670 tx=0x7f79d4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79d4003a40 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79d4003ba0 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d819a0a0 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79d4024790 con 0x7f79d8105c40 2024-09-16T00:41:28.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.098+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d819a4c0 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f79d401a430 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8062380 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79ceffd700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 0x7f79c403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f79d404c570 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79dd644700 1 -- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 msgr2=0x7f79c403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.100+0000 7f79dd644700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 0x7f79c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.105+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f79d4018b40 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.301+0000 7f79dd644700 1 -- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 msgr2=0x7f79c403a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.301+0000 7f79dd644700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 0x7f79c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.367+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f79d819d640 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.367+0000 7f79ceffd700 1 -- 172.21.15.53:0/1968482153 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f79d404bee0 con 0x7f79d8105c40 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 msgr2=0x7f79c403a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:41:28.007 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 0x7f79c403a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 msgr2=0x7f79d8199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f79d4011670 tx=0x7f79d4011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 shutdown_connections 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f79c4038440 0x7f79c403a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 --2- 172.21.15.53:0/1968482153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d8105c40 0x7f79d8199960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 >> 172.21.15.53:0/1968482153 conn(0x7f79d81012b0 msgr2=0x7f79d81029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 shutdown_connections 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:27.369+0000 7f79e00a9700 1 -- 172.21.15.53:0/1968482153 wait complete. 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-09-16T00:41:28.008 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 9... 2024-09-16T00:41:28.231 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:27 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1968482153' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T00:41:33.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: Active manager daemon smithi053.cjiiek restarted 2024-09-16T00:41:33.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:41:33.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T00:41:33.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: mgrmap e10: smithi053.cjiiek(active, starting, since 0.0032965s) 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:41:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:33 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f93039b5700 1 Processor -- start 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f93039b5700 1 -- start start 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f93039b5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:34.981 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f93039b5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1053d0 con 0x7f92fc104a80 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f9301751700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f9301751700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59616/0 (socket says 172.21.15.53:59616) 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.435+0000 7f9301751700 1 -- 172.21.15.53:0/1971925746 learned_addr learned my addr 172.21.15.53:0/1971925746 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.436+0000 7f9301751700 1 -- 172.21.15.53:0/1971925746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc105510 con 0x7f92fc104a80 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.436+0000 7f9301751700 1 --2- 172.21.15.53:0/1971925746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966f2a265eb6487b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.436+0000 7f92f3fff700 1 -- 172.21.15.53:0/1971925746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f8004180 con 0x7f92fc104a80 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.436+0000 7f92f3fff700 1 -- 172.21.15.53:0/1971925746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92f80042e0 con 0x7f92fc104a80 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.436+0000 7f92f3fff700 1 -- 172.21.15.53:0/1971925746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f8011af0 con 0x7f92fc104a80 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 -- 172.21.15.53:0/1971925746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 msgr2=0x7f92fc104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 --2- 172.21.15.53:0/1971925746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92f80098a0 tx=0x7f92f8009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 -- 172.21.15.53:0/1971925746 shutdown_connections 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 --2- 172.21.15.53:0/1971925746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc104e90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.982 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 -- 172.21.15.53:0/1971925746 >> 172.21.15.53:0/1971925746 conn(0x7f92fc100110 msgr2=0x7f92fc102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 -- 172.21.15.53:0/1971925746 shutdown_connections 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.437+0000 7f93039b5700 1 -- 172.21.15.53:0/1971925746 wait complete. 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f93039b5700 1 Processor -- start 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f93039b5700 1 -- start start 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f93039b5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f93039b5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc19c650 con 0x7f92fc104a80 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f9301751700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f9301751700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59632/0 (socket says 172.21.15.53:59632) 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f9301751700 1 -- 172.21.15.53:0/2399553834 learned_addr learned my addr 172.21.15.53:0/2399553834 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.438+0000 7f9301751700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8009550 con 0x7f92fc104a80 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f9301751700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92f8011ad0 tx=0x7f92f8011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f8003ab0 con 0x7f92fc104a80 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc19c790 con 0x7f92fc104a80 2024-09-16T00:41:34.983 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92f8003c10 con 0x7f92fc104a80 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f80198e0 con 0x7f92fc104a80 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.439+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc19cbb0 con 0x7f92fc104a80 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f92f8019b70 con 0x7f92fc104a80 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f92f27fc700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92e803b050 con 0x7f92e8038490 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f92f804c350 con 0x7f92fc104a80 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f9300f50700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.440+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.641+0000 7f9300f50700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:28.641+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:29.042+0000 7f9300f50700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:29.042+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T00:41:34.984 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:29.843+0000 7f9300f50700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:29.843+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:31.444+0000 7f9300f50700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:31.444+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:32.996+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f92f800b3e0 con 0x7f92fc104a80 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:32.996+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:32.996+0000 7f92f27fc700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:33.998+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f92f8010380 con 0x7f92fc104a80 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:33.998+0000 7f92f27fc700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:33.998+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92e803b050 con 0x7f92e8038490 2024-09-16T00:41:34.985 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:33.998+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:33.999+0000 7f9300f50700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92ec003a10 tx=0x7f92ec009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.000+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f92e803b050 con 0x7f92e8038490 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.006+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f92fc073df0 con 0x7f92e8038490 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f92f27fc700 1 -- 172.21.15.53:0/2399553834 <== mgr.14164 v2:172.21.15.53:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f92fc073df0 con 0x7f92e8038490 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 msgr2=0x7f92e803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92ec003a10 tx=0x7f92ec009270 comp rx=0 tx=0).stop 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 msgr2=0x7f92fc074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:34.988 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92f8011ad0 tx=0x7f92f8011bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 shutdown_connections 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f92e8038490 0x7f92e803a940 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 --2- 172.21.15.53:0/2399553834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92fc104a80 0x7f92fc074250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 >> 172.21.15.53:0/2399553834 conn(0x7f92fc100110 msgr2=0x7f92fc100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 shutdown_connections 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:34.007+0000 7f93039b5700 1 -- 172.21.15.53:0/2399553834 wait complete. 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 9 is available 2024-09-16T00:41:34.989 INFO:teuthology.orchestra.run.smithi053.stdout:Generating a dashboard self-signed certificate... 2024-09-16T00:41:35.229 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:34 smithi053 ceph-mon[27950]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T00:41:35.230 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:34 smithi053 ceph-mon[27950]: mgrmap e11: smithi053.cjiiek(active, since 1.00593s) 2024-09-16T00:41:35.230 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:34 smithi053 ceph-mon[27950]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T00:41:35.230 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:34 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:36.269 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:34] ENGINE Bus STARTING 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:34] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:34] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: [16/Sep/2024:00:41:34] ENGINE Bus STARTED 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: mgrmap e12: smithi053.cjiiek(active, since 2s) 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:36.270 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:35 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T00:41:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.449+0000 7fd35ac60700 1 Processor -- start 2024-09-16T00:41:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.449+0000 7fd35ac60700 1 -- start start 2024-09-16T00:41:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd35ac60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:36.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd35ac60700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3541064e0 con 0x7fd354105b90 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3589fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3589fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47688/0 (socket says 172.21.15.53:47688) 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3589fc700 1 -- 172.21.15.53:0/2174169606 learned_addr learned my addr 172.21.15.53:0/2174169606 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3589fc700 1 -- 172.21.15.53:0/2174169606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354106620 con 0x7fd354105b90 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3589fc700 1 --2- 172.21.15.53:0/2174169606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd348009e80 tx=0x7fd34800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a43c6b2e673e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.450+0000 7fd3537fe700 1 -- 172.21.15.53:0/2174169606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd34800e070 con 0x7fd354105b90 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd3537fe700 1 -- 172.21.15.53:0/2174169606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd34800b8c0 con 0x7fd354105b90 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd3537fe700 1 -- 172.21.15.53:0/2174169606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3480044d0 con 0x7fd354105b90 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 -- 172.21.15.53:0/2174169606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 msgr2=0x7fd354105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2174169606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd348009e80 tx=0x7fd34800b330 comp rx=0 tx=0).stop 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 -- 172.21.15.53:0/2174169606 shutdown_connections 2024-09-16T00:41:36.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2174169606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354105fa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 -- 172.21.15.53:0/2174169606 >> 172.21.15.53:0/2174169606 conn(0x7fd354101200 msgr2=0x7fd354103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 -- 172.21.15.53:0/2174169606 shutdown_connections 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.451+0000 7fd35ac60700 1 -- 172.21.15.53:0/2174169606 wait complete. 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd35ac60700 1 Processor -- start 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd35ac60700 1 -- start start 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd35ac60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd35ac60700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd354199e60 con 0x7fd354105b90 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd3589fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd3589fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47696/0 (socket says 172.21.15.53:47696) 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.452+0000 7fd3589fc700 1 -- 172.21.15.53:0/2297386468 learned_addr learned my addr 172.21.15.53:0/2297386468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd3589fc700 1 -- 172.21.15.53:0/2297386468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009b30 con 0x7fd354105b90 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd3589fc700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd348000f80 tx=0x7fd3480049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd34800e040 con 0x7fd354105b90 2024-09-16T00:41:36.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd34800bd00 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35419a060 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd348012770 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.453+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35419a4e0 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.454+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fd348019040 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.454+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35410a020 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.454+0000 7fd351ffb700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 0x7fd34403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.454+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd34804c0a0 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.454+0000 7fd353fff700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 0x7fd34403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.455+0000 7fd353fff700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 0x7fd34403a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd340006fd0 tx=0x7fd340006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.459+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd348011750 con 0x7fd354105b90 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.678+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3541034a0 con 0x7fd344038440 2024-09-16T00:41:36.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.719+0000 7fd351ffb700 1 -- 172.21.15.53:0/2297386468 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fd3541034a0 con 0x7fd344038440 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.721+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 msgr2=0x7fd34403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.721+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 0x7fd34403a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd340006fd0 tx=0x7fd340006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.721+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 msgr2=0x7fd354199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.721+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd348000f80 tx=0x7fd3480049f0 comp rx=0 tx=0).stop 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 shutdown_connections 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd344038440 0x7fd34403a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 --2- 172.21.15.53:0/2297386468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd354105b90 0x7fd354199920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 >> 172.21.15.53:0/2297386468 conn(0x7fd354101200 msgr2=0x7fd354102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 shutdown_connections 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:35.722+0000 7fd35ac60700 1 -- 172.21.15.53:0/2297386468 wait complete. 2024-09-16T00:41:36.280 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial admin user... 2024-09-16T00:41:37.168 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:36 smithi053 ceph-mon[27950]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:37.168 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:36 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:38.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:38 smithi053 ceph-mon[27950]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:38.294 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:38 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:38.428 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5gkwHARn2ldaq1Mf2r9zcebEhWpumt.CLFBy41RAnQETvOg7Pxx5i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726447297, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe658bb0700 1 Processor -- start 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe658bb0700 1 -- start start 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe658bb0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe658bb0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541053d0 con 0x7fe654104a80 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe65259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe65259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47700/0 (socket says 172.21.15.53:47700) 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.689+0000 7fe65259c700 1 -- 172.21.15.53:0/2076352383 learned_addr learned my addr 172.21.15.53:0/2076352383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.690+0000 7fe65259c700 1 -- 172.21.15.53:0/2076352383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654105510 con 0x7fe654104a80 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.690+0000 7fe65259c700 1 --2- 172.21.15.53:0/2076352383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6440098a0 tx=0x7fe644009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744da93edc0fe8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.690+0000 7fe65159a700 1 -- 172.21.15.53:0/2076352383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe644004180 con 0x7fe654104a80 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.690+0000 7fe65159a700 1 -- 172.21.15.53:0/2076352383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6440042e0 con 0x7fe654104a80 2024-09-16T00:41:38.429 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.690+0000 7fe65159a700 1 -- 172.21.15.53:0/2076352383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe644011af0 con 0x7fe654104a80 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 -- 172.21.15.53:0/2076352383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 msgr2=0x7fe654104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2076352383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe6440098a0 tx=0x7fe644009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 -- 172.21.15.53:0/2076352383 shutdown_connections 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2076352383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe654104e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 -- 172.21.15.53:0/2076352383 >> 172.21.15.53:0/2076352383 conn(0x7fe6541000f0 msgr2=0x7fe654102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 -- 172.21.15.53:0/2076352383 shutdown_connections 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 -- 172.21.15.53:0/2076352383 wait complete. 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.691+0000 7fe658bb0700 1 Processor -- start 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe658bb0700 1 -- start start 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe658bb0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe658bb0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541901a0 con 0x7fe654104a80 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe65259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:38.430 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe65259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47704/0 (socket says 172.21.15.53:47704) 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe65259c700 1 -- 172.21.15.53:0/2271828920 learned_addr learned my addr 172.21.15.53:0/2271828920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe65259c700 1 -- 172.21.15.53:0/2271828920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644009550 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe65259c700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe644006ba0 tx=0x7fe644011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe644003b00 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe64401a8e0 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65418e2b0 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.692+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6440199c0 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.693+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65418e6d0 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.693+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe644019c80 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.693+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe654062380 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.693+0000 7fe6437fe700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 0x7fe63c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.694+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fe64404c8d0 con 0x7fe654104a80 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.694+0000 7fe651d9b700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 0x7fe63c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:38.431 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.694+0000 7fe651d9b700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 0x7fe63c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe648006fd0 tx=0x7fe648006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.698+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe64402b340 con 0x7fe654104a80 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:36.917+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe6540621a0 con 0x7fe63c0383f0 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.165+0000 7fe6437fe700 1 -- 172.21.15.53:0/2271828920 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe6540621a0 con 0x7fe63c0383f0 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 msgr2=0x7fe63c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 0x7fe63c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe648006fd0 tx=0x7fe648006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 msgr2=0x7fe65418fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe644006ba0 tx=0x7fe644011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 shutdown_connections 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe63c0383f0 0x7fe63c03a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 --2- 172.21.15.53:0/2271828920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe654104a80 0x7fe65418fc60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 >> 172.21.15.53:0/2271828920 conn(0x7fe6541000f0 msgr2=0x7fe654079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.167+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 shutdown_connections 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:37.168+0000 7fe658bb0700 1 -- 172.21.15.53:0/2271828920 wait complete. 2024-09-16T00:41:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:Fetching dashboard port number... 2024-09-16T00:41:39.763 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.862+0000 7f928f7c6700 1 Processor -- start 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928f7c6700 1 -- start start 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928f7c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928f7c6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288108c60 con 0x7f9288079d20 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928d562700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928d562700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47720/0 (socket says 172.21.15.53:47720) 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928d562700 1 -- 172.21.15.53:0/1863686347 learned_addr learned my addr 172.21.15.53:0/1863686347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.863+0000 7f928d562700 1 -- 172.21.15.53:0/1863686347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288108da0 con 0x7f9288079d20 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928d562700 1 --2- 172.21.15.53:0/1863686347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92840098a0 tx=0x7f9284009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218a7011895dff43 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f927ffff700 1 -- 172.21.15.53:0/1863686347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9284004180 con 0x7f9288079d20 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f927ffff700 1 -- 172.21.15.53:0/1863686347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92840042e0 con 0x7f9288079d20 2024-09-16T00:41:39.764 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f927ffff700 1 -- 172.21.15.53:0/1863686347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9284011af0 con 0x7f9288079d20 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928f7c6700 1 -- 172.21.15.53:0/1863686347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 msgr2=0x7f9288108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928f7c6700 1 --2- 172.21.15.53:0/1863686347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92840098a0 tx=0x7f9284009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928f7c6700 1 -- 172.21.15.53:0/1863686347 shutdown_connections 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928f7c6700 1 --2- 172.21.15.53:0/1863686347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288079d20 0x7f9288108720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.864+0000 7f928f7c6700 1 -- 172.21.15.53:0/1863686347 >> 172.21.15.53:0/1863686347 conn(0x7f92881000f0 msgr2=0x7f9288102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.865+0000 7f928f7c6700 1 -- 172.21.15.53:0/1863686347 shutdown_connections 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.865+0000 7f928f7c6700 1 -- 172.21.15.53:0/1863686347 wait complete. 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.865+0000 7f928f7c6700 1 Processor -- start 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.865+0000 7f928f7c6700 1 -- start start 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928f7c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928f7c6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288106440 con 0x7f9288106030 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928d562700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:39.765 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928d562700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47724/0 (socket says 172.21.15.53:47724) 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928d562700 1 -- 172.21.15.53:0/3546794226 learned_addr learned my addr 172.21.15.53:0/3546794226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928d562700 1 -- 172.21.15.53:0/3546794226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009550 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928d562700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9284006ba0 tx=0x7f9284011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9284003b00 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f928401a8e0 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9288104c00 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9284019990 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.866+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288105020 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.867+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f9284019c00 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.867+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288062380 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.867+0000 7f927e7fc700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 0x7f927403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.868+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f928404c670 con 0x7f9288106030 2024-09-16T00:41:39.766 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.868+0000 7f928cd61700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 0x7f927403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.868+0000 7f928cd61700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 0x7f927403a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9278006fd0 tx=0x7f9278006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:38.872+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9284018710 con 0x7f9288106030 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.001+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f928402d440 con 0x7f9288106030 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.074+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f9288105320 con 0x7f9288106030 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.075+0000 7f927e7fc700 1 -- 172.21.15.53:0/3546794226 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f9284018710 con 0x7f9288106030 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 msgr2=0x7f927403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 0x7f927403a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9278006fd0 tx=0x7f9278006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 msgr2=0x7f92881046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9284006ba0 tx=0x7f9284011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 shutdown_connections 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9274038440 0x7f927403a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 --2- 172.21.15.53:0/3546794226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9288106030 0x7f92881046c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:39.767 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 >> 172.21.15.53:0/3546794226 conn(0x7f92881000f0 msgr2=0x7f9288101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:39.768 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 shutdown_connections 2024-09-16T00:41:39.768 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:39.077+0000 7f928f7c6700 1 -- 172.21.15.53:0/3546794226 wait complete. 2024-09-16T00:41:39.774 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T00:41:39.774 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout disabled 2024-09-16T00:41:39.783 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T00:41:39.783 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-16T00:41:39.783 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld.service is not enabled 2024-09-16T00:41:39.783 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T00:41:39.785 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph Dashboard is now available at: 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: URL: https://smithi053.front.sepia.ceph.com:8443/ 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: User: admin 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: Password: sv1xoucbez 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:39.786 INFO:teuthology.orchestra.run.smithi053.stdout:Saving cluster configuration to /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config directory 2024-09-16T00:41:39.787 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling autotune for osd_memory_target 2024-09-16T00:41:40.033 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:40 smithi053 ceph-mon[27950]: mgrmap e13: smithi053.cjiiek(active, since 6s) 2024-09-16T00:41:40.034 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:40 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3546794226' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T00:41:41.002 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.229+0000 7f06c8653700 1 Processor -- start 2024-09-16T00:41:41.002 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.229+0000 7f06c8653700 1 -- start start 2024-09-16T00:41:41.002 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c8653700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c8653700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01064c0 con 0x7f06c0105b70 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c63ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c63ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47740/0 (socket says 172.21.15.53:47740) 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c63ef700 1 -- 172.21.15.53:0/4288807886 learned_addr learned my addr 172.21.15.53:0/4288807886 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c63ef700 1 -- 172.21.15.53:0/4288807886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0106600 con 0x7f06c0105b70 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.230+0000 7f06c63ef700 1 --2- 172.21.15.53:0/4288807886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009e80 tx=0x7f06b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d65b6bc8d6f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c53ed700 1 -- 172.21.15.53:0/4288807886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b000e070 con 0x7f06c0105b70 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c53ed700 1 -- 172.21.15.53:0/4288807886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06b000b8c0 con 0x7f06c0105b70 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c53ed700 1 -- 172.21.15.53:0/4288807886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b00044d0 con 0x7f06c0105b70 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 -- 172.21.15.53:0/4288807886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 msgr2=0x7f06c0105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 --2- 172.21.15.53:0/4288807886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009e80 tx=0x7f06b000b330 comp rx=0 tx=0).stop 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 -- 172.21.15.53:0/4288807886 shutdown_connections 2024-09-16T00:41:41.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 --2- 172.21.15.53:0/4288807886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c0105f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 -- 172.21.15.53:0/4288807886 >> 172.21.15.53:0/4288807886 conn(0x7f06c0101220 msgr2=0x7f06c0103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.231+0000 7f06c8653700 1 -- 172.21.15.53:0/4288807886 shutdown_connections 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c8653700 1 -- 172.21.15.53:0/4288807886 wait complete. 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c8653700 1 Processor -- start 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c8653700 1 -- start start 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c8653700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c8653700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0199de0 con 0x7f06c0105b70 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c63ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c63ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47748/0 (socket says 172.21.15.53:47748) 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.232+0000 7f06c63ef700 1 -- 172.21.15.53:0/3100846520 learned_addr learned my addr 172.21.15.53:0/3100846520 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06c63ef700 1 -- 172.21.15.53:0/3100846520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0009b30 con 0x7f06c0105b70 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06c63ef700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06b0004070 tx=0x7f06b00049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b000e040 con 0x7f06c0105b70 2024-09-16T00:41:41.004 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06b000be00 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0199fe0 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b0012770 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.233+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c019a460 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.234+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f06b0019040 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.234+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0062380 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.234+0000 7f06bf7fe700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 0x7f06a803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.234+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f06b004c0a0 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.234+0000 7f06c5bee700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 0x7f06a803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.235+0000 7f06c5bee700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 0x7f06a803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06b4006fd0 tx=0x7f06b4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.239+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f06b0011390 con 0x7f06c0105b70 2024-09-16T00:41:41.005 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.466+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f06c0107a20 con 0x7f06c0105b70 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.466+0000 7f06bf7fe700 1 -- 172.21.15.53:0/3100846520 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f06b001f070 con 0x7f06c0105b70 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 msgr2=0x7f06a803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 0x7f06a803a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06b4006fd0 tx=0x7f06b4006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 msgr2=0x7f06c01998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06b0004070 tx=0x7f06b00049f0 comp rx=0 tx=0).stop 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 shutdown_connections 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a80384e0 0x7f06a803a990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 --2- 172.21.15.53:0/3100846520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c0105b70 0x7f06c01998a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 >> 172.21.15.53:0/3100846520 conn(0x7f06c0101220 msgr2=0x7f06c0101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 shutdown_connections 2024-09-16T00:41:41.006 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:40.468+0000 7f06c8653700 1 -- 172.21.15.53:0/3100846520 wait complete. 2024-09-16T00:41:42.309 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce83ffa700 1 Processor -- start 2024-09-16T00:41:42.309 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce83ffa700 1 -- start start 2024-09-16T00:41:42.309 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce83ffa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:42.309 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce83ffa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c079d40 con 0x7fce7c1066f0 2024-09-16T00:41:42.309 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce81d96700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce81d96700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47764/0 (socket says 172.21.15.53:47764) 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.431+0000 7fce81d96700 1 -- 172.21.15.53:0/4256890988 learned_addr learned my addr 172.21.15.53:0/4256890988 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.432+0000 7fce81d96700 1 -- 172.21.15.53:0/4256890988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c079e80 con 0x7fce7c1066f0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.432+0000 7fce81d96700 1 --2- 172.21.15.53:0/4256890988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce780098a0 tx=0x7fce78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a95634c8106545 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.432+0000 7fce80d94700 1 -- 172.21.15.53:0/4256890988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce78004180 con 0x7fce7c1066f0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.432+0000 7fce80d94700 1 -- 172.21.15.53:0/4256890988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce780042e0 con 0x7fce7c1066f0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.432+0000 7fce80d94700 1 -- 172.21.15.53:0/4256890988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce78011af0 con 0x7fce7c1066f0 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 -- 172.21.15.53:0/4256890988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 msgr2=0x7fce7c108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 --2- 172.21.15.53:0/4256890988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce780098a0 tx=0x7fce78009bb0 comp rx=0 tx=0).stop 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 -- 172.21.15.53:0/4256890988 shutdown_connections 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 --2- 172.21.15.53:0/4256890988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c108ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:42.310 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 -- 172.21.15.53:0/4256890988 >> 172.21.15.53:0/4256890988 conn(0x7fce7c1000f0 msgr2=0x7fce7c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 -- 172.21.15.53:0/4256890988 shutdown_connections 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 -- 172.21.15.53:0/4256890988 wait complete. 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.433+0000 7fce83ffa700 1 Processor -- start 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce83ffa700 1 -- start start 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce83ffa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce83ffa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c199e60 con 0x7fce7c1066f0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce81d96700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce81d96700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47768/0 (socket says 172.21.15.53:47768) 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce81d96700 1 -- 172.21.15.53:0/531794420 learned_addr learned my addr 172.21.15.53:0/531794420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce81d96700 1 -- 172.21.15.53:0/531794420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009550 con 0x7fce7c1066f0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce81d96700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce78000c00 tx=0x7fce78011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce78003a70 con 0x7fce7c1066f0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce78003bd0 con 0x7fce7c1066f0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c19a060 con 0x7fce7c1066f0 2024-09-16T00:41:42.311 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce780238c0 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.434+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c19a480 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.435+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fce78023b30 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.435+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c062380 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.436+0000 7fce72ffd700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 0x7fce6803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.436+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fce7804c3b0 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.436+0000 7fce81595700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 0x7fce6803a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.436+0000 7fce81595700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 0x7fce6803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006fd0 tx=0x7fce6c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.440+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fce78010970 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.752+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fce7c19d370 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.754+0000 7fce72ffd700 1 -- 172.21.15.53:0/531794420 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7fce7802c350 con 0x7fce7c1066f0 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 msgr2=0x7fce6803a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 0x7fce6803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce6c006fd0 tx=0x7fce6c006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 msgr2=0x7fce7c199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fce78000c00 tx=0x7fce78011b50 comp rx=0 tx=0).stop 2024-09-16T00:41:42.312 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 shutdown_connections 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fce68038530 0x7fce6803a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 --2- 172.21.15.53:0/531794420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c1066f0 0x7fce7c199920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.756+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 >> 172.21.15.53:0/531794420 conn(0x7fce7c1000f0 msgr2=0x7fce7c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.757+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 shutdown_connections 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr 2024-09-16T00:41:41.757+0000 7fce83ffa700 1 -- 172.21.15.53:0/531794420 wait complete. 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T00:41:42.313 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout: ceph telemetry on 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout:For more information see: 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:41:42.314 INFO:teuthology.orchestra.run.smithi053.stdout:Bootstrap complete. 2024-09-16T00:41:42.342 INFO:tasks.cephadm:Fetching config... 2024-09-16T00:41:42.342 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:41:42.342 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T00:41:42.359 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T00:41:42.359 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:41:42.359 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T00:41:42.415 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T00:41:42.415 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:41:42.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/keyring of=/dev/stdout 2024-09-16T00:41:42.481 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T00:41:42.481 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:41:42.481 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T00:41:42.537 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T00:41:42.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTpiJgjMKSvbASZqQNJ+d8sw1Uumz++dZbklMh5dwtRSSa1p2cUY4zIyzv5hxG5AyWbiCrrs+xgvr6IwFU3L9XUVnC9g7tB1ue4Eof54i+P+cwAq1Ocj5Xrez2p29pWrqZA6OmPb2m4Q1ISWhD0qsgQ5Wb28Haxr+2Kcz4fo8UCHPeO0HbSDvF1Bqu4pM6qcaHaE20kvel793xW4PJWsKtsIL/NTcGFUtSdHVZnLQIZcyKN+zRa2u3o6FwuG2MP+Z72PWGLjE9WeCRFt06cWjAk4yxMNssLh3SY+6Go4xJUeuRzVeRB25Hkn3IiiV4gQWf1V83AwMRYhSYq41UBVu5QlXys1SWyd9hqqj8wOjA5EAnsIfEJTwiJRT7Ufgj7I8nwaKjDZTTJdAA/Vic+Nh4mQe9apNiXz4yZFRlFOnW7/aw67PJhrKWK7IzMtkDDDSkP4o/cUu84jTKNn5Z76nTGt5zxNHsQHKqFmFz8S+Bq0VYp6RUVzgDMr64h9/9h/k= ceph-31d96aac-73c4-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:41:42.629 INFO:teuthology.orchestra.run.smithi053.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTpiJgjMKSvbASZqQNJ+d8sw1Uumz++dZbklMh5dwtRSSa1p2cUY4zIyzv5hxG5AyWbiCrrs+xgvr6IwFU3L9XUVnC9g7tB1ue4Eof54i+P+cwAq1Ocj5Xrez2p29pWrqZA6OmPb2m4Q1ISWhD0qsgQ5Wb28Haxr+2Kcz4fo8UCHPeO0HbSDvF1Bqu4pM6qcaHaE20kvel793xW4PJWsKtsIL/NTcGFUtSdHVZnLQIZcyKN+zRa2u3o6FwuG2MP+Z72PWGLjE9WeCRFt06cWjAk4yxMNssLh3SY+6Go4xJUeuRzVeRB25Hkn3IiiV4gQWf1V83AwMRYhSYq41UBVu5QlXys1SWyd9hqqj8wOjA5EAnsIfEJTwiJRT7Ufgj7I8nwaKjDZTTJdAA/Vic+Nh4mQe9apNiXz4yZFRlFOnW7/aw67PJhrKWK7IzMtkDDDSkP4o/cUu84jTKNn5Z76nTGt5zxNHsQHKqFmFz8S+Bq0VYp6RUVzgDMr64h9/9h/k= ceph-31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:41:42.642 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTpiJgjMKSvbASZqQNJ+d8sw1Uumz++dZbklMh5dwtRSSa1p2cUY4zIyzv5hxG5AyWbiCrrs+xgvr6IwFU3L9XUVnC9g7tB1ue4Eof54i+P+cwAq1Ocj5Xrez2p29pWrqZA6OmPb2m4Q1ISWhD0qsgQ5Wb28Haxr+2Kcz4fo8UCHPeO0HbSDvF1Bqu4pM6qcaHaE20kvel793xW4PJWsKtsIL/NTcGFUtSdHVZnLQIZcyKN+zRa2u3o6FwuG2MP+Z72PWGLjE9WeCRFt06cWjAk4yxMNssLh3SY+6Go4xJUeuRzVeRB25Hkn3IiiV4gQWf1V83AwMRYhSYq41UBVu5QlXys1SWyd9hqqj8wOjA5EAnsIfEJTwiJRT7Ufgj7I8nwaKjDZTTJdAA/Vic+Nh4mQe9apNiXz4yZFRlFOnW7/aw67PJhrKWK7IzMtkDDDSkP4o/cUu84jTKNn5Z76nTGt5zxNHsQHKqFmFz8S+Bq0VYp6RUVzgDMr64h9/9h/k= ceph-31d96aac-73c4-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T00:41:42.690 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTpiJgjMKSvbASZqQNJ+d8sw1Uumz++dZbklMh5dwtRSSa1p2cUY4zIyzv5hxG5AyWbiCrrs+xgvr6IwFU3L9XUVnC9g7tB1ue4Eof54i+P+cwAq1Ocj5Xrez2p29pWrqZA6OmPb2m4Q1ISWhD0qsgQ5Wb28Haxr+2Kcz4fo8UCHPeO0HbSDvF1Bqu4pM6qcaHaE20kvel793xW4PJWsKtsIL/NTcGFUtSdHVZnLQIZcyKN+zRa2u3o6FwuG2MP+Z72PWGLjE9WeCRFt06cWjAk4yxMNssLh3SY+6Go4xJUeuRzVeRB25Hkn3IiiV4gQWf1V83AwMRYhSYq41UBVu5QlXys1SWyd9hqqj8wOjA5EAnsIfEJTwiJRT7Ufgj7I8nwaKjDZTTJdAA/Vic+Nh4mQe9apNiXz4yZFRlFOnW7/aw67PJhrKWK7IzMtkDDDSkP4o/cUu84jTKNn5Z76nTGt5zxNHsQHKqFmFz8S+Bq0VYp6RUVzgDMr64h9/9h/k= ceph-31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:41:42.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T00:41:42.854 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:42 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/531794420' entity='client.admin' 2024-09-16T00:41:42.925 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:41:45.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 -- 172.21.15.53:0/2029452789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 msgr2=0x7f9da0100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:45.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 --2- 172.21.15.53:0/2029452789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0100240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009910 tx=0x7f9d9c009c20 comp rx=0 tx=0).stop 2024-09-16T00:41:45.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 -- 172.21.15.53:0/2029452789 shutdown_connections 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 --2- 172.21.15.53:0/2029452789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0100240 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 -- 172.21.15.53:0/2029452789 >> 172.21.15.53:0/2029452789 conn(0x7f9da00fb3c0 msgr2=0x7f9da00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 -- 172.21.15.53:0/2029452789 shutdown_connections 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.597+0000 7f9da829c700 1 -- 172.21.15.53:0/2029452789 wait complete. 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da829c700 1 Processor -- start 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da829c700 1 -- start start 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da829c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da829c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0075030 con 0x7f9da00ffe30 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da6038700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da6038700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41920/0 (socket says 172.21.15.53:41920) 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da6038700 1 -- 172.21.15.53:0/4200264481 learned_addr learned my addr 172.21.15.53:0/4200264481 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.598+0000 7f9da6038700 1 -- 172.21.15.53:0/4200264481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0095f0 con 0x7f9da00ffe30 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9da6038700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0092e0 tx=0x7f9d9c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:45.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d9c01d070 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d9c00be10 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0073140 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d9c00f460 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.599+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da00735e0 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f9d9c00f6d0 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0062380 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9d977fe700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 0x7f9d8c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f9d9c04c3e0 con 0x7f9da00ffe30 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9da5837700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 0x7f9d8c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:45.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.600+0000 7f9da5837700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 0x7f9d8c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006fd0 tx=0x7f9d90006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:45.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.605+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9d9c020370 con 0x7f9da00ffe30 2024-09-16T00:41:45.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.809+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f9da018e930 con 0x7f9da00ffe30 2024-09-16T00:41:45.809 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:41:45.810 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:45 smithi053 ceph-mon[27950]: Deploying daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:41:45.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.812+0000 7f9d977fe700 1 -- 172.21.15.53:0/4200264481 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9d9c027030 con 0x7f9da00ffe30 2024-09-16T00:41:45.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 msgr2=0x7f9d8c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:45.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 0x7f9d8c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006fd0 tx=0x7f9d90006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:45.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 msgr2=0x7f9da0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0092e0 tx=0x7f9d9c009e60 comp rx=0 tx=0).stop 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 shutdown_connections 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9d8c038490 0x7f9d8c03a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 --2- 172.21.15.53:0/4200264481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9da00ffe30 0x7f9da0074af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 >> 172.21.15.53:0/4200264481 conn(0x7f9da00fb3c0 msgr2=0x7f9da00fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 shutdown_connections 2024-09-16T00:41:45.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:45.814+0000 7f9da829c700 1 -- 172.21.15.53:0/4200264481 wait complete. 2024-09-16T00:41:46.954 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:46 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4200264481' entity='client.admin' 2024-09-16T00:41:46.981 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T00:41:46.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T00:41:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:41:49.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.797+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/383171102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 msgr2=0x7f2e44100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/383171102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44100230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009910 tx=0x7f2e40009c20 comp rx=0 tx=0).stop 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/383171102 shutdown_connections 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/383171102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44100230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/383171102 >> 172.21.15.53:0/383171102 conn(0x7f2e440fb3d0 msgr2=0x7f2e440fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/383171102 shutdown_connections 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/383171102 wait complete. 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 Processor -- start 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.798+0000 7f2e4bdc7700 1 -- start start 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e4bdc7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e4bdc7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e44075030 con 0x7f2e440ffe20 2024-09-16T00:41:49.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e49b63700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e49b63700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41946/0 (socket says 172.21.15.53:41946) 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e49b63700 1 -- 172.21.15.53:0/487329798 learned_addr learned my addr 172.21.15.53:0/487329798 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e49b63700 1 -- 172.21.15.53:0/487329798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400095f0 con 0x7f2e440ffe20 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e49b63700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e400092e0 tx=0x7f2e40009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e4001d070 con 0x7f2e440ffe20 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e44073140 con 0x7f2e440ffe20 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e4000be10 con 0x7f2e440ffe20 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e4000f460 con 0x7f2e440ffe20 2024-09-16T00:41:49.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.799+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e440735e0 con 0x7f2e440ffe20 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.800+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2e4000b960 con 0x7f2e440ffe20 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.800+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e44062380 con 0x7f2e440ffe20 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.801+0000 7f2e3affd700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 0x7f2e3003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.801+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2e4004c220 con 0x7f2e440ffe20 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.801+0000 7f2e49362700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 0x7f2e3003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:49.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.801+0000 7f2e49362700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 0x7f2e3003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e34006fd0 tx=0x7f2e34006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:49.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:49.806+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2e40022790 con 0x7f2e440ffe20 2024-09-16T00:41:50.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.016+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e44073820 con 0x7f2e300384e0 2024-09-16T00:41:50.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.020+0000 7f2e3affd700 1 -- 172.21.15.53:0/487329798 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2e44073820 con 0x7f2e300384e0 2024-09-16T00:41:50.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 msgr2=0x7f2e3003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:50.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 0x7f2e3003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e34006fd0 tx=0x7f2e34006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 msgr2=0x7f2e44074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e400092e0 tx=0x7f2e40009e60 comp rx=0 tx=0).stop 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 shutdown_connections 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2e300384e0 0x7f2e3003a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 --2- 172.21.15.53:0/487329798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e440ffe20 0x7f2e44074af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 >> 172.21.15.53:0/487329798 conn(0x7f2e440fb3d0 msgr2=0x7f2e440fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 shutdown_connections 2024-09-16T00:41:50.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:50.022+0000 7f2e4bdc7700 1 -- 172.21.15.53:0/487329798 wait complete. 2024-09-16T00:41:50.881 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2024-09-16T00:41:50.881 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:41:50.881 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2024-09-16T00:41:50.901 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:41:50.901 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:41:50.964 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2024-09-16T00:41:51.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch host add smithi152 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T00:41:51.310 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:51 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:41:51.693 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:41:52.066 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:52 smithi053 ceph-mon[27950]: Deploying daemon crash.smithi053 on smithi053 2024-09-16T00:41:54.145 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:54 smithi053 ceph-mon[27950]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:54.145 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:54 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- 172.21.15.53:0/2057997604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 msgr2=0x7fe144102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/2057997604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144102d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe140009910 tx=0x7fe140009c20 comp rx=0 tx=0).stop 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- 172.21.15.53:0/2057997604 shutdown_connections 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/2057997604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144102d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- 172.21.15.53:0/2057997604 >> 172.21.15.53:0/2057997604 conn(0x7fe1440fa2b0 msgr2=0x7fe1440fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- 172.21.15.53:0/2057997604 shutdown_connections 2024-09-16T00:41:54.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- 172.21.15.53:0/2057997604 wait complete. 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 Processor -- start 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.475+0000 7fe14bfe1700 1 -- start start 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe14bfe1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe14bfe1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441976b0 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe149d7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe149d7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52888/0 (socket says 172.21.15.53:52888) 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe149d7d700 1 -- 172.21.15.53:0/768346356 learned_addr learned my addr 172.21.15.53:0/768346356 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe149d7d700 1 -- 172.21.15.53:0/768346356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400095f0 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe149d7d700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe140005b40 tx=0x7fe140004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14001d070 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1441978b0 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe14000be10 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.476+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14000f460 con 0x7fe144100970 2024-09-16T00:41:54.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.477+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144197d50 con 0x7fe144100970 2024-09-16T00:41:54.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.477+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe144190f10 con 0x7fe144100970 2024-09-16T00:41:54.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.478+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fe14000b960 con 0x7fe144100970 2024-09-16T00:41:54.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.478+0000 7fe13affd700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 0x7fe13003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:41:54.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.478+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fe14004c3a0 con 0x7fe144100970 2024-09-16T00:41:54.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.478+0000 7fe14957c700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 0x7fe13003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:41:54.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.479+0000 7fe14957c700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 0x7fe13003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe134006fd0 tx=0x7fe134006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:41:54.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.487+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe14002a360 con 0x7fe144100970 2024-09-16T00:41:54.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:54.697+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7fe144061190 con 0x7fe130038490 2024-09-16T00:41:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: Deploying daemon node-exporter.smithi053 on smithi053 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:41:55.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:55 smithi053 ceph-mon[27950]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:57.068 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:56 smithi053 ceph-mon[27950]: Deploying cephadm binary to smithi152 2024-09-16T00:41:57.159 INFO:teuthology.orchestra.run.smithi053.stdout:Added host 'smithi152' with addr '172.21.15.152' 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.157+0000 7fe13affd700 1 -- 172.21.15.53:0/768346356 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe144061190 con 0x7fe130038490 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.159+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 msgr2=0x7fe13003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.159+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 0x7fe13003a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe134006fd0 tx=0x7fe134006e40 comp rx=0 tx=0).stop 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.159+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 msgr2=0x7fe144197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.159+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe140005b40 tx=0x7fe140004740 comp rx=0 tx=0).stop 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 shutdown_connections 2024-09-16T00:41:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe130038490 0x7fe13003a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 --2- 172.21.15.53:0/768346356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe144100970 0x7fe144197170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:41:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 >> 172.21.15.53:0/768346356 conn(0x7fe1440fa2b0 msgr2=0x7fe1440fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:41:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 shutdown_connections 2024-09-16T00:41:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:41:57.160+0000 7fe14bfe1700 1 -- 172.21.15.53:0/768346356 wait complete. 2024-09-16T00:41:58.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:57 smithi053 ceph-mon[27950]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:41:58.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:57 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:58.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T00:41:58.581 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: Added host smithi152 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:41:59.293 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:41:59 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/2994954613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 msgr2=0x7ffb54101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/2994954613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54101850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009910 tx=0x7ffb50009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/2994954613 shutdown_connections 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/2994954613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54101850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/2994954613 >> 172.21.15.53:0/2994954613 conn(0x7ffb540f9a50 msgr2=0x7ffb540fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/2994954613 shutdown_connections 2024-09-16T00:42:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.257+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/2994954613 wait complete. 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb5bc9e700 1 Processor -- start 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb5bc9e700 1 -- start start 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb5bc9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb5bc9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb541954a0 con 0x7ffb54101440 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb59a3a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb59a3a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52896/0 (socket says 172.21.15.53:52896) 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb59a3a700 1 -- 172.21.15.53:0/7961816 learned_addr learned my addr 172.21.15.53:0/7961816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb59a3a700 1 -- 172.21.15.53:0/7961816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500095f0 con 0x7ffb54101440 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.258+0000 7ffb59a3a700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005b40 tx=0x7ffb50004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.259+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb5001d070 con 0x7ffb54101440 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.259+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb5000be10 con 0x7ffb54101440 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.259+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb541956a0 con 0x7ffb54101440 2024-09-16T00:42:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.259+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb5000f460 con 0x7ffb54101440 2024-09-16T00:42:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.259+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54195b40 con 0x7ffb54101440 2024-09-16T00:42:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5418eb00 con 0x7ffb54101440 2024-09-16T00:42:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ffb500227e0 con 0x7ffb54101440 2024-09-16T00:42:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb4affd700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 0x7ffb4003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ffb5004c390 con 0x7ffb54101440 2024-09-16T00:42:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb59239700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 0x7ffb4003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.260+0000 7ffb59239700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 0x7ffb4003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.265+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffb5002bba0 con 0x7ffb54101440 2024-09-16T00:42:00.308 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:00 smithi053 ceph-mon[27950]: Deploying daemon alertmanager.smithi053 on smithi053 2024-09-16T00:42:00.308 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:00 smithi053 ceph-mon[27950]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:00.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.475+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb54061190 con 0x7ffb40038490 2024-09-16T00:42:00.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.476+0000 7ffb4affd700 1 -- 172.21.15.53:0/7961816 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7ffb54061190 con 0x7ffb40038490 2024-09-16T00:42:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:42:00.477 INFO:teuthology.orchestra.run.smithi053.stdout:[{"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2024-09-16T00:42:00.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 msgr2=0x7ffb4003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:00.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 0x7ffb4003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:00.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 msgr2=0x7ffb54194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:00.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005b40 tx=0x7ffb50004740 comp rx=0 tx=0).stop 2024-09-16T00:42:00.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 shutdown_connections 2024-09-16T00:42:00.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffb40038490 0x7ffb4003a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:00.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 --2- 172.21.15.53:0/7961816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb54101440 0x7ffb54194f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:00.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.478+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 >> 172.21.15.53:0/7961816 conn(0x7ffb540f9a50 msgr2=0x7ffb540fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:00.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.479+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 shutdown_connections 2024-09-16T00:42:00.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:00.479+0000 7ffb5bc9e700 1 -- 172.21.15.53:0/7961816 wait complete. 2024-09-16T00:42:01.474 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T00:42:01.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T00:42:01.700 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:42:02.060 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:01 smithi053 ceph-mon[27950]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:42:02.061 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:01 smithi053 ceph-mon[27950]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:04.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:04 smithi053 ceph-mon[27950]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:04.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:04 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:04.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 -- 172.21.15.53:0/87803713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 msgr2=0x7f5d78100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:04.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 --2- 172.21.15.53:0/87803713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78100230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b0a0 tx=0x7f5d6800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:42:04.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 -- 172.21.15.53:0/87803713 shutdown_connections 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 --2- 172.21.15.53:0/87803713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78100230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 -- 172.21.15.53:0/87803713 >> 172.21.15.53:0/87803713 conn(0x7f5d780fb3d0 msgr2=0x7f5d780fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 -- 172.21.15.53:0/87803713 shutdown_connections 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.706+0000 7f5d7d504700 1 -- 172.21.15.53:0/87803713 wait complete. 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d7d504700 1 Processor -- start 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d7d504700 1 -- start start 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d7d504700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d7d504700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781954b0 con 0x7f5d780ffe20 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49930/0 (socket says 172.21.15.53:49930) 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.707+0000 7f5d76ffd700 1 -- 172.21.15.53:0/164870342 learned_addr learned my addr 172.21.15.53:0/164870342 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:42:04.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d76ffd700 1 -- 172.21.15.53:0/164870342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009d00 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d76ffd700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009fd0 tx=0x7f5d6800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d6800e040 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d6800bdc0 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d781956b0 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d6801da40 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.708+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d78195ad0 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.709+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7818ea80 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.709+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5d6801dc30 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.709+0000 7f5d74ff9700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 0x7f5d6403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.709+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f5d6804c780 con 0x7f5d780ffe20 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.709+0000 7f5d6e7fc700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 0x7f5d6403a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:04.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.710+0000 7f5d6e7fc700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 0x7f5d6403a9e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:04.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.714+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5d6801a820 con 0x7f5d780ffe20 2024-09-16T00:42:04.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:04.923+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5d78062380 con 0x7f5d780ffe20 2024-09-16T00:42:05.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.048+0000 7f5d74ff9700 1 -- 172.21.15.53:0/164870342 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5d6801a820 con 0x7f5d780ffe20 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 msgr2=0x7f5d6403a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 0x7f5d6403a9e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 msgr2=0x7f5d78194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009fd0 tx=0x7f5d6800bb10 comp rx=0 tx=0).stop 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 shutdown_connections 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5d64038530 0x7f5d6403a9e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 --2- 172.21.15.53:0/164870342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d780ffe20 0x7f5d78194f70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 >> 172.21.15.53:0/164870342 conn(0x7f5d780fb3d0 msgr2=0x7f5d780fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 shutdown_connections 2024-09-16T00:42:05.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:42:05.050+0000 7f5d7d504700 1 -- 172.21.15.53:0/164870342 wait complete. 2024-09-16T00:42:05.052 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-16T00:42:05.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:05 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/164870342' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T00:42:06.249 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:06 smithi053 ceph-mon[27950]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:06.249 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:06 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/164870342' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T00:42:06.249 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:06 smithi053 ceph-mon[27950]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T00:42:06.277 INFO:tasks.cephadm:Adding mon.smithi053 on smithi053 2024-09-16T00:42:06.277 INFO:tasks.cephadm:Adding mon.smithi152 on smithi152 2024-09-16T00:42:06.278 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi053:172.21.15.53=smithi053;smithi152:172.21.15.152=smithi152' 2024-09-16T00:42:06.536 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:06.580 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:08.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.205+0000 7fefee8f6700 1 -- 172.21.15.152:0/3177836191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 msgr2=0x7fefe8100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:08.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.205+0000 7fefee8f6700 1 --2- 172.21.15.152:0/3177836191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8100740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009910 tx=0x7fefd8009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:08.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 -- 172.21.15.152:0/3177836191 shutdown_connections 2024-09-16T00:42:08.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 --2- 172.21.15.152:0/3177836191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8100740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:08.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 -- 172.21.15.152:0/3177836191 >> 172.21.15.152:0/3177836191 conn(0x7fefe80f9af0 msgr2=0x7fefe80fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:08.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 -- 172.21.15.152:0/3177836191 shutdown_connections 2024-09-16T00:42:08.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 -- 172.21.15.152:0/3177836191 wait complete. 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 Processor -- start 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.206+0000 7fefee8f6700 1 -- start start 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefee8f6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefee8f6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8194410 con 0x7fefe8100330 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefe7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:08.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefe7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:46096/0 (socket says 172.21.15.152:46096) 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefe7fff700 1 -- 172.21.15.152:0/355070604 learned_addr learned my addr 172.21.15.152:0/355070604 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefe7fff700 1 -- 172.21.15.152:0/355070604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80095f0 con 0x7fefe8100330 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.207+0000 7fefe7fff700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005b40 tx=0x7fefd8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.208+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefd801d070 con 0x7fefe8100330 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.208+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe8194610 con 0x7fefe8100330 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.208+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefd800be10 con 0x7fefe8100330 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.208+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefd800f460 con 0x7fefe8100330 2024-09-16T00:42:08.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.208+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe8194ab0 con 0x7fefe8100330 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.209+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe818d980 con 0x7fefe8100330 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.209+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fefd80227e0 con 0x7fefe8100330 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.209+0000 7fefe57fa700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 0x7fefd403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.209+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fefd804c380 con 0x7fefe8100330 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.209+0000 7fefe77fe700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 0x7fefd403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.210+0000 7fefe77fe700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 0x7fefd403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:08.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.218+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fefd802bba0 con 0x7fefe8100330 2024-09-16T00:42:08.277 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:08 smithi053 ceph-mon[27950]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:08.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.416+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi053:172.21.15.53=smithi053;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7fefe8061300 con 0x7fefd4038490 2024-09-16T00:42:08.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.421+0000 7fefe57fa700 1 -- 172.21.15.152:0/355070604 <== mgr.14164 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fefe8061300 con 0x7fefd4038490 2024-09-16T00:42:08.422 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mon update... 2024-09-16T00:42:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 msgr2=0x7fefd403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 0x7fefd403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:08.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 msgr2=0x7fefe8193ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005b40 tx=0x7fefd8004740 comp rx=0 tx=0).stop 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 shutdown_connections 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fefd4038490 0x7fefd403a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 --2- 172.21.15.152:0/355070604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefe8100330 0x7fefe8193ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 >> 172.21.15.152:0/355070604 conn(0x7fefe80f9af0 msgr2=0x7fefe80fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 shutdown_connections 2024-09-16T00:42:08.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:08.424+0000 7fefee8f6700 1 -- 172.21.15.152:0/355070604 wait complete. 2024-09-16T00:42:08.985 DEBUG:teuthology.orchestra.run.smithi152:mon.smithi152> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service 2024-09-16T00:42:08.988 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:08.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:09.207 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:09.262 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:09.773 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi053:172.21.15.53=smithi053;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:42:09.773 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: Saving service mon spec with placement smithi053:172.21.15.53=smithi053;smithi152:172.21.15.152=smithi152;count:2 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T00:42:09.774 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:09 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:10.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:10 smithi053 ceph-mon[27950]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-16T00:42:10.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:10 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T00:42:10.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:10 smithi053 ceph-mon[27950]: Deploying daemon grafana.smithi053 on smithi053 2024-09-16T00:42:10.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.702+0000 7fde733f0700 1 -- 172.21.15.152:0/1132229436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 msgr2=0x7fde6c0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:10.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.702+0000 7fde733f0700 1 --2- 172.21.15.152:0/1132229436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c0fe4f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00b0a0 tx=0x7fde5c00b3b0 comp rx=0 tx=0).stop 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.702+0000 7fde733f0700 1 -- 172.21.15.152:0/1132229436 shutdown_connections 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.702+0000 7fde733f0700 1 --2- 172.21.15.152:0/1132229436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c0fe4f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.702+0000 7fde733f0700 1 -- 172.21.15.152:0/1132229436 >> 172.21.15.152:0/1132229436 conn(0x7fde6c0f9af0 msgr2=0x7fde6c0fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 -- 172.21.15.152:0/1132229436 shutdown_connections 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 -- 172.21.15.152:0/1132229436 wait complete. 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 Processor -- start 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 -- start start 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:10.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.703+0000 7fde733f0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c19bb00 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde7118c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde7118c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:46116/0 (socket says 172.21.15.152:46116) 2024-09-16T00:42:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde7118c700 1 -- 172.21.15.152:0/545136203 learned_addr learned my addr 172.21.15.152:0/545136203 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde7118c700 1 -- 172.21.15.152:0/545136203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009d00 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde7118c700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009fd0 tx=0x7fde5c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde5c00e040 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde5c00bdc0 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6c19bd00 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde5c01da40 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.704+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6c19c120 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.705+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6c195240 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.705+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fde5c01d480 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.705+0000 7fde6a7fc700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 0x7fde5403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.705+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fde5c04c890 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.706+0000 7fde7098b700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 0x7fde5403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:10.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.706+0000 7fde7098b700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 0x7fde5403a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde60006fd0 tx=0x7fde60006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.711+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fde5c01c9b0 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.975+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde6c02cc30 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.976+0000 7fde6a7fc700 1 -- 172.21.15.152:0/545136203 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fde5c01c3e0 con 0x7fde6c0fe0e0 2024-09-16T00:42:10.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:10.976 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 msgr2=0x7fde5403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 0x7fde5403a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fde60006fd0 tx=0x7fde60006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 msgr2=0x7fde6c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009fd0 tx=0x7fde5c00bb10 comp rx=0 tx=0).stop 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 shutdown_connections 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fde540384e0 0x7fde5403a990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 --2- 172.21.15.152:0/545136203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde6c0fe0e0 0x7fde6c19b5c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 >> 172.21.15.152:0/545136203 conn(0x7fde6c0f9af0 msgr2=0x7fde6c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 shutdown_connections 2024-09-16T00:42:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:10.978+0000 7fde733f0700 1 -- 172.21.15.152:0/545136203 wait complete. 2024-09-16T00:42:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:12.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:11 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/545136203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:12.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:11 smithi053 ceph-mon[27950]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:12.576 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:12.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:12.772 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:12.815 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:14.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.271+0000 7f06c40f1700 1 -- 172.21.15.152:0/1943879172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 msgr2=0x7f06bc100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:14.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.271+0000 7f06c40f1700 1 --2- 172.21.15.152:0/1943879172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc100280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009910 tx=0x7f06b8009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 -- 172.21.15.152:0/1943879172 shutdown_connections 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 --2- 172.21.15.152:0/1943879172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc100280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 -- 172.21.15.152:0/1943879172 >> 172.21.15.152:0/1943879172 conn(0x7f06bc0fb470 msgr2=0x7f06bc0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 -- 172.21.15.152:0/1943879172 shutdown_connections 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 -- 172.21.15.152:0/1943879172 wait complete. 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 Processor -- start 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.272+0000 7f06c40f1700 1 -- start start 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c40f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c40f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc1954e0 con 0x7f06bc0ffe70 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c1e8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c1e8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:60112/0 (socket says 172.21.15.152:60112) 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c1e8d700 1 -- 172.21.15.152:0/2714334408 learned_addr learned my addr 172.21.15.152:0/2714334408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c1e8d700 1 -- 172.21.15.152:0/2714334408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80095f0 con 0x7f06bc0ffe70 2024-09-16T00:42:14.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c1e8d700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06b8005b40 tx=0x7f06b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b801d070 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06b800be10 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.273+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc1956e0 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.274+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06b800f460 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.274+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc195b80 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.274+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f06b800f6d0 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.275+0000 7f06b2ffd700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 0x7f06a803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.275+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f06b804c4a0 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.275+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc18ea70 con 0x7f06bc0ffe70 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.275+0000 7f06c168c700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 0x7f06a803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:14.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.275+0000 7f06c168c700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 0x7f06a803a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06ac006fd0 tx=0x7f06ac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:14.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.280+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f06b8027030 con 0x7f06bc0ffe70 2024-09-16T00:42:14.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:14 smithi053 ceph-mon[27950]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:14.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:14 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:14.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.546+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f06bc02cc30 con 0x7f06bc0ffe70 2024-09-16T00:42:14.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.547+0000 7f06b2ffd700 1 -- 172.21.15.152:0/2714334408 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f06b802c440 con 0x7f06bc0ffe70 2024-09-16T00:42:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:14.547 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:14.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 msgr2=0x7f06a803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:14.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 0x7f06a803a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06ac006fd0 tx=0x7f06ac006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:14.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 msgr2=0x7f06bc194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:14.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06b8005b40 tx=0x7f06b8004740 comp rx=0 tx=0).stop 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 shutdown_connections 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f06a8038490 0x7f06a803a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 --2- 172.21.15.152:0/2714334408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06bc0ffe70 0x7f06bc194fa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 >> 172.21.15.152:0/2714334408 conn(0x7f06bc0fb470 msgr2=0x7f06bc0fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 shutdown_connections 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:14.549+0000 7f06c40f1700 1 -- 172.21.15.152:0/2714334408 wait complete. 2024-09-16T00:42:14.550 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:15.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:15 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/2714334408' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:16.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:16.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:16.279 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:16.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:16 smithi053 ceph-mon[27950]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:16.323 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 -- 172.21.15.152:0/2028503612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 msgr2=0x7f62c40ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 --2- 172.21.15.152:0/2028503612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c40ff130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009910 tx=0x7f62b8009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 -- 172.21.15.152:0/2028503612 shutdown_connections 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 --2- 172.21.15.152:0/2028503612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c40ff130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 -- 172.21.15.152:0/2028503612 >> 172.21.15.152:0/2028503612 conn(0x7f62c40fa2b0 msgr2=0x7f62c40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 -- 172.21.15.152:0/2028503612 shutdown_connections 2024-09-16T00:42:17.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.686+0000 7f62c94a6700 1 -- 172.21.15.152:0/2028503612 wait complete. 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.687+0000 7f62c94a6700 1 Processor -- start 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.687+0000 7f62c94a6700 1 -- start start 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.687+0000 7f62c94a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.687+0000 7f62c94a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4195500 con 0x7f62c40fed20 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:60124/0 (socket says 172.21.15.152:60124) 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c2ffd700 1 -- 172.21.15.152:0/1638520258 learned_addr learned my addr 172.21.15.152:0/1638520258 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:17.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c2ffd700 1 -- 172.21.15.152:0/1638520258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80095f0 con 0x7f62c40fed20 2024-09-16T00:42:17.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c2ffd700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62b8005b40 tx=0x7f62b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:17.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b801d070 con 0x7f62c40fed20 2024-09-16T00:42:17.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c4195700 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62b800be10 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62b800f460 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.688+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4195ba0 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.689+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f62b800b960 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.689+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c418ea10 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.689+0000 7f62abfff700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 0x7f62ac03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.689+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f62b804c410 con 0x7f62c40fed20 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.690+0000 7f62c27fc700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 0x7f62ac03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:17.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.690+0000 7f62c27fc700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 0x7f62ac03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:17.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.694+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f62b802a360 con 0x7f62c40fed20 2024-09-16T00:42:17.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.959+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f62c402cc30 con 0x7f62c40fed20 2024-09-16T00:42:17.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.960+0000 7f62abfff700 1 -- 172.21.15.152:0/1638520258 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f62b8027030 con 0x7f62c40fed20 2024-09-16T00:42:17.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:17.961 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 msgr2=0x7f62ac03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 0x7f62ac03a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:17.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 msgr2=0x7f62c4194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62b8005b40 tx=0x7f62b8004740 comp rx=0 tx=0).stop 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 shutdown_connections 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62ac038490 0x7f62ac03a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 --2- 172.21.15.152:0/1638520258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62c40fed20 0x7f62c4194fc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 >> 172.21.15.152:0/1638520258 conn(0x7f62c40fa2b0 msgr2=0x7f62c40687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 shutdown_connections 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:17.962+0000 7f62c94a6700 1 -- 172.21.15.152:0/1638520258 wait complete. 2024-09-16T00:42:17.963 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:18.225 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:18 smithi053 ceph-mon[27950]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:18.225 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:18 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1638520258' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:19.587 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:19.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:19.788 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:19.831 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:20.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:20 smithi053 ceph-mon[27950]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 -- 172.21.15.152:0/1374709083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 msgr2=0x7ff448100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 --2- 172.21.15.152:0/1374709083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448100230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff438009910 tx=0x7ff438009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 -- 172.21.15.152:0/1374709083 shutdown_connections 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 --2- 172.21.15.152:0/1374709083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448100230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 -- 172.21.15.152:0/1374709083 >> 172.21.15.152:0/1374709083 conn(0x7ff4480fb3d0 msgr2=0x7ff4480fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 -- 172.21.15.152:0/1374709083 shutdown_connections 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.090+0000 7ff45020f700 1 -- 172.21.15.152:0/1374709083 wait complete. 2024-09-16T00:42:21.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff45020f700 1 Processor -- start 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff45020f700 1 -- start start 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff45020f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff45020f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4481954c0 con 0x7ff4480ffe20 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff44dfab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff44dfab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:60132/0 (socket says 172.21.15.152:60132) 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.091+0000 7ff44dfab700 1 -- 172.21.15.152:0/538103234 learned_addr learned my addr 172.21.15.152:0/538103234 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff44dfab700 1 -- 172.21.15.152:0/538103234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380095f0 con 0x7ff4480ffe20 2024-09-16T00:42:21.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff44dfab700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff438005b40 tx=0x7ff438004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:21.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff43801d070 con 0x7ff4480ffe20 2024-09-16T00:42:21.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff43800be10 con 0x7ff4480ffe20 2024-09-16T00:42:21.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4481956c0 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff43800f460 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.092+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448195b60 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.093+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff43800b960 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.093+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44818ea80 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.093+0000 7ff43effd700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 0x7ff43403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.093+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff43804c220 con 0x7ff4480ffe20 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.093+0000 7ff44d7aa700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 0x7ff43403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.094+0000 7ff44d7aa700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 0x7ff43403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff444006fd0 tx=0x7ff444006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:21.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.098+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff43802bba0 con 0x7ff4480ffe20 2024-09-16T00:42:21.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.362+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff44802cc30 con 0x7ff4480ffe20 2024-09-16T00:42:21.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.363+0000 7ff43effd700 1 -- 172.21.15.152:0/538103234 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff438027070 con 0x7ff4480ffe20 2024-09-16T00:42:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:21.364 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 msgr2=0x7ff43403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 0x7ff43403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff444006fd0 tx=0x7ff444006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 msgr2=0x7ff448194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff438005b40 tx=0x7ff438004740 comp rx=0 tx=0).stop 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 shutdown_connections 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ff434038490 0x7ff43403a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 --2- 172.21.15.152:0/538103234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480ffe20 0x7ff448194f80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 >> 172.21.15.152:0/538103234 conn(0x7ff4480fb3d0 msgr2=0x7ff4480fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 shutdown_connections 2024-09-16T00:42:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:21.365+0000 7ff45020f700 1 -- 172.21.15.152:0/538103234 wait complete. 2024-09-16T00:42:21.367 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:21.757 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:21 smithi053 ceph-mon[27950]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:21.757 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:21 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/538103234' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:22.947 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:22.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:23.143 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:23.186 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:22 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:24.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:24 smithi053 ceph-mon[27950]: Deploying daemon prometheus.smithi053 on smithi053 2024-09-16T00:42:24.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:24 smithi053 ceph-mon[27950]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:24.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:24 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/4168873240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 msgr2=0x7f5e840ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/4168873240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e840ff0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009910 tx=0x7f5e80009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/4168873240 shutdown_connections 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/4168873240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e840ff0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/4168873240 >> 172.21.15.152:0/4168873240 conn(0x7f5e840fa280 msgr2=0x7f5e840fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/4168873240 shutdown_connections 2024-09-16T00:42:24.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.562+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/4168873240 wait complete. 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e8c0bf700 1 Processor -- start 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e8c0bf700 1 -- start start 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e8c0bf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e8c0bf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e84197c90 con 0x7f5e840fecb0 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e89e5b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:24.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e89e5b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:48564/0 (socket says 172.21.15.152:48564) 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.563+0000 7f5e89e5b700 1 -- 172.21.15.152:0/834927769 learned_addr learned my addr 172.21.15.152:0/834927769 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e89e5b700 1 -- 172.21.15.152:0/834927769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800095f0 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e89e5b700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005950 tx=0x7f5e80009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e8001d070 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e84197dd0 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e8000be10 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e8000f460 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.564+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e84198210 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.565+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5e800227c0 con 0x7f5e840fecb0 2024-09-16T00:42:24.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.565+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840623f0 con 0x7f5e840fecb0 2024-09-16T00:42:24.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.565+0000 7f5e7affd700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 0x7f5e7003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:24.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.565+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f5e8004c4f0 con 0x7f5e840fecb0 2024-09-16T00:42:24.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.565+0000 7f5e8965a700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 0x7f5e7003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:24.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.566+0000 7f5e8965a700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 0x7f5e7003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:24.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.571+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5e840623f0 con 0x7f5e840fecb0 2024-09-16T00:42:24.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.837+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5e8418d990 con 0x7f5e840fecb0 2024-09-16T00:42:24.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.837+0000 7f5e7affd700 1 -- 172.21.15.152:0/834927769 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5e80027070 con 0x7f5e840fecb0 2024-09-16T00:42:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:24.838 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 msgr2=0x7f5e7003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 0x7f5e7003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e74006fd0 tx=0x7f5e74006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 msgr2=0x7f5e84068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005950 tx=0x7f5e80009e60 comp rx=0 tx=0).stop 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 shutdown_connections 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e70038490 0x7f5e7003a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 --2- 172.21.15.152:0/834927769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e840fecb0 0x7f5e84068ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 >> 172.21.15.152:0/834927769 conn(0x7f5e840fa280 msgr2=0x7f5e840faee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.839+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 shutdown_connections 2024-09-16T00:42:24.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:24.840+0000 7f5e8c0bf700 1 -- 172.21.15.152:0/834927769 wait complete. 2024-09-16T00:42:24.841 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:25.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:25 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/834927769' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:26.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:26 smithi053 ceph-mon[27950]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:26.404 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:26.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:26.600 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:26.644 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:28.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 -- 172.21.15.152:0/1551303491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 msgr2=0x7f80740ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1551303491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f80740ff130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8068009910 tx=0x7f8068009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 -- 172.21.15.152:0/1551303491 shutdown_connections 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1551303491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f80740ff130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 -- 172.21.15.152:0/1551303491 >> 172.21.15.152:0/1551303491 conn(0x7f80740fa2b0 msgr2=0x7f80740fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 -- 172.21.15.152:0/1551303491 shutdown_connections 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.034+0000 7f8078f6e700 1 -- 172.21.15.152:0/1551303491 wait complete. 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f8078f6e700 1 Processor -- start 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f8078f6e700 1 -- start start 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f8078f6e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f8078f6e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074197cd0 con 0x7f80740fed20 2024-09-16T00:42:28.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f807259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f807259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:48580/0 (socket says 172.21.15.152:48580) 2024-09-16T00:42:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f807259c700 1 -- 172.21.15.152:0/1300737077 learned_addr learned my addr 172.21.15.152:0/1300737077 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:28.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.035+0000 7f807259c700 1 -- 172.21.15.152:0/1300737077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680095f0 con 0x7f80740fed20 2024-09-16T00:42:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f807259c700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8068005950 tx=0x7f8068009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806801d070 con 0x7f80740fed20 2024-09-16T00:42:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8074197e10 con 0x7f80740fed20 2024-09-16T00:42:28.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f806800be10 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806800f460 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.036+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80741982b0 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.037+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f80680227c0 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.037+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80740623f0 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.037+0000 7f80637fe700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 0x7f805c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.037+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f806804c490 con 0x7f80740fed20 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.037+0000 7f8071d9b700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 0x7f805c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:28.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.038+0000 7f8071d9b700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 0x7f805c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8064006fd0 tx=0x7f8064006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:28.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.042+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f80740623f0 con 0x7f80740fed20 2024-09-16T00:42:28.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.307+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f807418da00 con 0x7f80740fed20 2024-09-16T00:42:28.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.308+0000 7f80637fe700 1 -- 172.21.15.152:0/1300737077 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8068027070 con 0x7f80740fed20 2024-09-16T00:42:28.308 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:28.309 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:28.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 msgr2=0x7f805c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:28.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 0x7f805c03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8064006fd0 tx=0x7f8064006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:28.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 msgr2=0x7f8074068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8068005950 tx=0x7f8068009e60 comp rx=0 tx=0).stop 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 shutdown_connections 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f805c038490 0x7f805c03a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 --2- 172.21.15.152:0/1300737077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80740fed20 0x7f8074068b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 >> 172.21.15.152:0/1300737077 conn(0x7f80740fa2b0 msgr2=0x7f80740faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 shutdown_connections 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:28.310+0000 7f8078f6e700 1 -- 172.21.15.152:0/1300737077 wait complete. 2024-09-16T00:42:28.311 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:28.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:28 smithi053 ceph-mon[27950]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:29.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:29 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1300737077' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:29.867 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:29.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:30.065 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:30.110 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:30.113 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:30 smithi053 ceph-mon[27950]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 -- 172.21.15.152:0/2956203833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 msgr2=0x7f68f8100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 --2- 172.21.15.152:0/2956203833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8100280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68e800b0a0 tx=0x7f68e800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 -- 172.21.15.152:0/2956203833 shutdown_connections 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 --2- 172.21.15.152:0/2956203833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8100280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 -- 172.21.15.152:0/2956203833 >> 172.21.15.152:0/2956203833 conn(0x7f68f80fb470 msgr2=0x7f68f80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 -- 172.21.15.152:0/2956203833 shutdown_connections 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.579+0000 7f68fcfda700 1 -- 172.21.15.152:0/2956203833 wait complete. 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68fcfda700 1 Processor -- start 2024-09-16T00:42:31.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68fcfda700 1 -- start start 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68fcfda700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68fcfda700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81954e0 con 0x7f68f80ffe70 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68f659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68f659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:48602/0 (socket says 172.21.15.152:48602) 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68f659c700 1 -- 172.21.15.152:0/374790166 learned_addr learned my addr 172.21.15.152:0/374790166 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:31.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68f659c700 1 -- 172.21.15.152:0/374790166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009d00 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68f659c700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fd0 tx=0x7f68e800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.580+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68e800e040 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f68e800bdc0 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f81956e0 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68e801da40 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8195b00 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f68e801dc80 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.581+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f818ea70 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.582+0000 7f68ef7fe700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 0x7f68e403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.582+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f68e804c840 con 0x7f68f80ffe70 2024-09-16T00:42:31.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.582+0000 7f68f5d9b700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 0x7f68e403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:31.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.582+0000 7f68f5d9b700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 0x7f68e403a990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68e0006fd0 tx=0x7f68e0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:31.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.587+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f68e801c5c0 con 0x7f68f80ffe70 2024-09-16T00:42:31.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.852+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f68f8062380 con 0x7f68f80ffe70 2024-09-16T00:42:31.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.852+0000 7f68ef7fe700 1 -- 172.21.15.152:0/374790166 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f68e801c3e0 con 0x7f68f80ffe70 2024-09-16T00:42:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:31.853 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:31.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 msgr2=0x7f68e403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 0x7f68e403a990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68e0006fd0 tx=0x7f68e0006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 msgr2=0x7f68f8194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fd0 tx=0x7f68e800bb10 comp rx=0 tx=0).stop 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 shutdown_connections 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f68e40384e0 0x7f68e403a990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 --2- 172.21.15.152:0/374790166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ffe70 0x7f68f8194fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 >> 172.21.15.152:0/374790166 conn(0x7f68f80fb470 msgr2=0x7f68f80fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 shutdown_connections 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:31.854+0000 7f68fcfda700 1 -- 172.21.15.152:0/374790166 wait complete. 2024-09-16T00:42:31.855 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:32.042 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:31 smithi053 ceph-mon[27950]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:32 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/374790166' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:32 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:32 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:32 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:32 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-16T00:42:33.438 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:33.438 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:33.628 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:33.671 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:34.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:34 smithi053 ceph-mon[27950]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:42:34.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:34 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:34.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:34 smithi053 ceph-mon[27950]: from='mgr.14164 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-16T00:42:34.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:34 smithi053 ceph-mon[27950]: mgrmap e14: smithi053.cjiiek(active, since 60s) 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 -- 172.21.15.152:0/1623350800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 msgr2=0x7fde0c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 --2- 172.21.15.152:0/1623350800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c100230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009910 tx=0x7fddfc009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 -- 172.21.15.152:0/1623350800 shutdown_connections 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 --2- 172.21.15.152:0/1623350800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c100230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 -- 172.21.15.152:0/1623350800 >> 172.21.15.152:0/1623350800 conn(0x7fde0c0fb3d0 msgr2=0x7fde0c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:35.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 -- 172.21.15.152:0/1623350800 shutdown_connections 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.031+0000 7fde12be0700 1 -- 172.21.15.152:0/1623350800 wait complete. 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde12be0700 1 Processor -- start 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde12be0700 1 -- start start 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde12be0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde12be0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c075030 con 0x7fde0c0ffe20 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde1097c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde1097c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:42818/0 (socket says 172.21.15.152:42818) 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde1097c700 1 -- 172.21.15.152:0/1305870875 learned_addr learned my addr 172.21.15.152:0/1305870875 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde1097c700 1 -- 172.21.15.152:0/1305870875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc0095f0 con 0x7fde0c0ffe20 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.032+0000 7fde1097c700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005b40 tx=0x7fddfc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.033+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddfc01d070 con 0x7fde0c0ffe20 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.033+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c073140 con 0x7fde0c0ffe20 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.033+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddfc00be10 con 0x7fde0c0ffe20 2024-09-16T00:42:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.033+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddfc00f460 con 0x7fde0c0ffe20 2024-09-16T00:42:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.033+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0735e0 con 0x7fde0c0ffe20 2024-09-16T00:42:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fddfc0227e0 con 0x7fde0c0ffe20 2024-09-16T00:42:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c062380 con 0x7fde0c0ffe20 2024-09-16T00:42:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde09ffb700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 0x7fddf403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fddfc04c320 con 0x7fde0c0ffe20 2024-09-16T00:42:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde0bfff700 1 -- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 msgr2=0x7fddf403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:42:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.034+0000 7fde0bfff700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 0x7fddf403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:42:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.039+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fddfc02b590 con 0x7fde0c0ffe20 2024-09-16T00:42:35.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.235+0000 7fde0bfff700 1 -- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 msgr2=0x7fddf403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:42:35.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.235+0000 7fde0bfff700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 0x7fddf403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:42:35.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.305+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde0c18e460 con 0x7fde0c0ffe20 2024-09-16T00:42:35.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.306+0000 7fde09ffb700 1 -- 172.21.15.152:0/1305870875 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fddfc027030 con 0x7fde0c0ffe20 2024-09-16T00:42:35.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:35.306 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:35.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 msgr2=0x7fddf403a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 0x7fddf403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 msgr2=0x7fde0c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005b40 tx=0x7fddfc004740 comp rx=0 tx=0).stop 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 shutdown_connections 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fddf40384e0 0x7fddf403a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 --2- 172.21.15.152:0/1305870875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0ffe20 0x7fde0c074af0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 >> 172.21.15.152:0/1305870875 conn(0x7fde0c0fb3d0 msgr2=0x7fde0c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 shutdown_connections 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:35.308+0000 7fde12be0700 1 -- 172.21.15.152:0/1305870875 wait complete. 2024-09-16T00:42:35.309 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:35.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:35 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1305870875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:36.927 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:36.927 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:37.166 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.645+0000 7fcb88fe7700 1 -- 172.21.15.152:0/744197130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 msgr2=0x7fcb84100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.645+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/744197130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84100280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009910 tx=0x7fcb78009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 -- 172.21.15.152:0/744197130 shutdown_connections 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/744197130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84100280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 -- 172.21.15.152:0/744197130 >> 172.21.15.152:0/744197130 conn(0x7fcb840fb470 msgr2=0x7fcb840fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 -- 172.21.15.152:0/744197130 shutdown_connections 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 -- 172.21.15.152:0/744197130 wait complete. 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 Processor -- start 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.646+0000 7fcb88fe7700 1 -- start start 2024-09-16T00:42:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb88fe7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb88fe7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb841954e0 con 0x7fcb840ffe70 2024-09-16T00:42:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb8259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb8259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:42836/0 (socket says 172.21.15.152:42836) 2024-09-16T00:42:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb8259c700 1 -- 172.21.15.152:0/1361968083 learned_addr learned my addr 172.21.15.152:0/1361968083 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb8259c700 1 -- 172.21.15.152:0/1361968083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780095f0 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb8259c700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb78005b40 tx=0x7fcb78004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb7801d070 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb7800be10 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb841956e0 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb7800f460 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.647+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb84195b80 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.648+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fcb7800b960 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.648+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8418ea70 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.649+0000 7fcb737fe700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 0x7fcb6c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.649+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fcb7804c410 con 0x7fcb840ffe70 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.649+0000 7fcb81d9b700 1 -- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 msgr2=0x7fcb6c03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:42:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.649+0000 7fcb81d9b700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 0x7fcb6c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:42:38.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.654+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcb7802a360 con 0x7fcb840ffe70 2024-09-16T00:42:38.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.850+0000 7fcb81d9b700 1 -- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 msgr2=0x7fcb6c03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.53:6800/2 2024-09-16T00:42:38.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.850+0000 7fcb81d9b700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 0x7fcb6c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T00:42:38.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.920+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcb8402cc30 con 0x7fcb840ffe70 2024-09-16T00:42:38.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.920+0000 7fcb737fe700 1 -- 172.21.15.152:0/1361968083 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fcb78027070 con 0x7fcb840ffe70 2024-09-16T00:42:38.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:38.921 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 msgr2=0x7fcb6c03a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 0x7fcb6c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 msgr2=0x7fcb84194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb78005b40 tx=0x7fcb78004740 comp rx=0 tx=0).stop 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 shutdown_connections 2024-09-16T00:42:38.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fcb6c0384e0 0x7fcb6c03a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:38.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 --2- 172.21.15.152:0/1361968083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb840ffe70 0x7fcb84194fa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:38.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 >> 172.21.15.152:0/1361968083 conn(0x7fcb840fb470 msgr2=0x7fcb840fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:38.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 shutdown_connections 2024-09-16T00:42:38.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:38.923+0000 7fcb88fe7700 1 -- 172.21.15.152:0/1361968083 wait complete. 2024-09-16T00:42:38.924 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:39.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:38 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1361968083' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:40.482 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: Active manager daemon smithi053.cjiiek restarted 2024-09-16T00:42:40.482 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:42:40.482 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T00:42:40.482 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: mgrmap e15: smithi053.cjiiek(active, starting, since 0.00292318s) 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:42:40.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:40.490 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:40.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:40.686 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:40.731 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:42:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:42:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:42:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:41 smithi053 ceph-mon[27950]: mgrmap e16: smithi053.cjiiek(active, since 1.00643s) 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 -- 172.21.15.152:0/4062354019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 msgr2=0x7f9e781007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/4062354019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e781007b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009910 tx=0x7f9e6c009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 -- 172.21.15.152:0/4062354019 shutdown_connections 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/4062354019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e781007b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 -- 172.21.15.152:0/4062354019 >> 172.21.15.152:0/4062354019 conn(0x7f9e780f9a50 msgr2=0x7f9e780fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 -- 172.21.15.152:0/4062354019 shutdown_connections 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.147+0000 7f9e7d80c700 1 -- 172.21.15.152:0/4062354019 wait complete. 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.148+0000 7f9e7d80c700 1 Processor -- start 2024-09-16T00:42:42.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.148+0000 7f9e7d80c700 1 -- start start 2024-09-16T00:42:42.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.148+0000 7f9e7d80c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:42.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.148+0000 7f9e7d80c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e781943c0 con 0x7f9e781003a0 2024-09-16T00:42:42.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:42.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:42862/0 (socket says 172.21.15.152:42862) 2024-09-16T00:42:42.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e76ffd700 1 -- 172.21.15.152:0/2951419598 learned_addr learned my addr 172.21.15.152:0/2951419598 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:42.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e76ffd700 1 -- 172.21.15.152:0/2951419598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0095f0 con 0x7f9e781003a0 2024-09-16T00:42:42.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e76ffd700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c005b40 tx=0x7f9e6c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:42.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e6c01d070 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e6c00be10 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e6c00f460 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e781945c0 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.149+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e78194a60 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.150+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7818dab0 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.150+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7f9e6c00f6d0 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.151+0000 7f9e7c80a700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 0x7f9e6003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.151+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f9e6c04c350 con 0x7f9e781003a0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.151+0000 7f9e767fc700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 0x7f9e6003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:42.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.151+0000 7f9e767fc700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 0x7f9e6003a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:42.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.155+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e6c02a360 con 0x7f9e781003a0 2024-09-16T00:42:42.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.436+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9e7802cc30 con 0x7f9e781003a0 2024-09-16T00:42:42.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.437+0000 7f9e7c80a700 1 -- 172.21.15.152:0/2951419598 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9e6c027020 con 0x7f9e781003a0 2024-09-16T00:42:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:42.439 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:42.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 msgr2=0x7f9e6003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:42.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 0x7f9e6003a7f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:42.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 msgr2=0x7f9e78193e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c005b40 tx=0x7f9e6c004740 comp rx=0 tx=0).stop 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 shutdown_connections 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9e60038340 0x7f9e6003a7f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 --2- 172.21.15.152:0/2951419598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e781003a0 0x7f9e78193e80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 >> 172.21.15.152:0/2951419598 conn(0x7f9e780f9a50 msgr2=0x7f9e780fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 shutdown_connections 2024-09-16T00:42:42.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:42.440+0000 7f9e7d80c700 1 -- 172.21.15.152:0/2951419598 wait complete. 2024-09-16T00:42:42.446 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:42.732 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:42 smithi053 ceph-mon[27950]: [16/Sep/2024:00:42:41] ENGINE Bus STARTING 2024-09-16T00:42:42.732 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:42 smithi053 ceph-mon[27950]: [16/Sep/2024:00:42:41] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:42:42.732 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:42 smithi053 ceph-mon[27950]: [16/Sep/2024:00:42:41] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:42:42.733 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:42 smithi053 ceph-mon[27950]: [16/Sep/2024:00:42:41] ENGINE Bus STARTED 2024-09-16T00:42:42.733 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:43 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/2951419598' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:43 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:43 smithi053 ceph-mon[27950]: mgrmap e17: smithi053.cjiiek(active, since 2s) 2024-09-16T00:42:44.018 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:44.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:44.546 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:44.603 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T00:42:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:42:46.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 -- 172.21.15.152:0/2710326564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 msgr2=0x7fed60100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2710326564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed60100740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009910 tx=0x7fed5c009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 -- 172.21.15.152:0/2710326564 shutdown_connections 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2710326564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed60100740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 -- 172.21.15.152:0/2710326564 >> 172.21.15.152:0/2710326564 conn(0x7fed600f9a50 msgr2=0x7fed600fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 -- 172.21.15.152:0/2710326564 shutdown_connections 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.657+0000 7fed67a9e700 1 -- 172.21.15.152:0/2710326564 wait complete. 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed67a9e700 1 Processor -- start 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed67a9e700 1 -- start start 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed67a9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed67a9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600fbf20 con 0x7fed60100330 2024-09-16T00:42:46.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed6583a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed6583a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:41024/0 (socket says 172.21.15.152:41024) 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed6583a700 1 -- 172.21.15.152:0/2386596111 learned_addr learned my addr 172.21.15.152:0/2386596111 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.658+0000 7fed6583a700 1 -- 172.21.15.152:0/2386596111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0095f0 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed6583a700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed5c005950 tx=0x7fed5c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed5c01d070 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed5c00be10 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600fa030 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed5c00f460 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.659+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600fa4d0 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.660+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60062380 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.660+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fed5c00f690 con 0x7fed60100330 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.660+0000 7fed56ffd700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 0x7fed4c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:46.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.660+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fed5c04c7c0 con 0x7fed60100330 2024-09-16T00:42:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.660+0000 7fed65039700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 0x7fed4c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.661+0000 7fed65039700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 0x7fed4c03aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed50006fd0 tx=0x7fed50006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:46.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.665+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fed5c02a360 con 0x7fed60100330 2024-09-16T00:42:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.948+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fed6018e400 con 0x7fed60100330 2024-09-16T00:42:46.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.949+0000 7fed56ffd700 1 -- 172.21.15.152:0/2386596111 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fed5c027070 con 0x7fed60100330 2024-09-16T00:42:46.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:46.950 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:46.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 msgr2=0x7fed4c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:46.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 0x7fed4c03aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed50006fd0 tx=0x7fed50006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:46.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 msgr2=0x7fed600fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed5c005950 tx=0x7fed5c009e60 comp rx=0 tx=0).stop 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 shutdown_connections 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fed4c038580 0x7fed4c03aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 --2- 172.21.15.152:0/2386596111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed60100330 0x7fed600fb9e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 >> 172.21.15.152:0/2386596111 conn(0x7fed600f9a50 msgr2=0x7fed600fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 shutdown_connections 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:46.951+0000 7fed67a9e700 1 -- 172.21.15.152:0/2386596111 wait complete. 2024-09-16T00:42:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:42:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:42:47.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:42:47.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:42:47.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:42:47.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:46 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:42:48.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:42:48.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:42:48.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: Deploying daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:42:48.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:47 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/2386596111' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:48.552 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:48.552 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:48.869 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:42:50.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 -- 172.21.15.152:0/3562375902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 msgr2=0x7f6eac0ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:50.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/3562375902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac0ff060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009910 tx=0x7f6e9c009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 -- 172.21.15.152:0/3562375902 shutdown_connections 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/3562375902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac0ff060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 -- 172.21.15.152:0/3562375902 >> 172.21.15.152:0/3562375902 conn(0x7f6eac075750 msgr2=0x7f6eac075b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 -- 172.21.15.152:0/3562375902 shutdown_connections 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.973+0000 7f6eb0aed700 1 -- 172.21.15.152:0/3562375902 wait complete. 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.974+0000 7f6eb0aed700 1 Processor -- start 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.974+0000 7f6eb0aed700 1 -- start start 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.974+0000 7f6eb0aed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:50.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.974+0000 7f6eb0aed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac195880 con 0x7f6eac0fec90 2024-09-16T00:42:50.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:41038/0 (socket says 172.21.15.152:41038) 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eaa59c700 1 -- 172.21.15.152:0/4174098641 learned_addr learned my addr 172.21.15.152:0/4174098641 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eaa59c700 1 -- 172.21.15.152:0/4174098641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0095f0 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eaa59c700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c005b40 tx=0x7f6e9c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c01d070 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e9c0044d0 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac195a80 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9c003930 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.975+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac195e40 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.976+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f6e9c003bf0 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.976+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac062380 con 0x7f6eac0fec90 2024-09-16T00:42:50.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.976+0000 7f6e9b7fe700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 0x7f6e9403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:50.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.976+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f6e9c04c3c0 con 0x7f6eac0fec90 2024-09-16T00:42:50.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.977+0000 7f6ea9d9b700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 0x7f6e9403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:50.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.977+0000 7f6ea9d9b700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 0x7f6e9403aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0006fd0 tx=0x7f6ea0006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:50.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:50.982+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6e9c02a950 con 0x7f6eac0fec90 2024-09-16T00:42:51.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.270+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6eac106fd0 con 0x7f6eac0fec90 2024-09-16T00:42:51.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.271+0000 7f6e9b7fe700 1 -- 172.21.15.152:0/4174098641 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f6e9c02a360 con 0x7f6eac0fec90 2024-09-16T00:42:51.273 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:51.273 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.273+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 msgr2=0x7f6e9403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.273+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 0x7f6e9403aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0006fd0 tx=0x7f6ea0006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.273+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 msgr2=0x7f6eac195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.273+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c005b40 tx=0x7f6e9c004c80 comp rx=0 tx=0).stop 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.273+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 shutdown_connections 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.274+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6e94038580 0x7f6e9403aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.274+0000 7f6eb0aed700 1 --2- 172.21.15.152:0/4174098641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac0fec90 0x7f6eac195340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.274+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 >> 172.21.15.152:0/4174098641 conn(0x7f6eac075750 msgr2=0x7f6eac1045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.274+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 shutdown_connections 2024-09-16T00:42:51.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:51.274+0000 7f6eb0aed700 1 -- 172.21.15.152:0/4174098641 wait complete. 2024-09-16T00:42:51.276 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:42:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T00:42:51.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:42:51.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: Deploying daemon crash.smithi152 on smithi152 2024-09-16T00:42:51.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:51 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/4174098641' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:53.623 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:53.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:54.014 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:42:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:54 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:54 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:54 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:54 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:54 smithi053 ceph-mon[27950]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.439+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/3371111589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 msgr2=0x7fb5c40ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.439+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/3371111589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c40ff390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009910 tx=0x7fb5b4009c20 comp rx=0 tx=0).stop 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/3371111589 shutdown_connections 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/3371111589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c40ff390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/3371111589 >> 172.21.15.152:0/3371111589 conn(0x7fb5c4074af0 msgr2=0x7fb5c4074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:56.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/3371111589 shutdown_connections 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/3371111589 wait complete. 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 Processor -- start 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.440+0000 7fb5c8b5f700 1 -- start start 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c8b5f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c8b5f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4196800 con 0x7fb5c40fefc0 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:60370/0 (socket says 172.21.15.152:60370) 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c259c700 1 -- 172.21.15.152:0/2325885017 learned_addr learned my addr 172.21.15.152:0/2325885017 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c259c700 1 -- 172.21.15.152:0/2325885017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40095f0 con 0x7fb5c40fefc0 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.441+0000 7fb5c259c700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400b5c0 tx=0x7fb5b4004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:56.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5b401d070 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5b400be10 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c4196a00 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5b4022df0 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c4196e20 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.442+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4107240 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.443+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fb5b400b960 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.443+0000 7fb5bb7fe700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 0x7fb5b003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.443+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fb5b404c580 con 0x7fb5c40fefc0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.443+0000 7fb5c1d9b700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 0x7fb5b003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.443+0000 7fb5c1d9b700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 0x7fb5b003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac006fd0 tx=0x7fb5ac006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:42:56.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.448+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb5b402a360 con 0x7fb5c40fefc0 2024-09-16T00:42:56.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.716+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb5c4062380 con 0x7fb5c40fefc0 2024-09-16T00:42:56.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.717+0000 7fb5bb7fe700 1 -- 172.21.15.152:0/2325885017 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb5b4027030 con 0x7fb5c40fefc0 2024-09-16T00:42:56.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:42:56.718 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:42:56.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 msgr2=0x7fb5b003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 0x7fb5b003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac006fd0 tx=0x7fb5ac006e40 comp rx=0 tx=0).stop 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 msgr2=0x7fb5c41962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400b5c0 tx=0x7fb5b4004cb0 comp rx=0 tx=0).stop 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 shutdown_connections 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb5b0038580 0x7fb5b003aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 --2- 172.21.15.152:0/2325885017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5c40fefc0 0x7fb5c41962c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 >> 172.21.15.152:0/2325885017 conn(0x7fb5c4074af0 msgr2=0x7fb5c41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 shutdown_connections 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:42:56.719+0000 7fb5c8b5f700 1 -- 172.21.15.152:0/2325885017 wait complete. 2024-09-16T00:42:56.720 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:42:56.745 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:56.745 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:42:57.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:57 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/2325885017' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:42:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:58.755 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:42:58.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:42:58.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:42:58 smithi053 ceph-mon[27950]: Deploying daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:42:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:43:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 -- 172.21.15.152:0/1202167468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 msgr2=0x7f9314100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 --2- 172.21.15.152:0/1202167468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314100360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9308009910 tx=0x7f9308009c20 comp rx=0 tx=0).stop 2024-09-16T00:43:00.742 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 -- 172.21.15.152:0/1202167468 shutdown_connections 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 --2- 172.21.15.152:0/1202167468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314100360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 -- 172.21.15.152:0/1202167468 >> 172.21.15.152:0/1202167468 conn(0x7f9314075550 msgr2=0x7f9314075950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 -- 172.21.15.152:0/1202167468 shutdown_connections 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 -- 172.21.15.152:0/1202167468 wait complete. 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.740+0000 7f931b014700 1 Processor -- start 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f931b014700 1 -- start start 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f931b014700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f931b014700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314197ab0 con 0x7f93140fff90 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f9318db0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f9318db0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:60386/0 (socket says 172.21.15.152:60386) 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f9318db0700 1 -- 172.21.15.152:0/82113791 learned_addr learned my addr 172.21.15.152:0/82113791 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f9318db0700 1 -- 172.21.15.152:0/82113791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080095f0 con 0x7f93140fff90 2024-09-16T00:43:00.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.741+0000 7f9318db0700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9308005b40 tx=0x7f9308004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:00.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.742+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f930801d070 con 0x7f93140fff90 2024-09-16T00:43:00.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.742+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314197cb0 con 0x7f93140fff90 2024-09-16T00:43:00.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.742+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f93080044d0 con 0x7f93140fff90 2024-09-16T00:43:00.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.742+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9308003930 con 0x7f93140fff90 2024-09-16T00:43:00.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.742+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9314198070 con 0x7f93140fff90 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f9308003bf0 con 0x7f93140fff90 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314062380 con 0x7f93140fff90 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f9311ffb700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 0x7f930403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f930804c410 con 0x7f93140fff90 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f9313fff700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 0x7f930403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:00.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.743+0000 7f9313fff700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 0x7f930403aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9300006fd0 tx=0x7f9300006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:00.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:00.748+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f930802a540 con 0x7f93140fff90 2024-09-16T00:43:01.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.025+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f93141988d0 con 0x7f93140fff90 2024-09-16T00:43:01.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.026+0000 7f9311ffb700 1 -- 172.21.15.152:0/82113791 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f930802a360 con 0x7f93140fff90 2024-09-16T00:43:01.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:43:01.026 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:43:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 msgr2=0x7f930403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 0x7f930403aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9300006fd0 tx=0x7f9300006e40 comp rx=0 tx=0).stop 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 msgr2=0x7f9314197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9308005b40 tx=0x7f9308004c80 comp rx=0 tx=0).stop 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 shutdown_connections 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f9304038580 0x7f930403aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 --2- 172.21.15.152:0/82113791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93140fff90 0x7f9314197570 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 >> 172.21.15.152:0/82113791 conn(0x7f9314075550 msgr2=0x7f93140febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 shutdown_connections 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:01.028+0000 7f931b014700 1 -- 172.21.15.152:0/82113791 wait complete. 2024-09-16T00:43:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/82113791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:43:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:02.749 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:43:02.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:43:02.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:02 smithi053 ceph-mon[27950]: Deploying daemon mon.smithi152 on smithi152 2024-09-16T00:43:03.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:03 smithi053 ceph-mon[27950]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:03.967 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.449+0000 7f7585f16700 1 -- 172.21.15.152:0/2857695031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 msgr2=0x7f75800ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.449+0000 7f7585f16700 1 --2- 172.21.15.152:0/2857695031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f75800ff570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7570009910 tx=0x7f7570009c20 comp rx=0 tx=0).stop 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.449+0000 7f7585f16700 1 -- 172.21.15.152:0/2857695031 shutdown_connections 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.449+0000 7f7585f16700 1 --2- 172.21.15.152:0/2857695031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f75800ff570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.449+0000 7f7585f16700 1 -- 172.21.15.152:0/2857695031 >> 172.21.15.152:0/2857695031 conn(0x7f7580074c10 msgr2=0x7f7580075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.450+0000 7f7585f16700 1 -- 172.21.15.152:0/2857695031 shutdown_connections 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.450+0000 7f7585f16700 1 -- 172.21.15.152:0/2857695031 wait complete. 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.450+0000 7f7585f16700 1 Processor -- start 2024-09-16T00:43:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.450+0000 7f7585f16700 1 -- start start 2024-09-16T00:43:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f7585f16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f7585f16700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7580195980 con 0x7f75800ff1a0 2024-09-16T00:43:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.152:40534/0 (socket says 172.21.15.152:40534) 2024-09-16T00:43:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757f7fe700 1 -- 172.21.15.152:0/1168693483 learned_addr learned my addr 172.21.15.152:0/1168693483 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:43:05.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757f7fe700 1 -- 172.21.15.152:0/1168693483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700095f0 con 0x7f75800ff1a0 2024-09-16T00:43:05.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757f7fe700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7570005b40 tx=0x7f7570004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:05.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f757001d070 con 0x7f75800ff1a0 2024-09-16T00:43:05.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7580195b80 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.451+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75700044d0 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.452+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7580195f40 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.452+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75700039a0 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.452+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f7570003b00 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.452+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580062380 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.453+0000 7f757cff9700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 0x7f756803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.453+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f757004c390 con 0x7f75800ff1a0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.453+0000 7f757effd700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 0x7f756803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:05.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.453+0000 7f757effd700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 0x7f756803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7574006fd0 tx=0x7f7574006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:05.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.458+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f757002a540 con 0x7f75800ff1a0 2024-09-16T00:43:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:05 smithi053 ceph-mon[27950]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:05.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.751+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7580199f30 con 0x7f75800ff1a0 2024-09-16T00:43:05.753 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.752+0000 7f757cff9700 1 -- 172.21.15.152:0/1168693483 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f757002a360 con 0x7f75800ff1a0 2024-09-16T00:43:05.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:43:05.753 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:40:26.906097Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T00:43:05.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 msgr2=0x7f756803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:05.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 0x7f756803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7574006fd0 tx=0x7f7574006e40 comp rx=0 tx=0).stop 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 msgr2=0x7f7580195440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7570005b40 tx=0x7f7570004c80 comp rx=0 tx=0).stop 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 shutdown_connections 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7568038580 0x7f756803aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 --2- 172.21.15.152:0/1168693483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800ff1a0 0x7f7580195440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 >> 172.21.15.152:0/1168693483 conn(0x7f7580074c10 msgr2=0x7f75800684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 shutdown_connections 2024-09-16T00:43:05.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:05.754+0000 7f7585f16700 1 -- 172.21.15.152:0/1168693483 wait complete. 2024-09-16T00:43:05.756 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-16T00:43:07.617 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T00:43:07.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T00:43:07.828 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: mon.smithi053 calling monitor election 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: mon.smithi152 calling monitor election 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/3413592814' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: mon.smithi053 is new leader, mons smithi053,smithi152 in quorum (ranks 0,1) 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: monmap e2: 2 mons at {smithi053=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: fsmap 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T00:43:11.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: mgrmap e17: smithi053.cjiiek(active, since 30s) 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/3413592814' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: overall HEALTH_OK 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/3413592814' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/3413592814' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:11.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:11.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 -- 172.21.15.152:0/3541955726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be00035c0 msgr2=0x7f0be0005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 --2- 172.21.15.152:0/3541955726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be00035c0 0x7f0be0005a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40fedb0 tx=0x7f0be400feb0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 -- 172.21.15.152:0/3541955726 shutdown_connections 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 --2- 172.21.15.152:0/3541955726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0be00035c0 0x7f0be0005a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 -- 172.21.15.152:0/3541955726 >> 172.21.15.152:0/3541955726 conn(0x7f0bf40fa9a0 msgr2=0x7f0bf40fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 -- 172.21.15.152:0/3541955726 shutdown_connections 2024-09-16T00:43:12.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.292+0000 7f0bfa286700 1 -- 172.21.15.152:0/3541955726 wait complete. 2024-09-16T00:43:12.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:11 smithi152 ceph-mon[33237]: mgrmap e18: smithi053.cjiiek(active, since 30s), standbys: smithi152.nlmwrx 2024-09-16T00:43:12.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:43:12.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:43:12.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.293+0000 7f0bfa286700 1 Processor -- start 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.293+0000 7f0bfa286700 1 -- start start 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bfa286700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bfa286700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 0x7f0bf4198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bfa286700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4194f90 con 0x7f0bf4194980 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bfa286700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4195100 con 0x7f0be00035c0 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54822/0 (socket says 172.21.15.152:54822) 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 -- 172.21.15.152:0/977293348 learned_addr learned my addr 172.21.15.152:0/977293348 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf37fe700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 0x7f0bf4198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 -- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 msgr2=0x7f0bf4194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-16T00:43:12.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 -- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 msgr2=0x7f0bf4194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf3fff700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf37fe700 1 -- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 msgr2=0x7f0bf4194440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.294+0000 7f0bf37fe700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bf37fe700 1 -- 172.21.15.152:0/977293348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be400f900 con 0x7f0bf4194980 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bf37fe700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 0x7f0bf4198df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00b500 tx=0x7f0bdc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bdc011800 con 0x7f0bf4194980 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0bdc011e10 con 0x7f0bf4194980 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf41993f0 con 0x7f0bf4194980 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bdc00f2e0 con 0x7f0bf4194980 2024-09-16T00:43:12.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.295+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4199940 con 0x7f0bf4194980 2024-09-16T00:43:12.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.296+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4199c70 con 0x7f0bf4194980 2024-09-16T00:43:12.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.297+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f0bdc011960 con 0x7f0bf4194980 2024-09-16T00:43:12.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.297+0000 7f0bf17fa700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 0x7f0bd406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:12.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.297+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0bdc089d40 con 0x7f0bf4194980 2024-09-16T00:43:12.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.297+0000 7f0bf3fff700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 0x7f0bd406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:12.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.298+0000 7f0bf3fff700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 0x7f0bd406ebb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0be4001eb0 tx=0x7f0be4005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:12.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.302+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0bdc055550 con 0x7f0bf4194980 2024-09-16T00:43:12.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:11 smithi053 ceph-mon[27950]: mgrmap e18: smithi053.cjiiek(active, since 30s), standbys: smithi152.nlmwrx 2024-09-16T00:43:12.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:43:12.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:43:12.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:43:12.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.582+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0bf419f090 con 0x7f0bf4194980 2024-09-16T00:43:12.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.583+0000 7f0bf17fa700 1 -- 172.21.15.152:0/977293348 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f0bdc058b70 con 0x7f0bf4194980 2024-09-16T00:43:12.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:43:12.584 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","modified":"2024-09-16T00:43:05.912723Z","created":"2024-09-16T00:40:26.906097Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi053","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 msgr2=0x7f0bd406ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 0x7f0bd406ebb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0be4001eb0 tx=0x7f0be4005960 comp rx=0 tx=0).stop 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 msgr2=0x7f0bf4198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 0x7f0bf4198df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00b500 tx=0x7f0bdc00b8c0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 shutdown_connections 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0bd406c700 0x7f0bd406ebb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0be00035c0 0x7f0bf4194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 --2- 172.21.15.152:0/977293348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf4194980 0x7f0bf4198df0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.585+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 >> 172.21.15.152:0/977293348 conn(0x7f0bf40fa9a0 msgr2=0x7f0bf418c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:12.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.586+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 shutdown_connections 2024-09-16T00:43:12.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:43:12.586+0000 7f0bfa286700 1 -- 172.21.15.152:0/977293348 wait complete. 2024-09-16T00:43:12.587 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2024-09-16T00:43:13.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:12 smithi152 ceph-mon[33237]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:13.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:12 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/977293348' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:43:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:12 smithi053 ceph-mon[27950]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:12 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/977293348' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T00:43:13.412 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T00:43:13.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T00:43:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:43:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Reconfiguring mon.smithi053 (unknown last config time)... 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: Reconfiguring daemon mon.smithi053 on smithi053 2024-09-16T00:43:14.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:14 smithi053 ceph-mon[27950]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Reconfiguring mon.smithi053 (unknown last config time)... 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: Reconfiguring daemon mon.smithi053 on smithi053 2024-09-16T00:43:14.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:14 smithi152 ceph-mon[33237]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 -- 172.21.15.53:0/2683781824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 msgr2=0x7f3db40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2683781824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db40ff790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009910 tx=0x7f3d9c009c20 comp rx=0 tx=0).stop 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 -- 172.21.15.53:0/2683781824 shutdown_connections 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2683781824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 0x7f3db4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2683781824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db40ff790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 -- 172.21.15.53:0/2683781824 >> 172.21.15.53:0/2683781824 conn(0x7f3db40fac80 msgr2=0x7f3db40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 -- 172.21.15.53:0/2683781824 shutdown_connections 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.458+0000 7f3db9f56700 1 -- 172.21.15.53:0/2683781824 wait complete. 2024-09-16T00:43:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 Processor -- start 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 -- start start 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 0x7f3db4101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4101850 con 0x7f3db40ff3c0 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db9f56700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4101990 con 0x7f3db40ffd60 2024-09-16T00:43:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55322/0 (socket says 172.21.15.53:55322) 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 -- 172.21.15.53:0/2572608091 learned_addr learned my addr 172.21.15.53:0/2572608091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db2ffd700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 0x7f3db4101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 -- 172.21.15.53:0/2572608091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 msgr2=0x7f3db4101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 0x7f3db4101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.459+0000 7f3db37fe700 1 -- 172.21.15.53:0/2572608091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0095f0 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db37fe700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00b5c0 tx=0x7f3d9c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9c01d070 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d9c004fa0 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d9c00f460 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db4101c10 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.460+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db41a23f0 con 0x7f3db40ff3c0 2024-09-16T00:43:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.461+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db404f2a0 con 0x7f3db40ff3c0 2024-09-16T00:43:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.461+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f3d9c022810 con 0x7f3db40ff3c0 2024-09-16T00:43:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.462+0000 7f3db0ff9700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 0x7f3da006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.462+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f3d9c08ba90 con 0x7f3db40ff3c0 2024-09-16T00:43:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.462+0000 7f3db2ffd700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 0x7f3da006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.462+0000 7f3db2ffd700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 0x7f3da006eac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005950 tx=0x7f3da40058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:16.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.466+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d9c057430 con 0x7f3db40ff3c0 2024-09-16T00:43:16.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.670+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3db41a2660 con 0x7f3db40ff3c0 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:43:16.671 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:16.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.670+0000 7f3db0ff9700 1 -- 172.21.15.53:0/2572608091 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f3d9c027020 con 0x7f3db40ff3c0 2024-09-16T00:43:16.672 INFO:teuthology.orchestra.run.smithi053.stdout:# minimal ceph.conf for 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:43:16.672 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-16T00:43:16.672 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:43:16.672 INFO:teuthology.orchestra.run.smithi053.stdout: mon_host = [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 msgr2=0x7f3da006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 0x7f3da006eac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005950 tx=0x7f3da40058e0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 msgr2=0x7f3db4100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00b5c0 tx=0x7f3d9c00be20 comp rx=0 tx=0).stop 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 shutdown_connections 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3da006c610 0x7f3da006eac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3db40ff3c0 0x7f3db4100dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 --2- 172.21.15.53:0/2572608091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3db40ffd60 0x7f3db4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 >> 172.21.15.53:0/2572608091 conn(0x7f3db40fac80 msgr2=0x7f3db41034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 shutdown_connections 2024-09-16T00:43:16.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:16.673+0000 7f3db9f56700 1 -- 172.21.15.53:0/2572608091 wait complete. 2024-09-16T00:43:16.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:16.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:43:16.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:43:16.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:17 smithi152 ceph-mon[33237]: Reconfiguring mgr.smithi053.cjiiek (unknown last config time)... 2024-09-16T00:43:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:17 smithi152 ceph-mon[33237]: Reconfiguring daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:43:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:17 smithi152 ceph-mon[33237]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:17 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2572608091' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:17.748 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:17 smithi053 ceph-mon[27950]: Reconfiguring mgr.smithi053.cjiiek (unknown last config time)... 2024-09-16T00:43:17.749 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:17 smithi053 ceph-mon[27950]: Reconfiguring daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:43:17.749 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:17 smithi053 ceph-mon[27950]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:17.749 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:17 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2572608091' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:18.223 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T00:43:18.223 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:43:18.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:43:18.254 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:43:18.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:43:18.320 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:43:18.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T00:43:18.354 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:43:18.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:43:18.424 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T00:43:18.424 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:43:18.424 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:43:18.441 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:43:18.442 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-16 00:42:31.624524177 +0000 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-16 00:37:36.769026317 +0000 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-16 00:37:36.769026317 +0000 2024-09-16T00:43:18.498 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-16 00:37:36.769026317 +0000 2024-09-16T00:43:18.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:43:18.563 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-16T00:43:18.563 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-16T00:43:18.564 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000108409 s, 4.7 MB/s 2024-09-16T00:43:18.565 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:43:18.622 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-09-16T00:43:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:43:18.679 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:18.679 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-16 00:42:31.624524177 +0000 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-16 00:37:37.085019784 +0000 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-16 00:37:37.085019784 +0000 2024-09-16T00:43:18.680 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-16 00:37:37.085019784 +0000 2024-09-16T00:43:18.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:43:18.744 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-16T00:43:18.744 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-16T00:43:18.744 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000107092 s, 4.8 MB/s 2024-09-16T00:43:18.745 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:43:18.803 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-09-16T00:43:18.859 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:43:18.859 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-16 00:42:31.624524177 +0000 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-16 00:37:37.414012983 +0000 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-16 00:37:37.414012983 +0000 2024-09-16T00:43:18.860 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-16 00:37:37.414012983 +0000 2024-09-16T00:43:18.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:43:18.921 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: Reconfiguring ceph-exporter.smithi053 (monmap changed)... 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: Reconfiguring daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:43:18.922 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:18 smithi053 ceph-mon[27950]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-16T00:43:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-16T00:43:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 9.0836e-05 s, 5.6 MB/s 2024-09-16T00:43:18.925 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:43:18.982 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-09-16T00:43:19.038 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:43:19.038 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:19.038 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-16T00:43:19.038 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:19.039 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:19.039 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-16 00:42:31.625524157 +0000 2024-09-16T00:43:19.039 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-16 00:37:37.762005788 +0000 2024-09-16T00:43:19.039 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-16 00:37:37.762005788 +0000 2024-09-16T00:43:19.039 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-16 00:37:37.762005788 +0000 2024-09-16T00:43:19.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:43:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-16T00:43:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-16T00:43:19.103 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000106732 s, 4.8 MB/s 2024-09-16T00:43:19.104 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:43:19.161 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:43:19.161 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T00:43:19.181 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T00:43:19.181 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-16T00:43:19.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: Reconfiguring ceph-exporter.smithi053 (monmap changed)... 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: Reconfiguring daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:43:19.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:18 smithi152 ceph-mon[33237]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-16 00:43:04.223716717 +0000 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-16 00:37:31.740678299 +0000 2024-09-16T00:43:19.214 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-16 00:37:31.740678299 +0000 2024-09-16T00:43:19.215 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-16 00:37:31.740678299 +0000 2024-09-16T00:43:19.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T00:43:19.281 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-16T00:43:19.282 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-16T00:43:19.282 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000230806 s, 2.2 MB/s 2024-09-16T00:43:19.283 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T00:43:19.345 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-16T00:43:19.416 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T00:43:19.416 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:19.416 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T00:43:19.416 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:19.417 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:19.417 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-16 00:43:04.223716717 +0000 2024-09-16T00:43:19.417 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-16 00:37:32.082674540 +0000 2024-09-16T00:43:19.417 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-16 00:37:32.082674540 +0000 2024-09-16T00:43:19.417 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-16 00:37:32.082674540 +0000 2024-09-16T00:43:19.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T00:43:19.490 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-16T00:43:19.490 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-16T00:43:19.491 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000209097 s, 2.4 MB/s 2024-09-16T00:43:19.492 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T00:43:19.560 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-16 00:43:04.223716717 +0000 2024-09-16T00:43:19.622 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-16 00:37:32.400671044 +0000 2024-09-16T00:43:19.622 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-16 00:37:32.400671044 +0000 2024-09-16T00:43:19.622 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-16 00:37:32.400671044 +0000 2024-09-16T00:43:19.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T00:43:19.688 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-16T00:43:19.688 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-16T00:43:19.688 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00022544 s, 2.3 MB/s 2024-09-16T00:43:19.689 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T00:43:19.750 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-16 00:43:04.224716705 +0000 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-16 00:37:32.719667538 +0000 2024-09-16T00:43:19.808 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-16 00:37:32.719667538 +0000 2024-09-16T00:43:19.809 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-16 00:37:32.719667538 +0000 2024-09-16T00:43:19.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T00:43:19.873 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-16T00:43:19.873 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-16T00:43:19.874 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000206231 s, 2.5 MB/s 2024-09-16T00:43:19.875 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T00:43:19.933 INFO:tasks.cephadm:Deploying osd.0 on smithi053 with /dev/vg_nvme/lv_4... 2024-09-16T00:43:19.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:43:20.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: Reconfiguring crash.smithi053 (monmap changed)... 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: Reconfiguring daemon crash.smithi053 on smithi053 2024-09-16T00:43:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:20 smithi152 ceph-mon[33237]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: Reconfiguring crash.smithi053 (monmap changed)... 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: Reconfiguring daemon crash.smithi053 on smithi053 2024-09-16T00:43:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:20 smithi053 ceph-mon[27950]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:21.018 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:43:22.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:22 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:22.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:22 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:22.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:22 smithi053 ceph-mon[27950]: Reconfiguring alertmanager.smithi053 (dependencies changed)... 2024-09-16T00:43:22.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:22 smithi053 ceph-mon[27950]: Reconfiguring daemon alertmanager.smithi053 on smithi053 2024-09-16T00:43:22.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:22 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:22 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:22 smithi152 ceph-mon[33237]: Reconfiguring alertmanager.smithi053 (dependencies changed)... 2024-09-16T00:43:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:22 smithi152 ceph-mon[33237]: Reconfiguring daemon alertmanager.smithi053 on smithi053 2024-09-16T00:43:23.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:23 smithi053 ceph-mon[27950]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:23.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:23 smithi152 ceph-mon[33237]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:25 smithi053 ceph-mon[27950]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:25 smithi152 ceph-mon[33237]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:26.814 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:26 smithi053 ceph-mon[27950]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:26.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:26 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:26.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:26 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:27.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:26 smithi152 ceph-mon[33237]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:27.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:26 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:27.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:26 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:28.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:27 smithi053 ceph-mon[27950]: Reconfiguring grafana.smithi053 (dependencies changed)... 2024-09-16T00:43:28.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:27 smithi053 ceph-mon[27950]: Reconfiguring daemon grafana.smithi053 on smithi053 2024-09-16T00:43:28.118 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:43:28.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_4 2024-09-16T00:43:28.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:27 smithi152 ceph-mon[33237]: Reconfiguring grafana.smithi053 (dependencies changed)... 2024-09-16T00:43:28.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:27 smithi152 ceph-mon[33237]: Reconfiguring daemon grafana.smithi053 on smithi053 2024-09-16T00:43:28.862 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:43:29.068 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:28 smithi053 ceph-mon[27950]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:29.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:28 smithi152 ceph-mon[33237]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/194613085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc100240 msgr2=0x7f1cdc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/194613085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc100240 0x7f1cdc100650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd0009b80 comp rx=0 tx=0).stop 2024-09-16T00:43:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/194613085 shutdown_connections 2024-09-16T00:43:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/194613085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/194613085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc100240 0x7f1cdc100650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.579+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/194613085 >> 172.21.15.53:0/194613085 conn(0x7f1cdc0fb890 msgr2=0x7f1cdc0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:31.582 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:31 smithi053 ceph-mon[27950]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:31.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.580+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/194613085 shutdown_connections 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.580+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/194613085 wait complete. 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 Processor -- start 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 -- start start 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc100240 0x7f1cdc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc073680 con 0x7f1cdc1014e0 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce3c0c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc0737c0 con 0x7f1cdc100240 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce11a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce11a7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37734/0 (socket says 172.21.15.53:37734) 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce11a7700 1 -- 172.21.15.53:0/464543409 learned_addr learned my addr 172.21.15.53:0/464543409 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:43:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.581+0000 7f1ce19a8700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc100240 0x7f1cdc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce11a7700 1 -- 172.21.15.53:0/464543409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc100240 msgr2=0x7f1cdc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce11a7700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc100240 0x7f1cdc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce11a7700 1 -- 172.21.15.53:0/464543409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009520 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce11a7700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e940 tx=0x7f1cd800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd8004a00 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1cd800cc70 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd80055b0 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc073aa0 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.582+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc19daf0 con 0x7f1cdc1014e0 2024-09-16T00:43:31.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.584+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc108d20 con 0x7f1cdc1014e0 2024-09-16T00:43:31.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.585+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f1cd800c7c0 con 0x7f1cdc1014e0 2024-09-16T00:43:31.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.585+0000 7f1cceffd700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 0x7f1cc806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:43:31.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.585+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f1cd8014070 con 0x7f1cdc1014e0 2024-09-16T00:43:31.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.585+0000 7f1ce19a8700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 0x7f1cc806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:43:31.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.586+0000 7f1ce19a8700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 0x7f1cc806eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000b6f0 tx=0x7f1cd0019040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:43:31.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.590+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1cd805a160 con 0x7f1cdc1014e0 2024-09-16T00:43:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:31 smithi152 ceph-mon[33237]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:31.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:31.801+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cdc105e30 con 0x7f1cc806c600 2024-09-16T00:43:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:43:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:43:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:32.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:43:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:43:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:33 smithi152 ceph-mon[33237]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:43:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:33 smithi152 ceph-mon[33237]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:33.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:33 smithi053 ceph-mon[27950]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:43:33.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:33 smithi053 ceph-mon[27950]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:35.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:35 smithi152 ceph-mon[33237]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:35 smithi053 ceph-mon[27950]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1726170759' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a"}]: dispatch 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1726170759' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a"}]': finished 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:43:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1726170759' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a"}]: dispatch 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1726170759' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a"}]': finished 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T00:43:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:37 smithi152 ceph-mon[33237]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:37 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/4057884453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:43:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:37 smithi053 ceph-mon[27950]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:37 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4057884453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:43:39.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:39 smithi152 ceph-mon[33237]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:39.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:39 smithi053 ceph-mon[27950]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:40.428 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:40.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:41.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:41 smithi152 ceph-mon[33237]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:41.736 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:41 smithi053 ceph-mon[27950]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:43.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:43 smithi152 ceph-mon[33237]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:43 smithi053 ceph-mon[27950]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:45.573 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:45 smithi053 ceph-mon[27950]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:45.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:45 smithi152 ceph-mon[33237]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:47.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:47.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:47.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: Reconfiguring ceph-exporter.smithi152 (monmap changed)... 2024-09-16T00:43:47.017 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:43:47.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:47.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: Reconfiguring daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:43:47.018 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:46 smithi053 ceph-mon[27950]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:47.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: Reconfiguring ceph-exporter.smithi152 (monmap changed)... 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: Reconfiguring daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:43:47.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:46 smithi152 ceph-mon[33237]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: Deploying daemon osd.0 on smithi053 2024-09-16T00:43:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-16T00:43:48.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:43:48.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:48.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:48 smithi053 ceph-mon[27950]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: Deploying daemon osd.0 on smithi053 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:48.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:48 smithi152 ceph-mon[33237]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-16T00:43:49.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:49.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:49.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:49.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:43:49.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:43:49.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:49 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:43:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:49 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:50.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: Reconfiguring mgr.smithi152.nlmwrx (monmap changed)... 2024-09-16T00:43:50.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: Reconfiguring daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:43:50.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:50.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:50.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:43:50.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:43:50.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:50 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: Reconfiguring mgr.smithi152.nlmwrx (monmap changed)... 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: Reconfiguring daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:43:50.592 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:50 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:43:51.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi053.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:43:51.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T00:43:51.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:51.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:43:51.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi053.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T00:43:52.662 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:43:52.662 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi053.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi053.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi053.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:52.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi053.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi053.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi053.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:43:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:53 smithi053 ceph-mon[27950]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:53 smithi152 ceph-mon[33237]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:55.489 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:55 smithi152 ceph-mon[33237]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:55 smithi053 ceph-mon[27950]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.192+0000 7f1cceffd700 1 -- 172.21.15.53:0/464543409 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1cdc105e30 con 0x7f1cc806c600 2024-09-16T00:43:56.193 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 0 on host 'smithi053' 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 msgr2=0x7f1cc806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 0x7f1cc806eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000b6f0 tx=0x7f1cd0019040 comp rx=0 tx=0).stop 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 msgr2=0x7f1cdc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800e940 tx=0x7f1cd800ec50 comp rx=0 tx=0).stop 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 shutdown_connections 2024-09-16T00:43:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1cc806c600 0x7f1cc806eab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:56.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc100240 0x7f1cdc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:56.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 --2- 172.21.15.53:0/464543409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cdc1014e0 0x7f1cdc073140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:43:56.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 >> 172.21.15.53:0/464543409 conn(0x7f1cdc0fb890 msgr2=0x7f1cdc104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:43:56.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 shutdown_connections 2024-09-16T00:43:56.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:43:56.195+0000 7f1ce3c0c700 1 -- 172.21.15.53:0/464543409 wait complete. 2024-09-16T00:43:56.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:56.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:56.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:56.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:56 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:43:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:56 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:56 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:43:56.993 DEBUG:teuthology.orchestra.run.smithi053:osd.0> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T00:43:56.996 INFO:tasks.cephadm:Deploying osd.1 on smithi053 with /dev/vg_nvme/lv_3... 2024-09-16T00:43:56.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:43:57.494 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:57 smithi053 ceph-mon[27950]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:57.494 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:57 smithi053 ceph-mon[27950]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:43:57.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:57 smithi152 ceph-mon[33237]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:57.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:57 smithi152 ceph-mon[33237]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:43:57.811 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:58.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:58.410 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[43046]: 2024-09-16T00:43:58.340+0000 7f031b49e700 -1 osd.0 0 waiting for initial osdmap 2024-09-16T00:43:58.411 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:43:58 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[43046]: 2024-09-16T00:43:58.344+0000 7f0317a94700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:58 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:59.605 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:59 smithi053 ceph-mon[27950]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:59.605 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:43:59 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:43:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:59 smithi152 ceph-mon[33237]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:43:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:43:59 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:44:00.546 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] boot 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:00.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:00 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:00.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: osd.0 [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] boot 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:00 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:01.518 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:01 smithi053 ceph-mon[27950]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:44:01.518 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:01 smithi053 ceph-mon[27950]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T00:44:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:01 smithi152 ceph-mon[33237]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T00:44:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:01 smithi152 ceph-mon[33237]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T00:44:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:44:01.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_3 2024-09-16T00:44:03.412 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:03 smithi053 ceph-mon[27950]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:44:03.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:03 smithi152 ceph-mon[33237]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:05.656 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 -- 172.21.15.53:0/3244776316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40ff150 msgr2=0x7fc6e40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/3244776316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40ff150 0x7fc6e40ff560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009910 tx=0x7fc6e0009c20 comp rx=0 tx=0).stop 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 -- 172.21.15.53:0/3244776316 shutdown_connections 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/3244776316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e4100350 0x7fc6e41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/3244776316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40ff150 0x7fc6e40ff560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 -- 172.21.15.53:0/3244776316 >> 172.21.15.53:0/3244776316 conn(0x7fc6e40fa700 msgr2=0x7fc6e40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 -- 172.21.15.53:0/3244776316 shutdown_connections 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.008+0000 7fc6ec07c700 1 -- 172.21.15.53:0/3244776316 wait complete. 2024-09-16T00:44:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 Processor -- start 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 -- start start 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e40ff150 0x7fc6e4195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4196620 con 0x7fc6e4100350 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6ec07c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4196760 con 0x7fc6e40ff150 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.009+0000 7fc6e9617700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34306/0 (socket says 172.21.15.53:34306) 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 -- 172.21.15.53:0/838236751 learned_addr learned my addr 172.21.15.53:0/838236751 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9e18700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e40ff150 0x7fc6e4195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 -- 172.21.15.53:0/838236751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e40ff150 msgr2=0x7fc6e4195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e40ff150 0x7fc6e4195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 -- 172.21.15.53:0/838236751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00095f0 con 0x7fc6e4100350 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6e9617700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e920 tx=0x7fc6d400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:44:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d400c9d0 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6d4010430 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e419b210 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4018650 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.010+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e419b760 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.011+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4107ca0 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.012+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fc6d40105a0 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.013+0000 7fc6daffd700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 0x7fc6d006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.013+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7fc6d4014070 con 0x7fc6e4100350 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.013+0000 7fc6e9e18700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 0x7fc6d006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.013+0000 7fc6e9e18700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 0x7fc6d006eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000b6f0 tx=0x7fc6e0005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:44:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.017+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc6d4051720 con 0x7fc6e4100350 2024-09-16T00:44:06.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:06.244+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e40694c0 con 0x7fc6d006c600 2024-09-16T00:44:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:06 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi053 2024-09-16T00:44:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:06 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi053 to 11844M 2024-09-16T00:44:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:06 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:44:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:06 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:44:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:06 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:06.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:06 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi053 2024-09-16T00:44:06.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:06 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi053 to 11844M 2024-09-16T00:44:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:06 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:44:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:06 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:44:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:06 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:07.650 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:07 smithi053 ceph-mon[27950]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:44:07.651 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:07 smithi053 ceph-mon[27950]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:07.651 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:07.651 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:07.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:07 smithi152 ceph-mon[33237]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:44:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:07 smithi152 ceph-mon[33237]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:09.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:09 smithi152 ceph-mon[33237]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:09.720 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:09 smithi053 ceph-mon[27950]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1220180923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd422dc9-c004-4434-b2e5-41b1657ad07b"}]: dispatch 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1220180923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd422dc9-c004-4434-b2e5-41b1657ad07b"}]': finished 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3502732261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:44:10.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:10.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1220180923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd422dc9-c004-4434-b2e5-41b1657ad07b"}]: dispatch 2024-09-16T00:44:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1220180923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd422dc9-c004-4434-b2e5-41b1657ad07b"}]': finished 2024-09-16T00:44:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T00:44:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3502732261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:44:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:11.692 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:11 smithi053 ceph-mon[27950]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:11.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:11 smithi152 ceph-mon[33237]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:12 smithi053 ceph-mon[27950]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:12.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:12 smithi152 ceph-mon[33237]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:15.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:15 smithi152 ceph-mon[33237]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:15.721 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:15 smithi053 ceph-mon[27950]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:16.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:16 smithi152 ceph-mon[33237]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:16.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:44:16.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:16 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:16 smithi053 ceph-mon[27950]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:44:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:16 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:18.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:17 smithi053 ceph-mon[27950]: Deploying daemon osd.1 on smithi053 2024-09-16T00:44:18.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:17 smithi152 ceph-mon[33237]: Deploying daemon osd.1 on smithi053 2024-09-16T00:44:19.051 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:18 smithi053 ceph-mon[27950]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:19.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:18 smithi152 ceph-mon[33237]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:21 smithi053 ceph-mon[27950]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:21.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:21 smithi152 ceph-mon[33237]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:23 smithi053 ceph-mon[27950]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:23.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:23 smithi152 ceph-mon[33237]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:25.690 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:25 smithi053 ceph-mon[27950]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:25.691 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:25.691 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:25.691 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:25 smithi152 ceph-mon[33237]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.301+0000 7fc6daffd700 1 -- 172.21.15.53:0/838236751 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc6e40694c0 con 0x7fc6d006c600 2024-09-16T00:44:26.327 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 1 on host 'smithi053' 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 msgr2=0x7fc6d006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 0x7fc6d006eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000b6f0 tx=0x7fc6e0005940 comp rx=0 tx=0).stop 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 msgr2=0x7fc6e4196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400e920 tx=0x7fc6d400ec30 comp rx=0 tx=0).stop 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 shutdown_connections 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc6d006c600 0x7fc6d006eab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6e40ff150 0x7fc6e4195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.303+0000 7fc6ec07c700 1 --2- 172.21.15.53:0/838236751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e4100350 0x7fc6e4196000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.304+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 >> 172.21.15.53:0/838236751 conn(0x7fc6e40fa700 msgr2=0x7fc6e4068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:44:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.304+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 shutdown_connections 2024-09-16T00:44:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:26.304+0000 7fc6ec07c700 1 -- 172.21.15.53:0/838236751 wait complete. 2024-09-16T00:44:27.261 DEBUG:teuthology.orchestra.run.smithi053:osd.1> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T00:44:27.264 INFO:tasks.cephadm:Deploying osd.2 on smithi053 with /dev/vg_nvme/lv_2... 2024-09-16T00:44:27.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:44:27.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:27.567 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:27.567 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:27 smithi053 ceph-mon[27950]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:27.567 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:27 smithi053 ceph-mon[27950]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:44:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:27 smithi152 ceph-mon[33237]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:27 smithi152 ceph-mon[33237]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:44:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-mon[27950]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:44:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-mon[27950]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T00:44:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-mon[27950]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:44:28.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[48438]: 2024-09-16T00:44:28.309+0000 7ff258904700 -1 osd.1 0 waiting for initial osdmap 2024-09-16T00:44:28.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:44:28 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[48438]: 2024-09-16T00:44:28.315+0000 7ff2526f5700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:44:28.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:28 smithi152 ceph-mon[33237]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:44:28.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:28 smithi152 ceph-mon[33237]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T00:44:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:28 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:28 smithi152 ceph-mon[33237]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:44:28.821 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:44:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:29 smithi053 ceph-mon[27950]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:44:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:29 smithi053 ceph-mon[27950]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T00:44:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:29 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:29 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:29 smithi053 ceph-mon[27950]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:29 smithi152 ceph-mon[33237]: from='osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:44:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:29 smithi152 ceph-mon[33237]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T00:44:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:29 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:29 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:29 smithi152 ceph-mon[33237]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T00:44:30.422 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:44:30.422 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:44:30.422 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:30.422 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] boot 2024-09-16T00:44:30.423 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T00:44:30.423 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:30 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:30.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:44:30.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:44:30.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: osd.1 [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] boot 2024-09-16T00:44:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T00:44:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:30 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:44:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:31 smithi152 ceph-mon[33237]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T00:44:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:31 smithi152 ceph-mon[33237]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:31 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:31 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:31.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:31 smithi053 ceph-mon[27950]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T00:44:31.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:31 smithi053 ceph-mon[27950]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:31.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:31 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:31.716 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:31 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:32.126 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:44:32.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:vg_nvme/lv_2 2024-09-16T00:44:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:44:33.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:33 smithi053 ceph-mon[27950]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:33 smithi152 ceph-mon[33237]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:35.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:35.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:44:35.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.650 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:35.650 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:35.650 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:35.650 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 -- 172.21.15.53:0/1119064980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0101440 msgr2=0x7f5eb0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:35.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/1119064980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0101440 0x7f5eb0101890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009910 tx=0x7f5ea4009c20 comp rx=0 tx=0).stop 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 -- 172.21.15.53:0/1119064980 shutdown_connections 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/1119064980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0101440 0x7f5eb0101890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/1119064980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0100240 0x7f5eb0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 -- 172.21.15.53:0/1119064980 >> 172.21.15.53:0/1119064980 conn(0x7f5eb00fb7f0 msgr2=0x7f5eb00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 -- 172.21.15.53:0/1119064980 shutdown_connections 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.919+0000 7f5eb63c5700 1 -- 172.21.15.53:0/1119064980 wait complete. 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 Processor -- start 2024-09-16T00:44:35.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 -- start start 2024-09-16T00:44:35.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 0x7f5eb0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01965f0 con 0x7f5eb0100240 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eb63c5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0196730 con 0x7f5eb0101440 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.920+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42262/0 (socket says 172.21.15.53:42262) 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 -- 172.21.15.53:0/2607099255 learned_addr learned my addr 172.21.15.53:0/2607099255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaf7fe700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 0x7f5eb0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 -- 172.21.15.53:0/2607099255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 msgr2=0x7f5eb0195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 0x7f5eb0195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 -- 172.21.15.53:0/2607099255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40095f0 con 0x7f5eb0100240 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaf7fe700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 0x7f5eb0195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:44:35.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eaffff700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000d900 tx=0x7f5ea000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea00041f0 con 0x7f5eb0100240 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb019b1e0 con 0x7f5eb0100240 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5ea0004350 con 0x7f5eb0100240 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ea0003da0 con 0x7f5eb0100240 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.921+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb019b730 con 0x7f5eb0100240 2024-09-16T00:44:35.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.922+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb0108d90 con 0x7f5eb0100240 2024-09-16T00:44:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.923+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f5ea0009730 con 0x7f5eb0100240 2024-09-16T00:44:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.923+0000 7f5ead7fa700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 0x7f5e9806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:44:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.924+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f5ea008aaf0 con 0x7f5eb0100240 2024-09-16T00:44:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.924+0000 7f5eaf7fe700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 0x7f5e9806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:44:35.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.924+0000 7f5eaf7fe700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 0x7f5e9806eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005b40 tx=0x7f5ea4005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:44:35.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:35.928+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5ea00599d0 con 0x7f5eb0100240 2024-09-16T00:44:36.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:36.169+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eb0105d90 con 0x7f5e9806c600 2024-09-16T00:44:36.462 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:36 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi053 2024-09-16T00:44:36.462 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:36 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi053 to 5922M 2024-09-16T00:44:36.462 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:44:36.462 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:44:36.462 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:36.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:36 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi053 2024-09-16T00:44:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:36 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi053 to 5922M 2024-09-16T00:44:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:44:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:44:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:37 smithi152 ceph-mon[33237]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:44:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:37 smithi152 ceph-mon[33237]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:37 smithi053 ceph-mon[27950]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:44:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:37 smithi053 ceph-mon[27950]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:39 smithi053 ceph-mon[27950]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:39.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:39 smithi152 ceph-mon[33237]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:40.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:40 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/710924524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6da8427-e1ea-4f98-890e-41f909d91892"}]: dispatch 2024-09-16T00:44:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:40 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/710924524' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6da8427-e1ea-4f98-890e-41f909d91892"}]': finished 2024-09-16T00:44:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:40 smithi152 ceph-mon[33237]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:44:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:40 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/710924524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6da8427-e1ea-4f98-890e-41f909d91892"}]: dispatch 2024-09-16T00:44:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:40 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/710924524' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6da8427-e1ea-4f98-890e-41f909d91892"}]': finished 2024-09-16T00:44:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:40 smithi053 ceph-mon[27950]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T00:44:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:41.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:41 smithi152 ceph-mon[33237]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:41 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3910516732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:44:41.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:41 smithi053 ceph-mon[27950]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:41 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3910516732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:44:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:42.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:42.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:42.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:42.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:44:42.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:43.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:43 smithi152 ceph-mon[33237]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:43.758 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:43 smithi053 ceph-mon[27950]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:45.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:45 smithi053 ceph-mon[27950]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:45.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:45 smithi152 ceph-mon[33237]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:47.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:46 smithi053 ceph-mon[27950]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:47.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:46 smithi152 ceph-mon[33237]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:48.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:44:48.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:48.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:47 smithi053 ceph-mon[27950]: Deploying daemon osd.2 on smithi053 2024-09-16T00:44:48.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:44:48.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:44:48.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:47 smithi152 ceph-mon[33237]: Deploying daemon osd.2 on smithi053 2024-09-16T00:44:48.921 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:48 smithi053 ceph-mon[27950]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:49.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:48 smithi152 ceph-mon[33237]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:51 smithi053 ceph-mon[27950]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:51.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:51 smithi152 ceph-mon[33237]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:53 smithi053 ceph-mon[27950]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:53 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:53 smithi152 ceph-mon[33237]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:53 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:44:55.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:55 smithi152 ceph-mon[33237]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:55.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:55 smithi053 ceph-mon[27950]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:44:56.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.636+0000 7f5ead7fa700 1 -- 172.21.15.53:0/2607099255 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5eb0105d90 con 0x7f5e9806c600 2024-09-16T00:44:56.637 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 2 on host 'smithi053' 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 msgr2=0x7f5e9806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 0x7f5e9806eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4005b40 tx=0x7f5ea4005a90 comp rx=0 tx=0).stop 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 msgr2=0x7f5eb0195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000d900 tx=0x7f5ea000dcc0 comp rx=0 tx=0).stop 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 shutdown_connections 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5e9806c600 0x7f5e9806eab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb0100240 0x7f5eb0195a90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 --2- 172.21.15.53:0/2607099255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eb0101440 0x7f5eb0195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 >> 172.21.15.53:0/2607099255 conn(0x7f5eb00fb7f0 msgr2=0x7f5eb0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 shutdown_connections 2024-09-16T00:44:56.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:44:56.638+0000 7f5eb63c5700 1 -- 172.21.15.53:0/2607099255 wait complete. 2024-09-16T00:44:56.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:56 smithi053 ceph-mon[27950]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:56.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:56 smithi053 ceph-mon[27950]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:44:56.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:56.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:56 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:57.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:56 smithi152 ceph-mon[33237]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:57.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:56 smithi152 ceph-mon[33237]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:44:57.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:56 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:57.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:56 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:44:57.636 DEBUG:teuthology.orchestra.run.smithi053:osd.2> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T00:44:57.639 INFO:tasks.cephadm:Deploying osd.3 on smithi152 with /dev/vg_nvme/lv_4... 2024-09-16T00:44:57.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T00:44:57.849 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:44:57.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:57 smithi152 ceph-mon[33237]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:44:57.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:57 smithi152 ceph-mon[33237]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T00:44:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:57 smithi152 ceph-mon[33237]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:44:57.998 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-mon[27950]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:44:57.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-mon[27950]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T00:44:57.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:57.999 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-mon[27950]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:44:57.999 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[53860]: 2024-09-16T00:44:57.798+0000 7f6c3996f700 -1 osd.2 0 waiting for initial osdmap 2024-09-16T00:44:57.999 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:44:57 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[53860]: 2024-09-16T00:44:57.803+0000 7f6c34762700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:44:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:58 smithi053 ceph-mon[27950]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:44:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:58 smithi053 ceph-mon[27950]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T00:44:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:58 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:58 smithi053 ceph-mon[27950]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:44:59.087 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:58 smithi152 ceph-mon[33237]: from='osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-16T00:44:59.087 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:58 smithi152 ceph-mon[33237]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T00:44:59.087 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:58 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:59.087 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:58 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:44:59.088 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:58 smithi152 ceph-mon[33237]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] boot 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T00:45:00.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:44:59 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: osd.2 [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] boot 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T00:45:00.185 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:44:59 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:45:00.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:45:00.207 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-09-16T00:45:00.406 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:45:01.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:00 smithi152 ceph-mon[33237]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T00:45:01.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:00 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:01.160 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:00 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:01.276 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:00 smithi053 ceph-mon[27950]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T00:45:01.276 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:00 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:01.276 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:00 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 -- 172.21.15.152:0/503916502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604100240 msgr2=0x7f4604100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 --2- 172.21.15.152:0/503916502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604100240 0x7f4604100650 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009910 tx=0x7f45f8009c20 comp rx=0 tx=0).stop 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 -- 172.21.15.152:0/503916502 shutdown_connections 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 --2- 172.21.15.152:0/503916502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604101440 0x7f4604101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 --2- 172.21.15.152:0/503916502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604100240 0x7f4604100650 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.844+0000 7f460ae97700 1 -- 172.21.15.152:0/503916502 >> 172.21.15.152:0/503916502 conn(0x7f46040fb7f0 msgr2=0x7f46040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.845+0000 7f460ae97700 1 -- 172.21.15.152:0/503916502 shutdown_connections 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.845+0000 7f460ae97700 1 -- 172.21.15.152:0/503916502 wait complete. 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.845+0000 7f460ae97700 1 Processor -- start 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.845+0000 7f460ae97700 1 -- start start 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f460ae97700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604100240 0x7f4604195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f460ae97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f460ae97700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4604196640 con 0x7f4604100240 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f460ae97700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4604196780 con 0x7f4604101440 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41826/0 (socket says 172.21.15.152:41826) 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 -- 172.21.15.152:0/3136057190 learned_addr learned my addr 172.21.15.152:0/3136057190 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4608c33700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604100240 0x7f4604195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 -- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604100240 msgr2=0x7f4604195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:01.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604100240 0x7f4604195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 -- 172.21.15.152:0/3136057190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80095f0 con 0x7f4604101440 2024-09-16T00:45:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4603fff700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d8d0 tx=0x7f45f000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f00098a0 con 0x7f4604101440 2024-09-16T00:45:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45f0010460 con 0x7f4604101440 2024-09-16T00:45:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460419b230 con 0x7f4604101440 2024-09-16T00:45:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.846+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f000f5f0 con 0x7f4604101440 2024-09-16T00:45:01.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.847+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460419b780 con 0x7f4604101440 2024-09-16T00:45:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.848+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4604108d90 con 0x7f4604101440 2024-09-16T00:45:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.848+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f45f0009a00 con 0x7f4604101440 2024-09-16T00:45:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.848+0000 7f4601ffb700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 0x7f45f406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.848+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3049+0+0 (secure 0 0 0) 0x7f45f008ac30 con 0x7f4604101440 2024-09-16T00:45:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.848+0000 7f4608c33700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 0x7f45f406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.849+0000 7f4608c33700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 0x7f45f406eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45f8006010 tx=0x7f45f800b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:01.853+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f45f0059870 con 0x7f4604101440 2024-09-16T00:45:02.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:01 smithi152 ceph-mon[33237]: pgmap v78: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:02.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:01 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:45:02.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:01 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:45:02.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:01 smithi152 ceph-mon[33237]: osdmap e21: 3 total, 3 up, 3 in 2024-09-16T00:45:02.054 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:01 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:45:02.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:02.052+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4604105d90 con 0x7f45f406c610 2024-09-16T00:45:02.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:01 smithi053 ceph-mon[27950]: pgmap v78: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:02.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:45:02.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T00:45:02.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:01 smithi053 ceph-mon[27950]: osdmap e21: 3 total, 3 up, 3 in 2024-09-16T00:45:02.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: osdmap e22: 3 total, 3 up, 3 in 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:03.101 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:02 smithi053 ceph-mon[27950]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:03.179 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: osdmap e22: 3 total, 3 up, 3 in 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:03.180 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:02 smithi152 ceph-mon[33237]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:03.565 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56193]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:45:03.565 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56193]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:03.565 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56193]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:03.565 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56193]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:03.815 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56320]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:45:03.815 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:03.815 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56320]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:03.815 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:45:03 smithi053 sudo[56320]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:04.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56341]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:45:04.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56341]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:04.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56341]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:04.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56341]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: osdmap e23: 3 total, 3 up, 3 in 2024-09-16T00:45:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi053 2024-09-16T00:45:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi053 to 3948M 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:03 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: osdmap e23: 3 total, 3 up, 3 in 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi053 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi053 to 3948M 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:04.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:04.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:03 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:04.807 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56443]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:45:04.807 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:04.807 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56443]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:04.807 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56443]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:04.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:04.891+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f45f00561b0 con 0x7f4604101440 2024-09-16T00:45:05.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56469]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:45:05.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56469]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:05.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56469]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:05.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:04 smithi053 sudo[56469]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1944003973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]: dispatch 2024-09-16T00:45:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]: dispatch 2024-09-16T00:45:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]': finished 2024-09-16T00:45:05.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T00:45:05.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:04 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:05.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:05.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/1944003973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]: dispatch 2024-09-16T00:45:05.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]: dispatch 2024-09-16T00:45:05.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5045443a-cf8b-40fb-9faf-4acf383f8ac8"}]': finished 2024-09-16T00:45:05.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T00:45:05.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:04 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:05.700 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56541]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:45:05.700 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56541]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:05.700 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56541]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:05.700 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56541]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:06.068 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56585]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:45:06.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56585]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:06.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56585]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:06.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:05 smithi053 sudo[56585]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:06.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 ceph-mon[33237]: mgrmap e19: smithi053.cjiiek(active, since 2m), standbys: smithi152.nlmwrx 2024-09-16T00:45:06.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/3257213310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:06.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 ceph-mon[33237]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:45:06.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37627]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T00:45:06.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37627]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:06.618 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37627]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:06.618 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37627]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:06.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 sudo[56623]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:45:06.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 sudo[56623]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:06.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 sudo[56623]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:06.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 sudo[56623]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:06.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 ceph-mon[27950]: mgrmap e19: smithi053.cjiiek(active, since 2m), standbys: smithi152.nlmwrx 2024-09-16T00:45:06.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/3257213310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:06.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:06 smithi053 ceph-mon[27950]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:45:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37815]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T00:45:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37815]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T00:45:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37815]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-16T00:45:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:06 smithi152 sudo[37815]: pam_unix(sudo:session): session closed for user root 2024-09-16T00:45:07.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:45:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T00:45:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:08 smithi152 ceph-mon[33237]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:08 smithi053 ceph-mon[27950]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:10.605 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:10.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:11.638 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:11 smithi152 ceph-mon[33237]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-16T00:45:11.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:11 smithi053 ceph-mon[27950]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-16T00:45:12.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:45:12.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:12.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:45:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:13.607 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:13 smithi152 ceph-mon[33237]: Deploying daemon osd.3 on smithi152 2024-09-16T00:45:13.607 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:13 smithi152 ceph-mon[33237]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-16T00:45:13.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:13 smithi053 ceph-mon[27950]: Deploying daemon osd.3 on smithi152 2024-09-16T00:45:13.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:13 smithi053 ceph-mon[27950]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-16T00:45:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:15 smithi152 ceph-mon[33237]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-16T00:45:15.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:15 smithi053 ceph-mon[27950]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-16T00:45:17.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:17 smithi152 ceph-mon[33237]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-16T00:45:17.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:17.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:17.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:17.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:17 smithi053 ceph-mon[27950]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-16T00:45:17.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:17.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:17.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:19.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.267+0000 7f4601ffb700 1 -- 172.21.15.152:0/3136057190 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4604105d90 con 0x7f45f406c610 2024-09-16T00:45:19.268 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 3 on host 'smithi152' 2024-09-16T00:45:19.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 msgr2=0x7f45f406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:19.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 0x7f45f406eac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45f8006010 tx=0x7f45f800b560 comp rx=0 tx=0).stop 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 msgr2=0x7f4604196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f45f000d8d0 tx=0x7f45f000dbe0 comp rx=0 tx=0).stop 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 shutdown_connections 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f45f406c610 0x7f45f406eac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4604100240 0x7f4604195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 --2- 172.21.15.152:0/3136057190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4604101440 0x7f4604196020 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 >> 172.21.15.152:0/3136057190 conn(0x7f46040fb7f0 msgr2=0x7f4604104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 shutdown_connections 2024-09-16T00:45:19.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:19.269+0000 7f460ae97700 1 -- 172.21.15.152:0/3136057190 wait complete. 2024-09-16T00:45:19.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:19 smithi152 ceph-mon[33237]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-16T00:45:19.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:19 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:19.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:19 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:19 smithi053 ceph-mon[27950]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-16T00:45:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:19 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:19 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:19.889 DEBUG:teuthology.orchestra.run.smithi152:osd.3> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T00:45:19.892 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2024-09-16T00:45:19.892 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T00:45:20.263 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:45:20.682 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:45:20 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:45:20.475+0000 7fbf38405640 -1 osd.3 0 log_to_monitors true 2024-09-16T00:45:21.408 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:21 smithi152 ceph-mon[33237]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-16T00:45:21.408 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:21 smithi152 ceph-mon[33237]: from='osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:45:21.408 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:21 smithi152 ceph-mon[33237]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:45:21.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:21 smithi053 ceph-mon[27950]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-16T00:45:21.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:21 smithi053 ceph-mon[27950]: from='osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:45:21.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:21 smithi053 ceph-mon[27950]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:45:22.646 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:45:22.384+0000 7fbf2d27b700 -1 osd.3 0 waiting for initial osdmap 2024-09-16T00:45:22.647 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:45:22.391+0000 7fbf25869700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:45:22.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-mon[33237]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:45:22.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-mon[33237]: osdmap e25: 4 total, 3 up, 4 in 2024-09-16T00:45:22.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:22.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-mon[33237]: from='osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:22.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:22 smithi152 ceph-mon[33237]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:22 smithi053 ceph-mon[27950]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:45:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:22 smithi053 ceph-mon[27950]: osdmap e25: 4 total, 3 up, 4 in 2024-09-16T00:45:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:22 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:22 smithi053 ceph-mon[27950]: from='osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:22 smithi053 ceph-mon[27950]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:22.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:45:22.944 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-09-16T00:45:23.146 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:45:23.551 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:23.551 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:45:23.552 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: osdmap e26: 4 total, 3 up, 4 in 2024-09-16T00:45:23.552 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:23.552 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:23.552 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:23.552 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:23 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: osdmap e26: 4 total, 3 up, 4 in 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:23 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:24.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:24 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:45:24.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:24 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:45:24.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:24 smithi152 ceph-mon[33237]: osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] boot 2024-09-16T00:45:24.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:24 smithi152 ceph-mon[33237]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T00:45:24.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:24 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:24.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:24 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:45:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:24 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:45:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:24 smithi053 ceph-mon[27950]: osd.3 [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] boot 2024-09-16T00:45:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:24 smithi053 ceph-mon[27950]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T00:45:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:24 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:45:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:25 smithi152 ceph-mon[33237]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:25 smithi152 ceph-mon[33237]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T00:45:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- 172.21.15.152:0/1633988850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0fe7c0 msgr2=0x7f07bc0febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 --2- 172.21.15.152:0/1633988850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc0febd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009910 tx=0x7f07b0009c20 comp rx=0 tx=0).stop 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- 172.21.15.152:0/1633988850 shutdown_connections 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 --2- 172.21.15.152:0/1633988850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc0ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 --2- 172.21.15.152:0/1633988850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc0febd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- 172.21.15.152:0/1633988850 >> 172.21.15.152:0/1633988850 conn(0x7f07bc0f9d70 msgr2=0x7f07bc0fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- 172.21.15.152:0/1633988850 shutdown_connections 2024-09-16T00:45:25.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- 172.21.15.152:0/1633988850 wait complete. 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 Processor -- start 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.684+0000 7f07c2a83700 1 -- start start 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c2a83700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc194840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c2a83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c2a83700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc1953a0 con 0x7f07bc0fe7c0 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c2a83700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc1954e0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48778/0 (socket says 172.21.15.152:48778) 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 -- 172.21.15.152:0/2578109641 learned_addr learned my addr 172.21.15.152:0/2578109641 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c081f700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc194840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 -- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0fe7c0 msgr2=0x7f07bc194840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc194840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 -- 172.21.15.152:0/2578109641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00095f0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07bbfff700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d8d0 tx=0x7f07a800dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:25.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a80098a0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07a8010460 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07a800f5f0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.685+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc104da0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.686+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc1052f0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.687+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07bc107b90 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.687+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f07a8009a00 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.687+0000 7f07b9ffb700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 0x7f07ac06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.687+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3631+0+0 (secure 0 0 0) 0x7f07a808af80 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.688+0000 7f07c081f700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 0x7f07ac06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:25.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.688+0000 7f07c081f700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 0x7f07ac06eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006010 tx=0x7f07b000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:25.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.692+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f07a80598a0 con 0x7f07bc0ff9c0 2024-09-16T00:45:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:25 smithi053 ceph-mon[27950]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:25 smithi053 ceph-mon[27950]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T00:45:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:25.900+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f07bc104310 con 0x7f07ac06c680 2024-09-16T00:45:26.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:26 smithi152 ceph-mon[33237]: osdmap e29: 4 total, 4 up, 4 in 2024-09-16T00:45:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:26 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:26 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:26 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:26 smithi152 ceph-mon[33237]: osdmap e30: 4 total, 4 up, 4 in 2024-09-16T00:45:26.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:26 smithi053 ceph-mon[27950]: osdmap e29: 4 total, 4 up, 4 in 2024-09-16T00:45:26.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:26 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:26.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:26 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:26.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:26 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:26.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:26 smithi053 ceph-mon[27950]: osdmap e30: 4 total, 4 up, 4 in 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:27.683 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:27.683 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:27.683 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.683 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:27 smithi152 ceph-mon[33237]: osdmap e31: 4 total, 4 up, 4 in 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:27.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:27 smithi053 ceph-mon[27950]: osdmap e31: 4 total, 4 up, 4 in 2024-09-16T00:45:28.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:28 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi152 2024-09-16T00:45:28.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:28 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi152 to 14912M 2024-09-16T00:45:28.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:28 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi152 2024-09-16T00:45:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:28 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi152 to 14912M 2024-09-16T00:45:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/4267227249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]: dispatch 2024-09-16T00:45:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]: dispatch 2024-09-16T00:45:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]': finished 2024-09-16T00:45:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T00:45:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:29 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/4267227249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]: dispatch 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]: dispatch 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7508fba1-f161-4f37-aba3-c670074fe7f4"}]': finished 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T00:45:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:29 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:30.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:30 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/4222794828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:30.719 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:30 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/4222794828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:31 smithi152 ceph-mon[33237]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-16T00:45:31.731 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:31 smithi053 ceph-mon[27950]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-16T00:45:33.633 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:33 smithi152 ceph-mon[33237]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:45:33.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:33 smithi053 ceph-mon[27950]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T00:45:35.694 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:35 smithi152 ceph-mon[33237]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:45:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:35 smithi053 ceph-mon[27950]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T00:45:36.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:45:36.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:45:36.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:37 smithi152 ceph-mon[33237]: Deploying daemon osd.4 on smithi152 2024-09-16T00:45:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:37 smithi152 ceph-mon[33237]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-16T00:45:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:37 smithi053 ceph-mon[27950]: Deploying daemon osd.4 on smithi152 2024-09-16T00:45:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:37 smithi053 ceph-mon[27950]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-16T00:45:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:39 smithi152 ceph-mon[33237]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:45:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:39 smithi053 ceph-mon[27950]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T00:45:40.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:41.694 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:41 smithi152 ceph-mon[33237]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T00:45:41.695 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:41.695 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:41.695 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:41 smithi053 ceph-mon[27950]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T00:45:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:42.674 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:42 smithi152 ceph-mon[33237]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:42 smithi053 ceph-mon[27950]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:44.314 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2024-09-16T00:45:44.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.312+0000 7f07b9ffb700 1 -- 172.21.15.152:0/2578109641 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f07bc104310 con 0x7f07ac06c680 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 msgr2=0x7f07ac06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 0x7f07ac06eb30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006010 tx=0x7f07b000b540 comp rx=0 tx=0).stop 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 msgr2=0x7f07bc194d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d8d0 tx=0x7f07a800dbe0 comp rx=0 tx=0).stop 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 shutdown_connections 2024-09-16T00:45:44.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f07ac06c680 0x7f07ac06eb30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:44.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07bc0fe7c0 0x7f07bc194840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:44.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 --2- 172.21.15.152:0/2578109641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07bc0ff9c0 0x7f07bc194d80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:44.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 >> 172.21.15.152:0/2578109641 conn(0x7f07bc0f9d70 msgr2=0x7f07bc102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:45:44.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 shutdown_connections 2024-09-16T00:45:44.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:44.315+0000 7f07c2a83700 1 -- 172.21.15.152:0/2578109641 wait complete. 2024-09-16T00:45:44.918 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T00:45:44.921 INFO:tasks.cephadm:Deploying osd.5 on smithi152 with /dev/vg_nvme/lv_2... 2024-09-16T00:45:44.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T00:45:45.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-mon[33237]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-mon[33237]: from='osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:45:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-mon[33237]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:45:45.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:45:45 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:45:45.175+0000 7fa0e8303640 -1 osd.4 0 log_to_monitors true 2024-09-16T00:45:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:45 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:45 smithi053 ceph-mon[27950]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:45 smithi053 ceph-mon[27950]: from='osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:45:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:45 smithi053 ceph-mon[27950]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:45:45.615 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:45:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:46 smithi053 ceph-mon[27950]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:45:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:46 smithi053 ceph-mon[27950]: osdmap e33: 5 total, 4 up, 5 in 2024-09-16T00:45:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:46 smithi053 ceph-mon[27950]: from='osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:46 smithi053 ceph-mon[27950]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:46.626 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:45:46.277+0000 7fa0dd179700 -1 osd.4 0 waiting for initial osdmap 2024-09-16T00:45:46.626 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:45:46.284+0000 7fa0d776b700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:45:46.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-mon[33237]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:45:46.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-mon[33237]: osdmap e33: 5 total, 4 up, 5 in 2024-09-16T00:45:46.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:46.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-mon[33237]: from='osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:46.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:46 smithi152 ceph-mon[33237]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: osdmap e34: 5 total, 4 up, 5 in 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:47 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:47.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: osdmap e34: 5 total, 4 up, 5 in 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:47 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:48.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:48 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:45:48.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:48 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:45:48.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:48 smithi152 ceph-mon[33237]: osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] boot 2024-09-16T00:45:48.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:48 smithi152 ceph-mon[33237]: osdmap e35: 5 total, 5 up, 5 in 2024-09-16T00:45:48.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:48 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:45:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:48 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:45:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:48 smithi053 ceph-mon[27950]: osd.4 [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] boot 2024-09-16T00:45:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:48 smithi053 ceph-mon[27950]: osdmap e35: 5 total, 5 up, 5 in 2024-09-16T00:45:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:45:48.978 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-16T00:45:49.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-09-16T00:45:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:49 smithi053 ceph-mon[27950]: osdmap e36: 5 total, 5 up, 5 in 2024-09-16T00:45:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:49 smithi053 ceph-mon[27950]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:49.618 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:45:49.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:49 smithi152 ceph-mon[33237]: osdmap e36: 5 total, 5 up, 5 in 2024-09-16T00:45:49.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:49 smithi152 ceph-mon[33237]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:51.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 -- 172.21.15.152:0/218573541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784103680 msgr2=0x7fb784105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/218573541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784103680 0x7fb784105a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb778009910 tx=0x7fb778009c20 comp rx=0 tx=0).stop 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 -- 172.21.15.152:0/218573541 shutdown_connections 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/218573541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784103680 0x7fb784105a60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/218573541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784100d60 0x7fb784103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 -- 172.21.15.152:0/218573541 >> 172.21.15.152:0/218573541 conn(0x7fb7840fa780 msgr2=0x7fb7840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 -- 172.21.15.152:0/218573541 shutdown_connections 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.345+0000 7fb78a7f6700 1 -- 172.21.15.152:0/218573541 wait complete. 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 Processor -- start 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 -- start start 2024-09-16T00:45:51.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784103680 0x7fb784196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784196620 con 0x7fb784103680 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb78a7f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784196760 con 0x7fb784100d60 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb783fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb783fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40798/0 (socket says 172.21.15.152:40798) 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.346+0000 7fb783fff700 1 -- 172.21.15.152:0/285583082 learned_addr learned my addr 172.21.15.152:0/285583082 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb783fff700 1 -- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784103680 msgr2=0x7fb784196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb783fff700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784103680 0x7fb784196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb783fff700 1 -- 172.21.15.152:0/285583082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780095f0 con 0x7fb784100d60 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb783fff700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb77400d900 tx=0x7fb77400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb774009900 con 0x7fb784100d60 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb774010460 con 0x7fb784100d60 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78419b210 con 0x7fb784100d60 2024-09-16T00:45:51.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77400f5f0 con 0x7fb784100d60 2024-09-16T00:45:51.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.347+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78419b760 con 0x7fb784100d60 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.348+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78418fbe0 con 0x7fb784100d60 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.349+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb7740105d0 con 0x7fb784100d60 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.349+0000 7fb7817fa700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 0x7fb76c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.349+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7fb77408ae60 con 0x7fb784100d60 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.349+0000 7fb7837fe700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 0x7fb76c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.350+0000 7fb7837fe700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 0x7fb76c06eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b5c0 tx=0x7fb778005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:45:51.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.353+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb7740595e0 con 0x7fb784100d60 2024-09-16T00:45:51.557 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:51 smithi152 ceph-mon[33237]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:45:51.554+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb784061190 con 0x7fb76c06c680 2024-09-16T00:45:51.700 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:51 smithi053 ceph-mon[27950]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:52.596 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:52.596 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:52.596 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.596 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:52.597 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:52.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:45:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:45:53.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:53 smithi152 ceph-mon[33237]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:53 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi152 2024-09-16T00:45:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:53 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi152 to 7456M 2024-09-16T00:45:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:53 smithi152 ceph-mon[33237]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:53.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:53 smithi053 ceph-mon[27950]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:45:53.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:53 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi152 2024-09-16T00:45:53.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:53 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi152 to 7456M 2024-09-16T00:45:53.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:53 smithi053 ceph-mon[27950]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:54 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/729943638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]: dispatch 2024-09-16T00:45:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:54 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]: dispatch 2024-09-16T00:45:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:54 smithi152 ceph-mon[33237]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]': finished 2024-09-16T00:45:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:54 smithi152 ceph-mon[33237]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T00:45:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:54 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:45:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:54 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/729943638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]: dispatch 2024-09-16T00:45:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:54 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]: dispatch 2024-09-16T00:45:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:54 smithi053 ceph-mon[27950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31"}]': finished 2024-09-16T00:45:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:54 smithi053 ceph-mon[27950]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T00:45:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:54 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:45:55.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:55 smithi152 ceph-mon[33237]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:55 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/1450627016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:55 smithi053 ceph-mon[27950]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:55 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/1450627016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T00:45:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:45:57.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:57 smithi152 ceph-mon[33237]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:57 smithi053 ceph-mon[27950]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:59.588 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:45:59 smithi152 ceph-mon[33237]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:45:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:45:59 smithi053 ceph-mon[27950]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:01 smithi152 ceph-mon[33237]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:01 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:46:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:01 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:01.778 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:01 smithi053 ceph-mon[27950]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:01.778 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:46:01.778 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:01 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:02.687 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:02 smithi152 ceph-mon[33237]: Deploying daemon osd.5 on smithi152 2024-09-16T00:46:02.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:02 smithi053 ceph-mon[27950]: Deploying daemon osd.5 on smithi152 2024-09-16T00:46:03.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:03 smithi152 ceph-mon[33237]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:03.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:03 smithi053 ceph-mon[27950]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:05 smithi152 ceph-mon[33237]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:05 smithi053 ceph-mon[27950]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:46:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:07 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:07 smithi053 ceph-mon[27950]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:46:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:07 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:07 smithi152 ceph-mon[33237]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:09.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:09 smithi152 ceph-mon[33237]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:09.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:09 smithi053 ceph-mon[27950]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:10.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.179+0000 7fb7817fa700 1 -- 172.21.15.152:0/285583082 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb784061190 con 0x7fb76c06c680 2024-09-16T00:46:10.180 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 5 on host 'smithi152' 2024-09-16T00:46:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 msgr2=0x7fb76c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 0x7fb76c06eb30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b5c0 tx=0x7fb778005960 comp rx=0 tx=0).stop 2024-09-16T00:46:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 msgr2=0x7fb784195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb77400d900 tx=0x7fb77400dcc0 comp rx=0 tx=0).stop 2024-09-16T00:46:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 shutdown_connections 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb76c06c680 0x7fb76c06eb30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb784100d60 0x7fb784195ac0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 --2- 172.21.15.152:0/285583082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784103680 0x7fb784196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.181+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 >> 172.21.15.152:0/285583082 conn(0x7fb7840fa780 msgr2=0x7fb7840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.182+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 shutdown_connections 2024-09-16T00:46:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:10.182+0000 7fb78a7f6700 1 -- 172.21.15.152:0/285583082 wait complete. 2024-09-16T00:46:10.763 DEBUG:teuthology.orchestra.run.smithi152:osd.5> sudo journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T00:46:10.765 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-16T00:46:10.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:46:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:11.376 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.377 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:46:11.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:46:11.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:11.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:11.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:11.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:12.405 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:12 smithi053 ceph-mon[27950]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:46:12.405 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:12 smithi053 ceph-mon[27950]: osdmap e38: 6 total, 5 up, 6 in 2024-09-16T00:46:12.405 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:12 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:12.406 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:12 smithi053 ceph-mon[27950]: from='osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:46:12.406 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:12 smithi053 ceph-mon[27950]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:46:12.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-mon[33237]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:46:12.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-mon[33237]: osdmap e38: 6 total, 5 up, 6 in 2024-09-16T00:46:12.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:12.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-mon[33237]: from='osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:46:12.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-mon[33237]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:46:12.448 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[48466]: 2024-09-16T00:46:12.169+0000 7fb9ca5bf700 -1 osd.5 0 waiting for initial osdmap 2024-09-16T00:46:12.448 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:46:12 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[48466]: 2024-09-16T00:46:12.178+0000 7fb9c33ae700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:46:12.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 -- 172.21.15.53:0/1669547386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294100240 msgr2=0x7f2294100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 --2- 172.21.15.53:0/1669547386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294100240 0x7f2294100650 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f229000b0a0 tx=0x7f229000b3b0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 -- 172.21.15.53:0/1669547386 shutdown_connections 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 --2- 172.21.15.53:0/1669547386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294101440 0x7f2294101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 --2- 172.21.15.53:0/1669547386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294100240 0x7f2294100650 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 -- 172.21.15.53:0/1669547386 >> 172.21.15.53:0/1669547386 conn(0x7f22940fb7f0 msgr2=0x7f22940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 -- 172.21.15.53:0/1669547386 shutdown_connections 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.773+0000 7f229b83d700 1 -- 172.21.15.53:0/1669547386 wait complete. 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 Processor -- start 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 -- start start 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 0x7f2294195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294196770 con 0x7f2294101440 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f229b83d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229419b180 con 0x7f2294100240 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59254/0 (socket says 172.21.15.53:59254) 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 -- 172.21.15.53:0/3737435225 learned_addr learned my addr 172.21.15.53:0/3737435225 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f22995d9700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 0x7f2294195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 -- 172.21.15.53:0/3737435225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 msgr2=0x7f2294195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 0x7f2294195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f2298dd8700 1 -- 172.21.15.53:0/3737435225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009d00 con 0x7f2294101440 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.774+0000 7f22995d9700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 0x7f2294195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f2298dd8700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f228400b4b0 tx=0x7f228400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2284011800 con 0x7f2294101440 2024-09-16T00:46:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2284011e10 con 0x7f2294101440 2024-09-16T00:46:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229419b380 con 0x7f2294101440 2024-09-16T00:46:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228400f2e0 con 0x7f2294101440 2024-09-16T00:46:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.775+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229419b8a0 con 0x7f2294101440 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.776+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294108e10 con 0x7f2294101440 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.776+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2284010380 con 0x7f2294101440 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.777+0000 7f228a7fc700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 0x7f228006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.777+0000 7f22995d9700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 0x7f228006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.777+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4186+0+0 (secure 0 0 0) 0x7f228408aeb0 con 0x7f2294101440 2024-09-16T00:46:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.777+0000 7f22995d9700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 0x7f228006eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2290009fd0 tx=0x7f229000b7b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.782+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2284055b10 con 0x7f2294101440 2024-09-16T00:46:12.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.986+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2294108fd0 con 0x7f2294101440 2024-09-16T00:46:12.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.986+0000 7f228a7fc700 1 -- 172.21.15.53:0/3737435225 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f22840150a0 con 0x7f2294101440 2024-09-16T00:46:12.988 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:12.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 msgr2=0x7f228006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:12.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 0x7f228006eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2290009fd0 tx=0x7f229000b7b0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 msgr2=0x7f2294196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:12.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f228400b4b0 tx=0x7f228400b870 comp rx=0 tx=0).stop 2024-09-16T00:46:12.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 shutdown_connections 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f228006c680 0x7f228006eb30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2294100240 0x7f2294195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 --2- 172.21.15.53:0/3737435225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2294101440 0x7f2294196150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 >> 172.21.15.53:0/3737435225 conn(0x7f22940fb7f0 msgr2=0x7f2294104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 shutdown_connections 2024-09-16T00:46:12.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:12.988+0000 7f229b83d700 1 -- 172.21.15.53:0/3737435225 wait complete. 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: osdmap e39: 6 total, 5 up, 6 in 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:13.288 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:13 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3737435225' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:46:13.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-16T00:46:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: osdmap e39: 6 total, 5 up, 6 in 2024-09-16T00:46:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-16T00:46:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:13 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3737435225' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:46:13.777 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1726447547,"num_in_osds":6,"osd_in_since":1726447553,"num_remapped_pgs":0} 2024-09-16T00:46:14.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: purged_snaps scrub starts 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: purged_snaps scrub ok 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] boot 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:14.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:46:14.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:14 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: purged_snaps scrub starts 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: purged_snaps scrub ok 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: osd.5 [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] boot 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:46:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:46:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:14 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:14.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T00:46:14.982 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:15.425 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: Detected new or changed devices on smithi152 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi152 to 4970M 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:46:15.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:15.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: Detected new or changed devices on smithi152 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi152 to 4970M 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:46:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:46:16.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.788+0000 7f3c047ef700 1 -- 172.21.15.53:0/2220140160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc0ff140 msgr2=0x7f3bfc0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.788+0000 7f3c047ef700 1 --2- 172.21.15.53:0/2220140160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc0ff550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009910 tx=0x7f3bf8009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.788+0000 7f3c047ef700 1 -- 172.21.15.53:0/2220140160 shutdown_connections 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.788+0000 7f3c047ef700 1 --2- 172.21.15.53:0/2220140160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc100340 0x7f3bfc100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.788+0000 7f3c047ef700 1 --2- 172.21.15.53:0/2220140160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc0ff550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.789+0000 7f3c047ef700 1 -- 172.21.15.53:0/2220140160 >> 172.21.15.53:0/2220140160 conn(0x7f3bfc0fa6d0 msgr2=0x7f3bfc0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.789+0000 7f3c047ef700 1 -- 172.21.15.53:0/2220140160 shutdown_connections 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.789+0000 7f3c047ef700 1 -- 172.21.15.53:0/2220140160 wait complete. 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.789+0000 7f3c047ef700 1 Processor -- start 2024-09-16T00:46:16.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.789+0000 7f3c047ef700 1 -- start start 2024-09-16T00:46:16.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c047ef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:16.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c047ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:16.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c047ef700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19cca0 con 0x7f3bfc100340 2024-09-16T00:46:16.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c047ef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc19cde0 con 0x7f3bfc0ff140 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59278/0 (socket says 172.21.15.53:59278) 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 -- 172.21.15.53:0/3443004866 learned_addr learned my addr 172.21.15.53:0/3443004866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c0258b700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 -- 172.21.15.53:0/3443004866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 msgr2=0x7f3bfc19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 -- 172.21.15.53:0/3443004866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80095f0 con 0x7f3bfc100340 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c0258b700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3c01d8a700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b4b0 tx=0x7f3bec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.790+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec011800 con 0x7f3bfc100340 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.791+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc1a1890 con 0x7f3bfc100340 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.791+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3bec011e10 con 0x7f3bfc100340 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.791+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec00f2e0 con 0x7f3bfc100340 2024-09-16T00:46:16.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.791+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc1a1de0 con 0x7f3bfc100340 2024-09-16T00:46:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.792+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc107d10 con 0x7f3bfc100340 2024-09-16T00:46:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.792+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3bec010380 con 0x7f3bfc100340 2024-09-16T00:46:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.793+0000 7f3bf37fe700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 0x7f3be806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.793+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f3bec08b110 con 0x7f3bfc100340 2024-09-16T00:46:16.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.793+0000 7f3c0258b700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 0x7f3be806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:16.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.793+0000 7f3c0258b700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 0x7f3be806eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8006010 tx=0x7f3bf8005ab0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:16.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:16.798+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3bec059660 con 0x7f3bfc100340 2024-09-16T00:46:17.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.008+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f3bfc107ed0 con 0x7f3bfc100340 2024-09-16T00:46:17.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.009+0000 7f3bf37fe700 1 -- 172.21.15.53:0/3443004866 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f3bec0591f0 con 0x7f3bfc100340 2024-09-16T00:46:17.010 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.010+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 msgr2=0x7f3be806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.010+0000 7f3c047ef700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 0x7f3be806eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8006010 tx=0x7f3bf8005ab0 comp rx=0 tx=0).stop 2024-09-16T00:46:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.010+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 msgr2=0x7f3bfc19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.010+0000 7f3c047ef700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b4b0 tx=0x7f3bec00b870 comp rx=0 tx=0).stop 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 shutdown_connections 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f3be806c680 0x7f3be806eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bfc0ff140 0x7f3bfc19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 --2- 172.21.15.53:0/3443004866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3bfc100340 0x7f3bfc19c680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 >> 172.21.15.53:0/3443004866 conn(0x7f3bfc0fa6d0 msgr2=0x7f3bfc068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 shutdown_connections 2024-09-16T00:46:17.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:17.011+0000 7f3c047ef700 1 -- 172.21.15.53:0/3443004866 wait complete. 2024-09-16T00:46:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:17 smithi152 ceph-mon[33237]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:17 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3443004866' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:46:17.728 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:17 smithi053 ceph-mon[27950]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:17.728 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:17 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3443004866' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T00:46:17.757 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1726447573,"num_in_osds":6,"osd_in_since":1726447553,"num_remapped_pgs":0} 2024-09-16T00:46:17.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:46:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:19.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:19 smithi053 ceph-mon[27950]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:19.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:19 smithi152 ceph-mon[33237]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 -- 172.21.15.53:0/898484176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ffd50 msgr2=0x7f0274103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 --2- 172.21.15.53:0/898484176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ffd50 0x7f0274103d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0268009910 tx=0x7f0268009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 -- 172.21.15.53:0/898484176 shutdown_connections 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 --2- 172.21.15.53:0/898484176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ffd50 0x7f0274103d20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 --2- 172.21.15.53:0/898484176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ff3b0 0x7f02740ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 -- 172.21.15.53:0/898484176 >> 172.21.15.53:0/898484176 conn(0x7f02740fac90 msgr2=0x7f02740fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 -- 172.21.15.53:0/898484176 shutdown_connections 2024-09-16T00:46:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.818+0000 7f027b63d700 1 -- 172.21.15.53:0/898484176 wait complete. 2024-09-16T00:46:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 Processor -- start 2024-09-16T00:46:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 -- start start 2024-09-16T00:46:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ffd50 0x7f02741964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:19.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274196b90 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f027b63d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027419a920 con 0x7f02740ffd50 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.819+0000 7f02793d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59290/0 (socket says 172.21.15.53:59290) 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 -- 172.21.15.53:0/2822997556 learned_addr learned my addr 172.21.15.53:0/2822997556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f0278bd8700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ffd50 0x7f02741964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 -- 172.21.15.53:0/2822997556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ffd50 msgr2=0x7f02741964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ffd50 0x7f02741964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 -- 172.21.15.53:0/2822997556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680095f0 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02793d9700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f027000b4b0 tx=0x7f027000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0270011800 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0270011e10 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027419ac00 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027000f2e0 con 0x7f02740ff3b0 2024-09-16T00:46:19.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.820+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027419b150 con 0x7f02740ff3b0 2024-09-16T00:46:19.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.821+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027404f2a0 con 0x7f02740ff3b0 2024-09-16T00:46:19.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.822+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0270010380 con 0x7f02740ff3b0 2024-09-16T00:46:19.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.822+0000 7f02667fc700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 0x7f026006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:19.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.822+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f027008aff0 con 0x7f02740ff3b0 2024-09-16T00:46:19.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.822+0000 7f0278bd8700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 0x7f026006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:19.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.823+0000 7f0278bd8700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 0x7f026006eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0274197590 tx=0x7f026801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:19.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:19.827+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0270055be0 con 0x7f02740ff3b0 2024-09-16T00:46:20.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.031+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027419b420 con 0x7f02740ff3b0 2024-09-16T00:46:20.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.032+0000 7f02667fc700 1 -- 172.21.15.53:0/2822997556 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11037 (secure 0 0 0) 0x7f0270059200 con 0x7f02740ff3b0 2024-09-16T00:46:20.033 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:20.033 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":41,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","created":"2024-09-16T00:40:30.607381+0000","modified":"2024-09-16T00:46:14.173089+0000","last_up_change":"2024-09-16T00:46:13.167665+0000","last_in_change":"2024-09-16T00:45:53.920511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:45:00.827169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6803","nonce":140782636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6805","nonce":140782636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6809","nonce":140782636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6807","nonce":140782636}]},"public_addr":"172.21.15.53:6803/140782636","cluster_addr":"172.21.15.53:6805/140782636","heartbeat_back_addr":"172.21.15.53:6809/140782636","heartbeat_front_addr":"172.21.15.53:6807/140782636","state":["exists","up"]},{"osd":1,"uuid":"fd422dc9-c004-4434-b2e5-41b1657ad07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6811","nonce":4284864954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6813","nonce":4284864954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6817","nonce":4284864954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6815","nonce":4284864954}]},"public_addr":"172.21.15.53:6811/4284864954","cluster_addr":"172.21.15.53:6813/4284864954","heartbeat_back_addr":"172.21.15.53:6817/4284864954","heartbeat_front_addr":"172.21.15.53:6815/4284864954","state":["exists","up"]},{"osd":2,"uuid":"e6da8427-e1ea-4f98-890e-41f909d91892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6819","nonce":4278429651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6821","nonce":4278429651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6825","nonce":4278429651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6823","nonce":4278429651}]},"public_addr":"172.21.15.53:6819/4278429651","cluster_addr":"172.21.15.53:6821/4278429651","heartbeat_back_addr":"172.21.15.53:6825/4278429651","heartbeat_front_addr":"172.21.15.53:6823/4278429651","state":["exists","up"]},{"osd":3,"uuid":"5045443a-cf8b-40fb-9faf-4acf383f8ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6801","nonce":1133456156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6803","nonce":1133456156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6807","nonce":1133456156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6805","nonce":1133456156}]},"public_addr":"172.21.15.152:6801/1133456156","cluster_addr":"172.21.15.152:6803/1133456156","heartbeat_back_addr":"172.21.15.152:6807/1133456156","heartbeat_front_addr":"172.21.15.152:6805/1133456156","state":["exists","up"]},{"osd":4,"uuid":"7508fba1-f161-4f37-aba3-c670074fe7f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6809","nonce":635956926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6811","nonce":635956926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6815","nonce":635956926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6813","nonce":635956926}]},"public_addr":"172.21.15.152:6809/635956926","cluster_addr":"172.21.15.152:6811/635956926","heartbeat_back_addr":"172.21.15.152:6815/635956926","heartbeat_front_addr":"172.21.15.152:6813/635956926","state":["exists","up"]},{"osd":5,"uuid":"eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6817","nonce":978992476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6819","nonce":978992476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6823","nonce":978992476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6821","nonce":978992476}]},"public_addr":"172.21.15.152:6817/978992476","cluster_addr":"172.21.15.152:6819/978992476","heartbeat_back_addr":"172.21.15.152:6823/978992476","heartbeat_front_addr":"172.21.15.152:6821/978992476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:43:57.824940+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:27.349730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:57.358764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:21.442070+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:46.137938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:46:11.199980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1711068346":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2791398459":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/1233292445":"2024-09-17T00:41:32.995408+0000","172.21.15.53:0/3622055572":"2024-09-17T00:41:32.995408+0000","172.21.15.53:6801/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2704105110":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2403024149":"2024-09-17T00:40:58.741023+0000","172.21.15.53:6800/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/1610550310":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2434528936":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2239443060":"2024-09-17T00:41:32.995408+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:46:20.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.034+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 msgr2=0x7f026006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:20.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.034+0000 7f027b63d700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 0x7f026006eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0274197590 tx=0x7f026801a040 comp rx=0 tx=0).stop 2024-09-16T00:46:20.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.034+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 msgr2=0x7f0274195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.034+0000 7f027b63d700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f027000b4b0 tx=0x7f027000b870 comp rx=0 tx=0).stop 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 shutdown_connections 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f026006c680 0x7f026006eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02740ff3b0 0x7f0274195f70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 --2- 172.21.15.53:0/2822997556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02740ffd50 0x7f02741964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 >> 172.21.15.53:0/2822997556 conn(0x7f02740fac90 msgr2=0x7f0274103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 shutdown_connections 2024-09-16T00:46:20.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:20.035+0000 7f027b63d700 1 -- 172.21.15.53:0/2822997556 wait complete. 2024-09-16T00:46:20.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:20 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2822997556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:20.710 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:20 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2822997556' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:20.736 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T00:45:00.827169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T00:46:20.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T00:46:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:21 smithi152 ceph-mon[33237]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:21.768 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:21 smithi053 ceph-mon[27950]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:22.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.733+0000 7fe088549700 1 -- 172.21.15.53:0/926435506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ffd50 msgr2=0x7fe080103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.733+0000 7fe088549700 1 --2- 172.21.15.53:0/926435506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ffd50 0x7fe080103d20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe070009910 tx=0x7fe070009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 -- 172.21.15.53:0/926435506 shutdown_connections 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 --2- 172.21.15.53:0/926435506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ffd50 0x7fe080103d20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 --2- 172.21.15.53:0/926435506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ff3b0 0x7fe0800ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 -- 172.21.15.53:0/926435506 >> 172.21.15.53:0/926435506 conn(0x7fe0800fac90 msgr2=0x7fe0800fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 -- 172.21.15.53:0/926435506 shutdown_connections 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 -- 172.21.15.53:0/926435506 wait complete. 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 Processor -- start 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 -- start start 2024-09-16T00:46:22.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.734+0000 7fe088549700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe088549700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ffd50 0x7fe08010a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe088549700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08010ab10 con 0x7fe0800ff3b0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe088549700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08010ac50 con 0x7fe0800ffd50 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43142/0 (socket says 172.21.15.53:43142) 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 -- 172.21.15.53:0/3109546486 learned_addr learned my addr 172.21.15.53:0/3109546486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe085ae4700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ffd50 0x7fe08010a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 -- 172.21.15.53:0/3109546486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ffd50 msgr2=0x7fe08010a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ffd50 0x7fe08010a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 -- 172.21.15.53:0/3109546486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700095f0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0862e5700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c8a0 tx=0x7fe07c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c00cea0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0801a20c0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe07c004830 con 0x7fe0800ff3b0 2024-09-16T00:46:22.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c0055b0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.735+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0801a24d0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.736+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080107720 con 0x7fe0800ff3b0 2024-09-16T00:46:22.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.737+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe07c007ad0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.737+0000 7fe0777fe700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 0x7fe06c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:22.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.738+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe07c08b2a0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.738+0000 7fe085ae4700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 0x7fe06c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:22.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.738+0000 7fe085ae4700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 0x7fe06c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe08010b880 tx=0x7fe07001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:22.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.742+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe07c055cc0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.940+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe08010ae10 con 0x7fe0800ff3b0 2024-09-16T00:46:22.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.941+0000 7fe0777fe700 1 -- 172.21.15.53:0/3109546486 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe07c0592e0 con 0x7fe0800ff3b0 2024-09-16T00:46:22.942 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-16T00:46:22.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 msgr2=0x7fe06c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:22.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 0x7fe06c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe08010b880 tx=0x7fe07001a040 comp rx=0 tx=0).stop 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 msgr2=0x7fe08010a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c8a0 tx=0x7fe07c00cc60 comp rx=0 tx=0).stop 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 shutdown_connections 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe06c06c680 0x7fe06c06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0800ff3b0 0x7fe08010a090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 --2- 172.21.15.53:0/3109546486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0800ffd50 0x7fe08010a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 >> 172.21.15.53:0/3109546486 conn(0x7fe0800fac90 msgr2=0x7fe0800fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 shutdown_connections 2024-09-16T00:46:22.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:22.943+0000 7fe088549700 1 -- 172.21.15.53:0/3109546486 wait complete. 2024-09-16T00:46:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:23 smithi053 ceph-mon[27950]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:23 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3109546486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:46:23.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:23 smithi152 ceph-mon[33237]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:23 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3109546486' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T00:46:23.730 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T00:46:23.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T00:46:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 -- 172.21.15.53:0/4148203761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080ffae0 msgr2=0x7f02080fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 --2- 172.21.15.53:0/4148203761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080ffae0 0x7f02080fff30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009910 tx=0x7f01fc009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 -- 172.21.15.53:0/4148203761 shutdown_connections 2024-09-16T00:46:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 --2- 172.21.15.53:0/4148203761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080ffae0 0x7f02080fff30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 --2- 172.21.15.53:0/4148203761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080fe8e0 0x7f02080fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 -- 172.21.15.53:0/4148203761 >> 172.21.15.53:0/4148203761 conn(0x7f02080f9e70 msgr2=0x7f02080fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 -- 172.21.15.53:0/4148203761 shutdown_connections 2024-09-16T00:46:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.560+0000 7f020d502700 1 -- 172.21.15.53:0/4148203761 wait complete. 2024-09-16T00:46:25.562 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:25 smithi053 ceph-mon[27950]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:25.562 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 Processor -- start 2024-09-16T00:46:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 -- start start 2024-09-16T00:46:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080ffae0 0x7f0208196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208196770 con 0x7f02080fe8e0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.561+0000 7f020d502700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020819b180 con 0x7f02080ffae0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43164/0 (socket says 172.21.15.53:43164) 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 -- 172.21.15.53:0/958775161 learned_addr learned my addr 172.21.15.53:0/958775161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f02067fc700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080ffae0 0x7f0208196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 -- 172.21.15.53:0/958775161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080ffae0 msgr2=0x7f0208196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080ffae0 0x7f0208196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 -- 172.21.15.53:0/958775161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0095f0 con 0x7f02080fe8e0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f0206ffd700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01f800b480 tx=0x7f01f800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01f8011800 con 0x7f02080fe8e0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f01f8011e10 con 0x7f02080fe8e0 2024-09-16T00:46:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020819b380 con 0x7f02080fe8e0 2024-09-16T00:46:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01f8010ea0 con 0x7f02080fe8e0 2024-09-16T00:46:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.562+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020819b8a0 con 0x7f02080fe8e0 2024-09-16T00:46:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.563+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02081074d0 con 0x7f02080fe8e0 2024-09-16T00:46:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.564+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f01f801a400 con 0x7f02080fe8e0 2024-09-16T00:46:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.564+0000 7f01effff700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 0x7f01f006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:25.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.564+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f01f808b010 con 0x7f02080fe8e0 2024-09-16T00:46:25.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.564+0000 7f02067fc700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 0x7f01f006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:25.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.565+0000 7f02067fc700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 0x7f01f006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01fc005090 tx=0x7f01fc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:25.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.569+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f01f8055bb0 con 0x7f02080fe8e0 2024-09-16T00:46:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:25 smithi152 ceph-mon[33237]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:25.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.847+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f020819bf10 con 0x7f02080fe8e0 2024-09-16T00:46:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.851+0000 7f01effff700 1 -- 172.21.15.53:0/958775161 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f01f80591d0 con 0x7f02080fe8e0 2024-09-16T00:46:25.851 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-16T00:46:25.852 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQDhf+dmV+mVMhAAGAzjMDozZNcPL5nPAnRNVA== 2024-09-16T00:46:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 msgr2=0x7f01f006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 0x7f01f006eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01fc005090 tx=0x7f01fc01a040 comp rx=0 tx=0).stop 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 msgr2=0x7f0208195c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01f800b480 tx=0x7f01f800b790 comp rx=0 tx=0).stop 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 shutdown_connections 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f01f006c680 0x7f01f006eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02080fe8e0 0x7f0208195c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 --2- 172.21.15.53:0/958775161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02080ffae0 0x7f0208196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 >> 172.21.15.53:0/958775161 conn(0x7f02080f9e70 msgr2=0x7f02080fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 shutdown_connections 2024-09-16T00:46:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:25.853+0000 7f020d502700 1 -- 172.21.15.53:0/958775161 wait complete. 2024-09-16T00:46:26.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:26 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/958775161' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:26.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:26 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/958775161' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:46:26.667 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:46:26.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T00:46:26.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T00:46:26.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:26 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/958775161' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:26.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:26 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/958775161' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:46:26.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T00:46:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-16T00:46:27.672 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:27 smithi152 ceph-mon[33237]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:27 smithi053 ceph-mon[27950]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/3671408328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 msgr2=0x7fa4e4105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/3671408328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4105660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009910 tx=0x7fa4d4009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/3671408328 shutdown_connections 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/3671408328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4105660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/3671408328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4e4069230 0x7fa4e4102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/3671408328 >> 172.21.15.152:0/3671408328 conn(0x7fa4e40fa610 msgr2=0x7fa4e40fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/3671408328 shutdown_connections 2024-09-16T00:46:28.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.462+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/3671408328 wait complete. 2024-09-16T00:46:28.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 Processor -- start 2024-09-16T00:46:28.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 -- start start 2024-09-16T00:46:28.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4e4069230 0x7fa4e4195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:28.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4196480 con 0x7fa4e4069230 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4eb7e6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e41965c0 con 0x7fa4e4103220 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39262/0 (socket says 172.21.15.152:39262) 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 -- 172.21.15.152:0/406996032 learned_addr learned my addr 172.21.15.152:0/406996032 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 -- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4e4069230 msgr2=0x7fa4e4195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4e4069230 0x7fa4e4195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.463+0000 7fa4e8d81700 1 -- 172.21.15.152:0/406996032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40095f0 con 0x7fa4e4103220 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4e8d81700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400bd70 tx=0x7fa4d400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d401d070 con 0x7fa4e4103220 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4d4022470 con 0x7fa4e4103220 2024-09-16T00:46:28.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e419b010 con 0x7fa4e4103220 2024-09-16T00:46:28.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4d400f670 con 0x7fa4e4103220 2024-09-16T00:46:28.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.464+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e419b500 con 0x7fa4e4103220 2024-09-16T00:46:28.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.465+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e418fae0 con 0x7fa4e4103220 2024-09-16T00:46:28.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.465+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa4d4022a50 con 0x7fa4e4103220 2024-09-16T00:46:28.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.466+0000 7fa4da7fc700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 0x7fa4d006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:28.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.466+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa4d408cb70 con 0x7fa4e4103220 2024-09-16T00:46:28.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.466+0000 7fa4e9582700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 0x7fa4d006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:28.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.466+0000 7fa4e9582700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 0x7fa4d006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4068f60 tx=0x7fa4e0005c90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:28.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.470+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa4d405b170 con 0x7fa4e4103220 2024-09-16T00:46:28.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.734+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa4e402cc30 con 0x7fa4e4103220 2024-09-16T00:46:28.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.741+0000 7fa4da7fc700 1 -- 172.21.15.152:0/406996032 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa4d4027050 con 0x7fa4e4103220 2024-09-16T00:46:28.741 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-09-16T00:46:28.741 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDkf+dm/HbkKxAAlT8iYVqdP+EGNVovvIjm2g== 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 msgr2=0x7fa4d006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 0x7fa4d006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4068f60 tx=0x7fa4e0005c90 comp rx=0 tx=0).stop 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 msgr2=0x7fa4e4195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400bd70 tx=0x7fa4d400be50 comp rx=0 tx=0).stop 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 shutdown_connections 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa4d006c680 0x7fa4d006eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4e4069230 0x7fa4e4195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 --2- 172.21.15.152:0/406996032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4e4103220 0x7fa4e4195e60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 >> 172.21.15.152:0/406996032 conn(0x7fa4e40fa610 msgr2=0x7fa4e40fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:28.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 shutdown_connections 2024-09-16T00:46:28.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:46:28.743+0000 7fa4eb7e6700 1 -- 172.21.15.152:0/406996032 wait complete. 2024-09-16T00:46:29.307 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:46:29.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-16T00:46:29.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T00:46:29.346 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T00:46:29.346 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T00:46:29.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T00:46:29.567 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:29.689 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:29 smithi053 ceph-mon[27950]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:29.689 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:29 smithi053 ceph-mon[27950]: from='client.? 172.21.15.152:0/406996032' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:29.689 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:29 smithi053 ceph-mon[27950]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:29.689 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:29 smithi053 ceph-mon[27950]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:46:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:29 smithi152 ceph-mon[33237]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:29 smithi152 ceph-mon[33237]: from='client.? 172.21.15.152:0/406996032' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:29 smithi152 ceph-mon[33237]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T00:46:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:29 smithi152 ceph-mon[33237]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 -- 172.21.15.53:0/249457613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e901004c0 msgr2=0x7f4e90100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 --2- 172.21.15.53:0/249457613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e901004c0 0x7f4e90100890 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009910 tx=0x7f4e78009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 -- 172.21.15.53:0/249457613 shutdown_connections 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 --2- 172.21.15.53:0/249457613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e90100e60 0x7f4e90104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 --2- 172.21.15.53:0/249457613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e901004c0 0x7f4e90100890 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 -- 172.21.15.53:0/249457613 >> 172.21.15.53:0/249457613 conn(0x7f4e900fbd80 msgr2=0x7f4e900fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 -- 172.21.15.53:0/249457613 shutdown_connections 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.360+0000 7f4e94b87700 1 -- 172.21.15.53:0/249457613 wait complete. 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 Processor -- start 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 -- start start 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 0x7f4e90195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90196b50 con 0x7f4e90100e60 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.361+0000 7f4e94b87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9019a870 con 0x7f4e901004c0 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43182/0 (socket says 172.21.15.53:43182) 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 -- 172.21.15.53:0/3576865621 learned_addr learned my addr 172.21.15.53:0/3576865621 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8e59c700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 0x7f4e90195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 -- 172.21.15.53:0/3576865621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 msgr2=0x7f4e90195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 0x7f4e90195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 -- 172.21.15.53:0/3576865621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780095f0 con 0x7f4e90100e60 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8e59c700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 0x7f4e90195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e8dd9b700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000d900 tx=0x7f4e8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e80009900 con 0x7f4e90100e60 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9019ab50 con 0x7f4e90100e60 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e80010460 con 0x7f4e90100e60 2024-09-16T00:46:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.362+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8000f5f0 con 0x7f4e90100e60 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.363+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9019b0a0 con 0x7f4e90100e60 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.364+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4e8000f820 con 0x7f4e90100e60 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.364+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e901087d0 con 0x7f4e90100e60 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.365+0000 7f4e877fe700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.365+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f4e8008c940 con 0x7f4e90100e60 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.365+0000 7f4e8e59c700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.365+0000 7f4e8e59c700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800b5c0 tx=0x7f4e7801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:31.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.374+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e8004b720 con 0x7f4e90100e60 2024-09-16T00:46:31.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.645+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4e9004f2a0 con 0x7f4e90100e60 2024-09-16T00:46:31.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.651+0000 7f4e877fe700 1 -- 172.21.15.53:0/3576865621 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172827 (secure 0 0 0) 0x7f4e8004a330 con 0x7f4e90100e60 2024-09-16T00:46:31.654 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 msgr2=0x7f4e7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800b5c0 tx=0x7f4e7801a040 comp rx=0 tx=0).stop 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 msgr2=0x7f4e90196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000d900 tx=0x7f4e8000dcc0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 shutdown_connections 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4e7c06c680 0x7f4e7c06eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e901004c0 0x7f4e90195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 --2- 172.21.15.53:0/3576865621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e90100e60 0x7f4e90196470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.653+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 >> 172.21.15.53:0/3576865621 conn(0x7f4e900fbd80 msgr2=0x7f4e900fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.654+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 shutdown_connections 2024-09-16T00:46:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:31.654+0000 7f4e94b87700 1 -- 172.21.15.53:0/3576865621 wait complete. 2024-09-16T00:46:31.665 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:31 smithi053 ceph-mon[27950]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:31 smithi152 ceph-mon[33237]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:32.455 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"active_gid":14213,"active_name":"smithi053.cjiiek","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":2},{"type":"v1","addr":"172.21.15.53:6801","nonce":2}]},"active_addr":"172.21.15.53:6801/2","active_change":"2024-09-16T00:42:40.312576+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi152.nlmwrx","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.53:8443/","prometheus":"http://172.21.15.53:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":937962924}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":2847731489}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":2799825029}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":4137071784}]}]} 2024-09-16T00:46:32.463 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T00:46:32.464 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T00:46:32.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:46:32.676 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:32.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:32 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3576865621' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T00:46:32.795 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:32 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3576865621' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T00:46:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:33 smithi152 ceph-mon[33237]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:33.772 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:33 smithi053 ceph-mon[27950]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:34.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 -- 172.21.15.53:0/4262419528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c0ffbd0 msgr2=0x7f7d5c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 --2- 172.21.15.53:0/4262419528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c0ffbd0 0x7f7d5c100040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009910 tx=0x7f7d44009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 -- 172.21.15.53:0/4262419528 shutdown_connections 2024-09-16T00:46:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 --2- 172.21.15.53:0/4262419528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c0ffbd0 0x7f7d5c100040 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 --2- 172.21.15.53:0/4262419528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d5c104130 0x7f7d5c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 -- 172.21.15.53:0/4262419528 >> 172.21.15.53:0/4262419528 conn(0x7f7d5c075130 msgr2=0x7f7d5c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 -- 172.21.15.53:0/4262419528 shutdown_connections 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.324+0000 7f7d61d77700 1 -- 172.21.15.53:0/4262419528 wait complete. 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 Processor -- start 2024-09-16T00:46:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 -- start start 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d5c0ffbd0 0x7f7d5c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c197800 con 0x7f7d5c104130 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d61d77700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c197940 con 0x7f7d5c0ffbd0 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37420/0 (socket says 172.21.15.53:37420) 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 -- 172.21.15.53:0/1637284838 learned_addr learned my addr 172.21.15.53:0/1637284838 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 -- 172.21.15.53:0/1637284838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d5c0ffbd0 msgr2=0x7f7d5c196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d5c0ffbd0 0x7f7d5c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.325+0000 7f7d5affd700 1 -- 172.21.15.53:0/1637284838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440095f0 con 0x7f7d5c104130 2024-09-16T00:46:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d5affd700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bd70 tx=0x7f7d4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4401d070 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c19fd10 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d4400f460 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d44017630 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.326+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c1a0120 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.327+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c04f2a0 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.328+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7d44003a60 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.328+0000 7f7d58ff9700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 0x7f7d4806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.328+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7d4408c9c0 con 0x7f7d5c104130 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.328+0000 7f7d5b7fe700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 0x7f7d4806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.329+0000 7f7d5b7fe700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 0x7f7d4806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c005950 tx=0x7f7d4c0058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.333+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7d440573e0 con 0x7f7d5c104130 2024-09-16T00:46:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.538+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d5c068b30 con 0x7f7d5c104130 2024-09-16T00:46:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.539+0000 7f7d58ff9700 1 -- 172.21.15.53:0/1637284838 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11037 (secure 0 0 0) 0x7f7d44020370 con 0x7f7d5c104130 2024-09-16T00:46:34.539 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:34.539 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":41,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","created":"2024-09-16T00:40:30.607381+0000","modified":"2024-09-16T00:46:14.173089+0000","last_up_change":"2024-09-16T00:46:13.167665+0000","last_in_change":"2024-09-16T00:45:53.920511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:45:00.827169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6803","nonce":140782636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6805","nonce":140782636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6809","nonce":140782636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6807","nonce":140782636}]},"public_addr":"172.21.15.53:6803/140782636","cluster_addr":"172.21.15.53:6805/140782636","heartbeat_back_addr":"172.21.15.53:6809/140782636","heartbeat_front_addr":"172.21.15.53:6807/140782636","state":["exists","up"]},{"osd":1,"uuid":"fd422dc9-c004-4434-b2e5-41b1657ad07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6811","nonce":4284864954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6813","nonce":4284864954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6817","nonce":4284864954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6815","nonce":4284864954}]},"public_addr":"172.21.15.53:6811/4284864954","cluster_addr":"172.21.15.53:6813/4284864954","heartbeat_back_addr":"172.21.15.53:6817/4284864954","heartbeat_front_addr":"172.21.15.53:6815/4284864954","state":["exists","up"]},{"osd":2,"uuid":"e6da8427-e1ea-4f98-890e-41f909d91892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6819","nonce":4278429651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6821","nonce":4278429651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6825","nonce":4278429651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6823","nonce":4278429651}]},"public_addr":"172.21.15.53:6819/4278429651","cluster_addr":"172.21.15.53:6821/4278429651","heartbeat_back_addr":"172.21.15.53:6825/4278429651","heartbeat_front_addr":"172.21.15.53:6823/4278429651","state":["exists","up"]},{"osd":3,"uuid":"5045443a-cf8b-40fb-9faf-4acf383f8ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6801","nonce":1133456156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6803","nonce":1133456156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6807","nonce":1133456156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6805","nonce":1133456156}]},"public_addr":"172.21.15.152:6801/1133456156","cluster_addr":"172.21.15.152:6803/1133456156","heartbeat_back_addr":"172.21.15.152:6807/1133456156","heartbeat_front_addr":"172.21.15.152:6805/1133456156","state":["exists","up"]},{"osd":4,"uuid":"7508fba1-f161-4f37-aba3-c670074fe7f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6809","nonce":635956926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6811","nonce":635956926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6815","nonce":635956926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6813","nonce":635956926}]},"public_addr":"172.21.15.152:6809/635956926","cluster_addr":"172.21.15.152:6811/635956926","heartbeat_back_addr":"172.21.15.152:6815/635956926","heartbeat_front_addr":"172.21.15.152:6813/635956926","state":["exists","up"]},{"osd":5,"uuid":"eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6817","nonce":978992476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6819","nonce":978992476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6823","nonce":978992476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6821","nonce":978992476}]},"public_addr":"172.21.15.152:6817/978992476","cluster_addr":"172.21.15.152:6819/978992476","heartbeat_back_addr":"172.21.15.152:6823/978992476","heartbeat_front_addr":"172.21.15.152:6821/978992476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:43:57.824940+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:27.349730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:57.358764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:21.442070+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:46.137938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:46:11.199980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1711068346":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2791398459":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/1233292445":"2024-09-17T00:41:32.995408+0000","172.21.15.53:0/3622055572":"2024-09-17T00:41:32.995408+0000","172.21.15.53:6801/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2704105110":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2403024149":"2024-09-17T00:40:58.741023+0000","172.21.15.53:6800/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/1610550310":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2434528936":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2239443060":"2024-09-17T00:41:32.995408+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:46:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 msgr2=0x7f7d4806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 0x7f7d4806eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c005950 tx=0x7f7d4c0058e0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 msgr2=0x7f7d5c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bd70 tx=0x7f7d4400be50 comp rx=0 tx=0).stop 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 shutdown_connections 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7d4806c680 0x7f7d4806eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d5c0ffbd0 0x7f7d5c196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 --2- 172.21.15.53:0/1637284838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d5c104130 0x7f7d5c1971e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 >> 172.21.15.53:0/1637284838 conn(0x7f7d5c075130 msgr2=0x7f7d5c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 shutdown_connections 2024-09-16T00:46:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:34.541+0000 7f7d61d77700 1 -- 172.21.15.53:0/1637284838 wait complete. 2024-09-16T00:46:35.397 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T00:46:35.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T00:46:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:35.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:35 smithi152 ceph-mon[33237]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:35 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1637284838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:35.731 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:35 smithi053 ceph-mon[27950]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:35.731 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:35 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1637284838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:37.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 -- 172.21.15.53:0/1666751562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 msgr2=0x7f082c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 --2- 172.21.15.53:0/1666751562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c104500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f082800b0a0 tx=0x7f082800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 -- 172.21.15.53:0/1666751562 shutdown_connections 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 --2- 172.21.15.53:0/1666751562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 0x7f082c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 --2- 172.21.15.53:0/1666751562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c104500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.160+0000 7f08337f2700 1 -- 172.21.15.53:0/1666751562 >> 172.21.15.53:0/1666751562 conn(0x7f082c075130 msgr2=0x7f082c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.161+0000 7f08337f2700 1 -- 172.21.15.53:0/1666751562 shutdown_connections 2024-09-16T00:46:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.161+0000 7f08337f2700 1 -- 172.21.15.53:0/1666751562 wait complete. 2024-09-16T00:46:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.161+0000 7f08337f2700 1 Processor -- start 2024-09-16T00:46:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.161+0000 7f08337f2700 1 -- start start 2024-09-16T00:46:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f08337f2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 0x7f082c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f08337f2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f08337f2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c197810 con 0x7f082c104130 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f08337f2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c197950 con 0x7f082c0ffbd0 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37440/0 (socket says 172.21.15.53:37440) 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 -- 172.21.15.53:0/3248872740 learned_addr learned my addr 172.21.15.53:0/3248872740 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f083158e700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 0x7f082c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 -- 172.21.15.53:0/3248872740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 msgr2=0x7f082c196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 0x7f082c196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 -- 172.21.15.53:0/3248872740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828009d00 con 0x7f082c104130 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.162+0000 7f0830d8d700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d8d0 tx=0x7f081c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.163+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081c0098a0 con 0x7f082c104130 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.163+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c19fd20 con 0x7f082c104130 2024-09-16T00:46:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.163+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f081c010460 con 0x7f082c104130 2024-09-16T00:46:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.163+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081c00f5f0 con 0x7f082c104130 2024-09-16T00:46:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.163+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c1a01e0 con 0x7f082c104130 2024-09-16T00:46:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.164+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c1076a0 con 0x7f082c104130 2024-09-16T00:46:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.164+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f081c009a00 con 0x7f082c104130 2024-09-16T00:46:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.165+0000 7f08227fc700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 0x7f081806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.165+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f081c08b350 con 0x7f082c104130 2024-09-16T00:46:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.165+0000 7f083158e700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 0x7f081806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.165+0000 7f083158e700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 0x7f081806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0828009480 tx=0x7f082800b7b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:37.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.169+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f081c055e10 con 0x7f082c104130 2024-09-16T00:46:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.372+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f082c04f2a0 con 0x7f082c104130 2024-09-16T00:46:37.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.373+0000 7f08227fc700 1 -- 172.21.15.53:0/3248872740 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11037 (secure 0 0 0) 0x7f081c08b070 con 0x7f082c104130 2024-09-16T00:46:37.374 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:46:37.374 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":41,"fsid":"31d96aac-73c4-11ef-bceb-c7b262605968","created":"2024-09-16T00:40:30.607381+0000","modified":"2024-09-16T00:46:14.173089+0000","last_up_change":"2024-09-16T00:46:13.167665+0000","last_in_change":"2024-09-16T00:45:53.920511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T00:45:00.827169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bfe4f2e0-d6cb-4c43-9bfd-0106b3810b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6803","nonce":140782636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6805","nonce":140782636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6809","nonce":140782636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":140782636},{"type":"v1","addr":"172.21.15.53:6807","nonce":140782636}]},"public_addr":"172.21.15.53:6803/140782636","cluster_addr":"172.21.15.53:6805/140782636","heartbeat_back_addr":"172.21.15.53:6809/140782636","heartbeat_front_addr":"172.21.15.53:6807/140782636","state":["exists","up"]},{"osd":1,"uuid":"fd422dc9-c004-4434-b2e5-41b1657ad07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6811","nonce":4284864954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6813","nonce":4284864954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6817","nonce":4284864954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":4284864954},{"type":"v1","addr":"172.21.15.53:6815","nonce":4284864954}]},"public_addr":"172.21.15.53:6811/4284864954","cluster_addr":"172.21.15.53:6813/4284864954","heartbeat_back_addr":"172.21.15.53:6817/4284864954","heartbeat_front_addr":"172.21.15.53:6815/4284864954","state":["exists","up"]},{"osd":2,"uuid":"e6da8427-e1ea-4f98-890e-41f909d91892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6819","nonce":4278429651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6821","nonce":4278429651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6825","nonce":4278429651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":4278429651},{"type":"v1","addr":"172.21.15.53:6823","nonce":4278429651}]},"public_addr":"172.21.15.53:6819/4278429651","cluster_addr":"172.21.15.53:6821/4278429651","heartbeat_back_addr":"172.21.15.53:6825/4278429651","heartbeat_front_addr":"172.21.15.53:6823/4278429651","state":["exists","up"]},{"osd":3,"uuid":"5045443a-cf8b-40fb-9faf-4acf383f8ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6801","nonce":1133456156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6803","nonce":1133456156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6807","nonce":1133456156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1133456156},{"type":"v1","addr":"172.21.15.152:6805","nonce":1133456156}]},"public_addr":"172.21.15.152:6801/1133456156","cluster_addr":"172.21.15.152:6803/1133456156","heartbeat_back_addr":"172.21.15.152:6807/1133456156","heartbeat_front_addr":"172.21.15.152:6805/1133456156","state":["exists","up"]},{"osd":4,"uuid":"7508fba1-f161-4f37-aba3-c670074fe7f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6809","nonce":635956926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6811","nonce":635956926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6815","nonce":635956926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":635956926},{"type":"v1","addr":"172.21.15.152:6813","nonce":635956926}]},"public_addr":"172.21.15.152:6809/635956926","cluster_addr":"172.21.15.152:6811/635956926","heartbeat_back_addr":"172.21.15.152:6815/635956926","heartbeat_front_addr":"172.21.15.152:6813/635956926","state":["exists","up"]},{"osd":5,"uuid":"eb8c1d37-8227-4ad4-a0e8-2bc0ee9e9b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6817","nonce":978992476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6819","nonce":978992476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6823","nonce":978992476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":978992476},{"type":"v1","addr":"172.21.15.152:6821","nonce":978992476}]},"public_addr":"172.21.15.152:6817/978992476","cluster_addr":"172.21.15.152:6819/978992476","heartbeat_back_addr":"172.21.15.152:6823/978992476","heartbeat_front_addr":"172.21.15.152:6821/978992476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:43:57.824940+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:27.349730+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:44:57.358764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:21.442070+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:45:46.137938+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T00:46:11.199980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1711068346":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2791398459":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/1233292445":"2024-09-17T00:41:32.995408+0000","172.21.15.53:0/3622055572":"2024-09-17T00:41:32.995408+0000","172.21.15.53:6801/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2704105110":"2024-09-17T00:42:40.312465+0000","172.21.15.53:0/2403024149":"2024-09-17T00:40:58.741023+0000","172.21.15.53:6800/2":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/1610550310":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2434528936":"2024-09-17T00:40:58.741023+0000","172.21.15.53:0/2239443060":"2024-09-17T00:41:32.995408+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 msgr2=0x7f081806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 0x7f081806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0828009480 tx=0x7f082800b7b0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 msgr2=0x7f082c1971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d8d0 tx=0x7f081c00dbe0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 shutdown_connections 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f081806c680 0x7f081806eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f082c0ffbd0 0x7f082c196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 --2- 172.21.15.53:0/3248872740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f082c104130 0x7f082c1971f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 >> 172.21.15.53:0/3248872740 conn(0x7f082c075130 msgr2=0x7f082c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 shutdown_connections 2024-09-16T00:46:37.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:37.375+0000 7f08337f2700 1 -- 172.21.15.53:0/3248872740 wait complete. 2024-09-16T00:46:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:37 smithi152 ceph-mon[33237]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:37 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3248872740' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:37.766 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:37 smithi053 ceph-mon[27950]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:37.766 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:37 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3248872740' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T00:46:38.140 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T00:46:38.140 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T00:46:38.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T00:46:38.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T00:46:38.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T00:46:38.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T00:46:38.409 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:38.423 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:38.962 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:39.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:39 smithi152 ceph-mon[33237]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:39 smithi053 ceph-mon[27950]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:40.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:40.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- 172.21.15.53:0/3161584107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a38073a00 msgr2=0x7f0a3810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/3161584107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a38073a00 0x7f0a3810c580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009910 tx=0x7f0a2c009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- 172.21.15.53:0/3161584107 shutdown_connections 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/3161584107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a38073a00 0x7f0a3810c580 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/3161584107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a380730f0 0x7f0a380734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- 172.21.15.53:0/3161584107 >> 172.21.15.53:0/3161584107 conn(0x7f0a380fbda0 msgr2=0x7f0a380fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- 172.21.15.53:0/3161584107 shutdown_connections 2024-09-16T00:46:41.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- 172.21.15.53:0/3161584107 wait complete. 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 Processor -- start 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.035+0000 7f0a3f72e700 1 -- start start 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3f72e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3f72e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 0x7f0a381985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3f72e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3819c930 con 0x7f0a380730f0 2024-09-16T00:46:41.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3f72e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3819caa0 con 0x7f0a38073a00 2024-09-16T00:46:41.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37456/0 (socket says 172.21.15.53:37456) 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 -- 172.21.15.53:0/2802940243 learned_addr learned my addr 172.21.15.53:0/2802940243 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3ccc9700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 0x7f0a381985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 -- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 msgr2=0x7f0a381985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 0x7f0a381985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0095f0 con 0x7f0a380730f0 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3ccc9700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 0x7f0a381985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a3d4ca700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a280060b0 tx=0x7f0a2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a2800dda0 con 0x7f0a380730f0 2024-09-16T00:46:41.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a2800f040 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.036+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a28014790 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.037+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3819cd80 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.037+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3819d2d0 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.037+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a3804f2a0 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.038+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0a280148f0 con 0x7f0a380730f0 2024-09-16T00:46:41.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.038+0000 7f0a367fc700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 0x7f0a2006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:41.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0a2808aeb0 con 0x7f0a380730f0 2024-09-16T00:46:41.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a3ccc9700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 0x7f0a2006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:41.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a367fc700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 0x7f0a20074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:41.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a20074cd0 con 0x7f0a20072210 2024-09-16T00:46:41.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a28090590 con 0x7f0a380730f0 2024-09-16T00:46:41.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a3dccb700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 0x7f0a20074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:41.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a3ccc9700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 0x7f0a2006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b5c0 tx=0x7f0a2c0053a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:41.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.039+0000 7f0a3dccb700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 0x7f0a20074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:41.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.040+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== osd.3 v2:172.21.15.152:6800/1133456156 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0a20074cd0 con 0x7f0a20072210 2024-09-16T00:46:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.056+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 --> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a3810f590 con 0x7f0a20072210 2024-09-16T00:46:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a367fc700 1 -- 172.21.15.53:0/2802940243 <== osd.3 v2:172.21.15.152:6800/1133456156 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a3810f590 con 0x7f0a20072210 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 msgr2=0x7f0a20074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 0x7f0a20074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 msgr2=0x7f0a2006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 0x7f0a2006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b5c0 tx=0x7f0a2c0053a0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 msgr2=0x7f0a38197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a280060b0 tx=0x7f0a2800d3b0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 shutdown_connections 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:6800/1133456156,v1:172.21.15.152:6801/1133456156] conn(0x7f0a20072210 0x7f0a20074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0a2006c680 0x7f0a2006eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a380730f0 0x7f0a38197f80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 --2- 172.21.15.53:0/2802940243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a38073a00 0x7f0a381985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 >> 172.21.15.53:0/2802940243 conn(0x7f0a380fbda0 msgr2=0x7f0a38106dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 shutdown_connections 2024-09-16T00:46:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:41.057+0000 7f0a3f72e700 1 -- 172.21.15.53:0/2802940243 wait complete. 2024-09-16T00:46:41.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:41 smithi152 ceph-mon[33237]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:41 smithi053 ceph-mon[27950]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:42.174 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:42.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:42 smithi053 ceph-mon[27950]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:42.638 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:42.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:42 smithi152 ceph-mon[33237]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:43.054 INFO:teuthology.orchestra.run.smithi053.stdout:115964117010 2024-09-16T00:46:43.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T00:46:44.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3419127662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ffd60 msgr2=0x7f0d80103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3419127662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ffd60 0x7f0d80103d30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009910 tx=0x7f0d68009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3419127662 shutdown_connections 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3419127662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ffd60 0x7f0d80103d30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3419127662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ff3c0 0x7f0d800ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.175+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3419127662 >> 172.21.15.53:0/3419127662 conn(0x7f0d800fac60 msgr2=0x7f0d800fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.176+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3419127662 shutdown_connections 2024-09-16T00:46:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.176+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3419127662 wait complete. 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.176+0000 7f0d85b3b700 1 Processor -- start 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d85b3b700 1 -- start start 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d85b3b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d85b3b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 0x7f0d801963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d85b3b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80196ab0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d85b3b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8019a840 con 0x7f0d800ffd60 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d76ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 0x7f0d801963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39818/0 (socket says 172.21.15.53:39818) 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.177+0000 7f0d7f7fe700 1 -- 172.21.15.53:0/3444986405 learned_addr learned my addr 172.21.15.53:0/3444986405 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7f7fe700 1 -- 172.21.15.53:0/3444986405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 msgr2=0x7f0d801963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7f7fe700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 0x7f0d801963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7f7fe700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680095f0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d76ffd700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 0x7f0d801963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7f7fe700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000d8d0 tx=0x7f0d7000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d700098a0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d70010460 con 0x7f0d800ff3c0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8019ab20 con 0x7f0d800ff3c0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7000f5f0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.178+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8019b040 con 0x7f0d800ff3c0 2024-09-16T00:46:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.179+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d8010c530 con 0x7f0d800ff3c0 2024-09-16T00:46:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.180+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0d70009a00 con 0x7f0d800ff3c0 2024-09-16T00:46:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7d7fa700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0d7008b2d0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d76ffd700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7d7fa700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 0x7f0d6c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d6c074cd0 con 0x7f0d6c072210 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d7008d9a0 con 0x7f0d800ff3c0 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7ffff700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 0x7f0d6c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.181+0000 7f0d7ffff700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 0x7f0d6c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.182+0000 7f0d76ffd700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 0x7f0d6c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006010 tx=0x7f0d6801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.183+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== osd.2 v2:172.21.15.53:6818/4278429651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d6c074cd0 con 0x7f0d6c072210 2024-09-16T00:46:44.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.201+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 --> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d80067980 con 0x7f0d6c072210 2024-09-16T00:46:44.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.201+0000 7f0d7d7fa700 1 -- 172.21.15.53:0/3444986405 <== osd.2 v2:172.21.15.53:6818/4278429651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d80067980 con 0x7f0d6c072210 2024-09-16T00:46:44.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.201+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 msgr2=0x7f0d6c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:44.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.201+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 0x7f0d6c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 msgr2=0x7f0d6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:44.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 0x7f0d6c06eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006010 tx=0x7f0d6801a040 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 msgr2=0x7f0d80195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000d8d0 tx=0x7f0d7000dbe0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 shutdown_connections 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6818/4278429651,v1:172.21.15.53:6819/4278429651] conn(0x7f0d6c072210 0x7f0d6c074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0d6c06c680 0x7f0d6c06eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d800ff3c0 0x7f0d80195e90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 --2- 172.21.15.53:0/3444986405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d800ffd60 0x7f0d801963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 >> 172.21.15.53:0/3444986405 conn(0x7f0d800fac60 msgr2=0x7f0d80069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 shutdown_connections 2024-09-16T00:46:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:44.202+0000 7f0d85b3b700 1 -- 172.21.15.53:0/3444986405 wait complete. 2024-09-16T00:46:45.138 INFO:teuthology.orchestra.run.smithi053.stdout:81604378648 2024-09-16T00:46:45.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T00:46:45.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:45 smithi152 ceph-mon[33237]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:45.701 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:45 smithi053 ceph-mon[27950]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 -- 172.21.15.53:0/3140963304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 msgr2=0x7f1a941017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 --2- 172.21.15.53:0/3140963304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941017f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009910 tx=0x7f1a84009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 -- 172.21.15.53:0/3140963304 shutdown_connections 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 --2- 172.21.15.53:0/3140963304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 0x7f1a9410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 --2- 172.21.15.53:0/3140963304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941017f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 -- 172.21.15.53:0/3140963304 >> 172.21.15.53:0/3140963304 conn(0x7f1a940fac60 msgr2=0x7f1a940fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 -- 172.21.15.53:0/3140963304 shutdown_connections 2024-09-16T00:46:47.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.287+0000 7f1a9908f700 1 -- 172.21.15.53:0/3140963304 wait complete. 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 Processor -- start 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 -- start start 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 0x7f1a941985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94198cd0 con 0x7f1a94101420 2024-09-16T00:46:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9908f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9419ca60 con 0x7f1a94101d30 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a92d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a92d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39840/0 (socket says 172.21.15.53:39840) 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a92d9d700 1 -- 172.21.15.53:0/1740504264 learned_addr learned my addr 172.21.15.53:0/1740504264 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.288+0000 7f1a9259c700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 0x7f1a941985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a92d9d700 1 -- 172.21.15.53:0/1740504264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 msgr2=0x7f1a941985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a92d9d700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 0x7f1a941985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a92d9d700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840095f0 con 0x7f1a94101420 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a92d9d700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400fa00 tx=0x7f1a8400fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8401d070 con 0x7f1a94101420 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a8400fe90 con 0x7f1a94101420 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9419cce0 con 0x7f1a94101420 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a84022470 con 0x7f1a94101420 2024-09-16T00:46:47.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.289+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9419d1d0 con 0x7f1a94101420 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.290+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a9410d630 con 0x7f1a94101420 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.291+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1a84003680 con 0x7f1a94101420 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.291+0000 7f1a7bfff700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 0x7f1a7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.291+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f1a8408c870 con 0x7f1a94101420 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.291+0000 7f1a9259c700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 0x7f1a7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a7bfff700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 0x7f1a7c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a7c074cd0 con 0x7f1a7c072210 2024-09-16T00:46:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a840912a0 con 0x7f1a94101420 2024-09-16T00:46:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a9359e700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 0x7f1a7c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a9259c700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 0x7f1a7c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a941996d0 tx=0x7f1a88009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.292+0000 7f1a9359e700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 0x7f1a7c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.293+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== osd.0 v2:172.21.15.53:6802/140782636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1a7c074cd0 con 0x7f1a7c072210 2024-09-16T00:46:47.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.310+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 --> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a94067980 con 0x7f1a7c072210 2024-09-16T00:46:47.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a7bfff700 1 -- 172.21.15.53:0/1740504264 <== osd.0 v2:172.21.15.53:6802/140782636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a94067980 con 0x7f1a7c072210 2024-09-16T00:46:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 msgr2=0x7f1a7c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 0x7f1a7c074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 msgr2=0x7f1a7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 0x7f1a7c06eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a941996d0 tx=0x7f1a88009260 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 msgr2=0x7f1a941980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400fa00 tx=0x7f1a8400fa30 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 shutdown_connections 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6802/140782636,v1:172.21.15.53:6803/140782636] conn(0x7f1a7c072210 0x7f1a7c074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f1a7c06c680 0x7f1a7c06eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a94101420 0x7f1a941980b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 --2- 172.21.15.53:0/1740504264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a94101d30 0x7f1a941985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.311+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 >> 172.21.15.53:0/1740504264 conn(0x7f1a940fac60 msgr2=0x7f1a940ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.312+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 shutdown_connections 2024-09-16T00:46:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:47.312+0000 7f1a9908f700 1 -- 172.21.15.53:0/1740504264 wait complete. 2024-09-16T00:46:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:47 smithi152 ceph-mon[33237]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:47.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:47 smithi053 ceph-mon[27950]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/744965361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 msgr2=0x7f6b681008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/744965361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b681008b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009910 tx=0x7f6b50009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/744965361 shutdown_connections 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/744965361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/744965361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b681008b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/744965361 >> 172.21.15.53:0/744965361 conn(0x7f6b680fbda0 msgr2=0x7f6b680fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/744965361 shutdown_connections 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/744965361 wait complete. 2024-09-16T00:46:48.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.460+0000 7f6b6d2bb700 1 Processor -- start 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b6d2bb700 1 -- start start 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b6d2bb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b6d2bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b6d2bb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68073ad0 con 0x7f6b681004e0 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b6d2bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68073c10 con 0x7f6b68100e80 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39868/0 (socket says 172.21.15.53:39868) 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 -- 172.21.15.53:0/2338421375 learned_addr learned my addr 172.21.15.53:0/2338421375 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b667fc700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 -- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 msgr2=0x7f6b68073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500095f0 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b667fc700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.461+0000 7f6b66ffd700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000fa00 tx=0x7f6b5000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5001d070 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b50005640 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b68073e90 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b500226a0 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b681a23f0 con 0x7f6b681004e0 2024-09-16T00:46:48.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.462+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b6810d670 con 0x7f6b681004e0 2024-09-16T00:46:48.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.463+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6b50003680 con 0x7f6b681004e0 2024-09-16T00:46:48.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b5ffff700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 0x7f6b5406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:48.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6b5008cad0 con 0x7f6b681004e0 2024-09-16T00:46:48.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b667fc700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 0x7f6b5406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:48.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b5ffff700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 0x7f6b54074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b54074cd0 con 0x7f6b54072210 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5008cf30 con 0x7f6b681004e0 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b677fe700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 0x7f6b54074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.464+0000 7f6b667fc700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 0x7f6b5406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b68074840 tx=0x7f6b58009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.465+0000 7f6b677fe700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 0x7f6b54074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:48.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.465+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== osd.5 v2:172.21.15.152:6816/978992476 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6b54074cd0 con 0x7f6b54072210 2024-09-16T00:46:48.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.481+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 --> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b6804f2a0 con 0x7f6b54072210 2024-09-16T00:46:48.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b5ffff700 1 -- 172.21.15.53:0/2338421375 <== osd.5 v2:172.21.15.152:6816/978992476 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6b6804f2a0 con 0x7f6b54072210 2024-09-16T00:46:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 msgr2=0x7f6b54074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 0x7f6b54074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 msgr2=0x7f6b5406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 0x7f6b5406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b68074840 tx=0x7f6b58009260 comp rx=0 tx=0).stop 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 msgr2=0x7f6b68073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000fa00 tx=0x7f6b5000fae0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 shutdown_connections 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:6816/978992476,v1:172.21.15.152:6817/978992476] conn(0x7f6b54072210 0x7f6b54074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f6b5406c680 0x7f6b5406eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b681004e0 0x7f6b68073050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 --2- 172.21.15.53:0/2338421375 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b68100e80 0x7f6b68073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 >> 172.21.15.53:0/2338421375 conn(0x7f6b680fbda0 msgr2=0x7f6b680fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 shutdown_connections 2024-09-16T00:46:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:48.482+0000 7f6b6d2bb700 1 -- 172.21.15.53:0/2338421375 wait complete. 2024-09-16T00:46:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:49.519 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:49 smithi053 ceph-mon[27950]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:49.520 INFO:teuthology.orchestra.run.smithi053.stdout:38654705701 2024-09-16T00:46:49.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T00:46:49.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:49 smithi152 ceph-mon[33237]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 -- 172.21.15.53:0/2307898454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6981004e0 msgr2=0x7fc6981008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2307898454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6981004e0 0x7fc6981008b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc688009910 tx=0x7fc688009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 -- 172.21.15.53:0/2307898454 shutdown_connections 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2307898454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc698100e80 0x7fc698104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2307898454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6981004e0 0x7fc6981008b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 -- 172.21.15.53:0/2307898454 >> 172.21.15.53:0/2307898454 conn(0x7fc6980fbda0 msgr2=0x7fc6980fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 -- 172.21.15.53:0/2307898454 shutdown_connections 2024-09-16T00:46:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.698+0000 7fc69d21f700 1 -- 172.21.15.53:0/2307898454 wait complete. 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 Processor -- start 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 -- start start 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 0x7fc698195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698196b10 con 0x7fc698100e80 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.699+0000 7fc69d21f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69819a8a0 con 0x7fc6981004e0 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39892/0 (socket says 172.21.15.53:39892) 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 -- 172.21.15.53:0/2994573911 learned_addr learned my addr 172.21.15.53:0/2994573911 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc696d9d700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 0x7fc698195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 -- 172.21.15.53:0/2994573911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 msgr2=0x7fc698195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:49.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 0x7fc698195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880095f0 con 0x7fc698100e80 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc696d9d700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 0x7fc698195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc68e59c700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc68000d900 tx=0x7fc68000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680009900 con 0x7fc698100e80 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc680010460 con 0x7fc698100e80 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69819ab80 con 0x7fc698100e80 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68000f5f0 con 0x7fc698100e80 2024-09-16T00:46:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.700+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69819b0d0 con 0x7fc698100e80 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.701+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc69810d670 con 0x7fc698100e80 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.702+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc6800105d0 con 0x7fc698100e80 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.702+0000 7fc694d99700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc68008b5c0 con 0x7fc698100e80 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc696d9d700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc694d99700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 0x7fc684074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc684074cd0 con 0x7fc684072210 2024-09-16T00:46:49.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc68008ba40 con 0x7fc698100e80 2024-09-16T00:46:49.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc69759e700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 0x7fc684074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:49.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc696d9d700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b5c0 tx=0x7fc68801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:49.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.703+0000 7fc69759e700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 0x7fc684074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:49.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.704+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== osd.1 v2:172.21.15.53:6810/4284864954 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc684074cd0 con 0x7fc684072210 2024-09-16T00:46:49.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.720+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 --> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc69804f2a0 con 0x7fc684072210 2024-09-16T00:46:49.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.720+0000 7fc694d99700 1 -- 172.21.15.53:0/2994573911 <== osd.1 v2:172.21.15.53:6810/4284864954 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc69804f2a0 con 0x7fc684072210 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 msgr2=0x7fc684074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 0x7fc684074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 msgr2=0x7fc68406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b5c0 tx=0x7fc68801a040 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 msgr2=0x7fc698196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc68000d900 tx=0x7fc68000dcc0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 shutdown_connections 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6810/4284864954,v1:172.21.15.53:6811/4284864954] conn(0x7fc684072210 0x7fc684074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6981004e0 0x7fc698195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 --2- 172.21.15.53:0/2994573911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc698100e80 0x7fc698196430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 >> 172.21.15.53:0/2994573911 conn(0x7fc6980fbda0 msgr2=0x7fc6980fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 shutdown_connections 2024-09-16T00:46:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:49.721+0000 7fc69d21f700 1 -- 172.21.15.53:0/2994573911 wait complete. 2024-09-16T00:46:50.704 INFO:teuthology.orchestra.run.smithi053.stdout:171798691850 2024-09-16T00:46:50.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T00:46:51.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:51 smithi053 ceph-mon[27950]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:51.691 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:51.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:51 smithi152 ceph-mon[33237]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:51.705 INFO:teuthology.orchestra.run.smithi053.stdout:60129542175 2024-09-16T00:46:51.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/508705415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ffd60 msgr2=0x7f5c34103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/508705415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ffd60 0x7f5c34103d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009910 tx=0x7f5c24009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/508705415 shutdown_connections 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/508705415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ffd60 0x7f5c34103d30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/508705415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340ff3c0 0x7f5c340ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/508705415 >> 172.21.15.53:0/508705415 conn(0x7f5c340fac80 msgr2=0x7f5c340fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/508705415 shutdown_connections 2024-09-16T00:46:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/508705415 wait complete. 2024-09-16T00:46:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.215+0000 7f5c3bdf6700 1 Processor -- start 2024-09-16T00:46:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c3bdf6700 1 -- start start 2024-09-16T00:46:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c3bdf6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c3bdf6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340ffd60 0x7f5c34195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c3bdf6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34195a30 con 0x7f5c340ff3c0 2024-09-16T00:46:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c3bdf6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341997c0 con 0x7f5c340ffd60 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39914/0 (socket says 172.21.15.53:39914) 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 -- 172.21.15.53:0/2305095711 learned_addr learned my addr 172.21.15.53:0/2305095711 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 -- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340ffd60 msgr2=0x7f5c34195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340ffd60 0x7f5c34195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.216+0000 7f5c39b92700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240095f0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c39b92700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d8d0 tx=0x7f5c3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c30009940 con 0x7f5c340ff3c0 2024-09-16T00:46:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c30010460 con 0x7f5c340ff3c0 2024-09-16T00:46:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c3000f5f0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c34199aa0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.217+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c34199ff0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.218+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c3410c530 con 0x7f5c340ff3c0 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5c300105d0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 0x7f5c2006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5c3008b8d0 con 0x7f5c340ff3c0 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c39391700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 0x7f5c2006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 0x7f5c20074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c20074cd0 con 0x7f5c20072210 2024-09-16T00:46:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.219+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c3008bd30 con 0x7f5c340ff3c0 2024-09-16T00:46:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.220+0000 7f5c39391700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 0x7f5c2006eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b5c0 tx=0x7f5c24005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.220+0000 7f5c3a393700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 0x7f5c20074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.220+0000 7f5c3a393700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 0x7f5c20074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.221+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== osd.4 v2:172.21.15.152:6808/635956926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5c20074cd0 con 0x7f5c20072210 2024-09-16T00:46:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 --> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c3404f2a0 con 0x7f5c20072210 2024-09-16T00:46:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c2affd700 1 -- 172.21.15.53:0/2305095711 <== osd.4 v2:172.21.15.152:6808/635956926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5c3404f2a0 con 0x7f5c20072210 2024-09-16T00:46:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 msgr2=0x7f5c20074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 0x7f5c20074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 msgr2=0x7f5c2006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 0x7f5c2006eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400b5c0 tx=0x7f5c24005960 comp rx=0 tx=0).stop 2024-09-16T00:46:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 msgr2=0x7f5c34194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.237+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d8d0 tx=0x7f5c3000dc90 comp rx=0 tx=0).stop 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 shutdown_connections 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:6808/635956926,v1:172.21.15.152:6809/635956926] conn(0x7f5c20072210 0x7f5c20074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5c2006c680 0x7f5c2006eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c340ff3c0 0x7f5c34194e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 --2- 172.21.15.53:0/2305095711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340ffd60 0x7f5c34195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 >> 172.21.15.53:0/2305095711 conn(0x7f5c340fac80 msgr2=0x7f5c340fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 shutdown_connections 2024-09-16T00:46:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:52.238+0000 7f5c3bdf6700 1 -- 172.21.15.53:0/2305095711 wait complete. 2024-09-16T00:46:53.326 INFO:teuthology.orchestra.run.smithi053.stdout:150323855375 2024-09-16T00:46:53.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T00:46:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:53 smithi053 ceph-mon[27950]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:53.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:53 smithi152 ceph-mon[33237]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 -- 172.21.15.53:0/1045589081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 msgr2=0x7f232c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 --2- 172.21.15.53:0/1045589081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c100890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2320009910 tx=0x7f2320009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 -- 172.21.15.53:0/1045589081 shutdown_connections 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 --2- 172.21.15.53:0/1045589081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 --2- 172.21.15.53:0/1045589081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c100890 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 -- 172.21.15.53:0/1045589081 >> 172.21.15.53:0/1045589081 conn(0x7f232c0fbd80 msgr2=0x7f232c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 -- 172.21.15.53:0/1045589081 shutdown_connections 2024-09-16T00:46:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.351+0000 7f2332f55700 1 -- 172.21.15.53:0/1045589081 wait complete. 2024-09-16T00:46:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.352+0000 7f2332f55700 1 Processor -- start 2024-09-16T00:46:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.352+0000 7f2332f55700 1 -- start start 2024-09-16T00:46:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2332f55700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2332f55700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2332f55700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c196b50 con 0x7f232c1004c0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2332f55700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19a8e0 con 0x7f232c100e60 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43126/0 (socket says 172.21.15.53:43126) 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 -- 172.21.15.53:0/3862204605 learned_addr learned my addr 172.21.15.53:0/3862204605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f232bfff700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 -- 172.21.15.53:0/3862204605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 msgr2=0x7f232c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 -- 172.21.15.53:0/3862204605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200095f0 con 0x7f232c1004c0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f232bfff700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2330cf1700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2320006010 tx=0x7f232000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f232001d070 con 0x7f232c1004c0 2024-09-16T00:46:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2320004f50 con 0x7f232c1004c0 2024-09-16T00:46:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c19ab60 con 0x7f232c1004c0 2024-09-16T00:46:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.353+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2320021640 con 0x7f232c1004c0 2024-09-16T00:46:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.354+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c19b050 con 0x7f232c1004c0 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.354+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c1087d0 con 0x7f232c1004c0 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.355+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f232000f460 con 0x7f232c1004c0 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.355+0000 7f2329ffb700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 0x7f231c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.356+0000 7f232bfff700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 0x7f231c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.356+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f232008c6d0 con 0x7f232c1004c0 2024-09-16T00:46:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.356+0000 7f232bfff700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 0x7f231c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2318005950 tx=0x7f23180058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.361+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2320057190 con 0x7f232c1004c0 2024-09-16T00:46:55.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.562+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f232c04f2a0 con 0x7f232c1004c0 2024-09-16T00:46:55.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.563+0000 7f2329ffb700 1 -- 172.21.15.53:0/3862204605 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f232000fe60 con 0x7f232c1004c0 2024-09-16T00:46:55.564 INFO:teuthology.orchestra.run.smithi053.stdout:81604378650 2024-09-16T00:46:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 msgr2=0x7f231c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 0x7f231c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2318005950 tx=0x7f23180058e0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 msgr2=0x7f232c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2320006010 tx=0x7f232000be20 comp rx=0 tx=0).stop 2024-09-16T00:46:55.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 shutdown_connections 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f231c06c680 0x7f231c06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f232c1004c0 0x7f232c195f30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 --2- 172.21.15.53:0/3862204605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f232c100e60 0x7f232c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 >> 172.21.15.53:0/3862204605 conn(0x7f232c0fbd80 msgr2=0x7f232c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 shutdown_connections 2024-09-16T00:46:55.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.565+0000 7f2332f55700 1 -- 172.21.15.53:0/3862204605 wait complete. 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 -- 172.21.15.53:0/591770547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 msgr2=0x7f4abc100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 --2- 172.21.15.53:0/591770547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc100040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009910 tx=0x7f4aac009c20 comp rx=0 tx=0).stop 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 -- 172.21.15.53:0/591770547 shutdown_connections 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 --2- 172.21.15.53:0/591770547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc100040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 --2- 172.21.15.53:0/591770547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 -- 172.21.15.53:0/591770547 >> 172.21.15.53:0/591770547 conn(0x7f4abc075130 msgr2=0x7f4abc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 -- 172.21.15.53:0/591770547 shutdown_connections 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.661+0000 7f4ac3357700 1 -- 172.21.15.53:0/591770547 wait complete. 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 Processor -- start 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 -- start start 2024-09-16T00:46:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc196a70 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac3357700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc19a800 con 0x7f4abc104130 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac10f3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac10f3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43134/0 (socket says 172.21.15.53:43134) 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.662+0000 7f4ac10f3700 1 -- 172.21.15.53:0/543295207 learned_addr learned my addr 172.21.15.53:0/543295207 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac08f2700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac10f3700 1 -- 172.21.15.53:0/543295207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 msgr2=0x7f4abc196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac10f3700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac10f3700 1 -- 172.21.15.53:0/543295207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0095f0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac08f2700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac10f3700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d8d0 tx=0x7f4ab800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:55.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab8009940 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc19aae0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ab8010460 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ab800f5f0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.663+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc19b030 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.664+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc1086a0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.664+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4ab80105d0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.665+0000 7f4ab27fc700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 0x7f4aa806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:46:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.665+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f4ab808b4a0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.665+0000 7f4ac08f2700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 0x7f4aa806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:46:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.666+0000 7f4ac08f2700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 0x7f4aa806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4abc197470 tx=0x7f4aac00b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:46:55.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.670+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ab8055f60 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:55 smithi152 ceph-mon[33237]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:55.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:55 smithi053 ceph-mon[27950]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:46:55.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.872+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4abc04f2a0 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.872+0000 7f4ab27fc700 1 -- 172.21.15.53:0/543295207 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ab8059580 con 0x7f4abc0ffbd0 2024-09-16T00:46:55.873 INFO:teuthology.orchestra.run.smithi053.stdout:115964117013 2024-09-16T00:46:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 msgr2=0x7f4aa806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 0x7f4aa806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4abc197470 tx=0x7f4aac00b560 comp rx=0 tx=0).stop 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 msgr2=0x7f4abc195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800d8d0 tx=0x7f4ab800dc90 comp rx=0 tx=0).stop 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 shutdown_connections 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4aa806c680 0x7f4aa806eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4abc0ffbd0 0x7f4abc195e50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 --2- 172.21.15.53:0/543295207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4abc104130 0x7f4abc196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:46:55.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 >> 172.21.15.53:0/543295207 conn(0x7f4abc075130 msgr2=0x7f4abc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:46:55.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 shutdown_connections 2024-09-16T00:46:55.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:46:55.875+0000 7f4ac3357700 1 -- 172.21.15.53:0/543295207 wait complete. 2024-09-16T00:46:56.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:56 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3862204605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T00:46:56.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:56 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/543295207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T00:46:56.581 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-16T00:46:56.581 DEBUG:teuthology.parallel:result is None 2024-09-16T00:46:56.601 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:56.602 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:56.603 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:46:56.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:56 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3862204605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T00:46:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:56 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/543295207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T00:46:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:57 smithi152 ceph-mon[33237]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:57.775 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:57 smithi053 ceph-mon[27950]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:46:59 smithi152 ceph-mon[33237]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:46:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:46:59 smithi053 ceph-mon[27950]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:01.040 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117013 for osd.3 2024-09-16T00:47:01.040 DEBUG:teuthology.parallel:result is None 2024-09-16T00:47:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:01 smithi053 ceph-mon[27950]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:01 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1211735586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T00:47:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:01 smithi152 ceph-mon[33237]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:01 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1211735586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T00:47:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 -- 172.21.15.53:0/2902866700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 msgr2=0x7f5c0c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/2902866700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c10a2e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009910 tx=0x7f5bf4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 -- 172.21.15.53:0/2902866700 shutdown_connections 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/2902866700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c10a2e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/2902866700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 0x7f5c0c1016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 -- 172.21.15.53:0/2902866700 >> 172.21.15.53:0/2902866700 conn(0x7f5c0c0fac90 msgr2=0x7f5c0c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 -- 172.21.15.53:0/2902866700 shutdown_connections 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 -- 172.21.15.53:0/2902866700 wait complete. 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.202+0000 7f5c11b5c700 1 Processor -- start 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c11b5c700 1 -- start start 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c11b5c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 0x7f5c0c195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:02.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c11b5c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c11b5c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c196af0 con 0x7f5c0c101c10 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c11b5c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c19a880 con 0x7f5c0c101300 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43144/0 (socket says 172.21.15.53:43144) 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 -- 172.21.15.53:0/1211735586 learned_addr learned my addr 172.21.15.53:0/1211735586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c0b7fe700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 0x7f5c0c195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 -- 172.21.15.53:0/1211735586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 msgr2=0x7f5c0c195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 0x7f5c0c195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 -- 172.21.15.53:0/1211735586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40095f0 con 0x7f5c0c101c10 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.203+0000 7f5c03fff700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf401d070 con 0x7f5c0c101c10 2024-09-16T00:47:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5bf400f460 con 0x7f5c0c101c10 2024-09-16T00:47:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c19ab00 con 0x7f5c0c101c10 2024-09-16T00:47:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf4021640 con 0x7f5c0c101c10 2024-09-16T00:47:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c19aff0 con 0x7f5c0c101c10 2024-09-16T00:47:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.204+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c1079e0 con 0x7f5c0c101c10 2024-09-16T00:47:02.015 INFO:teuthology.orchestra.run.smithi053.stdout:38654705704 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.205+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5bf400fad0 con 0x7f5c0c101c10 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.206+0000 7f5c097fa700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 0x7f5bf806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.206+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5bf408c6d0 con 0x7f5c0c101c10 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.206+0000 7f5c0b7fe700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 0x7f5bf806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.206+0000 7f5c0b7fe700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 0x7f5bf806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005fd0 tx=0x7f5bfc00a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.210+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5bf4057210 con 0x7f5c0c101c10 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.419+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c0c04f2a0 con 0x7f5c0c101c10 2024-09-16T00:47:02.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.419+0000 7f5c097fa700 1 -- 172.21.15.53:0/1211735586 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bf405a830 con 0x7f5c0c101c10 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 msgr2=0x7f5bf806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 0x7f5bf806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005fd0 tx=0x7f5bfc00a560 comp rx=0 tx=0).stop 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 msgr2=0x7f5c0c196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006010 tx=0x7f5bf40056a0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 shutdown_connections 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5bf806c680 0x7f5bf806eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c101300 0x7f5c0c195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 --2- 172.21.15.53:0/1211735586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c0c101c10 0x7f5c0c196410 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 >> 172.21.15.53:0/1211735586 conn(0x7f5c0c0fac90 msgr2=0x7f5c0c104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 shutdown_connections 2024-09-16T00:47:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:01.421+0000 7f5c11b5c700 1 -- 172.21.15.53:0/1211735586 wait complete. 2024-09-16T00:47:02.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705701 got 38654705704 for osd.0 2024-09-16T00:47:02.770 DEBUG:teuthology.parallel:result is None 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2008171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 msgr2=0x7f5ab40ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2008171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab40ff780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009910 tx=0x7f5aa4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2008171 shutdown_connections 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2008171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 0x7f5ab4103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2008171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab40ff780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2008171 >> 172.21.15.53:0/2008171 conn(0x7f5ab40fac90 msgr2=0x7f5ab40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2008171 shutdown_connections 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.389+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2008171 wait complete. 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 Processor -- start 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 -- start start 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 0x7f5ab4196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4196a70 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.390+0000 7f5ab9e33700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab419a800 con 0x7f5ab40ffd50 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59112/0 (socket says 172.21.15.53:59112) 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 -- 172.21.15.53:0/2018360611 learned_addr learned my addr 172.21.15.53:0/2018360611 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:03.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 -- 172.21.15.53:0/2018360611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 msgr2=0x7f5ab4196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab2ffd700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 0x7f5ab4196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 0x7f5ab4196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 -- 172.21.15.53:0/2018360611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40095f0 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab37fe700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006010 tx=0x7f5aa400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa401d070 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab419aa80 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5aa400f460 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4021640 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.391+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab419af70 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.393+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab41086d0 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.393+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5aa400fab0 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.393+0000 7f5ab0ff9700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 0x7f5a9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:03.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.394+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f5aa408c7c0 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.394+0000 7f5ab2ffd700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 0x7f5a9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:03.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.394+0000 7f5ab2ffd700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 0x7f5a9c06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4197470 tx=0x7f5aa8005cf0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:03.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.398+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5aa4057280 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:03 smithi053 ceph-mon[27950]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.615+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5ab41972b0 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.618 INFO:teuthology.orchestra.run.smithi053.stdout:171798691853 2024-09-16T00:47:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.616+0000 7f5ab0ff9700 1 -- 172.21.15.53:0/2018360611 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aa4026090 con 0x7f5ab40ff3b0 2024-09-16T00:47:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 msgr2=0x7f5a9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 0x7f5a9c06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4197470 tx=0x7f5aa8005cf0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 msgr2=0x7f5ab4195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4006010 tx=0x7f5aa400be20 comp rx=0 tx=0).stop 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 shutdown_connections 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f5a9c06c680 0x7f5a9c06eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ab40ff3b0 0x7f5ab4195e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 --2- 172.21.15.53:0/2018360611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ab40ffd50 0x7f5ab4196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.618+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 >> 172.21.15.53:0/2018360611 conn(0x7f5ab40fac90 msgr2=0x7f5ab4069130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.619+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 shutdown_connections 2024-09-16T00:47:03.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:03.619+0000 7f5ab9e33700 1 -- 172.21.15.53:0/2018360611 wait complete. 2024-09-16T00:47:03.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:03 smithi152 ceph-mon[33237]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:04.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691853 for osd.5 2024-09-16T00:47:04.318 DEBUG:teuthology.parallel:result is None 2024-09-16T00:47:04.565 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:04 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2018360611' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T00:47:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 -- 172.21.15.53:0/3030923676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 msgr2=0x7f98ec103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 --2- 172.21.15.53:0/3030923676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec103d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98dc009910 tx=0x7f98dc009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 -- 172.21.15.53:0/3030923676 shutdown_connections 2024-09-16T00:47:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 --2- 172.21.15.53:0/3030923676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec103d30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 --2- 172.21.15.53:0/3030923676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 -- 172.21.15.53:0/3030923676 >> 172.21.15.53:0/3030923676 conn(0x7f98ec0fac80 msgr2=0x7f98ec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 -- 172.21.15.53:0/3030923676 shutdown_connections 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.588+0000 7f98f386f700 1 -- 172.21.15.53:0/3030923676 wait complete. 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 Processor -- start 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 -- start start 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec198cd0 con 0x7f98ec0ffd60 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f386f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec19c9f0 con 0x7f98ec0ff3c0 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f0e0a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f0e0a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59126/0 (socket says 172.21.15.53:59126) 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f0e0a700 1 -- 172.21.15.53:0/1519756836 learned_addr learned my addr 172.21.15.53:0/1519756836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f160b700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f0e0a700 1 -- 172.21.15.53:0/1519756836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 msgr2=0x7f98ec1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.589+0000 7f98f0e0a700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98f0e0a700 1 -- 172.21.15.53:0/1519756836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0095f0 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98f160b700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98f0e0a700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0092e0 tx=0x7f98dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98dc01d070 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98dc00f460 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec19cc70 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98dc017630 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.590+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec19d160 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.591+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec04f2a0 con 0x7f98ec0ffd60 2024-09-16T00:47:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.591+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f98dc003a60 con 0x7f98ec0ffd60 2024-09-16T00:47:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.592+0000 7f98e27fc700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 0x7f98d806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:04.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.592+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f98dc08c950 con 0x7f98ec0ffd60 2024-09-16T00:47:04.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.592+0000 7f98f160b700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 0x7f98d806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:04.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.593+0000 7f98f160b700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 0x7f98d806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005950 tx=0x7f98e80058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:04.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.597+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f98dc057410 con 0x7f98ec0ffd60 2024-09-16T00:47:04.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:04 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2018360611' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T00:47:04.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.801+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98ec19d440 con 0x7f98ec0ffd60 2024-09-16T00:47:04.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.801+0000 7f98e27fc700 1 -- 172.21.15.53:0/1519756836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98dc05aa30 con 0x7f98ec0ffd60 2024-09-16T00:47:04.803 INFO:teuthology.orchestra.run.smithi053.stdout:60129542178 2024-09-16T00:47:04.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 msgr2=0x7f98d806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:04.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 0x7f98d806eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005950 tx=0x7f98e80058e0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 msgr2=0x7f98ec1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0092e0 tx=0x7f98dc00be20 comp rx=0 tx=0).stop 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 shutdown_connections 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f98d806c680 0x7f98d806eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98ec0ff3c0 0x7f98ec1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 --2- 172.21.15.53:0/1519756836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98ec0ffd60 0x7f98ec1985f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 >> 172.21.15.53:0/1519756836 conn(0x7f98ec0fac80 msgr2=0x7f98ec0696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 shutdown_connections 2024-09-16T00:47:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:04.804+0000 7f98f386f700 1 -- 172.21.15.53:0/1519756836 wait complete. 2024-09-16T00:47:05.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 -- 172.21.15.53:0/2140863528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 msgr2=0x7fb214104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 --2- 172.21.15.53:0/2140863528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214104e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb208009910 tx=0x7fb208009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 -- 172.21.15.53:0/2140863528 shutdown_connections 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 --2- 172.21.15.53:0/2140863528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214104e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 --2- 172.21.15.53:0/2140863528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 0x7fb2141008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 -- 172.21.15.53:0/2140863528 >> 172.21.15.53:0/2140863528 conn(0x7fb2140fbda0 msgr2=0x7fb2140fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 -- 172.21.15.53:0/2140863528 shutdown_connections 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 -- 172.21.15.53:0/2140863528 wait complete. 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.082+0000 7fb21a683700 1 Processor -- start 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb21a683700 1 -- start start 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb21a683700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 0x7fb214073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb21a683700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb21a683700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214073ad0 con 0x7fb214100e80 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb21a683700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214073c10 con 0x7fb2141004e0 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59140/0 (socket says 172.21.15.53:59140) 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 -- 172.21.15.53:0/3399938156 learned_addr learned my addr 172.21.15.53:0/3399938156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 -- 172.21.15.53:0/3399938156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 msgr2=0x7fb214073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb213fff700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 0x7fb214073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 0x7fb214073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.083+0000 7fb2137fe700 1 -- 172.21.15.53:0/3399938156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080095f0 con 0x7fb214100e80 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb2137fe700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb20800bda0 tx=0x7fb20800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:05.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb20801d070 con 0x7fb214100e80 2024-09-16T00:47:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb20800f460 con 0x7fb214100e80 2024-09-16T00:47:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214073e90 con 0x7fb214100e80 2024-09-16T00:47:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb208017630 con 0x7fb214100e80 2024-09-16T00:47:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.084+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2141a2410 con 0x7fb214100e80 2024-09-16T00:47:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.085+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214108850 con 0x7fb214100e80 2024-09-16T00:47:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.085+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb208003a60 con 0x7fb214100e80 2024-09-16T00:47:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.086+0000 7fb2117fa700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 0x7fb1fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.086+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb20808c8a0 con 0x7fb214100e80 2024-09-16T00:47:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.086+0000 7fb213fff700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 0x7fb1fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.086+0000 7fb213fff700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 0x7fb1fc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb204005950 tx=0x7fb2040058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:05.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.090+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb2080573e0 con 0x7fb214100e80 2024-09-16T00:47:05.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.292+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb214074580 con 0x7fb214100e80 2024-09-16T00:47:05.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.292+0000 7fb2117fa700 1 -- 172.21.15.53:0/3399938156 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb20805aa00 con 0x7fb214100e80 2024-09-16T00:47:05.294 INFO:teuthology.orchestra.run.smithi053.stdout:150323855378 2024-09-16T00:47:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.294+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 msgr2=0x7fb1fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.294+0000 7fb21a683700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 0x7fb1fc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb204005950 tx=0x7fb2040058e0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.294+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 msgr2=0x7fb214073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.294+0000 7fb21a683700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb20800bda0 tx=0x7fb20800be80 comp rx=0 tx=0).stop 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 shutdown_connections 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb1fc06c680 0x7fb1fc06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2141004e0 0x7fb214073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 --2- 172.21.15.53:0/3399938156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb214100e80 0x7fb214073590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 >> 172.21.15.53:0/3399938156 conn(0x7fb2140fbda0 msgr2=0x7fb2140fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 shutdown_connections 2024-09-16T00:47:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:05.295+0000 7fb21a683700 1 -- 172.21.15.53:0/3399938156 wait complete. 2024-09-16T00:47:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:05 smithi053 ceph-mon[27950]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:05 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1519756836' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T00:47:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:05 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3399938156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T00:47:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:05 smithi152 ceph-mon[33237]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:05 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1519756836' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T00:47:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:05 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3399938156' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T00:47:05.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542178 for osd.1 2024-09-16T00:47:05.784 DEBUG:teuthology.parallel:result is None 2024-09-16T00:47:06.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855375 got 150323855378 for osd.4 2024-09-16T00:47:06.497 DEBUG:teuthology.parallel:result is None 2024-09-16T00:47:06.497 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T00:47:06.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T00:47:06.718 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:07.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:07 smithi152 ceph-mon[33237]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:07 smithi053 ceph-mon[27950]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 -- 172.21.15.53:0/511046435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ffd60 msgr2=0x7fe550103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 --2- 172.21.15.53:0/511046435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ffd60 0x7fe550103d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe544009910 tx=0x7fe544009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 -- 172.21.15.53:0/511046435 shutdown_connections 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 --2- 172.21.15.53:0/511046435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ffd60 0x7fe550103d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 --2- 172.21.15.53:0/511046435 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ff3c0 0x7fe5500ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 -- 172.21.15.53:0/511046435 >> 172.21.15.53:0/511046435 conn(0x7fe5500fac80 msgr2=0x7fe5500fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 -- 172.21.15.53:0/511046435 shutdown_connections 2024-09-16T00:47:08.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.502+0000 7fe555f94700 1 -- 172.21.15.53:0/511046435 wait complete. 2024-09-16T00:47:08.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 Processor -- start 2024-09-16T00:47:08.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 -- start start 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ffd60 0x7fe550196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550196b50 con 0x7fe5500ff3c0 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.503+0000 7fe555f94700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55019a8e0 con 0x7fe5500ffd60 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59162/0 (socket says 172.21.15.53:59162) 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 -- 172.21.15.53:0/3933160259 learned_addr learned my addr 172.21.15.53:0/3933160259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54effd700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ffd60 0x7fe550196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 -- 172.21.15.53:0/3933160259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ffd60 msgr2=0x7fe550196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ffd60 0x7fe550196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 -- 172.21.15.53:0/3933160259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440095f0 con 0x7fe5500ff3c0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54f7fe700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b4b0 tx=0x7fe54000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe540011800 con 0x7fe5500ff3c0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe540011e10 con 0x7fe5500ff3c0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55019abc0 con 0x7fe5500ff3c0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54000f2e0 con 0x7fe5500ff3c0 2024-09-16T00:47:08.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.504+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55019b110 con 0x7fe5500ff3c0 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.505+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55004f2a0 con 0x7fe5500ff3c0 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.506+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe540010380 con 0x7fe5500ff3c0 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.506+0000 7fe54cff9700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 0x7fe53806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.506+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe54008b070 con 0x7fe5500ff3c0 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.507+0000 7fe54effd700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 0x7fe53806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:08.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.507+0000 7fe54effd700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 0x7fe53806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe550197550 tx=0x7fe54401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:08.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.511+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe540055b30 con 0x7fe5500ff3c0 2024-09-16T00:47:08.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.706+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe55019b430 con 0x7fe53806c680 2024-09-16T00:47:08.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.707+0000 7fe54cff9700 1 -- 172.21.15.53:0/3933160259 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27890 (secure 0 0 0) 0x7fe55019b430 con 0x7fe53806c680 2024-09-16T00:47:08.708 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:08.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.709+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 msgr2=0x7fe53806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:08.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.709+0000 7fe555f94700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 0x7fe53806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe550197550 tx=0x7fe54401a040 comp rx=0 tx=0).stop 2024-09-16T00:47:08.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.709+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 msgr2=0x7fe550195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:08.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.709+0000 7fe555f94700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe54000b4b0 tx=0x7fe54000b7c0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 shutdown_connections 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe53806c680 0x7fe53806eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5500ff3c0 0x7fe550195f30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 --2- 172.21.15.53:0/3933160259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5500ffd60 0x7fe550196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 >> 172.21.15.53:0/3933160259 conn(0x7fe5500fac80 msgr2=0x7fe5501037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 shutdown_connections 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:08.710+0000 7fe555f94700 1 -- 172.21.15.53:0/3933160259 wait complete. 2024-09-16T00:47:08.711 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-16T00:47:09.380 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-16T00:47:08.362223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002437"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T00:46:13.171438+0000","last_change":"2024-09-16T00:45:47.278387+0000","last_active":"2024-09-16T00:46:13.171438+0000","last_peered":"2024-09-16T00:46:13.171438+0000","last_clean":"2024-09-16T00:46:13.171438+0000","last_became_active":"2024-09-16T00:45:47.278044+0000","last_became_peered":"2024-09-16T00:45:47.278044+0000","last_unstale":"2024-09-16T00:46:13.171438+0000","last_undegraded":"2024-09-16T00:46:13.171438+0000","last_fullsized":"2024-09-16T00:46:13.171438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:45:00.877326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:45:00.877326+0000","last_clean_scrub_stamp":"2024-09-16T00:45:00.877326+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:59.758469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.442}]},{"osd":1,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Sep 16 00:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.254,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.314}]},{"osd":1,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.37},"min":{"1min":0.26800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.246,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Sep 16 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 00:46:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.255},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.26300000000000001}]},{"osd":2,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38200000000000001,"15min":0.38500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54300000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60999999999999999}]},{"osd":4,"last update":"Mon Sep 16 00:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.621},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":16.745000000000001,"5min":16.745000000000001,"15min":16.745000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Sep 16 00:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Sep 16 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Sep 16 00:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T00:47:09.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T00:47:09.596 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:09.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:09 smithi152 ceph-mon[33237]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:09.717 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:09 smithi053 ceph-mon[27950]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:10 smithi152 ceph-mon[33237]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:47:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:10.704 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:10 smithi053 ceph-mon[27950]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:47:10.704 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 -- 172.21.15.53:0/1020915165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 msgr2=0x7fa430103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 --2- 172.21.15.53:0/1020915165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa430103c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa420009910 tx=0x7fa420009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 -- 172.21.15.53:0/1020915165 shutdown_connections 2024-09-16T00:47:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 --2- 172.21.15.53:0/1020915165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa430103c70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 --2- 172.21.15.53:0/1020915165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 0x7fa430100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.311+0000 7fa43863e700 1 -- 172.21.15.53:0/1020915165 >> 172.21.15.53:0/1020915165 conn(0x7fa430075010 msgr2=0x7fa430075410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.312+0000 7fa43863e700 1 -- 172.21.15.53:0/1020915165 shutdown_connections 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.312+0000 7fa43863e700 1 -- 172.21.15.53:0/1020915165 wait complete. 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.312+0000 7fa43863e700 1 Processor -- start 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.312+0000 7fa43863e700 1 -- start start 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa43863e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 0x7fa43019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa43863e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa43863e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43019c620 con 0x7fa430100720 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa43863e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430195ad0 con 0x7fa4300ffd80 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59182/0 (socket says 172.21.15.53:59182) 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 -- 172.21.15.53:0/1443989192 learned_addr learned my addr 172.21.15.53:0/1443989192 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa4363da700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 0x7fa43019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 -- 172.21.15.53:0/1443989192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 msgr2=0x7fa43019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 0x7fa43019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 -- 172.21.15.53:0/1443989192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200095f0 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa435bd9700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa42000bd70 tx=0x7fa42000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42001d070 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.313+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa42000f460 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.314+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa430195d50 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.314+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa420017630 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.314+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa430196240 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.315+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43004f2a0 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.315+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa42000f5d0 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.316+0000 7fa4277fe700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 0x7fa41c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.316+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa42008c9a0 con 0x7fa430100720 2024-09-16T00:47:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.316+0000 7fa4363da700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 0x7fa41c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.316+0000 7fa4363da700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 0x7fa41c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005950 tx=0x7fa42c00b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.320+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa42005aef0 con 0x7fa430100720 2024-09-16T00:47:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.516+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa430196620 con 0x7fa41c06c680 2024-09-16T00:47:11.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.517+0000 7fa4277fe700 1 -- 172.21.15.53:0/1443989192 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27875 (secure 0 0 0) 0x7fa430196620 con 0x7fa41c06c680 2024-09-16T00:47:11.518 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 msgr2=0x7fa41c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 0x7fa41c06eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005950 tx=0x7fa42c00b410 comp rx=0 tx=0).stop 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 msgr2=0x7fa43019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa42000bd70 tx=0x7fa42000bda0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 shutdown_connections 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa41c06c680 0x7fa41c06eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4300ffd80 0x7fa43019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 --2- 172.21.15.53:0/1443989192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa430100720 0x7fa43019bf90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.519+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 >> 172.21.15.53:0/1443989192 conn(0x7fa430075010 msgr2=0x7fa430068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.520+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 shutdown_connections 2024-09-16T00:47:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:11.520+0000 7fa43863e700 1 -- 172.21.15.53:0/1443989192 wait complete. 2024-09-16T00:47:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-16T00:47:11.568 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:11 smithi053 ceph-mon[27950]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:11.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:11 smithi152 ceph-mon[33237]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:12.143 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-16T00:47:10.362564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002276"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T00:46:13.171438+0000","last_change":"2024-09-16T00:45:47.278387+0000","last_active":"2024-09-16T00:46:13.171438+0000","last_peered":"2024-09-16T00:46:13.171438+0000","last_clean":"2024-09-16T00:46:13.171438+0000","last_became_active":"2024-09-16T00:45:47.278044+0000","last_became_peered":"2024-09-16T00:45:47.278044+0000","last_unstale":"2024-09-16T00:46:13.171438+0000","last_undegraded":"2024-09-16T00:46:13.171438+0000","last_fullsized":"2024-09-16T00:46:13.171438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T00:45:00.877326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T00:45:00.877326+0000","last_clean_scrub_stamp":"2024-09-16T00:45:00.877326+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:59.758469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Sep 16 00:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.255,"5min":0.254,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.314}]},{"osd":1,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.37,"15min":0.37},"min":{"1min":0.26800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.246,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Sep 16 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Mon Sep 16 00:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 00:46:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.32700000000000001},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.33800000000000002},"min":{"1min":0.26300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.44}]},{"osd":2,"last update":"Mon Sep 16 00:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38200000000000001,"15min":0.38500000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.40300000000000002,"15min":0.40999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.54300000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Sep 16 00:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Sep 16 00:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":16.745000000000001,"5min":16.745000000000001,"15min":16.745000000000001},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 00:46:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.246}]},{"osd":2,"last update":"Mon Sep 16 00:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38800000000000001,"15min":0.39200000000000002},"min":{"1min":0.26800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.314},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.377,"15min":0.38100000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.36699999999999999}]},{"osd":3,"last update":"Mon Sep 16 00:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48199999999999998}]},{"osd":4,"last update":"Mon Sep 16 00:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T00:47:12.144 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T00:47:12.144 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T00:47:12.144 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T00:47:12.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T00:47:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:13.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:13 smithi053 ceph-mon[27950]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:47:13.657 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:13 smithi053 ceph-mon[27950]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:13.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:13 smithi152 ceph-mon[33237]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T00:47:13.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:13 smithi152 ceph-mon[33237]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 -- 172.21.15.53:0/3094103931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 msgr2=0x7f587c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 --2- 172.21.15.53:0/3094103931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1008b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5878009910 tx=0x7f5878009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 -- 172.21.15.53:0/3094103931 shutdown_connections 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 --2- 172.21.15.53:0/3094103931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 0x7f587c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 --2- 172.21.15.53:0/3094103931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1008b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 -- 172.21.15.53:0/3094103931 >> 172.21.15.53:0/3094103931 conn(0x7f587c0fbda0 msgr2=0x7f587c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 -- 172.21.15.53:0/3094103931 shutdown_connections 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.045+0000 7f5883477700 1 -- 172.21.15.53:0/3094103931 wait complete. 2024-09-16T00:47:14.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 Processor -- start 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 -- start start 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 0x7f587c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c198cc0 con 0x7f587c1004e0 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5883477700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c19ca50 con 0x7f587c100e80 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5881213700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5881213700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49890/0 (socket says 172.21.15.53:49890) 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.046+0000 7f5881213700 1 -- 172.21.15.53:0/2383061210 learned_addr learned my addr 172.21.15.53:0/2383061210 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5880a12700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 0x7f587c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5881213700 1 -- 172.21.15.53:0/2383061210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 msgr2=0x7f587c1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5881213700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 0x7f587c1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5881213700 1 -- 172.21.15.53:0/2383061210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780095f0 con 0x7f587c1004e0 2024-09-16T00:47:14.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5881213700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5878006010 tx=0x7f587800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587801d070 con 0x7f587c1004e0 2024-09-16T00:47:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c19ccd0 con 0x7f587c1004e0 2024-09-16T00:47:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5878004fa0 con 0x7f587c1004e0 2024-09-16T00:47:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587800f690 con 0x7f587c1004e0 2024-09-16T00:47:14.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.047+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c19d1c0 con 0x7f587c1004e0 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.048+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c1045d0 con 0x7f587c1004e0 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.049+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5878022470 con 0x7f587c1004e0 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.049+0000 7f586e7fc700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 0x7f586806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.049+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f587808cbe0 con 0x7f587c1004e0 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.049+0000 7f5880a12700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 0x7f586806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:14.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.050+0000 7f5880a12700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 0x7f586806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f587c1996c0 tx=0x7f587000a300 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:14.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.054+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f58780576a0 con 0x7f587c1004e0 2024-09-16T00:47:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.298+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f587c199500 con 0x7f587c1004e0 2024-09-16T00:47:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.299+0000 7f586e7fc700 1 -- 172.21.15.53:0/2383061210 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f587805acc0 con 0x7f587c1004e0 2024-09-16T00:47:14.299 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:14.300 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T00:47:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 msgr2=0x7f586806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 0x7f586806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f587c1996c0 tx=0x7f587000a300 comp rx=0 tx=0).stop 2024-09-16T00:47:14.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 msgr2=0x7f587c1980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5878006010 tx=0x7f587800bd70 comp rx=0 tx=0).stop 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 shutdown_connections 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f586806c680 0x7f586806eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f587c1004e0 0x7f587c1980a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 --2- 172.21.15.53:0/2383061210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f587c100e80 0x7f587c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 >> 172.21.15.53:0/2383061210 conn(0x7f587c0fbda0 msgr2=0x7f587c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 shutdown_connections 2024-09-16T00:47:14.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:14.302+0000 7f5883477700 1 -- 172.21.15.53:0/2383061210 wait complete. 2024-09-16T00:47:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:14 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2383061210' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T00:47:14.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:14 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2383061210' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T00:47:14.952 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T00:47:14.952 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T00:47:14.953 INFO:teuthology.run_tasks:Running task print... 2024-09-16T00:47:14.963 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-16T00:47:14.963 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:14.983 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:14.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-16T00:47:15.203 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:15.590 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:15 smithi053 ceph-mon[27950]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:15.590 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:15.590 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:15.590 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:15.590 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:15 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:15.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:15 smithi152 ceph-mon[33237]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:15 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:16.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 -- 172.21.15.53:0/2837442933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 msgr2=0x7f25e40ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 --2- 172.21.15.53:0/2837442933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40ffa70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009910 tx=0x7f25d4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 -- 172.21.15.53:0/2837442933 shutdown_connections 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 --2- 172.21.15.53:0/2837442933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 0x7f25e41007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 --2- 172.21.15.53:0/2837442933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40ffa70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.899+0000 7f25ea37d700 1 -- 172.21.15.53:0/2837442933 >> 172.21.15.53:0/2837442933 conn(0x7f25e40f9e50 msgr2=0x7f25e40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 -- 172.21.15.53:0/2837442933 shutdown_connections 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 -- 172.21.15.53:0/2837442933 wait complete. 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 Processor -- start 2024-09-16T00:47:16.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 -- start start 2024-09-16T00:47:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.900+0000 7f25ea37d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 0x7f25e419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25ea37d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e419adf0 con 0x7f25e40ff660 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25ea37d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e419af30 con 0x7f25e4100380 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49914/0 (socket says 172.21.15.53:49914) 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 -- 172.21.15.53:0/45119859 learned_addr learned my addr 172.21.15.53:0/45119859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e37fe700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 0x7f25e419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 -- 172.21.15.53:0/45119859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 msgr2=0x7f25e419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 0x7f25e419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 -- 172.21.15.53:0/45119859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40095f0 con 0x7f25e40ff660 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e3fff700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd70 tx=0x7f25d400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d401d070 con 0x7f25e40ff660 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f25d400f460 con 0x7f25e40ff660 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e419b1b0 con 0x7f25e40ff660 2024-09-16T00:47:16.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.901+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d4021640 con 0x7f25e40ff660 2024-09-16T00:47:16.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.902+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e419b6a0 con 0x7f25e40ff660 2024-09-16T00:47:16.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.903+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e4107cb0 con 0x7f25e40ff660 2024-09-16T00:47:16.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.903+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f25d400fa90 con 0x7f25e40ff660 2024-09-16T00:47:16.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.903+0000 7f25e17fa700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 0x7f25cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:16.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.904+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f25d408c6c0 con 0x7f25e40ff660 2024-09-16T00:47:16.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.904+0000 7f25e37fe700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 0x7f25cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:16.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.904+0000 7f25e37fe700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 0x7f25cc06eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005950 tx=0x7f25d80058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:16.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:16.908+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f25d405ac90 con 0x7f25e40ff660 2024-09-16T00:47:17.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.107+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f25e4107ea0 con 0x7f25e40ff660 2024-09-16T00:47:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.111+0000 7f25e17fa700 1 -- 172.21.15.53:0/45119859 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f25d405a820 con 0x7f25e40ff660 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.113+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 msgr2=0x7f25cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.113+0000 7f25ea37d700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 0x7f25cc06eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005950 tx=0x7f25d80058e0 comp rx=0 tx=0).stop 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.113+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 msgr2=0x7f25e40fed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.113+0000 7f25ea37d700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25d400bd70 tx=0x7f25d400be50 comp rx=0 tx=0).stop 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 shutdown_connections 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25cc06c680 0x7f25cc06eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25e40ff660 0x7f25e40fed80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 --2- 172.21.15.53:0/45119859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25e4100380 0x7f25e419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 >> 172.21.15.53:0/45119859 conn(0x7f25e40f9e50 msgr2=0x7f25e41035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 shutdown_connections 2024-09-16T00:47:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:17.114+0000 7f25ea37d700 1 -- 172.21.15.53:0/45119859 wait complete. 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/45119859' entity='client.admin' 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:17.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:17 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/45119859' entity='client.admin' 2024-09-16T00:47:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:17 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:17.818 INFO:teuthology.run_tasks:Running task print... 2024-09-16T00:47:17.827 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-16T00:47:17.827 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:17.846 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:17.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T00:47:18.057 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:19 smithi053 ceph-mon[27950]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:19.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:19 smithi152 ceph-mon[33237]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:19.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 -- 172.21.15.53:0/726995341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c069250 msgr2=0x7f264c102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 --2- 172.21.15.53:0/726995341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c069250 0x7f264c102df0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f263c009910 tx=0x7f263c009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 -- 172.21.15.53:0/726995341 shutdown_connections 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 --2- 172.21.15.53:0/726995341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c103330 0x7f264c105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 --2- 172.21.15.53:0/726995341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c069250 0x7f264c102df0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 -- 172.21.15.53:0/726995341 >> 172.21.15.53:0/726995341 conn(0x7f264c0fa780 msgr2=0x7f264c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 -- 172.21.15.53:0/726995341 shutdown_connections 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.878+0000 7f2651f57700 1 -- 172.21.15.53:0/726995341 wait complete. 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.879+0000 7f2651f57700 1 Processor -- start 2024-09-16T00:47:19.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.879+0000 7f2651f57700 1 -- start start 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f2651f57700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c069250 0x7f264c195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f2651f57700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f2651f57700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1966c0 con 0x7f264c103330 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f2651f57700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c196800 con 0x7f264c069250 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49928/0 (socket says 172.21.15.53:49928) 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 -- 172.21.15.53:0/771767844 learned_addr learned my addr 172.21.15.53:0/771767844 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264b7fe700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c069250 0x7f264c195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 -- 172.21.15.53:0/771767844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c069250 msgr2=0x7f264c195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c069250 0x7f264c195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 -- 172.21.15.53:0/771767844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0095f0 con 0x7f264c103330 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f264affd700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f264000b4b0 tx=0x7f264000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.880+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2640011800 con 0x7f264c103330 2024-09-16T00:47:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.881+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c19b2b0 con 0x7f264c103330 2024-09-16T00:47:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.881+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2640011e10 con 0x7f264c103330 2024-09-16T00:47:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.881+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264000f2e0 con 0x7f264c103330 2024-09-16T00:47:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.881+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c19b800 con 0x7f264c103330 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.882+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c18fc50 con 0x7f264c103330 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.882+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2640010380 con 0x7f264c103330 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.883+0000 7f2648ff9700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.883+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f264008b100 con 0x7f264c103330 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.883+0000 7f264b7fe700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.883+0000 7f264b7fe700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f263c005090 tx=0x7f263c00b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:19.887+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f26400595b0 con 0x7f264c103330 2024-09-16T00:47:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.105+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f264c061190 con 0x7f263406c680 2024-09-16T00:47:20.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.106+0000 7f2648ff9700 1 -- 172.21.15.53:0/771767844 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f264c061190 con 0x7f263406c680 2024-09-16T00:47:20.107 INFO:teuthology.orchestra.run.smithi053.stdout:Backend: cephadm 2024-09-16T00:47:20.107 INFO:teuthology.orchestra.run.smithi053.stdout:Available: Yes 2024-09-16T00:47:20.107 INFO:teuthology.orchestra.run.smithi053.stdout:Paused: No 2024-09-16T00:47:20.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 msgr2=0x7f263406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f263c005090 tx=0x7f263c00b560 comp rx=0 tx=0).stop 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 msgr2=0x7f264c1960a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f264000b4b0 tx=0x7f264000b7c0 comp rx=0 tx=0).stop 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 shutdown_connections 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f264c069250 0x7f264c195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 --2- 172.21.15.53:0/771767844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c103330 0x7f264c1960a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 >> 172.21.15.53:0/771767844 conn(0x7f264c0fa780 msgr2=0x7f264c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 shutdown_connections 2024-09-16T00:47:20.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:20.109+0000 7f2651f57700 1 -- 172.21.15.53:0/771767844 wait complete. 2024-09-16T00:47:20.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T00:47:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:21.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:21 smithi053 ceph-mon[27950]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:21.483 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:21 smithi053 ceph-mon[27950]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:21.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:21 smithi152 ceph-mon[33237]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:21 smithi152 ceph-mon[33237]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- 172.21.15.53:0/1434145649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 msgr2=0x7f7de40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 --2- 172.21.15.53:0/1434145649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de40ff560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009910 tx=0x7f7dd4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- 172.21.15.53:0/1434145649 shutdown_connections 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 --2- 172.21.15.53:0/1434145649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7de41003f0 0x7f7de4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 --2- 172.21.15.53:0/1434145649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de40ff560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- 172.21.15.53:0/1434145649 >> 172.21.15.53:0/1434145649 conn(0x7f7de40fa7a0 msgr2=0x7f7de40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- 172.21.15.53:0/1434145649 shutdown_connections 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- 172.21.15.53:0/1434145649 wait complete. 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 Processor -- start 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.801+0000 7f7dea60e700 1 -- start start 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7dea60e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7dea60e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7de41003f0 0x7f7de41017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7dea60e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4101d10 con 0x7f7de40ff150 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7dea60e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4101e50 con 0x7f7de41003f0 2024-09-16T00:47:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44276/0 (socket says 172.21.15.53:44276) 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 -- 172.21.15.53:0/3502968490 learned_addr learned my addr 172.21.15.53:0/3502968490 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 -- 172.21.15.53:0/3502968490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7de41003f0 msgr2=0x7f7de41017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7de41003f0 0x7f7de41017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 -- 172.21.15.53:0/3502968490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40095f0 con 0x7f7de40ff150 2024-09-16T00:47:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de3fff700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b5c0 tx=0x7f7dd400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd401d070 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7dd4022470 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de41020d0 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.802+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd400f690 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.803+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de41025c0 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.803+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4068ab0 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.804+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7dd4004b70 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.804+0000 7f7de17fa700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 0x7f7dcc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.805+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7dd408cbf0 con 0x7f7de40ff150 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.805+0000 7f7de37fe700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 0x7f7dcc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.805+0000 7f7de37fe700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 0x7f7dcc06eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80097b0 tx=0x7f7dd8006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:22.809+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7dd405b1f0 con 0x7f7de40ff150 2024-09-16T00:47:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.021+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de40694e0 con 0x7f7dcc06c680 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.030+0000 7f7de17fa700 1 -- 172.21.15.53:0/3502968490 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7f7de40694e0 con 0x7f7dcc06c680 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (3m) 2m ago 5m 26.7M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (5m) 2m ago 5m 7050k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (4m) 72s ago 4m 6937k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:47:23.031 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (5m) 2m ago 5m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (4m) 72s ago 4m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (3m) 2m ago 5m 77.3M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:9283,8765,8443 running (6m) 2m ago 6m 477M - 18.2.0 dc2bc1663786 308f181966ac 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (4m) 72s ago 4m 437M - 18.2.0 dc2bc1663786 ad027230756c 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (6m) 2m ago 6m 42.9M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (4m) 72s ago 4m 40.4M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (5m) 2m ago 5m 16.6M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 72s ago 4m 15.7M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (3m) 2m ago 3m 45.2M 3948M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (3m) 2m ago 3m 40.6M 3948M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (2m) 2m ago 2m 39.4M 3948M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (2m) 72s ago 2m 41.2M 4970M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (102s) 72s ago 101s 38.9M 4970M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:47:23.032 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (77s) 72s ago 76s 10.8M 4970M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:47:23.033 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (3m) 2m ago 4m 42.2M - 2.43.0 a07b618ecd1d 61cdcd6b91c6 2024-09-16T00:47:23.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 msgr2=0x7f7dcc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 0x7f7dcc06eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80097b0 tx=0x7f7dd8006d20 comp rx=0 tx=0).stop 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 msgr2=0x7f7de4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b5c0 tx=0x7f7dd400be20 comp rx=0 tx=0).stop 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 shutdown_connections 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7dcc06c680 0x7f7dcc06eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7de40ff150 0x7f7de4103180 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 --2- 172.21.15.53:0/3502968490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7de41003f0 0x7f7de41017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 >> 172.21.15.53:0/3502968490 conn(0x7f7de40fa7a0 msgr2=0x7f7de4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 shutdown_connections 2024-09-16T00:47:23.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:23.033+0000 7f7dea60e700 1 -- 172.21.15.53:0/3502968490 wait complete. 2024-09-16T00:47:23.623 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:23 smithi053 ceph-mon[27950]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:23.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T00:47:23.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:23 smithi152 ceph-mon[33237]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:23.853 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:24.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:24 smithi053 ceph-mon[27950]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:24.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:24 smithi152 ceph-mon[33237]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:25 smithi053 ceph-mon[27950]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 -- 172.21.15.53:0/3348023812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710103310 msgr2=0x7f5710105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 --2- 172.21.15.53:0/3348023812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710103310 0x7f5710105790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5704009910 tx=0x7f5704009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 -- 172.21.15.53:0/3348023812 shutdown_connections 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 --2- 172.21.15.53:0/3348023812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710103310 0x7f5710105790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 --2- 172.21.15.53:0/3348023812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710069270 0x7f5710102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 -- 172.21.15.53:0/3348023812 >> 172.21.15.53:0/3348023812 conn(0x7f57100fa780 msgr2=0x7f57100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 -- 172.21.15.53:0/3348023812 shutdown_connections 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 -- 172.21.15.53:0/3348023812 wait complete. 2024-09-16T00:47:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.572+0000 7f57161b1700 1 Processor -- start 2024-09-16T00:47:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f57161b1700 1 -- start start 2024-09-16T00:47:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f57161b1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710103310 0x7f5710195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f57161b1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f57161b1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710196510 con 0x7f5710196010 2024-09-16T00:47:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f57161b1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710196680 con 0x7f5710103310 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44294/0 (socket says 172.21.15.53:44294) 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 -- 172.21.15.53:0/1346150411 learned_addr learned my addr 172.21.15.53:0/1346150411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 -- 172.21.15.53:0/1346150411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710103310 msgr2=0x7f5710195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570f7fe700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710103310 0x7f5710195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710103310 0x7f5710195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 -- 172.21.15.53:0/1346150411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040095f0 con 0x7f5710196010 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.573+0000 7f570effd700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5704006010 tx=0x7f570400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.574+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570401d070 con 0x7f5710196010 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.574+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f570400f460 con 0x7f5710196010 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.574+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571019b5c0 con 0x7f5710196010 2024-09-16T00:47:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.574+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5704017630 con 0x7f5710196010 2024-09-16T00:47:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.574+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571019ba80 con 0x7f5710196010 2024-09-16T00:47:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.575+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571018fbf0 con 0x7f5710196010 2024-09-16T00:47:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.575+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f570400f5d0 con 0x7f5710196010 2024-09-16T00:47:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.576+0000 7f570cff9700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 0x7f56f806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.576+0000 7f570f7fe700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 0x7f56f806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.576+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f570408c940 con 0x7f5710196010 2024-09-16T00:47:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.576+0000 7f570f7fe700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 0x7f56f806eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5700005950 tx=0x7f57000058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.580+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f570405ae90 con 0x7f5710196010 2024-09-16T00:47:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:25 smithi152 ceph-mon[33237]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:25.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.789+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f571002cf60 con 0x7f56f806c680 2024-09-16T00:47:25.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.794+0000 7f570cff9700 1 -- 172.21.15.53:0/1346150411 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f571002cf60 con 0x7f56f806c680 2024-09-16T00:47:25.796 INFO:teuthology.orchestra.run.smithi053.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T00:47:25.796 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-09-16T00:47:25.796 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-16T00:47:25.796 INFO:teuthology.orchestra.run.smithi053.stdout:crash 2/2 2m ago 6m * 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:mgr 2/2 2m ago 6m count:2 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:mon 2/2 2m ago 5m smithi053:172.21.15.53=smithi053;smithi152:172.21.15.152=smithi152;count:2 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:osd 6 2m ago - 2024-09-16T00:47:25.797 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 msgr2=0x7f56f806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 0x7f56f806eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5700005950 tx=0x7f57000058e0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 msgr2=0x7f571019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5704006010 tx=0x7f570400be20 comp rx=0 tx=0).stop 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 shutdown_connections 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f56f806c680 0x7f56f806eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5710103310 0x7f5710195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 --2- 172.21.15.53:0/1346150411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710196010 0x7f571019b080 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 >> 172.21.15.53:0/1346150411 conn(0x7f57100fa780 msgr2=0x7f57100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:25.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 shutdown_connections 2024-09-16T00:47:25.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:25.796+0000 7f57161b1700 1 -- 172.21.15.53:0/1346150411 wait complete. 2024-09-16T00:47:26.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T00:47:26.707 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:27.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:27 smithi152 ceph-mon[33237]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:27 smithi152 ceph-mon[33237]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:27.786 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:27 smithi053 ceph-mon[27950]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:27.786 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:27 smithi053 ceph-mon[27950]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 -- 172.21.15.53:0/1166917365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa341014e0 msgr2=0x7ffa34101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/1166917365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa341014e0 0x7ffa34101930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009910 tx=0x7ffa28009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 -- 172.21.15.53:0/1166917365 shutdown_connections 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/1166917365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa341014e0 0x7ffa34101930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/1166917365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa340fe500 0x7ffa340fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 -- 172.21.15.53:0/1166917365 >> 172.21.15.53:0/1166917365 conn(0x7ffa340f9e50 msgr2=0x7ffa340fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:28.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 -- 172.21.15.53:0/1166917365 shutdown_connections 2024-09-16T00:47:28.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.340+0000 7ffa38a1f700 1 -- 172.21.15.53:0/1166917365 wait complete. 2024-09-16T00:47:28.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 Processor -- start 2024-09-16T00:47:28.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 -- start start 2024-09-16T00:47:28.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:28.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa341014e0 0x7ffa34196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34196630 con 0x7ffa340fe500 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa38a1f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34196770 con 0x7ffa341014e0 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.341+0000 7ffa3259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44310/0 (socket says 172.21.15.53:44310) 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 -- 172.21.15.53:0/95763922 learned_addr learned my addr 172.21.15.53:0/95763922 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa31d9b700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa341014e0 0x7ffa34196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 -- 172.21.15.53:0/95763922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa341014e0 msgr2=0x7ffa34196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa341014e0 0x7ffa34196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 -- 172.21.15.53:0/95763922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280095f0 con 0x7ffa340fe500 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa3259c700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e8f0 tx=0x7ffa2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa24009790 con 0x7ffa340fe500 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa240044d0 con 0x7ffa340fe500 2024-09-16T00:47:28.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3419b220 con 0x7ffa340fe500 2024-09-16T00:47:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa24003da0 con 0x7ffa340fe500 2024-09-16T00:47:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.342+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3419b770 con 0x7ffa340fe500 2024-09-16T00:47:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.343+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34108d80 con 0x7ffa340fe500 2024-09-16T00:47:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.344+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffa2400cba0 con 0x7ffa340fe500 2024-09-16T00:47:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.344+0000 7ffa237fe700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 0x7ffa1c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.344+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7ffa24014070 con 0x7ffa340fe500 2024-09-16T00:47:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.344+0000 7ffa31d9b700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 0x7ffa1c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.345+0000 7ffa31d9b700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 0x7ffa1c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800b6f0 tx=0x7ffa28009f70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:28.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.349+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa24059ef0 con 0x7ffa340fe500 2024-09-16T00:47:28.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.557+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa34105e30 con 0x7ffa1c06c680 2024-09-16T00:47:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.558+0000 7ffa237fe700 1 -- 172.21.15.53:0/95763922 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7ffa34105e30 con 0x7ffa1c06c680 2024-09-16T00:47:28.559 INFO:teuthology.orchestra.run.smithi053.stdout:HOST ADDR LABELS STATUS 2024-09-16T00:47:28.559 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 172.21.15.53 2024-09-16T00:47:28.559 INFO:teuthology.orchestra.run.smithi053.stdout:smithi152 172.21.15.152 2024-09-16T00:47:28.559 INFO:teuthology.orchestra.run.smithi053.stdout:2 hosts in cluster 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.560+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 msgr2=0x7ffa1c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.560+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 0x7ffa1c06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800b6f0 tx=0x7ffa28009f70 comp rx=0 tx=0).stop 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.560+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 msgr2=0x7ffa34195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.560+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e8f0 tx=0x7ffa2400ecb0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.560+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 shutdown_connections 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1c06c680 0x7ffa1c06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa340fe500 0x7ffa34195ad0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 --2- 172.21.15.53:0/95763922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa341014e0 0x7ffa34196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:28.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 >> 172.21.15.53:0/95763922 conn(0x7ffa340f9e50 msgr2=0x7ffa34104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:28.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 shutdown_connections 2024-09-16T00:47:28.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:28.561+0000 7ffa38a1f700 1 -- 172.21.15.53:0/95763922 wait complete. 2024-09-16T00:47:29.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T00:47:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:29 smithi152 ceph-mon[33237]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:29.712 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:29 smithi053 ceph-mon[27950]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:30.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:30 smithi152 ceph-mon[33237]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:30.728 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:30 smithi053 ceph-mon[27950]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:31.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 -- 172.21.15.53:0/3629560318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924100d60 msgr2=0x7f1924103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 --2- 172.21.15.53:0/3629560318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924100d60 0x7f1924103140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1918009910 tx=0x7f1918009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 -- 172.21.15.53:0/3629560318 shutdown_connections 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 --2- 172.21.15.53:0/3629560318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924103680 0x7f1924105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 --2- 172.21.15.53:0/3629560318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924100d60 0x7f1924103140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 -- 172.21.15.53:0/3629560318 >> 172.21.15.53:0/3629560318 conn(0x7f19240fa780 msgr2=0x7f19240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 -- 172.21.15.53:0/3629560318 shutdown_connections 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.139+0000 7f192acbf700 1 -- 172.21.15.53:0/3629560318 wait complete. 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 Processor -- start 2024-09-16T00:47:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 -- start start 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924100d60 0x7f1924197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241987f0 con 0x7f1924103680 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f192acbf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924198960 con 0x7f1924100d60 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44334/0 (socket says 172.21.15.53:44334) 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 -- 172.21.15.53:0/374988079 learned_addr learned my addr 172.21.15.53:0/374988079 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1928a5b700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924100d60 0x7f1924197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 -- 172.21.15.53:0/374988079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924100d60 msgr2=0x7f1924197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:31.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924100d60 0x7f1924197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.140+0000 7f1923fff700 1 -- 172.21.15.53:0/374988079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180095f0 con 0x7f1924103680 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f1923fff700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f191000d8d0 tx=0x7f191000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1910009940 con 0x7f1924103680 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192419d3f0 con 0x7f1924103680 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1910010460 con 0x7f1924103680 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191000f5f0 con 0x7f1924103680 2024-09-16T00:47:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.141+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192419d940 con 0x7f1924103680 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.142+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19240fc340 con 0x7f1924103680 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.142+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f19100105d0 con 0x7f1924103680 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.143+0000 7f1921ffb700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 0x7f191406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.143+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f191008b3b0 con 0x7f1924103680 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.143+0000 7f1928a5b700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 0x7f191406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.143+0000 7f1928a5b700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 0x7f191406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1918005090 tx=0x7f1918005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:31.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.147+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1910055ef0 con 0x7f1924103680 2024-09-16T00:47:31.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.355+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1924061190 con 0x7f191406c680 2024-09-16T00:47:31.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.356+0000 7f1921ffb700 1 -- 172.21.15.53:0/374988079 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1924061190 con 0x7f191406c680 2024-09-16T00:47:31.357 INFO:teuthology.orchestra.run.smithi053.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T00:47:31.357 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300G8480DGN 447G No 2m ago LVM detected, locked 2024-09-16T00:47:31.357 INFO:teuthology.orchestra.run.smithi053.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 77s ago LVM detected, locked 2024-09-16T00:47:31.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 msgr2=0x7f191406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:31.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 0x7f191406eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1918005090 tx=0x7f1918005a90 comp rx=0 tx=0).stop 2024-09-16T00:47:31.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 msgr2=0x7f19241981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:31.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f191000d8d0 tx=0x7f191000dc90 comp rx=0 tx=0).stop 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 shutdown_connections 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f191406c680 0x7f191406eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1924100d60 0x7f1924197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 --2- 172.21.15.53:0/374988079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1924103680 0x7f19241981f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 >> 172.21.15.53:0/374988079 conn(0x7f19240fa780 msgr2=0x7f19240ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 shutdown_connections 2024-09-16T00:47:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:31.359+0000 7f192acbf700 1 -- 172.21.15.53:0/374988079 wait complete. 2024-09-16T00:47:31.648 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:31 smithi053 ceph-mon[27950]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:31 smithi152 ceph-mon[33237]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:32.105 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:32.117 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:32.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-16T00:47:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:32.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:32 smithi152 ceph-mon[33237]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:32.712 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:32 smithi053 ceph-mon[27950]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:33 smithi152 ceph-mon[33237]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:33.741 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:33 smithi053 ceph-mon[27950]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 -- 172.21.15.53:0/1104210072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc1003d0 msgr2=0x7f2cdc100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 --2- 172.21.15.53:0/1104210072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc100840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009910 tx=0x7f2cc8009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 -- 172.21.15.53:0/1104210072 shutdown_connections 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 --2- 172.21.15.53:0/1104210072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc100840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 --2- 172.21.15.53:0/1104210072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 -- 172.21.15.53:0/1104210072 >> 172.21.15.53:0/1104210072 conn(0x7f2cdc0fa780 msgr2=0x7f2cdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 -- 172.21.15.53:0/1104210072 shutdown_connections 2024-09-16T00:47:33.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.979+0000 7f2ce308c700 1 -- 172.21.15.53:0/1104210072 wait complete. 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 Processor -- start 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 -- start start 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc196660 con 0x7f2cdc0ff130 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce308c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc1967a0 con 0x7f2cdc1003d0 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce0e28700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce0e28700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48552/0 (socket says 172.21.15.53:48552) 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce0e28700 1 -- 172.21.15.53:0/2056741456 learned_addr learned my addr 172.21.15.53:0/2056741456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:33.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2cdbfff700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce0e28700 1 -- 172.21.15.53:0/2056741456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc1003d0 msgr2=0x7f2cdc196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.980+0000 7f2ce0e28700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2ce0e28700 1 -- 172.21.15.53:0/2056741456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80095f0 con 0x7f2cdc0ff130 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2ce0e28700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b4b0 tx=0x7f2cd000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd0011800 con 0x7f2cdc0ff130 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2cd0011e10 con 0x7f2cdc0ff130 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc19b250 con 0x7f2cdc0ff130 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd000f2e0 con 0x7f2cdc0ff130 2024-09-16T00:47:33.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.981+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc19b7a0 con 0x7f2cdc0ff130 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.982+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc18fb80 con 0x7f2cdc0ff130 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.982+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2cd0010380 con 0x7f2cdc0ff130 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.983+0000 7f2cd9ffb700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 0x7f2ccc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.983+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f2cd008af80 con 0x7f2cdc0ff130 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.983+0000 7f2cdbfff700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 0x7f2ccc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:33.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.983+0000 7f2cdbfff700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 0x7f2ccc06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc800b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:33.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:33.987+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2cd0059600 con 0x7f2cdc0ff130 2024-09-16T00:47:34.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:34.218+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cdc061190 con 0x7f2ccc06c680 2024-09-16T00:47:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:34 smithi053 ceph-mon[27950]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:34 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T00:47:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:34 smithi053 ceph-mon[27950]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:35.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:34 smithi152 ceph-mon[33237]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:47:35.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:34 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T00:47:35.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:34 smithi152 ceph-mon[33237]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:35.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.734+0000 7f2cd9ffb700 1 -- 172.21.15.53:0/2056741456 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2cdc061190 con 0x7f2ccc06c680 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 msgr2=0x7f2ccc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 0x7f2ccc06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8006010 tx=0x7f2cc800b540 comp rx=0 tx=0).stop 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 msgr2=0x7f2cdc195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b4b0 tx=0x7f2cd000b7c0 comp rx=0 tx=0).stop 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 shutdown_connections 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2ccc06c680 0x7f2ccc06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cdc0ff130 0x7f2cdc195b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 --2- 172.21.15.53:0/2056741456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cdc1003d0 0x7f2cdc196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 >> 172.21.15.53:0/2056741456 conn(0x7f2cdc0fa780 msgr2=0x7f2cdc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 shutdown_connections 2024-09-16T00:47:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:35.736+0000 7f2ce308c700 1 -- 172.21.15.53:0/2056741456 wait complete. 2024-09-16T00:47:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T00:47:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:35 smithi053 ceph-mon[27950]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T00:47:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:35 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T00:47:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[27946]: 2024-09-16T00:47:35.713+0000 7fa57b71f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:47:36.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T00:47:36.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:35 smithi152 ceph-mon[33237]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T00:47:36.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:35 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T00:47:36.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: fsmap cephfs:0 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: Saving service mds.cephfs spec with placement count:4 2024-09-16T00:47:36.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: Deploying daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:47:36.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:36 smithi152 ceph-mon[33237]: pgmap v180: 65 pgs: 15 creating+peering, 1 active+clean, 49 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:36.967 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T00:47:36.967 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T00:47:36.967 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T00:47:36.967 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: fsmap cephfs:0 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: Saving service mds.cephfs spec with placement count:4 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:36.968 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: Deploying daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:47:36.969 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:36 smithi053 ceph-mon[27950]: pgmap v180: 65 pgs: 15 creating+peering, 1 active+clean, 49 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:37.722 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:37.938 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:37 smithi053 ceph-mon[27950]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T00:47:38.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:37 smithi152 ceph-mon[33237]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T00:47:38.961 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:38 smithi053 ceph-mon[27950]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T00:47:38.961 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:38 smithi053 ceph-mon[27950]: pgmap v183: 65 pgs: 15 creating+peering, 7 active+clean, 43 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:39.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:38 smithi152 ceph-mon[33237]: osdmap e46: 6 total, 6 up, 6 in 2024-09-16T00:47:39.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:38 smithi152 ceph-mon[33237]: pgmap v183: 65 pgs: 15 creating+peering, 7 active+clean, 43 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.541+0000 7ffa35db7700 1 -- 172.21.15.53:0/175771636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa30100240 msgr2=0x7ffa30100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:39.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.541+0000 7ffa35db7700 1 --2- 172.21.15.53:0/175771636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa30100240 0x7ffa30100650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009910 tx=0x7ffa20009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 -- 172.21.15.53:0/175771636 shutdown_connections 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 --2- 172.21.15.53:0/175771636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa301014e0 0x7ffa30101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 --2- 172.21.15.53:0/175771636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa30100240 0x7ffa30100650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 -- 172.21.15.53:0/175771636 >> 172.21.15.53:0/175771636 conn(0x7ffa300fb890 msgr2=0x7ffa300fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 -- 172.21.15.53:0/175771636 shutdown_connections 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 -- 172.21.15.53:0/175771636 wait complete. 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 Processor -- start 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.542+0000 7ffa35db7700 1 -- start start 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa35db7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa30100240 0x7ffa30195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa35db7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa35db7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301965f0 con 0x7ffa301014e0 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa35db7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30196730 con 0x7ffa30100240 2024-09-16T00:47:39.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:39.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48568/0 (socket says 172.21.15.53:48568) 2024-09-16T00:47:39.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 -- 172.21.15.53:0/565435034 learned_addr learned my addr 172.21.15.53:0/565435034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:39.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2f7fe700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa30100240 0x7ffa30195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 -- 172.21.15.53:0/565435034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa30100240 msgr2=0x7ffa30195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa30100240 0x7ffa30195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.543+0000 7ffa2effd700 1 -- 172.21.15.53:0/565435034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200095f0 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa2effd700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400d8d0 tx=0x7ffa2400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa240098a0 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3019b1e0 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa24010460 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2400f5f0 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.544+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3019b730 con 0x7ffa301014e0 2024-09-16T00:47:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.545+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30108d20 con 0x7ffa301014e0 2024-09-16T00:47:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.545+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffa24009a00 con 0x7ffa301014e0 2024-09-16T00:47:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.546+0000 7ffa2cff9700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 0x7ffa1806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.546+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffa2408b720 con 0x7ffa301014e0 2024-09-16T00:47:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.546+0000 7ffa2f7fe700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 0x7ffa1806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.547+0000 7ffa2f7fe700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 0x7ffa1806eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa20006010 tx=0x7ffa2000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:39.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.555+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa24059940 con 0x7ffa301014e0 2024-09-16T00:47:39.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.807+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa30108ee0 con 0x7ffa301014e0 2024-09-16T00:47:39.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.807+0000 7ffa2cff9700 1 -- 172.21.15.53:0/565435034 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7ffa240594d0 con 0x7ffa301014e0 2024-09-16T00:47:39.808 INFO:teuthology.orchestra.run.smithi053.stdout:e2 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 2 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:35.714275+0000 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:47:39.809 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:in 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:up {} 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:47:39.810 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 0 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:39.811 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 msgr2=0x7ffa1806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 0x7ffa1806eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa20006010 tx=0x7ffa2000b540 comp rx=0 tx=0).stop 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 msgr2=0x7ffa30195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400d8d0 tx=0x7ffa2400dbe0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 shutdown_connections 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7ffa1806c680 0x7ffa1806eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa30100240 0x7ffa30195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 --2- 172.21.15.53:0/565435034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa301014e0 0x7ffa30195fd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 >> 172.21.15.53:0/565435034 conn(0x7ffa300fb890 msgr2=0x7ffa30104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 shutdown_connections 2024-09-16T00:47:39.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:39.810+0000 7ffa35db7700 1 -- 172.21.15.53:0/565435034 wait complete. 2024-09-16T00:47:39.813 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 2 2024-09-16T00:47:40.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:39 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/565435034' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:47:40.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:39 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/565435034' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:47:40.861 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:40.871 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:40.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-16T00:47:41.083 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: Deploying daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: pgmap v184: 65 pgs: 3 creating+peering, 56 active+clean, 6 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:boot 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: daemon mds.cephfs.smithi053.cdsuag assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: Cluster is now healthy 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: fsmap cephfs:0 1 up:standby 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:creating} 2024-09-16T00:47:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:41 smithi152 ceph-mon[33237]: daemon mds.cephfs.smithi053.cdsuag is now active in filesystem cephfs as rank 0 2024-09-16T00:47:41.425 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.425 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.425 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: Deploying daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: pgmap v184: 65 pgs: 3 creating+peering, 56 active+clean, 6 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:boot 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: daemon mds.cephfs.smithi053.cdsuag assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: Cluster is now healthy 2024-09-16T00:47:41.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: fsmap cephfs:0 1 up:standby 2024-09-16T00:47:41.427 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:47:41.427 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:creating} 2024-09-16T00:47:41.427 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:41 smithi053 ceph-mon[27950]: daemon mds.cephfs.smithi053.cdsuag is now active in filesystem cephfs as rank 0 2024-09-16T00:47:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 -- 172.21.15.53:0/103943352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0100250 msgr2=0x7f30f0100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 --2- 172.21.15.53:0/103943352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0100250 0x7f30f0100660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009910 tx=0x7f30e0009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 -- 172.21.15.53:0/103943352 shutdown_connections 2024-09-16T00:47:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 --2- 172.21.15.53:0/103943352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0101450 0x7f30f01018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 --2- 172.21.15.53:0/103943352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0100250 0x7f30f0100660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 -- 172.21.15.53:0/103943352 >> 172.21.15.53:0/103943352 conn(0x7f30f00fb7e0 msgr2=0x7f30f00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 -- 172.21.15.53:0/103943352 shutdown_connections 2024-09-16T00:47:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.731+0000 7f30f5670700 1 -- 172.21.15.53:0/103943352 wait complete. 2024-09-16T00:47:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 Processor -- start 2024-09-16T00:47:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 -- start start 2024-09-16T00:47:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 0x7f30f0195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0196640 con 0x7f30f0101450 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.732+0000 7f30f5670700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0196780 con 0x7f30f0100250 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30ee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30ee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53286/0 (socket says 172.21.15.53:53286) 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30ee7fc700 1 -- 172.21.15.53:0/3005440402 learned_addr learned my addr 172.21.15.53:0/3005440402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30eeffd700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 0x7f30f0195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30eeffd700 1 -- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 msgr2=0x7f30f0196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30eeffd700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30eeffd700 1 -- 172.21.15.53:0/3005440402 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00095f0 con 0x7f30f0100250 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30ee7fc700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30eeffd700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 0x7f30f0195ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f30e0000c00 tx=0x7f30e000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e001d070 con 0x7f30f0100250 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f30e0005dc0 con 0x7f30f0100250 2024-09-16T00:47:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.733+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f019b1d0 con 0x7f30f0100250 2024-09-16T00:47:42.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.734+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e0022470 con 0x7f30f0100250 2024-09-16T00:47:42.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.734+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f019b690 con 0x7f30f0100250 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.735+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0108da0 con 0x7f30f0100250 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.735+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f30e00225d0 con 0x7f30f0100250 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.735+0000 7f30d7fff700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 0x7f30d806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.736+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f30e008cb80 con 0x7f30f0100250 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.736+0000 7f30ee7fc700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 0x7f30d806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.736+0000 7f30ee7fc700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 0x7f30d806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011550 tx=0x7f30e4009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:42.740+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f30e005ade0 con 0x7f30f0100250 2024-09-16T00:47:43.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.005+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f30f019bd20 con 0x7f30f0100250 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:active 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: pgmap v185: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 154 B/s wr, 0 op/s 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:43.006 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:42 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:43.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:active 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: pgmap v185: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 154 B/s wr, 0 op/s 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:42 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:43.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.879+0000 7f30d7fff700 1 -- 172.21.15.53:0/3005440402 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f30e005a970 con 0x7f30f0100250 2024-09-16T00:47:43.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 msgr2=0x7f30d806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:43.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 0x7f30d806eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e4011550 tx=0x7f30e4009260 comp rx=0 tx=0).stop 2024-09-16T00:47:43.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 msgr2=0x7f30f0195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:43.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 0x7f30f0195ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f30e0000c00 tx=0x7f30e000fa00 comp rx=0 tx=0).stop 2024-09-16T00:47:43.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 shutdown_connections 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f30d806c680 0x7f30d806eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30f0100250 0x7f30f0195ae0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 --2- 172.21.15.53:0/3005440402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30f0101450 0x7f30f0196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 >> 172.21.15.53:0/3005440402 conn(0x7f30f00fb7e0 msgr2=0x7f30f0104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 shutdown_connections 2024-09-16T00:47:43.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:43.882+0000 7f30f5670700 1 -- 172.21.15.53:0/3005440402 wait complete. 2024-09-16T00:47:44.122 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: Deploying daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:47:44.122 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:boot 2024-09-16T00:47:44.122 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:44.122 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:47:44.122 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:44.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3005440402' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T00:47:44.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:43 smithi053 ceph-mon[27950]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: Deploying daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:boot 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3005440402' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T00:47:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:43 smithi152 ceph-mon[33237]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T00:47:44.802 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:44.814 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:44.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-16T00:47:45.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:44 smithi053 ceph-mon[27950]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T00:47:45.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:44 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:45.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:44 smithi053 ceph-mon[27950]: pgmap v186: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 2 op/s 2024-09-16T00:47:45.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:44 smithi152 ceph-mon[33237]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T00:47:45.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:44 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby 2024-09-16T00:47:45.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:44 smithi152 ceph-mon[33237]: pgmap v186: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 2 op/s 2024-09-16T00:47:45.362 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: Deploying daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] up:boot 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2 up:standby 2024-09-16T00:47:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:46 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: Deploying daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] up:boot 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2 up:standby 2024-09-16T00:47:46.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:46 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:47:46.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 -- 172.21.15.53:0/2715434700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 msgr2=0x7f04c4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:46.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 --2- 172.21.15.53:0/2715434700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4100840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009910 tx=0x7f04b4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:46.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 -- 172.21.15.53:0/2715434700 shutdown_connections 2024-09-16T00:47:46.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 --2- 172.21.15.53:0/2715434700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4100840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 --2- 172.21.15.53:0/2715434700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 0x7f04c40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 -- 172.21.15.53:0/2715434700 >> 172.21.15.53:0/2715434700 conn(0x7f04c40fa780 msgr2=0x7f04c40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 -- 172.21.15.53:0/2715434700 shutdown_connections 2024-09-16T00:47:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.911+0000 7f04cc290700 1 -- 172.21.15.53:0/2715434700 wait complete. 2024-09-16T00:47:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 Processor -- start 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 -- start start 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 0x7f04c4195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41965d0 con 0x7f04c41003d0 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04cc290700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4196710 con 0x7f04c40ff130 2024-09-16T00:47:46.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:46.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53320/0 (socket says 172.21.15.53:53320) 2024-09-16T00:47:46.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 -- 172.21.15.53:0/1797487136 learned_addr learned my addr 172.21.15.53:0/1797487136 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:46.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04ca02c700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 0x7f04c4195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:46.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 -- 172.21.15.53:0/1797487136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 msgr2=0x7f04c4195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:46.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 0x7f04c4195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:46.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.912+0000 7f04c982b700 1 -- 172.21.15.53:0/1797487136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40095f0 con 0x7f04c41003d0 2024-09-16T00:47:46.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04c982b700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000c00 tx=0x7f04b400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:46.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b401d070 con 0x7f04c41003d0 2024-09-16T00:47:46.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f04b4005dc0 con 0x7f04c41003d0 2024-09-16T00:47:46.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c419b160 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04b40226a0 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.913+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c419b650 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.914+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4107c10 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.914+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f04b40038f0 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.915+0000 7f04bb7fe700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 0x7f04b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.915+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f04b408cba0 con 0x7f04c41003d0 2024-09-16T00:47:46.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.915+0000 7f04ca02c700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 0x7f04b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:46.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.915+0000 7f04ca02c700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 0x7f04b006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009c60 tx=0x7f04c0009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:46.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:46.923+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f04b405ae40 con 0x7f04c41003d0 2024-09-16T00:47:47.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.173+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f04c4107e00 con 0x7f04c41003d0 2024-09-16T00:47:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:47 smithi152 ceph-mon[33237]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-16T00:47:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:47 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1797487136' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T00:47:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:47 smithi053 ceph-mon[27950]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-16T00:47:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:47 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1797487136' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T00:47:47.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.886+0000 7f04bb7fe700 1 -- 172.21.15.53:0/1797487136 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f04b4003680 con 0x7f04c41003d0 2024-09-16T00:47:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 msgr2=0x7f04b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 0x7f04b006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009c60 tx=0x7f04c0009260 comp rx=0 tx=0).stop 2024-09-16T00:47:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 msgr2=0x7f04c4195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04b4000c00 tx=0x7f04b400f690 comp rx=0 tx=0).stop 2024-09-16T00:47:47.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 shutdown_connections 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f04b006c680 0x7f04b006eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04c40ff130 0x7f04c4195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 --2- 172.21.15.53:0/1797487136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04c41003d0 0x7f04c4195fb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 >> 172.21.15.53:0/1797487136 conn(0x7f04c40fa780 msgr2=0x7f04c4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.889+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 shutdown_connections 2024-09-16T00:47:47.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:47.890+0000 7f04cc290700 1 -- 172.21.15.53:0/1797487136 wait complete. 2024-09-16T00:47:48.624 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:48.635 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:48.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1797487136' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.152:6826/1217546391,v1:172.21.15.152:6827/1217546391] up:boot 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:49.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:48 smithi152 ceph-mon[33237]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1797487136' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.152:6826/1217546391,v1:172.21.15.152:6827/1217546391] up:boot 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:49.215 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:49.216 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:48 smithi053 ceph-mon[27950]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T00:47:49.442 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:50.239 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:50 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:active 2024-09-16T00:47:50.239 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:50 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:50.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:50 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] up:active 2024-09-16T00:47:50.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:50 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 -- 172.21.15.53:0/2429747065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0101450 msgr2=0x7f25d01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 --2- 172.21.15.53:0/2429747065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0101450 0x7f25d01018a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009910 tx=0x7f25bc009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 -- 172.21.15.53:0/2429747065 shutdown_connections 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 --2- 172.21.15.53:0/2429747065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0101450 0x7f25d01018a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 --2- 172.21.15.53:0/2429747065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0100250 0x7f25d0100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 -- 172.21.15.53:0/2429747065 >> 172.21.15.53:0/2429747065 conn(0x7f25d00fb7e0 msgr2=0x7f25d00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 -- 172.21.15.53:0/2429747065 shutdown_connections 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.092+0000 7f25d7176700 1 -- 172.21.15.53:0/2429747065 wait complete. 2024-09-16T00:47:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 Processor -- start 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 -- start start 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0101450 0x7f25d0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d01996f0 con 0x7f25d0100250 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d7176700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0199830 con 0x7f25d0101450 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d4f12700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d4f12700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53336/0 (socket says 172.21.15.53:53336) 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.093+0000 7f25d4f12700 1 -- 172.21.15.53:0/2938035545 learned_addr learned my addr 172.21.15.53:0/2938035545 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25cffff700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0101450 0x7f25d0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d4f12700 1 -- 172.21.15.53:0/2938035545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0101450 msgr2=0x7f25d0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d4f12700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0101450 0x7f25d0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d4f12700 1 -- 172.21.15.53:0/2938035545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0095f0 con 0x7f25d0100250 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d4f12700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f25c400d900 tx=0x7f25c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c40041f0 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0073680 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f25c4004350 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c4003da0 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.094+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0073ba0 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.095+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0073e20 con 0x7f25d0100250 2024-09-16T00:47:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.096+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f25c4010670 con 0x7f25d0100250 2024-09-16T00:47:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.096+0000 7f25cdffb700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 0x7f25c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.097+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f25c408b940 con 0x7f25d0100250 2024-09-16T00:47:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.097+0000 7f25cffff700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 0x7f25c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.097+0000 7f25cffff700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 0x7f25c006eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006010 tx=0x7f25bc00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.101+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f25c4059b60 con 0x7f25d0100250 2024-09-16T00:47:51.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] up:standby 2024-09-16T00:47:51.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: Dropping low affinity standby-replay daemon mds.cephfs.smithi152.ocdywv in favor of higher affinity standby. 2024-09-16T00:47:51.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:51.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T00:47:51.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:51.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:51.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-16T00:47:51.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:51 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:51.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:51.353+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f25d01a2520 con 0x7f25d0100250 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] up:standby 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: Dropping low affinity standby-replay daemon mds.cephfs.smithi152.ocdywv in favor of higher affinity standby. 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 1 up:standby 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-16T00:47:51.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:51 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:52.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.209+0000 7f25cdffb700 1 -- 172.21.15.53:0/2938035545 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v16) v1 ==== 133+0+0 (secure 0 0 0) 0x7f25c40596f0 con 0x7f25d0100250 2024-09-16T00:47:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 msgr2=0x7f25c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 0x7f25c006eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006010 tx=0x7f25bc00b540 comp rx=0 tx=0).stop 2024-09-16T00:47:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 msgr2=0x7f25d0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f25c400d900 tx=0x7f25c400dcc0 comp rx=0 tx=0).stop 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 shutdown_connections 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f25c006c680 0x7f25c006eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d0100250 0x7f25d0074af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 --2- 172.21.15.53:0/2938035545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d0101450 0x7f25d0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 >> 172.21.15.53:0/2938035545 conn(0x7f25d00fb7e0 msgr2=0x7f25d0104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 shutdown_connections 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:52.212+0000 7f25d7176700 1 -- 172.21.15.53:0/2938035545 wait complete. 2024-09-16T00:47:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:inline data disabled 2024-09-16T00:47:52.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:52 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:boot 2024-09-16T00:47:52.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:52 smithi053 ceph-mon[27950]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:standby 2024-09-16T00:47:52.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:52 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:52.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:47:52.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:52 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2938035545' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-16T00:47:52.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:52 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:boot 2024-09-16T00:47:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:52 smithi152 ceph-mon[33237]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:standby 2024-09-16T00:47:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:52 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:47:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:52 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2938035545' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-16T00:47:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:53 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2938035545' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-16T00:47:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:53 smithi053 ceph-mon[27950]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:53 smithi053 ceph-mon[27950]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-16T00:47:53.627 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T00:47:53.637 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:47:53.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T00:47:53.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:53 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2938035545' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-16T00:47:53.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:53 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:47:53.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:53 smithi152 ceph-mon[33237]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-16T00:47:54.034 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:55 smithi053 ceph-mon[27950]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-16T00:47:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:55.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:55 smithi152 ceph-mon[33237]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-16T00:47:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:47:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 -- 172.21.15.53:0/1520458025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce4103310 msgr2=0x7efce4105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 --2- 172.21.15.53:0/1520458025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce4103310 0x7efce4105790 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009910 tx=0x7efcd4009c20 comp rx=0 tx=0).stop 2024-09-16T00:47:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 -- 172.21.15.53:0/1520458025 shutdown_connections 2024-09-16T00:47:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 --2- 172.21.15.53:0/1520458025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce4103310 0x7efce4105790 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 --2- 172.21.15.53:0/1520458025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4069270 0x7efce4102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 -- 172.21.15.53:0/1520458025 >> 172.21.15.53:0/1520458025 conn(0x7efce40fa780 msgr2=0x7efce40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 -- 172.21.15.53:0/1520458025 shutdown_connections 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.435+0000 7efceb161700 1 -- 172.21.15.53:0/1520458025 wait complete. 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.436+0000 7efceb161700 1 Processor -- start 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.436+0000 7efceb161700 1 -- start start 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efceb161700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4103310 0x7efce419c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efceb161700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efceb161700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce419cb00 con 0x7efce419c600 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efceb161700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce419cc70 con 0x7efce4103310 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42060/0 (socket says 172.21.15.53:42060) 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 -- 172.21.15.53:0/709779760 learned_addr learned my addr 172.21.15.53:0/709779760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efce8efd700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4103310 0x7efce419c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:56.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 -- 172.21.15.53:0/709779760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4103310 msgr2=0x7efce419c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4103310 0x7efce419c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 -- 172.21.15.53:0/709779760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd40095f0 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.437+0000 7efcdbfff700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006010 tx=0x7efcd400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.438+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd401d070 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.438+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce41a1bb0 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.438+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efcd400f460 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.438+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcd4021640 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.438+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce41a2070 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.439+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4108cd0 con 0x7efce419c600 2024-09-16T00:47:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.439+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efcd4003a60 con 0x7efce419c600 2024-09-16T00:47:56.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.440+0000 7efcd9ffb700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 0x7efccc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:56.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.440+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efcd408ca40 con 0x7efce419c600 2024-09-16T00:47:56.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.440+0000 7efce8efd700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 0x7efccc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:56.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.440+0000 7efce8efd700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 0x7efccc06eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efce0005950 tx=0x7efce000b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:56.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.445+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efcd405ac60 con 0x7efce419c600 2024-09-16T00:47:56.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.706+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efce4069270 con 0x7efce419c600 2024-09-16T00:47:56.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.707+0000 7efcd9ffb700 1 -- 172.21.15.53:0/709779760 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7efcd405a7f0 con 0x7efce419c600 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:47:56.708 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:47:56.709 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:47:56.710 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:47:56.711 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 msgr2=0x7efccc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 0x7efccc06eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efce0005950 tx=0x7efce000b410 comp rx=0 tx=0).stop 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 msgr2=0x7efce41a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efcd4006010 tx=0x7efcd400bd70 comp rx=0 tx=0).stop 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 shutdown_connections 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7efccc06c680 0x7efccc06eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efce4103310 0x7efce419c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 --2- 172.21.15.53:0/709779760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efce419c600 0x7efce41a1670 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:56.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 >> 172.21.15.53:0/709779760 conn(0x7efce40fa780 msgr2=0x7efce40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:56.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 shutdown_connections 2024-09-16T00:47:56.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:56.709+0000 7efceb161700 1 -- 172.21.15.53:0/709779760 wait complete. 2024-09-16T00:47:56.713 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:47:57.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-16T00:47:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/709779760' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:47:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:57 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:57.714 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-16T00:47:57.714 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.714 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.715 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:47:57.715 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:47:57.715 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:57.715 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/709779760' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:47:57.715 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:57 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:47:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:59 smithi152 ceph-mon[33237]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-16T00:47:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:59 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:47:59 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:59.729 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:59 smithi053 ceph-mon[27950]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-16T00:47:59.729 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:59 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:59.729 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:47:59 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 -- 172.21.15.53:0/1758132127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 msgr2=0x7f3744100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 --2- 172.21.15.53:0/1758132127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744100660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f373400b0a0 tx=0x7f373400b3b0 comp rx=0 tx=0).stop 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 -- 172.21.15.53:0/1758132127 shutdown_connections 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 --2- 172.21.15.53:0/1758132127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3744101450 0x7f37441018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 --2- 172.21.15.53:0/1758132127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744100660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 -- 172.21.15.53:0/1758132127 >> 172.21.15.53:0/1758132127 conn(0x7f37440fb7e0 msgr2=0x7f37440fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 -- 172.21.15.53:0/1758132127 shutdown_connections 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.835+0000 7f3749f7a700 1 -- 172.21.15.53:0/1758132127 wait complete. 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 Processor -- start 2024-09-16T00:47:59.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 -- start start 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3744101450 0x7f3744196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441967b0 con 0x7f3744100250 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f3749f7a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374419b1c0 con 0x7f3744101450 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42064/0 (socket says 172.21.15.53:42064) 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 -- 172.21.15.53:0/3661029204 learned_addr learned my addr 172.21.15.53:0/3661029204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 -- 172.21.15.53:0/3661029204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3744101450 msgr2=0x7f3744196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3744101450 0x7f3744196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.836+0000 7f37437fe700 1 -- 172.21.15.53:0/3661029204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009d00 con 0x7f3744100250 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f37437fe700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f373400b070 tx=0x7f3734003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373400e040 con 0x7f3744100250 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f373400ce60 con 0x7f3744100250 2024-09-16T00:47:59.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374419b360 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373401da90 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.837+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374419b820 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.838+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744108e20 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.838+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3734004250 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.839+0000 7f37417fa700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 0x7f373006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.839+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f373408d450 con 0x7f3744100250 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.839+0000 7f373affd700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 0x7f373006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.839+0000 7f373affd700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 0x7f373006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f372c0097b0 tx=0x7f372c006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:47:59.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:47:59.843+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3734057be0 con 0x7f3744100250 2024-09-16T00:48:00.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.096+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3744108fe0 con 0x7f3744100250 2024-09-16T00:48:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.096+0000 7f37417fa700 1 -- 172.21.15.53:0/3661029204 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f373405b200 con 0x7f3744100250 2024-09-16T00:48:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.098+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 msgr2=0x7f373006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.098+0000 7f3749f7a700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 0x7f373006eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f372c0097b0 tx=0x7f372c006d20 comp rx=0 tx=0).stop 2024-09-16T00:48:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.098+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 msgr2=0x7f3744195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.098+0000 7f3749f7a700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f373400b070 tx=0x7f3734003ce0 comp rx=0 tx=0).stop 2024-09-16T00:48:00.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 shutdown_connections 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f373006c680 0x7f373006eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3744100250 0x7f3744195c50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 --2- 172.21.15.53:0/3661029204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3744101450 0x7f3744196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 >> 172.21.15.53:0/3661029204 conn(0x7f37440fb7e0 msgr2=0x7f3744104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 shutdown_connections 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:00.099+0000 7f3749f7a700 1 -- 172.21.15.53:0/3661029204 wait complete. 2024-09-16T00:48:00.100 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:48:00.112 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:48:00.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:00 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3661029204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:48:00.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:00 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3661029204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:48:00.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-16T00:48:01.347 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:01.650 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:01 smithi053 ceph-mon[27950]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-16T00:48:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:01 smithi152 ceph-mon[33237]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-16T00:48:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:03 smithi053 ceph-mon[27950]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:03.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:03 smithi152 ceph-mon[33237]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 -- 172.21.15.53:0/1503781008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 msgr2=0x7fbe08105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/1503781008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08105790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009910 tx=0x7fbdf4009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:03.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 -- 172.21.15.53:0/1503781008 shutdown_connections 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/1503781008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08105790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/1503781008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08069270 0x7fbe08102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 -- 172.21.15.53:0/1503781008 >> 172.21.15.53:0/1503781008 conn(0x7fbe080fa780 msgr2=0x7fbe080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 -- 172.21.15.53:0/1503781008 shutdown_connections 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.862+0000 7fbe0eea3700 1 -- 172.21.15.53:0/1503781008 wait complete. 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 Processor -- start 2024-09-16T00:48:03.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 -- start start 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08196010 0x7fbe0819b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08196510 con 0x7fbe08103310 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0eea3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08196680 con 0x7fbe08196010 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0cc3f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0cc3f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54488/0 (socket says 172.21.15.53:54488) 2024-09-16T00:48:03.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe0cc3f700 1 -- 172.21.15.53:0/3803997953 learned_addr learned my addr 172.21.15.53:0/3803997953 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.863+0000 7fbe07fff700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08196010 0x7fbe0819b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0cc3f700 1 -- 172.21.15.53:0/3803997953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08196010 msgr2=0x7fbe0819b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0cc3f700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08196010 0x7fbe0819b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0cc3f700 1 -- 172.21.15.53:0/3803997953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40095f0 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0cc3f700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00d900 tx=0x7fbdfc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc009900 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0819b620 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbdfc010460 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdfc00f5f0 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.864+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0819bb40 con 0x7fbe08103310 2024-09-16T00:48:03.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.865+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0818fbf0 con 0x7fbe08103310 2024-09-16T00:48:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.866+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbdfc0105d0 con 0x7fbe08103310 2024-09-16T00:48:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.866+0000 7fbe05ffb700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 0x7fbdf806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:03.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.866+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbdfc08b2a0 con 0x7fbe08103310 2024-09-16T00:48:03.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.866+0000 7fbe07fff700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 0x7fbdf806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:03.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.867+0000 7fbe07fff700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 0x7fbdf806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006010 tx=0x7fbdf400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:03.875+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbdfc059540 con 0x7fbe08103310 2024-09-16T00:48:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.186+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fbe08069270 con 0x7fbe08103310 2024-09-16T00:48:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.187+0000 7fbe05ffb700 1 -- 172.21.15.53:0/3803997953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+83 (secure 0 0 0) 0x7fbdfc0590d0 con 0x7fbe08103310 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 msgr2=0x7fbdf806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 0x7fbdf806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006010 tx=0x7fbdf400b540 comp rx=0 tx=0).stop 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 msgr2=0x7fbe08195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00d900 tx=0x7fbdfc00dc10 comp rx=0 tx=0).stop 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 shutdown_connections 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fbdf806c680 0x7fbdf806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe08103310 0x7fbe08195ad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 --2- 172.21.15.53:0/3803997953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe08196010 0x7fbe0819b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 >> 172.21.15.53:0/3803997953 conn(0x7fbe080fa780 msgr2=0x7fbe080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:04.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 shutdown_connections 2024-09-16T00:48:04.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:04.189+0000 7fbe0eea3700 1 -- 172.21.15.53:0/3803997953 wait complete. 2024-09-16T00:48:04.201 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:48:04.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:04 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3803997953' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T00:48:04.817 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:04 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3803997953' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T00:48:04.840 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-16T00:48:04.853 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T00:48:05.179 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:05 smithi053 ceph-mon[27950]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:05.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:05 smithi152 ceph-mon[33237]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:07.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 -- 172.21.15.53:0/3199470606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ffc60 msgr2=0x7f922c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:07.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 --2- 172.21.15.53:0/3199470606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ffc60 0x7f922c10a6d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9214009910 tx=0x7f9214009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:07.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 -- 172.21.15.53:0/3199470606 shutdown_connections 2024-09-16T00:48:07.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 --2- 172.21.15.53:0/3199470606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ffc60 0x7f922c10a6d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 --2- 172.21.15.53:0/3199470606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ff350 0x7f922c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 -- 172.21.15.53:0/3199470606 >> 172.21.15.53:0/3199470606 conn(0x7f922c0748b0 msgr2=0x7f922c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 -- 172.21.15.53:0/3199470606 shutdown_connections 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.396+0000 7f9230954700 1 -- 172.21.15.53:0/3199470606 wait complete. 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 Processor -- start 2024-09-16T00:48:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 -- start start 2024-09-16T00:48:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ffc60 0x7f922c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c198d20 con 0x7f922c0ff350 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f9230954700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c19cab0 con 0x7f922c0ffc60 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f922a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f922a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54504/0 (socket says 172.21.15.53:54504) 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.397+0000 7f922a59c700 1 -- 172.21.15.53:0/2314443890 learned_addr learned my addr 172.21.15.53:0/2314443890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f9229d9b700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ffc60 0x7f922c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f922a59c700 1 -- 172.21.15.53:0/2314443890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ffc60 msgr2=0x7f922c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f922a59c700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ffc60 0x7f922c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f922a59c700 1 -- 172.21.15.53:0/2314443890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140095f0 con 0x7f922c0ff350 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f922a59c700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ada0 tx=0x7f921c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921c00f070 con 0x7f922c0ff350 2024-09-16T00:48:07.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c19cd90 con 0x7f922c0ff350 2024-09-16T00:48:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.398+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f921c007be0 con 0x7f922c0ff350 2024-09-16T00:48:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.399+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921c0083f0 con 0x7f922c0ff350 2024-09-16T00:48:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.399+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c19d2e0 con 0x7f922c0ff350 2024-09-16T00:48:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.400+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c10a1d0 con 0x7f922c0ff350 2024-09-16T00:48:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.400+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f921c00cad0 con 0x7f922c0ff350 2024-09-16T00:48:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.400+0000 7f92237fe700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 0x7f921806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.401+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f921c08b120 con 0x7f922c0ff350 2024-09-16T00:48:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.401+0000 7f9229d9b700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 0x7f921806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.401+0000 7f9229d9b700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 0x7f921806eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92140059d0 tx=0x7f921401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.405+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f921c055930 con 0x7f922c0ff350 2024-09-16T00:48:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.665+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f922c04f2a0 con 0x7f922c0ff350 2024-09-16T00:48:07.666 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:07 smithi053 ceph-mon[27950]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:07.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.666+0000 7f92237fe700 1 -- 172.21.15.53:0/2314443890 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f921c058f50 con 0x7f922c0ff350 2024-09-16T00:48:07.667 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:48:07.667 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:47:52.208118+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6827/239552761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":239552761},{"type":"v1","addr":"172.21.15.53:6827","nonce":239552761}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi053.jsdknu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.53:6829/3568284150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":3568284150},{"type":"v1","addr":"172.21.15.53:6829","nonce":3568284150}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 msgr2=0x7f921806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 0x7f921806eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92140059d0 tx=0x7f921401a040 comp rx=0 tx=0).stop 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 msgr2=0x7f922c198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f921c00ada0 tx=0x7f921c00c330 comp rx=0 tx=0).stop 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 shutdown_connections 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f921806c680 0x7f921806eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f922c0ff350 0x7f922c198100 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 --2- 172.21.15.53:0/2314443890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f922c0ffc60 0x7f922c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 >> 172.21.15.53:0/2314443890 conn(0x7f922c0748b0 msgr2=0x7f922c107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 shutdown_connections 2024-09-16T00:48:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:07.668+0000 7f9230954700 1 -- 172.21.15.53:0/2314443890 wait complete. 2024-09-16T00:48:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:48:07.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:07 smithi152 ceph-mon[33237]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:08.310 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-16T00:48:08.310 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T00:48:08.339 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T00:48:08.339 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-16T00:48:08.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:08.339 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-16T00:48:08.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:08.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-09-16T00:48:08.428 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-09-16T00:48:08.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:48:08.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:08.430 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-16T00:48:08.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:08.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-16T00:48:08.527 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-09-16T00:48:08.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T00:48:08.529 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T00:48:08.529 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T00:48:08.529 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:08.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T00:48:08.552 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2314443890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:48:08.553 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:08 smithi053 ceph-mon[27950]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:08.738 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:08.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2314443890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T00:48:08.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:08 smithi152 ceph-mon[33237]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 -- 172.21.15.53:0/244397103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc1004e0 msgr2=0x7f4fcc1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 --2- 172.21.15.53:0/244397103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc1008b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009910 tx=0x7f4fbc009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 -- 172.21.15.53:0/244397103 shutdown_connections 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 --2- 172.21.15.53:0/244397103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc100e80 0x7f4fcc104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 --2- 172.21.15.53:0/244397103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc1008b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 -- 172.21.15.53:0/244397103 >> 172.21.15.53:0/244397103 conn(0x7f4fcc0fbda0 msgr2=0x7f4fcc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 -- 172.21.15.53:0/244397103 shutdown_connections 2024-09-16T00:48:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 -- 172.21.15.53:0/244397103 wait complete. 2024-09-16T00:48:10.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:10 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.461+0000 7f4fd1328700 1 Processor -- start 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fd1328700 1 -- start start 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fd1328700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fd1328700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fd1328700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc196a80 con 0x7f4fcc100e80 2024-09-16T00:48:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fd1328700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc196bc0 con 0x7f4fcc1004e0 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54514/0 (socket says 172.21.15.53:54514) 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fca7fc700 1 -- 172.21.15.53:0/4247338504 learned_addr learned my addr 172.21.15.53:0/4247338504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.462+0000 7f4fcaffd700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fca7fc700 1 -- 172.21.15.53:0/4247338504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc1004e0 msgr2=0x7f4fcc195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fca7fc700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fca7fc700 1 -- 172.21.15.53:0/4247338504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0095f0 con 0x7f4fcc100e80 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fca7fc700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000c960 tx=0x7f4fc000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc0007a70 con 0x7f4fcc100e80 2024-09-16T00:48:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0007bd0 con 0x7f4fcc100e80 2024-09-16T00:48:10.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc19aa10 con 0x7f4fcc100e80 2024-09-16T00:48:10.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fc0018630 con 0x7f4fcc100e80 2024-09-16T00:48:10.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.463+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc19af60 con 0x7f4fcc100e80 2024-09-16T00:48:10.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.464+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb8005320 con 0x7f4fcc100e80 2024-09-16T00:48:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.465+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4fc000f450 con 0x7f4fcc100e80 2024-09-16T00:48:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.465+0000 7f4fb3fff700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 0x7f4fb406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.465+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4fc008b690 con 0x7f4fcc100e80 2024-09-16T00:48:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.465+0000 7f4fcaffd700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 0x7f4fb406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.466+0000 7f4fcaffd700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 0x7f4fb406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006010 tx=0x7f4fbc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.470+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4fc0055e20 con 0x7f4fcc100e80 2024-09-16T00:48:10.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:10 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.716+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4fb8006200 con 0x7f4fcc100e80 2024-09-16T00:48:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.716+0000 7f4fb3fff700 1 -- 172.21.15.53:0/4247338504 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f4fc0059440 con 0x7f4fcc100e80 2024-09-16T00:48:10.717 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 msgr2=0x7f4fb406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 0x7f4fb406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006010 tx=0x7f4fbc01a040 comp rx=0 tx=0).stop 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 msgr2=0x7f4fcc196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000c960 tx=0x7f4fc000cc70 comp rx=0 tx=0).stop 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 shutdown_connections 2024-09-16T00:48:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4fb406c680 0x7f4fb406eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fcc1004e0 0x7f4fcc195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 --2- 172.21.15.53:0/4247338504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fcc100e80 0x7f4fcc196430 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.718+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 >> 172.21.15.53:0/4247338504 conn(0x7f4fcc0fbda0 msgr2=0x7f4fcc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.719+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 shutdown_connections 2024-09-16T00:48:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:10.719+0000 7f4fd1328700 1 -- 172.21.15.53:0/4247338504 wait complete. 2024-09-16T00:48:11.334 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T00:48:11.335 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T00:48:11.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:11.335 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-16T00:48:11.393 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T00:48:11.393 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-16T00:48:11.394 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42328sec preferred_lft 42328sec 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-16T00:48:11.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T00:48:11.395 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T00:48:11.396 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-16T00:48:11.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:11.565 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:11 smithi053 ceph-mon[27950]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:11.565 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:11 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4247338504' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:48:11.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:11.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:11.620 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T00:48:11.645 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-16T00:48:11.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:11.647 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-16T00:48:11.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:11 smithi152 ceph-mon[33237]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:11.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:11 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/4247338504' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:48:11.722 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-16T00:48:11.722 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T00:48:11.722 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-16T00:48:11.722 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-16T00:48:11.723 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-16T00:48:11.723 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-16T00:48:11.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:12.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:12.043 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-16T00:48:12.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:12.060 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-09-16T00:48:12.116 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:12.116 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-16T00:48:12.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T00:48:12.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T00:48:12.116 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-16T00:48:12.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:12.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:12.236 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T00:48:12.236 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:12.236 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-16T00:48:12.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T00:48:12.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T00:48:12.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T00:48:12.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T00:48:12.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T00:48:12.237 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-16T00:48:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:12.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:12.395 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:12.395 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-16T00:48:12.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-16T00:48:12.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T00:48:12.395 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-16T00:48:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:12.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:12.474 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:48:12.474 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:12.490 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T00:48:12.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:48:12.490 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:12.546 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T00:48:12.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:12.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T00:48:12.690 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T00:48:12.690 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T00:48:12.690 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2024-09-16T00:48:12.809 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T00:48:12.809 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T00:48:12.809 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2024-09-16T00:48:12.810 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.152:3300" 2024-09-16T00:48:12.810 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:invalid new device string format 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.152:3300" 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.152:6789" 2024-09-16T00:48:12.815 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.152:6789:/ 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=31d96aac-73c4-11ef-bceb-c7b262605968" will pass to kernel 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: You just mounted a file system that supports labels which does not 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T00:48:12.816 INFO:teuthology.orchestra.run.smithi053.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T00:48:12.818 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T00:48:12.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:12.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:12.844 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:12.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:12.955 INFO:teuthology.orchestra.run.smithi053.stdout:client24317 2024-09-16T00:48:12.956 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:48:12.956 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T00:48:12.974 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:13.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:13.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:13.076 INFO:teuthology.orchestra.run.smithi053.stdout:client24317 2024-09-16T00:48:13.077 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:13.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:13.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:13.139 INFO:teuthology.orchestra.run.smithi053.stdout:client24317 2024-09-16T00:48:13.139 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/31d96aac-73c4-11ef-bceb-c7b262605968.client24317/status') 2024-09-16T00:48:13.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:13.203 INFO:teuthology.orchestra.run.smithi053.stdout:instance: client.24317 (3)172.21.15.53:0/4112295100 2024-09-16T00:48:13.203 INFO:teuthology.orchestra.run.smithi053.stdout:blocklisted: false 2024-09-16T00:48:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records in 2024-09-16T00:48:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:0+1 records out 2024-09-16T00:48:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:71 bytes copied, 2.3836e-05 s, 3.0 MB/s 2024-09-16T00:48:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:13.210 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T00:48:13.210 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T00:48:13.210 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:13.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T00:48:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:13.541 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:13 smithi053 ceph-mon[27950]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T00:48:13.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:13 smithi152 ceph-mon[33237]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 -- 172.21.15.53:0/522463019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 msgr2=0x7f46200ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 --2- 172.21.15.53:0/522463019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f46200ff780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4610009910 tx=0x7f4610009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 -- 172.21.15.53:0/522463019 shutdown_connections 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 --2- 172.21.15.53:0/522463019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 --2- 172.21.15.53:0/522463019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f46200ff780 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 -- 172.21.15.53:0/522463019 >> 172.21.15.53:0/522463019 conn(0x7f46200fac90 msgr2=0x7f46200fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 -- 172.21.15.53:0/522463019 shutdown_connections 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.253+0000 7f4624e9c700 1 -- 172.21.15.53:0/522463019 wait complete. 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 Processor -- start 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 -- start start 2024-09-16T00:48:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4620101840 con 0x7f46200ff3b0 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f4624e9c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4620101980 con 0x7f46200ffd50 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f461e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f461e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46336/0 (socket says 172.21.15.53:46336) 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f461e59c700 1 -- 172.21.15.53:0/537797657 learned_addr learned my addr 172.21.15.53:0/537797657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.254+0000 7f461dd9b700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f461e59c700 1 -- 172.21.15.53:0/537797657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 msgr2=0x7f4620101300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f461e59c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620101300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f461e59c700 1 -- 172.21.15.53:0/537797657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100095f0 con 0x7f46200ff3b0 2024-09-16T00:48:15.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f461dd9b700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:48:15.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f461e59c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4610006010 tx=0x7f461000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461001d070 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4620101c00 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f461000f460 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4610021640 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.255+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46201a23e0 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.256+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462004f2a0 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.257+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f461000faf0 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.257+0000 7f460f7fe700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 0x7f460806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.257+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f461008ca60 con 0x7f46200ff3b0 2024-09-16T00:48:15.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.257+0000 7f461dd9b700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 0x7f460806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:15.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.258+0000 7f461dd9b700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 0x7f460806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46201025b0 tx=0x7f4614008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:15.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.262+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4610057270 con 0x7f46200ff3b0 2024-09-16T00:48:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.509+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46201a2710 con 0x7f46200ff3b0 2024-09-16T00:48:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.510+0000 7f460f7fe700 1 -- 172.21.15.53:0/537797657 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f461005a890 con 0x7f46200ff3b0 2024-09-16T00:48:15.510 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T00:48:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 msgr2=0x7f460806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 0x7f460806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46201025b0 tx=0x7f4614008040 comp rx=0 tx=0).stop 2024-09-16T00:48:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 msgr2=0x7f4620100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4610006010 tx=0x7f461000be20 comp rx=0 tx=0).stop 2024-09-16T00:48:15.513 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:15 smithi053 ceph-mon[27950]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 shutdown_connections 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f460806c680 0x7f460806eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46200ff3b0 0x7f4620100dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 --2- 172.21.15.53:0/537797657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46200ffd50 0x7f4620101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 >> 172.21.15.53:0/537797657 conn(0x7f46200fac90 msgr2=0x7f4620103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 shutdown_connections 2024-09-16T00:48:15.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:15.512+0000 7f4624e9c700 1 -- 172.21.15.53:0/537797657 wait complete. 2024-09-16T00:48:15.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:15 smithi152 ceph-mon[33237]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T00:48:16.350 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T00:48:16.350 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T00:48:16.350 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-09-16T00:48:16.350 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T00:48:16.351 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:16.351 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T00:48:16.351 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T00:48:16.351 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T00:48:16.351 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T00:48:16.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:16.351 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-09-16T00:48:16.368 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T00:48:16.368 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T00:48:16.368 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T00:48:16.369 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-09-16T00:48:16.370 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T00:48:16.370 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42341sec preferred_lft 42341sec 2024-09-16T00:48:16.370 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link noprefixroute 2024-09-16T00:48:16.370 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-16T00:48:16.370 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-09-16T00:48:16.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T00:48:16.371 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-16T00:48:16.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:16.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:16.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:16.569 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T00:48:16.593 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-09-16T00:48:16.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:16.595 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-09-16T00:48:16.665 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-09-16T00:48:16.666 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T00:48:16.666 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T00:48:16.666 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T00:48:16.666 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T00:48:16.666 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:16.666 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-16T00:48:16.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T00:48:16.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T00:48:16.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T00:48:16.667 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-16T00:48:16.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:16 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/537797657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:48:16.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:16 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/537797657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T00:48:16.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:16.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:16.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:16.933 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-16T00:48:16.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:16.949 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-09-16T00:48:17.005 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:17.005 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-16T00:48:17.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T00:48:17.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T00:48:17.005 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-16T00:48:17.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:17.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.123 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T00:48:17.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T00:48:17.124 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-16T00:48:17.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:17.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.249 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T00:48:17.249 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-16T00:48:17.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-09-16T00:48:17.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T00:48:17.249 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-16T00:48:17.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:48:17.331 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:17.353 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T00:48:17.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T00:48:17.354 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:17.409 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T00:48:17.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:17.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T00:48:17.505 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T00:48:17.505 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T00:48:17.505 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-16T00:48:17.625 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T00:48:17.625 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T00:48:17.625 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-16T00:48:17.625 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.152:3300" 2024-09-16T00:48:17.625 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.53:3300,172.21.15.152:3300" 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.53:6789,172.21.15.152:6789" 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.53:6789,172.21.15.152:6789:/ 2024-09-16T00:48:17.631 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=31d96aac-73c4-11ef-bceb-c7b262605968" will pass to kernel 2024-09-16T00:48:17.632 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T00:48:17.632 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-09-16T00:48:17.632 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T00:48:17.632 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T00:48:17.632 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T00:48:17.634 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T00:48:17.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T00:48:17.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:17.659 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:17 smithi152 ceph-mon[33237]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T00:48:17.744 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:17.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.752 INFO:teuthology.orchestra.run.smithi152.stdout:client14524 2024-09-16T00:48:17.753 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:48:17.753 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T00:48:17.770 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:17.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:17 smithi053 ceph-mon[27950]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T00:48:17.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:17.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.865 INFO:teuthology.orchestra.run.smithi152.stdout:client14524 2024-09-16T00:48:17.865 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T00:48:17.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T00:48:17.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.921 INFO:teuthology.orchestra.run.smithi152.stdout:client14524 2024-09-16T00:48:17.921 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/31d96aac-73c4-11ef-bceb-c7b262605968.client14524/status') 2024-09-16T00:48:17.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T00:48:17.979 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.14524 (3)172.21.15.152:0/2639839516 2024-09-16T00:48:17.979 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-09-16T00:48:17.979 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-09-16T00:48:17.979 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-09-16T00:48:17.979 INFO:teuthology.orchestra.run.smithi152.stderr:72 bytes copied, 3.9459e-05 s, 1.8 MB/s 2024-09-16T00:48:17.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-16T00:48:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T00:48:17.986 INFO:teuthology.run_tasks:Running task print... 2024-09-16T00:48:17.995 INFO:teuthology.task.print:**** done client 2024-09-16T00:48:17.996 INFO:teuthology.run_tasks:Running task parallel... 2024-09-16T00:48:18.019 INFO:teuthology.task.parallel:starting parallel... 2024-09-16T00:48:18.019 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T00:48:18.020 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T00:48:18.020 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:48:18.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-16T00:48:18.021 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T00:48:18.021 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-16T00:48:18.026 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T00:48:18.026 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T00:48:18.026 INFO:tasks.workunit:timeout=3h 2024-09-16T00:48:18.026 INFO:tasks.workunit:cleanup=True 2024-09-16T00:48:18.026 DEBUG:teuthology.orchestra.run.smithi053:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:18.047 INFO:teuthology.orchestra.run.smithi053.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-16 00:47:40.867647088 +0000 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-16 00:48:12.842505393 +0000 2024-09-16T00:48:18.048 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-09-16 00:47:40.867647088 +0000 2024-09-16T00:48:18.048 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T00:48:18.048 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T00:48:18.118 DEBUG:teuthology.orchestra.run.smithi152:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-16 00:48:18.113396753 +0000 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-16 00:48:18.113396753 +0000 2024-09-16T00:48:18.135 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-16 00:47:40.867647088 +0000 2024-09-16T00:48:18.136 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-16T00:48:18.136 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-16T00:48:18.204 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T00:48:18.205 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T00:48:18.222 INFO:tasks.workunit.client.0.smithi053.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T00:48:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:18.260 INFO:tasks.workunit.client.1.smithi152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-16T00:48:19.694 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:19 smithi053 ceph-mon[27950]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T00:48:19.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:19 smithi152 ceph-mon[33237]: pgmap v203: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-16T00:48:20.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 -- 172.21.15.53:0/2167527360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 msgr2=0x7faa40101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 --2- 172.21.15.53:0/2167527360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40101890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa34009910 tx=0x7faa34009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 -- 172.21.15.53:0/2167527360 shutdown_connections 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 --2- 172.21.15.53:0/2167527360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40101890 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 --2- 172.21.15.53:0/2167527360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 -- 172.21.15.53:0/2167527360 >> 172.21.15.53:0/2167527360 conn(0x7faa400fb7f0 msgr2=0x7faa400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 -- 172.21.15.53:0/2167527360 shutdown_connections 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.065+0000 7faa45a43700 1 -- 172.21.15.53:0/2167527360 wait complete. 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 Processor -- start 2024-09-16T00:48:20.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 -- start start 2024-09-16T00:48:20.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40073680 con 0x7faa40101440 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.066+0000 7faa45a43700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400737c0 con 0x7faa40100240 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46356/0 (socket says 172.21.15.53:46356) 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 -- 172.21.15.53:0/4193034442 learned_addr learned my addr 172.21.15.53:0/4193034442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3effd700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 -- 172.21.15.53:0/4193034442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 msgr2=0x7faa40074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 -- 172.21.15.53:0/4193034442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa340095f0 con 0x7faa40101440 2024-09-16T00:48:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3effd700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa3e7fc700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa3400bd70 tx=0x7faa3400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3401d070 con 0x7faa40101440 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40073a40 con 0x7faa40101440 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa34022470 con 0x7faa40101440 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.067+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3400f670 con 0x7faa40101440 2024-09-16T00:48:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.068+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40073f30 con 0x7faa40101440 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.068+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa40108d90 con 0x7faa40101440 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.069+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7faa34022a50 con 0x7faa40101440 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.069+0000 7faa44a41700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 0x7faa2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.070+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faa3408ce20 con 0x7faa40101440 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.070+0000 7faa3effd700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 0x7faa2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:20.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.070+0000 7faa3effd700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 0x7faa2806eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa401012a0 tx=0x7faa30005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.074+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faa3405b0f0 con 0x7faa40101440 2024-09-16T00:48:20.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.275+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7faa4019df70 con 0x7faa40101440 2024-09-16T00:48:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.279+0000 7faa44a41700 1 -- 172.21.15.53:0/4193034442 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7faa3405ac80 con 0x7faa40101440 2024-09-16T00:48:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.281+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 msgr2=0x7faa2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.281+0000 7faa45a43700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 0x7faa2806eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa401012a0 tx=0x7faa30005f90 comp rx=0 tx=0).stop 2024-09-16T00:48:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.281+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 msgr2=0x7faa40073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.281+0000 7faa45a43700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa3400bd70 tx=0x7faa3400be50 comp rx=0 tx=0).stop 2024-09-16T00:48:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 shutdown_connections 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7faa2806c680 0x7faa2806eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa40100240 0x7faa40074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 --2- 172.21.15.53:0/4193034442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa40101440 0x7faa40073140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 >> 172.21.15.53:0/4193034442 conn(0x7faa400fb7f0 msgr2=0x7faa40104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 shutdown_connections 2024-09-16T00:48:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:20.282+0000 7faa45a43700 1 -- 172.21.15.53:0/4193034442 wait complete. 2024-09-16T00:48:21.006 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T00:48:21.007 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:48:21.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-16T00:48:21.265 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4193034442' entity='client.admin' 2024-09-16T00:48:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:48:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-16T00:48:21.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:21.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:21.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:21 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:21.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/4193034442' entity='client.admin' 2024-09-16T00:48:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:48:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-16T00:48:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:21 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- 172.21.15.53:0/2842394110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 msgr2=0x7f62e8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 --2- 172.21.15.53:0/2842394110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8100650 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009910 tx=0x7f62e4009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- 172.21.15.53:0/2842394110 shutdown_connections 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 --2- 172.21.15.53:0/2842394110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 0x7f62e8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 --2- 172.21.15.53:0/2842394110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8100650 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- 172.21.15.53:0/2842394110 >> 172.21.15.53:0/2842394110 conn(0x7f62e80fb7f0 msgr2=0x7f62e80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:23.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- 172.21.15.53:0/2842394110 shutdown_connections 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- 172.21.15.53:0/2842394110 wait complete. 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 Processor -- start 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.071+0000 7f62f065c700 1 -- start start 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62f065c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62f065c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 0x7f62e8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62f065c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8196610 con 0x7f62e8100240 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62f065c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8196750 con 0x7f62e8101440 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56924/0 (socket says 172.21.15.53:56924) 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 -- 172.21.15.53:0/2056720003 learned_addr learned my addr 172.21.15.53:0/2056720003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62edbf7700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 0x7f62e8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 -- 172.21.15.53:0/2056720003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 msgr2=0x7f62e8195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:23.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 0x7f62e8195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 -- 172.21.15.53:0/2056720003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40095f0 con 0x7f62e8100240 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62ee3f8700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62e400bda0 tx=0x7f62e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62e401d070 con 0x7f62e8100240 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e819b1a0 con 0x7f62e8100240 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62e400f460 con 0x7f62e8100240 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.072+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62e4021640 con 0x7f62e8100240 2024-09-16T00:48:23.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.073+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e819b690 con 0x7f62e8100240 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.074+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8108d90 con 0x7f62e8100240 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.074+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f62e400f5d0 con 0x7f62e8100240 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.075+0000 7f62df7fe700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 0x7f62d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.075+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f62e408cb10 con 0x7f62e8100240 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.075+0000 7f62edbf7700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 0x7f62d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:23.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.075+0000 7f62edbf7700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 0x7f62d406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62d8005950 tx=0x7f62d80058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:23.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.079+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f62e405ad30 con 0x7f62e8100240 2024-09-16T00:48:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.279+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f62e8108f50 con 0x7f62e8100240 2024-09-16T00:48:23.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.279+0000 7f62df7fe700 1 -- 172.21.15.53:0/2056720003 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7f62e405a8c0 con 0x7f62e8100240 2024-09-16T00:48:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 msgr2=0x7f62d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 0x7f62d406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62d8005950 tx=0x7f62d80058e0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 msgr2=0x7f62e8195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62e400bda0 tx=0x7f62e400be80 comp rx=0 tx=0).stop 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 shutdown_connections 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f62d406c680 0x7f62d406eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e8100240 0x7f62e8195ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 --2- 172.21.15.53:0/2056720003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62e8101440 0x7f62e8195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 >> 172.21.15.53:0/2056720003 conn(0x7f62e80fb7f0 msgr2=0x7f62e8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 shutdown_connections 2024-09-16T00:48:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:23.281+0000 7f62f065c700 1 -- 172.21.15.53:0/2056720003 wait complete. 2024-09-16T00:48:23.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:23 smithi152 ceph-mon[33237]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-16T00:48:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:23 smithi053 ceph-mon[27950]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-16T00:48:24.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-16T00:48:24.283 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:25.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:25 smithi053 ceph-mon[27950]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-16T00:48:25.663 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:25 smithi152 ceph-mon[33237]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-16T00:48:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:25.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 -- 172.21.15.53:0/4230742554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec101440 msgr2=0x7fd4ec101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:25.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 --2- 172.21.15.53:0/4230742554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec101440 0x7fd4ec101890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009910 tx=0x7fd4e0009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:25.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 -- 172.21.15.53:0/4230742554 shutdown_connections 2024-09-16T00:48:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 --2- 172.21.15.53:0/4230742554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec101440 0x7fd4ec101890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 --2- 172.21.15.53:0/4230742554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec100240 0x7fd4ec100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 -- 172.21.15.53:0/4230742554 >> 172.21.15.53:0/4230742554 conn(0x7fd4ec0fb7f0 msgr2=0x7fd4ec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 -- 172.21.15.53:0/4230742554 shutdown_connections 2024-09-16T00:48:25.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.896+0000 7fd4f205b700 1 -- 172.21.15.53:0/4230742554 wait complete. 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 Processor -- start 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 -- start start 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec101440 0x7fd4ec073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec073680 con 0x7fd4ec100240 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.897+0000 7fd4f205b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0737c0 con 0x7fd4ec101440 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56940/0 (socket says 172.21.15.53:56940) 2024-09-16T00:48:25.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 -- 172.21.15.53:0/3424302668 learned_addr learned my addr 172.21.15.53:0/3424302668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eaffd700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec101440 0x7fd4ec073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 -- 172.21.15.53:0/3424302668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec101440 msgr2=0x7fd4ec073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec101440 0x7fd4ec073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 -- 172.21.15.53:0/3424302668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00095f0 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4eb7fe700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c8f0 tx=0x7fd4dc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc0078e0 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec073aa0 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4dc00f450 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc018610 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.898+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec19daf0 con 0x7fd4ec100240 2024-09-16T00:48:25.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.899+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec108d90 con 0x7fd4ec100240 2024-09-16T00:48:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.900+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd4dc00f5c0 con 0x7fd4ec100240 2024-09-16T00:48:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.900+0000 7fd4e8ff9700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 0x7fd4d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.901+0000 7fd4eaffd700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 0x7fd4d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.901+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd4dc08b6b0 con 0x7fd4ec100240 2024-09-16T00:48:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.901+0000 7fd4eaffd700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 0x7fd4d406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0006010 tx=0x7fd4e000b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:25.905+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd4dc0598d0 con 0x7fd4ec100240 2024-09-16T00:48:26.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.109+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd4ec108f50 con 0x7fd4ec100240 2024-09-16T00:48:26.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.110+0000 7fd4e8ff9700 1 -- 172.21.15.53:0/3424302668 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd4ec108f50 con 0x7fd4ec100240 2024-09-16T00:48:26.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 msgr2=0x7fd4d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:26.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 0x7fd4d406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0006010 tx=0x7fd4e000b560 comp rx=0 tx=0).stop 2024-09-16T00:48:26.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 msgr2=0x7fd4ec074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:26.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c8f0 tx=0x7fd4dc00cc00 comp rx=0 tx=0).stop 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 shutdown_connections 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fd4d406c680 0x7fd4d406eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec100240 0x7fd4ec074af0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 --2- 172.21.15.53:0/3424302668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ec101440 0x7fd4ec073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 >> 172.21.15.53:0/3424302668 conn(0x7fd4ec0fb7f0 msgr2=0x7fd4ec104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 shutdown_connections 2024-09-16T00:48:26.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:26.112+0000 7fd4f205b700 1 -- 172.21.15.53:0/3424302668 wait complete. 2024-09-16T00:48:26.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-16T00:48:26.982 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:27 smithi152 ceph-mon[33237]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-16T00:48:27.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:27 smithi053 ceph-mon[27950]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-16T00:48:28.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 -- 172.21.15.53:0/1783941408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c101440 msgr2=0x7fc94c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:28.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 --2- 172.21.15.53:0/1783941408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c101440 0x7fc94c101890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc940009910 tx=0x7fc940009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 -- 172.21.15.53:0/1783941408 shutdown_connections 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 --2- 172.21.15.53:0/1783941408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c101440 0x7fc94c101890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 --2- 172.21.15.53:0/1783941408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c100240 0x7fc94c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 -- 172.21.15.53:0/1783941408 >> 172.21.15.53:0/1783941408 conn(0x7fc94c0fb7f0 msgr2=0x7fc94c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 -- 172.21.15.53:0/1783941408 shutdown_connections 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.761+0000 7fc951f19700 1 -- 172.21.15.53:0/1783941408 wait complete. 2024-09-16T00:48:28.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 Processor -- start 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 -- start start 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c101440 0x7fc94c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c073680 con 0x7fc94c100240 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.762+0000 7fc951f19700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0737c0 con 0x7fc94c101440 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:28.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56948/0 (socket says 172.21.15.53:56948) 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 -- 172.21.15.53:0/3416377236 learned_addr learned my addr 172.21.15.53:0/3416377236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94affd700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c101440 0x7fc94c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 -- 172.21.15.53:0/3416377236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c101440 msgr2=0x7fc94c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c101440 0x7fc94c073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 -- 172.21.15.53:0/3416377236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400095f0 con 0x7fc94c100240 2024-09-16T00:48:28.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc94b7fe700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00b480 tx=0x7fc93c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:28.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93c011800 con 0x7fc94c100240 2024-09-16T00:48:28.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc93c011e10 con 0x7fc94c100240 2024-09-16T00:48:28.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c073aa0 con 0x7fc94c100240 2024-09-16T00:48:28.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93c010ea0 con 0x7fc94c100240 2024-09-16T00:48:28.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.763+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c19dbe0 con 0x7fc94c100240 2024-09-16T00:48:28.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.765+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c108e30 con 0x7fc94c100240 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.765+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc93c010380 con 0x7fc94c100240 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.765+0000 7fc948ff9700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 0x7fc93406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.766+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc93c08b330 con 0x7fc94c100240 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.766+0000 7fc94affd700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 0x7fc93406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.766+0000 7fc94affd700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 0x7fc93406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b5c0 tx=0x7fc9400052a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:28.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.770+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc93c059600 con 0x7fc94c100240 2024-09-16T00:48:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.970+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fc94c108ff0 con 0x7fc94c100240 2024-09-16T00:48:28.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.971+0000 7fc948ff9700 1 -- 172.21.15.53:0/3416377236 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7fc94c108ff0 con 0x7fc94c100240 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 msgr2=0x7fc93406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 0x7fc93406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc94000b5c0 tx=0x7fc9400052a0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 msgr2=0x7fc94c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00b480 tx=0x7fc93c00b790 comp rx=0 tx=0).stop 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 shutdown_connections 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fc93406c680 0x7fc93406eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc94c100240 0x7fc94c074af0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 --2- 172.21.15.53:0/3416377236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc94c101440 0x7fc94c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 >> 172.21.15.53:0/3416377236 conn(0x7fc94c0fb7f0 msgr2=0x7fc94c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 shutdown_connections 2024-09-16T00:48:28.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:28.973+0000 7fc951f19700 1 -- 172.21.15.53:0/3416377236 wait complete. 2024-09-16T00:48:29.687 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:29 smithi053 ceph-mon[27950]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-16T00:48:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:29 smithi152 ceph-mon[33237]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-16T00:48:29.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-16T00:48:29.935 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:31.599 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:31 smithi053 ceph-mon[27950]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-16T00:48:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:31 smithi152 ceph-mon[33237]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-16T00:48:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.713+0000 7f0617abd700 1 -- 172.21.15.53:0/3538589453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 msgr2=0x7f0610101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.713+0000 7f0617abd700 1 --2- 172.21.15.53:0/3538589453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610101890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0600009910 tx=0x7f0600009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 -- 172.21.15.53:0/3538589453 shutdown_connections 2024-09-16T00:48:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 --2- 172.21.15.53:0/3538589453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610101890 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 --2- 172.21.15.53:0/3538589453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 0x7f0610100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 -- 172.21.15.53:0/3538589453 >> 172.21.15.53:0/3538589453 conn(0x7f06100fb7f0 msgr2=0x7f06100fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 -- 172.21.15.53:0/3538589453 shutdown_connections 2024-09-16T00:48:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 -- 172.21.15.53:0/3538589453 wait complete. 2024-09-16T00:48:31.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 Processor -- start 2024-09-16T00:48:31.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.714+0000 7f0617abd700 1 -- start start 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0617abd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 0x7f0610195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0617abd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0617abd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06101965f0 con 0x7f0610101440 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0617abd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610196730 con 0x7f0610100240 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56968/0 (socket says 172.21.15.53:56968) 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 -- 172.21.15.53:0/1466189145 learned_addr learned my addr 172.21.15.53:0/1466189145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615859700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 0x7f0610195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 -- 172.21.15.53:0/1466189145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 msgr2=0x7f0610195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 0x7f0610195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 -- 172.21.15.53:0/1466189145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000095f0 con 0x7f0610101440 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.715+0000 7f0615058700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06000092e0 tx=0x7f060000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.716+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060001d070 con 0x7f0610101440 2024-09-16T00:48:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.716+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f060000f460 con 0x7f0610101440 2024-09-16T00:48:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.716+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061019b180 con 0x7f0610101440 2024-09-16T00:48:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.716+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0600021620 con 0x7f0610101440 2024-09-16T00:48:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.716+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061019b670 con 0x7f0610101440 2024-09-16T00:48:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.717+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610108d90 con 0x7f0610101440 2024-09-16T00:48:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.717+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f060000fa90 con 0x7f0610101440 2024-09-16T00:48:31.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.718+0000 7f0606ffd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 0x7f05fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:31.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.718+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f060008cae0 con 0x7f0610101440 2024-09-16T00:48:31.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.718+0000 7f0615859700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 0x7f05fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:31.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.719+0000 7f0615859700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 0x7f05fc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06101012a0 tx=0x7f060c00a380 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:31.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.724+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f060005ad00 con 0x7f0610101440 2024-09-16T00:48:31.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.942+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}) v1 -- 0x7f0610105d90 con 0x7f05fc06c680 2024-09-16T00:48:31.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.947+0000 7f0606ffd700 1 -- 172.21.15.53:0/1466189145 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f0610105d90 con 0x7f05fc06c680 2024-09-16T00:48:31.948 INFO:teuthology.orchestra.run.smithi053.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.949+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 msgr2=0x7f05fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.949+0000 7f0617abd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 0x7f05fc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06101012a0 tx=0x7f060c00a380 comp rx=0 tx=0).stop 2024-09-16T00:48:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.949+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 msgr2=0x7f0610195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.949+0000 7f0617abd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06000092e0 tx=0x7f060000bd70 comp rx=0 tx=0).stop 2024-09-16T00:48:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 shutdown_connections 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f05fc06c680 0x7f05fc06eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0610100240 0x7f0610195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 --2- 172.21.15.53:0/1466189145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0610101440 0x7f0610195fd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 >> 172.21.15.53:0/1466189145 conn(0x7f06100fb7f0 msgr2=0x7f0610104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 shutdown_connections 2024-09-16T00:48:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:31.950+0000 7f0617abd700 1 -- 172.21.15.53:0/1466189145 wait complete. 2024-09-16T00:48:32.775 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T00:48:32.776 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T00:48:32.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-16T00:48:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:33.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:32 smithi053 ceph-mon[27950]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T00:48:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:32 smithi152 ceph-mon[33237]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 -- 172.21.15.53:0/2554744723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0ff150 msgr2=0x7f59ec0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 --2- 172.21.15.53:0/2554744723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0ff150 0x7f59ec0ff560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009910 tx=0x7f59e8009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 -- 172.21.15.53:0/2554744723 shutdown_connections 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 --2- 172.21.15.53:0/2554744723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec100350 0x7f59ec1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 --2- 172.21.15.53:0/2554744723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0ff150 0x7f59ec0ff560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 -- 172.21.15.53:0/2554744723 >> 172.21.15.53:0/2554744723 conn(0x7f59ec0fa700 msgr2=0x7f59ec0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:35.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 -- 172.21.15.53:0/2554744723 shutdown_connections 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.105+0000 7f59f33f4700 1 -- 172.21.15.53:0/2554744723 wait complete. 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 Processor -- start 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 -- start start 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 0x7f59ec196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec196650 con 0x7f59ec100350 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f33f4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec196790 con 0x7f59ec0ff150 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f1190700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f098f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 0x7f59ec196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f1190700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:54664/0 (socket says 172.21.15.53:54664) 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f1190700 1 -- 172.21.15.53:0/508561431 learned_addr learned my addr 172.21.15.53:0/508561431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.106+0000 7f59f098f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 0x7f59ec196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33298/0 (socket says 172.21.15.53:33298) 2024-09-16T00:48:35.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f1190700 1 -- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 msgr2=0x7f59ec196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f1190700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 0x7f59ec196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f1190700 1 -- 172.21.15.53:0/508561431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e80095f0 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f1190700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59e8000c00 tx=0x7f59e800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e801d070 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59e8005dc0 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec19b1e0 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e8022470 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.107+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec19b6d0 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.108+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec107ca0 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.109+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f59e8003810 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.110+0000 7f59e27fc700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 0x7f59d806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.110+0000 7f59f098f700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 0x7f59d806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.110+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f59e808cd00 con 0x7f59ec0ff150 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.110+0000 7f59f098f700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 0x7f59d806eb80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009c60 tx=0x7f59dc009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:35.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.114+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f59e805aea0 con 0x7f59ec0ff150 2024-09-16T00:48:35.438 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:35 smithi053 ceph-mon[27950]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:35.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.452+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59ec0694e0 con 0x7f59d806c6d0 2024-09-16T00:48:35.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.453+0000 7f59e27fc700 1 -- 172.21.15.53:0/508561431 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f59ec0694e0 con 0x7f59d806c6d0 2024-09-16T00:48:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.455+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 msgr2=0x7f59d806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.455+0000 7f59f33f4700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 0x7f59d806eb80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009c60 tx=0x7f59dc009260 comp rx=0 tx=0).stop 2024-09-16T00:48:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.455+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 msgr2=0x7f59ec195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.455+0000 7f59f33f4700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59e8000c00 tx=0x7f59e800f690 comp rx=0 tx=0).stop 2024-09-16T00:48:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 shutdown_connections 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f59d806c6d0 0x7f59d806eb80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59ec0ff150 0x7f59ec195af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 --2- 172.21.15.53:0/508561431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec100350 0x7f59ec196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 >> 172.21.15.53:0/508561431 conn(0x7f59ec0fa700 msgr2=0x7f59ec068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 shutdown_connections 2024-09-16T00:48:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.456+0000 7f59f33f4700 1 -- 172.21.15.53:0/508561431 wait complete. 2024-09-16T00:48:35.470 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 -- 172.21.15.53:0/1089279504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 msgr2=0x7fe774100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/1089279504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe774100840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe764009910 tx=0x7fe764009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 -- 172.21.15.53:0/1089279504 shutdown_connections 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/1089279504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe774100840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/1089279504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 0x7fe7740ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 -- 172.21.15.53:0/1089279504 >> 172.21.15.53:0/1089279504 conn(0x7fe7740fa780 msgr2=0x7fe7740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 -- 172.21.15.53:0/1089279504 shutdown_connections 2024-09-16T00:48:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.605+0000 7fe77c3f0700 1 -- 172.21.15.53:0/1089279504 wait complete. 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 Processor -- start 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 -- start start 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 0x7fe774071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774072910 con 0x7fe7741003d0 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77c3f0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741a1610 con 0x7fe7740ff130 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77998b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77998b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33320/0 (socket says 172.21.15.53:33320) 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77998b700 1 -- 172.21.15.53:0/3774195642 learned_addr learned my addr 172.21.15.53:0/3774195642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.606+0000 7fe77a18c700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 0x7fe774071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77998b700 1 -- 172.21.15.53:0/3774195642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 msgr2=0x7fe774071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77998b700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 0x7fe774071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77998b700 1 -- 172.21.15.53:0/3774195642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640095f0 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77998b700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe764006010 tx=0x7fe76400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76401d070 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7741a17b0 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe76400f460 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe764021640 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.607+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7741a1c00 con 0x7fe7741003d0 2024-09-16T00:48:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.609+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe774106ae0 con 0x7fe7741003d0 2024-09-16T00:48:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.610+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe76400fab0 con 0x7fe7741003d0 2024-09-16T00:48:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.610+0000 7fe76b7fe700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 0x7fe760070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.610+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe76408cb90 con 0x7fe7741003d0 2024-09-16T00:48:35.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.611+0000 7fe77a18c700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 0x7fe760070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:35.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.611+0000 7fe77a18c700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 0x7fe760070d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe770005fd0 tx=0x7fe77000a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:35.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.617+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe76405ae30 con 0x7fe7741003d0 2024-09-16T00:48:35.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:35 smithi152 ceph-mon[33237]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-16T00:48:35.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.941+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe774104d20 con 0x7fe76006e890 2024-09-16T00:48:35.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.942+0000 7fe76b7fe700 1 -- 172.21.15.53:0/3774195642 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fe774104d20 con 0x7fe76006e890 2024-09-16T00:48:35.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 msgr2=0x7fe760070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 0x7fe760070d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe770005fd0 tx=0x7fe77000a560 comp rx=0 tx=0).stop 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 msgr2=0x7fe7740722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe764006010 tx=0x7fe76400be20 comp rx=0 tx=0).stop 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 shutdown_connections 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe76006e890 0x7fe760070d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7740ff130 0x7fe774071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 --2- 172.21.15.53:0/3774195642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7741003d0 0x7fe7740722f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 >> 172.21.15.53:0/3774195642 conn(0x7fe7740fa780 msgr2=0x7fe774103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 shutdown_connections 2024-09-16T00:48:35.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:35.945+0000 7fe77c3f0700 1 -- 172.21.15.53:0/3774195642 wait complete. 2024-09-16T00:48:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.088+0000 7f150f7fe700 1 -- 172.21.15.53:0/3200892042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150400baf0 con 0x7f15101021d0 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 -- 172.21.15.53:0/3200892042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15101021d0 msgr2=0x7f15100fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 --2- 172.21.15.53:0/3200892042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15101021d0 0x7f15100fe300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1504009910 tx=0x7f1504009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 -- 172.21.15.53:0/3200892042 shutdown_connections 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 --2- 172.21.15.53:0/3200892042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15101021d0 0x7f15100fe300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 --2- 172.21.15.53:0/3200892042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1510101880 0x7f1510101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 -- 172.21.15.53:0/3200892042 >> 172.21.15.53:0/3200892042 conn(0x7f15100f9f10 msgr2=0x7f15100fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 -- 172.21.15.53:0/3200892042 shutdown_connections 2024-09-16T00:48:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.089+0000 7f1516cce700 1 -- 172.21.15.53:0/3200892042 wait complete. 2024-09-16T00:48:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 Processor -- start 2024-09-16T00:48:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 -- start start 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15101021d0 0x7f15100ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510199710 con 0x7f1510101880 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1516cce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510199850 con 0x7f15101021d0 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1514a6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1514a6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33336/0 (socket says 172.21.15.53:33336) 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.090+0000 7f1514a6a700 1 -- 172.21.15.53:0/2352262139 learned_addr learned my addr 172.21.15.53:0/2352262139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f150ffff700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15101021d0 0x7f15100ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f1514a6a700 1 -- 172.21.15.53:0/2352262139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15101021d0 msgr2=0x7f15100ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f1514a6a700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15101021d0 0x7f15100ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f1514a6a700 1 -- 172.21.15.53:0/2352262139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040095f0 con 0x7f1510101880 2024-09-16T00:48:36.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f1514a6a700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f150000e920 tx=0x7f150000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.091+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150000c9d0 con 0x7f1510101880 2024-09-16T00:48:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.092+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1500010430 con 0x7f1510101880 2024-09-16T00:48:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.092+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1500018650 con 0x7f1510101880 2024-09-16T00:48:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.092+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15100ffb10 con 0x7f1510101880 2024-09-16T00:48:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.092+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15100fff70 con 0x7f1510101880 2024-09-16T00:48:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.093+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510100240 con 0x7f1510101880 2024-09-16T00:48:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.094+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f15000105a0 con 0x7f1510101880 2024-09-16T00:48:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.095+0000 7f150dffb700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 0x7f14f806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.095+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1500014070 con 0x7f1510101880 2024-09-16T00:48:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.095+0000 7f150ffff700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 0x7f14f806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.096+0000 7f150ffff700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 0x7f14f806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f150400b6f0 tx=0x7f1504005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:36.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.104+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1500051720 con 0x7f1510101880 2024-09-16T00:48:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.413+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1510105f70 con 0x7f14f806c680 2024-09-16T00:48:36.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.431+0000 7f150dffb700 1 -- 172.21.15.53:0/2352262139 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f1510105f70 con 0x7f14f806c680 2024-09-16T00:48:36.432 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:48:36.432 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (5m) 28s ago 6m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:48:36.432 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (6m) 28s ago 6m 7453k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:48:36.432 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (5m) 37s ago 5m 7155k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (6m) 28s ago 6m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (5m) 37s ago 5m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (5m) 28s ago 6m 84.2M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (56s) 28s ago 56s 17.4M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (51s) 28s ago 51s 16.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (54s) 37s ago 53s 13.0M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (48s) 37s ago 48s 11.5M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:9283,8765,8443 running (7m) 28s ago 7m 487M - 18.2.0 dc2bc1663786 308f181966ac 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (5m) 37s ago 5m 438M - 18.2.0 dc2bc1663786 ad027230756c 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (8m) 28s ago 8m 44.1M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (5m) 37s ago 5m 36.1M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (6m) 28s ago 6m 15.8M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 37s ago 5m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:48:36.433 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (4m) 28s ago 4m 50.7M 3948M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (4m) 28s ago 4m 47.4M 3948M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (3m) 28s ago 3m 45.7M 3948M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (3m) 37s ago 3m 46.7M 4970M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (2m) 37s ago 2m 44.0M 4970M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (2m) 37s ago 2m 44.7M 4970M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (4m) 28s ago 6m 63.0M - 2.43.0 a07b618ecd1d 61cdcd6b91c6 2024-09-16T00:48:36.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 msgr2=0x7f14f806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 0x7f14f806eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f150400b6f0 tx=0x7f1504005940 comp rx=0 tx=0).stop 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 msgr2=0x7f1510100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f150000e920 tx=0x7f150000ec30 comp rx=0 tx=0).stop 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 shutdown_connections 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f14f806c680 0x7f14f806eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1510101880 0x7f1510100f80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 --2- 172.21.15.53:0/2352262139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15101021d0 0x7f15100ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 >> 172.21.15.53:0/2352262139 conn(0x7f15100f9f10 msgr2=0x7f1510104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 shutdown_connections 2024-09-16T00:48:36.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.434+0000 7f1516cce700 1 -- 172.21.15.53:0/2352262139 wait complete. 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 -- 172.21.15.53:0/127159398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7138101880 msgr2=0x7f7138101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 --2- 172.21.15.53:0/127159398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7138101880 0x7f7138101c90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7128009910 tx=0x7f7128009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 -- 172.21.15.53:0/127159398 shutdown_connections 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 --2- 172.21.15.53:0/127159398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71381021d0 0x7f71380fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 --2- 172.21.15.53:0/127159398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7138101880 0x7f7138101c90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 -- 172.21.15.53:0/127159398 >> 172.21.15.53:0/127159398 conn(0x7f71380f9f10 msgr2=0x7f71380fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.581+0000 7f713e869700 1 -- 172.21.15.53:0/127159398 shutdown_connections 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.582+0000 7f713e869700 1 -- 172.21.15.53:0/127159398 wait complete. 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.582+0000 7f713e869700 1 Processor -- start 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.582+0000 7f713e869700 1 -- start start 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f713e869700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f713e869700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 0x7f71380ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f713e869700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380ffb10 con 0x7f71381021d0 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f713e869700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380ffc50 con 0x7f7138101880 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f7137fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f7137fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:54718/0 (socket says 172.21.15.53:54718) 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f7137fff700 1 -- 172.21.15.53:0/205017193 learned_addr learned my addr 172.21.15.53:0/205017193 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.583+0000 7f71377fe700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 0x7f71380ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f7137fff700 1 -- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 msgr2=0x7f71380ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f7137fff700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 0x7f71380ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f7137fff700 1 -- 172.21.15.53:0/205017193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280095f0 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f71377fe700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 0x7f71380ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f7137fff700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7128000c00 tx=0x7f712800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712801d070 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7128005dc0 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71280226a0 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.584+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71380ffed0 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.585+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71381002b0 con 0x7f7138101880 2024-09-16T00:48:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.586+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7138108d40 con 0x7f7138101880 2024-09-16T00:48:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.587+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f712800faf0 con 0x7f7138101880 2024-09-16T00:48:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.587+0000 7f71357fa700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 0x7f712006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.587+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f712808cd30 con 0x7f7138101880 2024-09-16T00:48:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.587+0000 7f71377fe700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 0x7f712006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.588+0000 7f71377fe700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 0x7f712006eb80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7138102600 tx=0x7f712c009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:36.592+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f712805aed0 con 0x7f7138101880 2024-09-16T00:48:36.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:36 smithi152 ceph-mon[33237]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:36.746 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:36 smithi053 ceph-mon[27950]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:37.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.004+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f713819df20 con 0x7f7138101880 2024-09-16T00:48:37.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.005+0000 7f71357fa700 1 -- 172.21.15.53:0/205017193 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f712805aa60 con 0x7f7138101880 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:48:37.006 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:48:37.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:48:37.007 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:48:37.007 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-16T00:48:37.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:48:37.007 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:48:37.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 msgr2=0x7f712006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 0x7f712006eb80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7138102600 tx=0x7f712c009260 comp rx=0 tx=0).stop 2024-09-16T00:48:37.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 msgr2=0x7f7138100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7128000c00 tx=0x7f712800f690 comp rx=0 tx=0).stop 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 shutdown_connections 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f712006c6d0 0x7f712006eb80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7138101880 0x7f7138100f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 --2- 172.21.15.53:0/205017193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71381021d0 0x7f71380ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 >> 172.21.15.53:0/205017193 conn(0x7f71380f9f10 msgr2=0x7f7138104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 shutdown_connections 2024-09-16T00:48:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.008+0000 7f713e869700 1 -- 172.21.15.53:0/205017193 wait complete. 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 -- 172.21.15.53:0/1920543132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 msgr2=0x7f396c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 --2- 172.21.15.53:0/1920543132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c103140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3968009910 tx=0x7f3968009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 -- 172.21.15.53:0/1920543132 shutdown_connections 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 --2- 172.21.15.53:0/1920543132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 0x7f396c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 --2- 172.21.15.53:0/1920543132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c103140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 -- 172.21.15.53:0/1920543132 >> 172.21.15.53:0/1920543132 conn(0x7f396c0fa780 msgr2=0x7f396c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 -- 172.21.15.53:0/1920543132 shutdown_connections 2024-09-16T00:48:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.148+0000 7f3973ae7700 1 -- 172.21.15.53:0/1920543132 wait complete. 2024-09-16T00:48:37.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.149+0000 7f3973ae7700 1 Processor -- start 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.149+0000 7f3973ae7700 1 -- start start 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3973ae7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3973ae7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 0x7f396c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3973ae7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c196610 con 0x7f396c100d60 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3973ae7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c196750 con 0x7f396c103680 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33372/0 (socket says 172.21.15.53:33372) 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 -- 172.21.15.53:0/3292323470 learned_addr learned my addr 172.21.15.53:0/3292323470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971082700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 0x7f396c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 -- 172.21.15.53:0/3292323470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 msgr2=0x7f396c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 0x7f396c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 -- 172.21.15.53:0/3292323470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680095f0 con 0x7f396c100d60 2024-09-16T00:48:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.150+0000 7f3971883700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f396800bda0 tx=0x7f396800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.151+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396801d070 con 0x7f396c100d60 2024-09-16T00:48:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.151+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3968005dc0 con 0x7f396c100d60 2024-09-16T00:48:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.151+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c0feb50 con 0x7f396c100d60 2024-09-16T00:48:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.151+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396800fe80 con 0x7f396c100d60 2024-09-16T00:48:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.151+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c0ff040 con 0x7f396c100d60 2024-09-16T00:48:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.153+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c18fbc0 con 0x7f396c100d60 2024-09-16T00:48:37.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.154+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f396800f6f0 con 0x7f396c100d60 2024-09-16T00:48:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.154+0000 7f3962ffd700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 0x7f395806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.155+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f396808ca70 con 0x7f396c100d60 2024-09-16T00:48:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.155+0000 7f3971082700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 0x7f395806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.155+0000 7f3971082700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 0x7f395806eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f395c005950 tx=0x7f395c013040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.161+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f396805ac90 con 0x7f396c100d60 2024-09-16T00:48:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.534+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f396c02cc30 con 0x7f396c100d60 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.534+0000 7f3962ffd700 1 -- 172.21.15.53:0/3292323470 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f3968026750 con 0x7f396c100d60 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:48:37.536 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:48:37.537 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:48:37.538 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:48:37.539 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:48:37.539 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:48:37.539 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:48:37.539 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:48:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 msgr2=0x7f395806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 0x7f395806eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f395c005950 tx=0x7f395c013040 comp rx=0 tx=0).stop 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 msgr2=0x7f396c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f396800bda0 tx=0x7f396800bdd0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 shutdown_connections 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f395806c680 0x7f395806eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396c100d60 0x7f396c195ab0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 --2- 172.21.15.53:0/3292323470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f396c103680 0x7f396c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 >> 172.21.15.53:0/3292323470 conn(0x7f396c0fa780 msgr2=0x7f396c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 shutdown_connections 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.537+0000 7f3973ae7700 1 -- 172.21.15.53:0/3292323470 wait complete. 2024-09-16T00:48:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 -- 172.21.15.53:0/4079178261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f4101120 msgr2=0x7fe0f4107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 --2- 172.21.15.53:0/4079178261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f4101120 0x7fe0f4107a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009910 tx=0x7fe0e0009c20 comp rx=0 tx=0).stop 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 -- 172.21.15.53:0/4079178261 shutdown_connections 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 --2- 172.21.15.53:0/4079178261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f4101120 0x7fe0f4107a60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 --2- 172.21.15.53:0/4079178261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f41007d0 0x7fe0f4100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 -- 172.21.15.53:0/4079178261 >> 172.21.15.53:0/4079178261 conn(0x7fe0f40f9f10 msgr2=0x7fe0f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 -- 172.21.15.53:0/4079178261 shutdown_connections 2024-09-16T00:48:37.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.681+0000 7fe0faebb700 1 -- 172.21.15.53:0/4079178261 wait complete. 2024-09-16T00:48:37.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.682+0000 7fe0faebb700 1 Processor -- start 2024-09-16T00:48:37.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0faebb700 1 -- start start 2024-09-16T00:48:37.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0faebb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0faebb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4101120 0x7fe0f41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33390/0 (socket says 172.21.15.53:33390) 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0faebb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41987d0 con 0x7fe0f41007d0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 -- 172.21.15.53:0/915783389 learned_addr learned my addr 172.21.15.53:0/915783389 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4198940 con 0x7fe0f4101120 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f3fff700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4101120 0x7fe0f41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 -- 172.21.15.53:0/915783389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4101120 msgr2=0x7fe0f41981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4101120 0x7fe0f41981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.683+0000 7fe0f8c57700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8009520 con 0x7fe0f41007d0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0f8c57700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800eab0 tx=0x7fe0e800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e800cba0 con 0x7fe0f41007d0 2024-09-16T00:48:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e00095f0 con 0x7fe0f41007d0 2024-09-16T00:48:37.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe0e80044d0 con 0x7fe0f41007d0 2024-09-16T00:48:37.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e80051f0 con 0x7fe0f41007d0 2024-09-16T00:48:37.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.684+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f419d790 con 0x7fe0f41007d0 2024-09-16T00:48:37.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.686+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4191df0 con 0x7fe0f41007d0 2024-09-16T00:48:37.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.687+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe0e800cd00 con 0x7fe0f41007d0 2024-09-16T00:48:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.687+0000 7fe0f1ffb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 0x7fe0e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.687+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe0e8014070 con 0x7fe0f41007d0 2024-09-16T00:48:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.688+0000 7fe0f3fff700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 0x7fe0e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.688+0000 7fe0f3fff700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 0x7fe0e406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0f41991a0 tx=0x7fe0e0009f70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:37.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:37.694+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe0e8059b40 con 0x7fe0f41007d0 2024-09-16T00:48:37.696 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:37 smithi053 ceph-mon[27950]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:37.696 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:37 smithi053 ceph-mon[27950]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:37.696 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:37 smithi053 ceph-mon[27950]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:37.696 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:37 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/205017193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:48:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:37 smithi152 ceph-mon[33237]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:37 smithi152 ceph-mon[33237]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:37 smithi152 ceph-mon[33237]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:37 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/205017193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:48:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.039+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f4061190 con 0x7fe0e406c680 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "", 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc image", 2024-09-16T00:48:38.043 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:48:38.044 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:48:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.041+0000 7fe0f1ffb700 1 -- 172.21.15.53:0/915783389 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fe0f4061190 con 0x7fe0e406c680 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.043+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 msgr2=0x7fe0e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.043+0000 7fe0faebb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 0x7fe0e406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0f41991a0 tx=0x7fe0e0009f70 comp rx=0 tx=0).stop 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.043+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 msgr2=0x7fe0f4197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.043+0000 7fe0faebb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800eab0 tx=0x7fe0e800edc0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.043+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 shutdown_connections 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe0e406c680 0x7fe0e406eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f41007d0 0x7fe0f4197c90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 --2- 172.21.15.53:0/915783389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0f4101120 0x7fe0f41981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 >> 172.21.15.53:0/915783389 conn(0x7fe0f40f9f10 msgr2=0x7fe0f40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 shutdown_connections 2024-09-16T00:48:38.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.044+0000 7fe0faebb700 1 -- 172.21.15.53:0/915783389 wait complete. 2024-09-16T00:48:38.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 -- 172.21.15.53:0/2390004062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030069230 msgr2=0x7fa030102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 --2- 172.21.15.53:0/2390004062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030069230 0x7fa030102e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa024009870 tx=0x7fa024009b80 comp rx=0 tx=0).stop 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 -- 172.21.15.53:0/2390004062 shutdown_connections 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 --2- 172.21.15.53:0/2390004062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030103350 0x7fa030105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 --2- 172.21.15.53:0/2390004062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030069230 0x7fa030102e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.215+0000 7fa036c81700 1 -- 172.21.15.53:0/2390004062 >> 172.21.15.53:0/2390004062 conn(0x7fa0300fa780 msgr2=0x7fa0300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.216+0000 7fa036c81700 1 -- 172.21.15.53:0/2390004062 shutdown_connections 2024-09-16T00:48:38.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.216+0000 7fa036c81700 1 -- 172.21.15.53:0/2390004062 wait complete. 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 Processor -- start 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 -- start start 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 0x7fa03019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 0x7fa03019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019cbd0 con 0x7fa030069230 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa036c81700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019cd10 con 0x7fa030103350 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.217+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 0x7fa03019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa034a1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 0x7fa03019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 0x7fa03019c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:54786/0 (socket says 172.21.15.53:54786) 2024-09-16T00:48:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa02ffff700 1 -- 172.21.15.53:0/2202697429 learned_addr learned my addr 172.21.15.53:0/2202697429 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:48:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa034a1d700 1 -- 172.21.15.53:0/2202697429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 msgr2=0x7fa03019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa034a1d700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 0x7fa03019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.218+0000 7fa034a1d700 1 -- 172.21.15.53:0/2202697429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024009520 con 0x7fa030069230 2024-09-16T00:48:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.219+0000 7fa034a1d700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 0x7fa03019c100 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa024000c00 tx=0x7fa02400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:38.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.219+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02401c070 con 0x7fa030069230 2024-09-16T00:48:38.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.219+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0301a1770 con 0x7fa030069230 2024-09-16T00:48:38.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.219+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa024022420 con 0x7fa030069230 2024-09-16T00:48:38.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.219+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0301a1c30 con 0x7fa030069230 2024-09-16T00:48:38.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.220+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02402c610 con 0x7fa030069230 2024-09-16T00:48:38.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.221+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0300fc340 con 0x7fa030069230 2024-09-16T00:48:38.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.222+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa024020070 con 0x7fa030069230 2024-09-16T00:48:38.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.222+0000 7fa02dffb700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 0x7fa02006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:48:38.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.222+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa02408c9b0 con 0x7fa030069230 2024-09-16T00:48:38.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.223+0000 7fa02ffff700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 0x7fa02006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:48:38.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.223+0000 7fa02ffff700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 0x7fa02006eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00ac30 tx=0x7fa01c005ef0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:48:38.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.231+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa02405ac80 con 0x7fa030069230 2024-09-16T00:48:38.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.700+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa03002cc30 con 0x7fa030069230 2024-09-16T00:48:38.702 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:38 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3292323470' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:48:38.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.700+0000 7fa02dffb700 1 -- 172.21.15.53:0/2202697429 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa02405a810 con 0x7fa030069230 2024-09-16T00:48:38.702 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 msgr2=0x7fa02006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 0x7fa02006eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00ac30 tx=0x7fa01c005ef0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 msgr2=0x7fa03019c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 0x7fa03019c100 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa024000c00 tx=0x7fa02400f740 comp rx=0 tx=0).stop 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 shutdown_connections 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa02006c680 0x7fa02006eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa030069230 0x7fa03019c100 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 --2- 172.21.15.53:0/2202697429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa030103350 0x7fa03019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:48:38.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.703+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 >> 172.21.15.53:0/2202697429 conn(0x7fa0300fa780 msgr2=0x7fa0301006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:48:38.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.704+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 shutdown_connections 2024-09-16T00:48:38.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:48:38.704+0000 7fa036c81700 1 -- 172.21.15.53:0/2202697429 wait complete. 2024-09-16T00:48:38.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:38 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3292323470' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:48:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:39 smithi053 ceph-mon[27950]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:39 smithi053 ceph-mon[27950]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:39 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2202697429' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:48:39.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:39 smithi152 ceph-mon[33237]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:48:39.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:39 smithi152 ceph-mon[33237]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:39.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:39 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2202697429' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:48:40.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:40 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:40.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:40 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:41 smithi053 ceph-mon[27950]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:41.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:41 smithi152 ceph-mon[33237]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:43.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:43 smithi053 ceph-mon[27950]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:43.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:43 smithi152 ceph-mon[33237]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:45.748 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:45 smithi152 ceph-mon[33237]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:45 smithi053 ceph-mon[27950]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:47.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:47 smithi152 ceph-mon[33237]: pgmap v217: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:47.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:47 smithi053 ceph-mon[27950]: pgmap v217: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:49.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:49 smithi152 ceph-mon[33237]: pgmap v218: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:49.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:49 smithi053 ceph-mon[27950]: pgmap v218: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:51.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:51 smithi152 ceph-mon[33237]: pgmap v219: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:51.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:51 smithi053 ceph-mon[27950]: pgmap v219: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:48:53.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:53 smithi152 ceph-mon[33237]: pgmap v220: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:53.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:53 smithi053 ceph-mon[27950]: pgmap v220: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:48:55.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:55 smithi152 ceph-mon[33237]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-16T00:48:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:55 smithi053 ceph-mon[27950]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-16T00:48:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:48:57.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:57 smithi152 ceph-mon[33237]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T00:48:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:57 smithi053 ceph-mon[27950]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T00:48:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:48:59 smithi152 ceph-mon[33237]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T00:48:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:48:59 smithi053 ceph-mon[27950]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-16T00:49:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:01 smithi152 ceph-mon[33237]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:49:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:01 smithi053 ceph-mon[27950]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:49:03.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:03 smithi152 ceph-mon[33237]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:49:03.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:03 smithi053 ceph-mon[27950]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:49:05.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:05 smithi152 ceph-mon[33237]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:49:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:05 smithi053 ceph-mon[27950]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:49:07.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:07 smithi152 ceph-mon[33237]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-16T00:49:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:07 smithi053 ceph-mon[27950]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-16T00:49:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.878+0000 7fa9178c7700 1 -- 172.21.15.53:0/1507088293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910100d60 msgr2=0x7fa910103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.878+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1507088293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910100d60 0x7fa910103140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009910 tx=0x7fa90c009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.879+0000 7fa9178c7700 1 -- 172.21.15.53:0/1507088293 shutdown_connections 2024-09-16T00:49:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.879+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1507088293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910103680 0x7fa910105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.879+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1507088293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910100d60 0x7fa910103140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.879+0000 7fa9178c7700 1 -- 172.21.15.53:0/1507088293 >> 172.21.15.53:0/1507088293 conn(0x7fa9100fa780 msgr2=0x7fa9100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.880+0000 7fa9178c7700 1 -- 172.21.15.53:0/1507088293 shutdown_connections 2024-09-16T00:49:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.880+0000 7fa9178c7700 1 -- 172.21.15.53:0/1507088293 wait complete. 2024-09-16T00:49:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.881+0000 7fa9178c7700 1 Processor -- start 2024-09-16T00:49:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.881+0000 7fa9178c7700 1 -- start start 2024-09-16T00:49:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa9178c7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 0x7fa910195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:08.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa9178c7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa914e62700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa915663700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 0x7fa910195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa914e62700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52234/0 (socket says 172.21.15.53:52234) 2024-09-16T00:49:08.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa915663700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 0x7fa910195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:41716/0 (socket says 172.21.15.53:41716) 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa914e62700 1 -- 172.21.15.53:0/1497691602 learned_addr learned my addr 172.21.15.53:0/1497691602 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910196610 con 0x7fa910103680 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.882+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910196750 con 0x7fa910100d60 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa914e62700 1 -- 172.21.15.53:0/1497691602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 msgr2=0x7fa910195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa914e62700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 0x7fa910195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa914e62700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0095f0 con 0x7fa910103680 2024-09-16T00:49:08.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa914e62700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa90000e920 tx=0x7fa90000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90000c9d0 con 0x7fa910103680 2024-09-16T00:49:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.883+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa900010430 con 0x7fa910103680 2024-09-16T00:49:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.884+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91019b200 con 0x7fa910103680 2024-09-16T00:49:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.884+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91019b690 con 0x7fa910103680 2024-09-16T00:49:08.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.884+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa900018650 con 0x7fa910103680 2024-09-16T00:49:08.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.885+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4005320 con 0x7fa910103680 2024-09-16T00:49:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.886+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa9000187b0 con 0x7fa910103680 2024-09-16T00:49:08.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.887+0000 7fa9067fc700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 0x7fa8fc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.887+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa900014070 con 0x7fa910103680 2024-09-16T00:49:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.887+0000 7fa915663700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 0x7fa8fc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:08.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.888+0000 7fa915663700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 0x7fa8fc06eb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009fd0 tx=0x7fa90c005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:08.896+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa900051720 con 0x7fa910103680 2024-09-16T00:49:09.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.186+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8f4000bf0 con 0x7fa8fc06c6d0 2024-09-16T00:49:09.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.188+0000 7fa9067fc700 1 -- 172.21.15.53:0/1497691602 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fa8f4000bf0 con 0x7fa8fc06c6d0 2024-09-16T00:49:09.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 msgr2=0x7fa8fc06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 0x7fa8fc06eb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009fd0 tx=0x7fa90c005a90 comp rx=0 tx=0).stop 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 msgr2=0x7fa910195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa90000e920 tx=0x7fa90000ec30 comp rx=0 tx=0).stop 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 shutdown_connections 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fa8fc06c6d0 0x7fa8fc06eb80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa910100d60 0x7fa910195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 --2- 172.21.15.53:0/1497691602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa910103680 0x7fa910195ff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 >> 172.21.15.53:0/1497691602 conn(0x7fa9100fa780 msgr2=0x7fa9100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 shutdown_connections 2024-09-16T00:49:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.191+0000 7fa9178c7700 1 -- 172.21.15.53:0/1497691602 wait complete. 2024-09-16T00:49:09.207 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:49:09.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 -- 172.21.15.53:0/755527968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 msgr2=0x7f2d800fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 --2- 172.21.15.53:0/755527968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d800fe910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009910 tx=0x7f2d70009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:09.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 -- 172.21.15.53:0/755527968 shutdown_connections 2024-09-16T00:49:09.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 --2- 172.21.15.53:0/755527968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d800ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 --2- 172.21.15.53:0/755527968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d800fe910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 -- 172.21.15.53:0/755527968 >> 172.21.15.53:0/755527968 conn(0x7f2d800f9f10 msgr2=0x7f2d800fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 -- 172.21.15.53:0/755527968 shutdown_connections 2024-09-16T00:49:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.321+0000 7f2d852a2700 1 -- 172.21.15.53:0/755527968 wait complete. 2024-09-16T00:49:09.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.322+0000 7f2d852a2700 1 Processor -- start 2024-09-16T00:49:09.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.322+0000 7f2d852a2700 1 -- start start 2024-09-16T00:49:09.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.322+0000 7f2d852a2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.322+0000 7f2d852a2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d852a2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80198870 con 0x7f2d800fe500 2024-09-16T00:49:09.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:41742/0 (socket says 172.21.15.53:41742) 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7e7fc700 1 -- 172.21.15.53:0/1906000948 learned_addr learned my addr 172.21.15.53:0/1906000948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52254/0 (socket says 172.21.15.53:52254) 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8019d280 con 0x7f2d800fee50 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7effd700 1 -- 172.21.15.53:0/1906000948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 msgr2=0x7f2d80198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7effd700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.323+0000 7f2d7effd700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700095f0 con 0x7f2d800fe500 2024-09-16T00:49:09.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d7e7fc700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:49:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d7effd700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d70000c00 tx=0x7f2d7000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7001d070 con 0x7f2d800fe500 2024-09-16T00:49:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d70005dc0 con 0x7f2d800fe500 2024-09-16T00:49:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d70017400 con 0x7f2d800fe500 2024-09-16T00:49:09.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.324+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8019d420 con 0x7f2d800fe500 2024-09-16T00:49:09.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.325+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8019d8e0 con 0x7f2d800fe500 2024-09-16T00:49:09.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.326+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8010af40 con 0x7f2d800fe500 2024-09-16T00:49:09.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.326+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2d70003810 con 0x7f2d800fe500 2024-09-16T00:49:09.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.327+0000 7f2d67fff700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 0x7f2d6806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.327+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2d7008cb60 con 0x7f2d800fe500 2024-09-16T00:49:09.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.328+0000 7f2d7e7fc700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 0x7f2d6806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.328+0000 7f2d7e7fc700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 0x7f2d6806eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d74011550 tx=0x7f2d74009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:09.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.332+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2d70057440 con 0x7f2d800fe500 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: Upgrade: Target is version 19.1.1-326-g8921c8ef (unknown) 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: Upgrade: Need to upgrade myself (mgr.smithi053.cjiiek) 2024-09-16T00:49:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:09 smithi053 ceph-mon[27950]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-16T00:49:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.577+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d801090c0 con 0x7f2d6806c6d0 2024-09-16T00:49:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.579+0000 7f2d67fff700 1 -- 172.21.15.53:0/1906000948 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f2d801090c0 con 0x7f2d6806c6d0 2024-09-16T00:49:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.581+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 msgr2=0x7f2d6806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.581+0000 7f2d852a2700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 0x7f2d6806eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d74011550 tx=0x7f2d74009260 comp rx=0 tx=0).stop 2024-09-16T00:49:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.581+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 msgr2=0x7f2d80197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.581+0000 7f2d852a2700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d70000c00 tx=0x7f2d7000f690 comp rx=0 tx=0).stop 2024-09-16T00:49:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 shutdown_connections 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f2d6806c6d0 0x7f2d6806eb80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d800fe500 0x7f2d80197d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 --2- 172.21.15.53:0/1906000948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d800fee50 0x7f2d80198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 >> 172.21.15.53:0/1906000948 conn(0x7f2d800f9f10 msgr2=0x7f2d801079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 shutdown_connections 2024-09-16T00:49:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.582+0000 7f2d852a2700 1 -- 172.21.15.53:0/1906000948 wait complete. 2024-09-16T00:49:09.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:09.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: Upgrade: Target is version 19.1.1-326-g8921c8ef (unknown) 2024-09-16T00:49:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, digests ['quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80'] 2024-09-16T00:49:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:49:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: Upgrade: Need to upgrade myself (mgr.smithi053.cjiiek) 2024-09-16T00:49:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:09 smithi152 ceph-mon[33237]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 -- 172.21.15.53:0/1357467943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 msgr2=0x7f0534105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 --2- 172.21.15.53:0/1357467943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f0534105a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0524009910 tx=0x7f0524009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 -- 172.21.15.53:0/1357467943 shutdown_connections 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 --2- 172.21.15.53:0/1357467943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f0534105a40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 --2- 172.21.15.53:0/1357467943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f0534103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.696+0000 7f053c3fd700 1 -- 172.21.15.53:0/1357467943 >> 172.21.15.53:0/1357467943 conn(0x7f05340fa700 msgr2=0x7f05340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.697+0000 7f053c3fd700 1 -- 172.21.15.53:0/1357467943 shutdown_connections 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.697+0000 7f053c3fd700 1 -- 172.21.15.53:0/1357467943 wait complete. 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.697+0000 7f053c3fd700 1 Processor -- start 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053c3fd700 1 -- start start 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053c3fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f053410ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053c3fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053c3fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053410f850 con 0x7f0534103660 2024-09-16T00:49:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053c3fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053410f990 con 0x7f0534100d40 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f0539998700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f0539998700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52274/0 (socket says 172.21.15.53:52274) 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f0539998700 1 -- 172.21.15.53:0/4093773992 learned_addr learned my addr 172.21.15.53:0/4093773992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f053a199700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f053410ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f0539998700 1 -- 172.21.15.53:0/4093773992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 msgr2=0x7f053410ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.698+0000 7f0539998700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f053410ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f0539998700 1 -- 172.21.15.53:0/4093773992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240095f0 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f053a199700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f053410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f0539998700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0524000c00 tx=0x7f052400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052401d070 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05341123d0 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05341128c0 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0524005dc0 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.699+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05240226a0 con 0x7f0534103660 2024-09-16T00:49:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.701+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0534100950 con 0x7f0534103660 2024-09-16T00:49:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.702+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0524003680 con 0x7f0534103660 2024-09-16T00:49:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.702+0000 7f052b7fe700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 0x7f052006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.703+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f052408cb00 con 0x7f0534103660 2024-09-16T00:49:09.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.708+0000 7f053a199700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 0x7f052006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:09.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.708+0000 7f053a199700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 0x7f052006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0530009be0 tx=0x7f0530009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:09.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:09.711+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f052405add0 con 0x7f0534103660 2024-09-16T00:49:10.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.041+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0534112bf0 con 0x7f052006c680 2024-09-16T00:49:10.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.054+0000 7f052b7fe700 1 -- 172.21.15.53:0/4093773992 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f0534112bf0 con 0x7f052006c680 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (5m) 62s ago 7m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (7m) 62s ago 7m 7453k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (6m) 71s ago 6m 7155k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (7m) 62s ago 7m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (6m) 71s ago 6m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (5m) 62s ago 6m 84.2M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (90s) 62s ago 89s 17.4M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (85s) 62s ago 84s 16.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:49:10.058 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (87s) 71s ago 87s 13.0M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (82s) 71s ago 82s 11.5M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:9283,8765,8443 running (8m) 62s ago 8m 487M - 18.2.0 dc2bc1663786 308f181966ac 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (6m) 71s ago 6m 438M - 18.2.0 dc2bc1663786 ad027230756c 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (8m) 62s ago 8m 44.1M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (6m) 71s ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (7m) 62s ago 7m 15.8M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 71s ago 6m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (5m) 62s ago 5m 50.7M 3948M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (4m) 62s ago 4m 47.4M 3948M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (4m) 62s ago 4m 45.7M 3948M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (3m) 71s ago 3m 46.7M 4970M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (3m) 71s ago 3m 44.0M 4970M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (3m) 71s ago 3m 44.7M 4970M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:49:10.059 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (5m) 62s ago 6m 63.0M - 2.43.0 a07b618ecd1d 61cdcd6b91c6 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 msgr2=0x7f052006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 0x7f052006eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0530009be0 tx=0x7f0530009260 comp rx=0 tx=0).stop 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 msgr2=0x7f053410f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0524000c00 tx=0x7f052400f740 comp rx=0 tx=0).stop 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 shutdown_connections 2024-09-16T00:49:10.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f052006c680 0x7f052006eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.056+0000 7f053c3fd700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0534100d40 0x7f053410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.057+0000 7f053c3fd700 1 --2- 172.21.15.53:0/4093773992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534103660 0x7f053410f230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.057+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 >> 172.21.15.53:0/4093773992 conn(0x7f05340fa700 msgr2=0x7f05340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:10.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.057+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 shutdown_connections 2024-09-16T00:49:10.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.058+0000 7f053c3fd700 1 -- 172.21.15.53:0/4093773992 wait complete. 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 -- 172.21.15.53:0/648754878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86141003d0 msgr2=0x7f8614100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 --2- 172.21.15.53:0/648754878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86141003d0 0x7f8614100840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8604009910 tx=0x7f8604009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 -- 172.21.15.53:0/648754878 shutdown_connections 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 --2- 172.21.15.53:0/648754878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86141003d0 0x7f8614100840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 --2- 172.21.15.53:0/648754878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86140ff130 0x7f86140ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 -- 172.21.15.53:0/648754878 >> 172.21.15.53:0/648754878 conn(0x7f86140fa780 msgr2=0x7f86140fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 -- 172.21.15.53:0/648754878 shutdown_connections 2024-09-16T00:49:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.168+0000 7f861b497700 1 -- 172.21.15.53:0/648754878 wait complete. 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.169+0000 7f861b497700 1 Processor -- start 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.169+0000 7f861b497700 1 -- start start 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.169+0000 7f861b497700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.169+0000 7f861b497700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86141003d0 0x7f86141981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f861b497700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86141987a0 con 0x7f86140ff130 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f861b497700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614198910 con 0x7f86141003d0 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52304/0 (socket says 172.21.15.53:52304) 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 -- 172.21.15.53:0/2229764406 learned_addr learned my addr 172.21.15.53:0/2229764406 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8618a32700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86141003d0 0x7f86141981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 -- 172.21.15.53:0/2229764406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86141003d0 msgr2=0x7f86141981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86141003d0 0x7f86141981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 -- 172.21.15.53:0/2229764406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040095f0 con 0x7f86140ff130 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f8619233700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f861000e920 tx=0x7f861000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.170+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861000c9d0 con 0x7f86140ff130 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.171+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8610010430 con 0x7f86140ff130 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.171+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861419d3a0 con 0x7f86140ff130 2024-09-16T00:49:10.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.171+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8610018650 con 0x7f86140ff130 2024-09-16T00:49:10.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.171+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861419d8c0 con 0x7f86140ff130 2024-09-16T00:49:10.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.172+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86141064c0 con 0x7f86140ff130 2024-09-16T00:49:10.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.173+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f86100105a0 con 0x7f86140ff130 2024-09-16T00:49:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.174+0000 7f860a7fc700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 0x7f860006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.174+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8610014070 con 0x7f86140ff130 2024-09-16T00:49:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.174+0000 7f8618a32700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 0x7f860006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.175+0000 7f8618a32700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 0x7f860006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8604009fd0 tx=0x7f8604005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:10.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.179+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8610051720 con 0x7f86140ff130 2024-09-16T00:49:10.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:10 smithi053 ceph-mon[27950]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 on smithi152 2024-09-16T00:49:10.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:10 smithi053 ceph-mon[27950]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:10.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.499+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8614061990 con 0x7f86140ff130 2024-09-16T00:49:10.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.499+0000 7f860a7fc700 1 -- 172.21.15.53:0/2229764406 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f8610056350 con 0x7f86140ff130 2024-09-16T00:49:10.500 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:49:10.500 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:49:10.500 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:49:10.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:49:10.501 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:49:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 msgr2=0x7f860006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 0x7f860006eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8604009fd0 tx=0x7f8604005940 comp rx=0 tx=0).stop 2024-09-16T00:49:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 msgr2=0x7f8614197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f861000e920 tx=0x7f861000ec30 comp rx=0 tx=0).stop 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 shutdown_connections 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f860006c680 0x7f860006eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86140ff130 0x7f8614197c60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 --2- 172.21.15.53:0/2229764406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86141003d0 0x7f86141981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 >> 172.21.15.53:0/2229764406 conn(0x7f86140fa780 msgr2=0x7f8614103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 shutdown_connections 2024-09-16T00:49:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.502+0000 7f861b497700 1 -- 172.21.15.53:0/2229764406 wait complete. 2024-09-16T00:49:10.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 -- 172.21.15.53:0/3171758104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0100c30 msgr2=0x7f0ef0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3171758104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0100c30 0x7f0ef0103010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009910 tx=0x7f0ee0009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:10.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 -- 172.21.15.53:0/3171758104 shutdown_connections 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3171758104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0103550 0x7f0ef0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3171758104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0100c30 0x7f0ef0103010 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 -- 172.21.15.53:0/3171758104 >> 172.21.15.53:0/3171758104 conn(0x7f0ef00fa610 msgr2=0x7f0ef00fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 -- 172.21.15.53:0/3171758104 shutdown_connections 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.615+0000 7f0ef593a700 1 -- 172.21.15.53:0/3171758104 wait complete. 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.616+0000 7f0ef593a700 1 Processor -- start 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.616+0000 7f0ef593a700 1 -- start start 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.616+0000 7f0ef593a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 0x7f0ef0100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.616+0000 7f0ef593a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.616+0000 7f0eee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eee7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52330/0 (socket says 172.21.15.53:52330) 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0ef593a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00ff120 con 0x7f0ef0103550 2024-09-16T00:49:10.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0ef593a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00ff260 con 0x7f0ef0100c30 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 0x7f0ef0100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eeeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 0x7f0ef0100540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:41794/0 (socket says 172.21.15.53:41794) 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eeeffd700 1 -- 172.21.15.53:0/3931638288 learned_addr learned my addr 172.21.15.53:0/3931638288 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eee7fc700 1 -- 172.21.15.53:0/3931638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 msgr2=0x7f0ef0100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eee7fc700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 0x7f0ef0100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:10.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eee7fc700 1 -- 172.21.15.53:0/3931638288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00095f0 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0eee7fc700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400e970 tx=0x7f0ee400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.617+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee400c9d0 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.618+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef00ff540 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.618+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ee4004030 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.618+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef00ffa30 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.618+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee4005020 con 0x7f0ef0103550 2024-09-16T00:49:10.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.619+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef018fab0 con 0x7f0ef0103550 2024-09-16T00:49:10.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.620+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0ee40041a0 con 0x7f0ef0103550 2024-09-16T00:49:10.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.620+0000 7f0ef4938700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 0x7f0ed806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:10.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.620+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0ee4014070 con 0x7f0ef0103550 2024-09-16T00:49:10.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.620+0000 7f0eeeffd700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 0x7f0ed806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:10.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.621+0000 7f0eeeffd700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 0x7f0ed806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009fd0 tx=0x7f0ee0005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:10.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:10.629+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0ee4059ce0 con 0x7f0ef0103550 2024-09-16T00:49:10.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:10 smithi152 ceph-mon[33237]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 on smithi152 2024-09-16T00:49:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:10 smithi152 ceph-mon[33237]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.121+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0ef0108bd0 con 0x7f0ef0103550 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.121+0000 7f0ef4938700 1 -- 172.21.15.53:0/3931638288 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f0ee4059870 con 0x7f0ef0103550 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:49:11.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:49:11.123 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:11.124 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:11.125 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 msgr2=0x7f0ed806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 0x7f0ed806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009fd0 tx=0x7f0ee0005940 comp rx=0 tx=0).stop 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 msgr2=0x7f0ef00febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400e970 tx=0x7f0ee400ec80 comp rx=0 tx=0).stop 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 shutdown_connections 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f0ed806c680 0x7f0ed806eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef0100c30 0x7f0ef0100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 --2- 172.21.15.53:0/3931638288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ef0103550 0x7f0ef00febe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 >> 172.21.15.53:0/3931638288 conn(0x7f0ef00fa610 msgr2=0x7f0ef00fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.124+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 shutdown_connections 2024-09-16T00:49:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.125+0000 7f0ef593a700 1 -- 172.21.15.53:0/3931638288 wait complete. 2024-09-16T00:49:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:49:11.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 -- 172.21.15.53:0/1698379814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4069230 msgr2=0x7fe0a4102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 --2- 172.21.15.53:0/1698379814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4069230 0x7fe0a4102e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009910 tx=0x7fe0a0009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 -- 172.21.15.53:0/1698379814 shutdown_connections 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 --2- 172.21.15.53:0/1698379814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0a4103350 0x7fe0a4105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 --2- 172.21.15.53:0/1698379814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4069230 0x7fe0a4102e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 -- 172.21.15.53:0/1698379814 >> 172.21.15.53:0/1698379814 conn(0x7fe0a40fa780 msgr2=0x7fe0a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:11.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 -- 172.21.15.53:0/1698379814 shutdown_connections 2024-09-16T00:49:11.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.237+0000 7fe0ab510700 1 -- 172.21.15.53:0/1698379814 wait complete. 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 Processor -- start 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 -- start start 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0a4069230 0x7fe0a4195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41965e0 con 0x7fe0a4103350 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0ab510700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4196720 con 0x7fe0a4069230 2024-09-16T00:49:11.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0a8aab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0a8aab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52346/0 (socket says 172.21.15.53:52346) 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.238+0000 7fe0a8aab700 1 -- 172.21.15.53:0/3695678039 learned_addr learned my addr 172.21.15.53:0/3695678039 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0a8aab700 1 -- 172.21.15.53:0/3695678039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0a4069230 msgr2=0x7fe0a4195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0a8aab700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0a4069230 0x7fe0a4195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0a8aab700 1 -- 172.21.15.53:0/3695678039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00095f0 con 0x7fe0a4103350 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0a8aab700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d900 tx=0x7fe09400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0940041f0 con 0x7fe0a4103350 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe094004ce0 con 0x7fe0a4103350 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a419b1d0 con 0x7fe0a4103350 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe09400b750 con 0x7fe0a4103350 2024-09-16T00:49:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.239+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a419b6d0 con 0x7fe0a4103350 2024-09-16T00:49:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.241+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a4108cf0 con 0x7fe0a4103350 2024-09-16T00:49:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.242+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe094004350 con 0x7fe0a4103350 2024-09-16T00:49:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.242+0000 7fe09a7fc700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 0x7fe09006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.242+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe09408b920 con 0x7fe0a4103350 2024-09-16T00:49:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.242+0000 7fe0a92ac700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 0x7fe09006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.243+0000 7fe0a92ac700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 0x7fe09006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b5c0 tx=0x7fe0a0005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:11.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.250+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe094059b40 con 0x7fe0a4103350 2024-09-16T00:49:11.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.511+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a4104010 con 0x7fe09006c680 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2229764406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:49:11.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:11 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3931638288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "0/23 daemons upgraded", 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 image on host smithi152", 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:49:11.513 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:49:11.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.512+0000 7fe09a7fc700 1 -- 172.21.15.53:0/3695678039 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fe0a4104010 con 0x7fe09006c680 2024-09-16T00:49:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 msgr2=0x7fe09006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 0x7fe09006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000b5c0 tx=0x7fe0a0005fd0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 msgr2=0x7fe0a4195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d900 tx=0x7fe09400dcc0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 shutdown_connections 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe09006c680 0x7fe09006eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0a4069230 0x7fe0a4195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 --2- 172.21.15.53:0/3695678039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0a4103350 0x7fe0a4195fc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 >> 172.21.15.53:0/3695678039 conn(0x7fe0a40fa780 msgr2=0x7fe0a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 shutdown_connections 2024-09-16T00:49:11.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.515+0000 7fe0ab510700 1 -- 172.21.15.53:0/3695678039 wait complete. 2024-09-16T00:49:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 -- 172.21.15.53:0/1416182464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 msgr2=0x7fe6641059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 --2- 172.21.15.53:0/1416182464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6641059e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe658009910 tx=0x7fe658009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 -- 172.21.15.53:0/1416182464 shutdown_connections 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 --2- 172.21.15.53:0/1416182464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6641059e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 --2- 172.21.15.53:0/1416182464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 0x7fe6641030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 -- 172.21.15.53:0/1416182464 >> 172.21.15.53:0/1416182464 conn(0x7fe6640fa700 msgr2=0x7fe6640fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 -- 172.21.15.53:0/1416182464 shutdown_connections 2024-09-16T00:49:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.630+0000 7fe668a6e700 1 -- 172.21.15.53:0/1416182464 wait complete. 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 Processor -- start 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 -- start start 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 0x7fe6641005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640ff1d0 con 0x7fe664103600 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe668a6e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640ff310 con 0x7fe664100ce0 2024-09-16T00:49:11.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe661d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe661d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52364/0 (socket says 172.21.15.53:52364) 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe661d9b700 1 -- 172.21.15.53:0/3620695021 learned_addr learned my addr 172.21.15.53:0/3620695021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.631+0000 7fe66259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 0x7fe6641005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe661d9b700 1 -- 172.21.15.53:0/3620695021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 msgr2=0x7fe6641005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe661d9b700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 0x7fe6641005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe661d9b700 1 -- 172.21.15.53:0/3620695021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580095f0 con 0x7fe664103600 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe661d9b700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe658005b40 tx=0x7fe65800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe65801d070 con 0x7fe664103600 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe65800f460 con 0x7fe664103600 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6640ff590 con 0x7fe664103600 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.632+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe658021620 con 0x7fe664103600 2024-09-16T00:49:11.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.633+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6640ffa80 con 0x7fe664103600 2024-09-16T00:49:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.634+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66418fc70 con 0x7fe664103600 2024-09-16T00:49:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.635+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe65800fa40 con 0x7fe664103600 2024-09-16T00:49:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.635+0000 7fe6537fe700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 0x7fe64c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.635+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe65808c980 con 0x7fe664103600 2024-09-16T00:49:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.636+0000 7fe66259c700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 0x7fe64c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.636+0000 7fe66259c700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 0x7fe64c06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe654007be0 tx=0x7fe6540073d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.640+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe65805ac20 con 0x7fe664103600 2024-09-16T00:49:11.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T00:49:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2229764406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:49:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:11 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3931638288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:49:11.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.929+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe66402cc30 con 0x7fe664103600 2024-09-16T00:49:11.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.930+0000 7fe6537fe700 1 -- 172.21.15.53:0/3620695021 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe65805a7b0 con 0x7fe664103600 2024-09-16T00:49:11.930 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:49:11.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 msgr2=0x7fe64c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 0x7fe64c06eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe654007be0 tx=0x7fe6540073d0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 msgr2=0x7fe6640fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe658005b40 tx=0x7fe65800bd70 comp rx=0 tx=0).stop 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 shutdown_connections 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fe64c06c680 0x7fe64c06eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe664100ce0 0x7fe6641005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 --2- 172.21.15.53:0/3620695021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe664103600 0x7fe6640fec90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 >> 172.21.15.53:0/3620695021 conn(0x7fe6640fa700 msgr2=0x7fe6640fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 shutdown_connections 2024-09-16T00:49:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:11.932+0000 7fe668a6e700 1 -- 172.21.15.53:0/3620695021 wait complete. 2024-09-16T00:49:12.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:12 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/3620695021' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:49:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:12 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/3620695021' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:49:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:13 smithi152 ceph-mon[33237]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:13 smithi152 ceph-mon[33237]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:13.702 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:13 smithi053 ceph-mon[27950]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:13.703 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:13 smithi053 ceph-mon[27950]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:15 smithi152 ceph-mon[33237]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:49:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:15 smithi053 ceph-mon[27950]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:49:16.773 INFO:tasks.workunit.client.1.smithi152.stderr:Updating files: 88% (11367/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T00:49:17.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:17 smithi152 ceph-mon[33237]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:17.717 INFO:tasks.workunit.client.1.smithi152.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T00:49:17.717 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.717 INFO:tasks.workunit.client.1.smithi152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: git switch -c 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr:Or undo this operation with: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.718 INFO:tasks.workunit.client.1.smithi152.stderr: git switch - 2024-09-16T00:49:17.719 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.719 INFO:tasks.workunit.client.1.smithi152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T00:49:17.719 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-16T00:49:17.719 INFO:tasks.workunit.client.1.smithi152.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T00:49:17.723 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-16T00:49:17.790 INFO:tasks.workunit.client.1.smithi152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T00:49:17.793 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T00:49:17.793 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T00:49:17.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:17 smithi053 ceph-mon[27950]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:18.492 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T00:49:18.563 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T00:49:18.604 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T00:49:18.605 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T00:49:18.606 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T00:49:18.646 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T00:49:18.650 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T00:49:18.650 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-16T00:49:18.707 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-16T00:49:18.708 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T00:49:18.709 DEBUG:teuthology.orchestra.run.smithi152:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-16T00:49:18.770 INFO:tasks.workunit.client.1.smithi152.stderr:+ mkdir -p fsstress 2024-09-16T00:49:18.772 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd fsstress 2024-09-16T00:49:18.772 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T00:49:18.772 INFO:tasks.workunit.client.1.smithi152.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T00:49:19.354 INFO:tasks.workunit.client.1.smithi152.stderr:+ tar xzf ltp-full.tgz 2024-09-16T00:49:19.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:19 smithi152 ceph-mon[33237]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:19 smithi053 ceph-mon[27950]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:49:21.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:21 smithi152 ceph-mon[33237]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-16T00:49:21.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:21 smithi053 ceph-mon[27950]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-16T00:49:23.529 INFO:tasks.workunit.client.0.smithi053.stderr:Updating files: 84% (10829/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T00:49:23.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:23 smithi152 ceph-mon[33237]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2.9 KiB/s wr, 1 op/s 2024-09-16T00:49:23.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:23 smithi053 ceph-mon[27950]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2.9 KiB/s wr, 1 op/s 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T00:49:24.657 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: git switch -c 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr:Or undo this operation with: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: git switch - 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-09-16T00:49:24.658 INFO:tasks.workunit.client.0.smithi053.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T00:49:24.664 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T00:49:24.704 INFO:tasks.workunit.client.0.smithi053.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T00:49:24.706 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T00:49:24.706 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T00:49:25.561 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T00:49:25.636 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T00:49:25.680 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T00:49:25.682 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T00:49:25.682 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T00:49:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:25 smithi152 ceph-mon[33237]: pgmap v236: 65 pgs: 65 active+clean; 12 MiB data, 181 MiB used, 536 GiB / 536 GiB avail; 385 KiB/s rd, 1019 KiB/s wr, 33 op/s 2024-09-16T00:49:25.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:25 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:25.723 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T00:49:25.727 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T00:49:25.728 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T00:49:25.785 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-16T00:49:25.787 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T00:49:25.787 DEBUG:teuthology.orchestra.run.smithi053:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-16T00:49:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:25 smithi053 ceph-mon[27950]: pgmap v236: 65 pgs: 65 active+clean; 12 MiB data, 181 MiB used, 536 GiB / 536 GiB avail; 385 KiB/s rd, 1019 KiB/s wr, 33 op/s 2024-09-16T00:49:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:25 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:25.843 INFO:tasks.workunit.client.0.smithi053.stderr:+ mkdir -p fsstress 2024-09-16T00:49:25.846 INFO:tasks.workunit.client.0.smithi053.stderr:+ pushd fsstress 2024-09-16T00:49:25.847 INFO:tasks.workunit.client.0.smithi053.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T00:49:25.847 INFO:tasks.workunit.client.0.smithi053.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T00:49:27.196 INFO:tasks.workunit.client.0.smithi053.stderr:+ tar xzf ltp-full.tgz 2024-09-16T00:49:27.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:27 smithi152 ceph-mon[33237]: pgmap v237: 65 pgs: 65 active+clean; 32 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 2.7 MiB/s wr, 156 op/s 2024-09-16T00:49:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:27 smithi053 ceph-mon[27950]: pgmap v237: 65 pgs: 65 active+clean; 32 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 2.7 MiB/s wr, 156 op/s 2024-09-16T00:49:29.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:29 smithi152 ceph-mon[33237]: pgmap v238: 65 pgs: 65 active+clean; 33 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-09-16T00:49:29.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:29 smithi053 ceph-mon[27950]: pgmap v238: 65 pgs: 65 active+clean; 33 MiB data, 259 MiB used, 536 GiB / 536 GiB avail; 778 KiB/s rd, 2.8 MiB/s wr, 182 op/s 2024-09-16T00:49:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:31 smithi152 ceph-mon[33237]: pgmap v239: 65 pgs: 65 active+clean; 46 MiB data, 325 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 263 op/s 2024-09-16T00:49:31.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:31 smithi053 ceph-mon[27950]: pgmap v239: 65 pgs: 65 active+clean; 46 MiB data, 325 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 263 op/s 2024-09-16T00:49:33.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:33 smithi152 ceph-mon[33237]: pgmap v240: 65 pgs: 65 active+clean; 46 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-09-16T00:49:33.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:33 smithi053 ceph-mon[27950]: pgmap v240: 65 pgs: 65 active+clean; 46 MiB data, 329 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 269 op/s 2024-09-16T00:49:35.605 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:35 smithi152 ceph-mon[33237]: pgmap v241: 65 pgs: 65 active+clean; 66 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.7 MiB/s wr, 321 op/s 2024-09-16T00:49:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:35 smithi053 ceph-mon[27950]: pgmap v241: 65 pgs: 65 active+clean; 66 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.7 MiB/s wr, 321 op/s 2024-09-16T00:49:37.586 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:37 smithi152 ceph-mon[33237]: pgmap v242: 65 pgs: 65 active+clean; 76 MiB data, 418 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 331 op/s 2024-09-16T00:49:37.587 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:37.587 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:49:37.587 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:49:37.587 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:37 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:49:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:37 smithi053 ceph-mon[27950]: pgmap v242: 65 pgs: 65 active+clean; 76 MiB data, 418 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 331 op/s 2024-09-16T00:49:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:49:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:49:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:37 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:49:38.666 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:38 smithi152 ceph-mon[33237]: Upgrade: Updating mgr.smithi152.nlmwrx 2024-09-16T00:49:38.666 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:38 smithi152 ceph-mon[33237]: Deploying daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:49:38.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:38 smithi053 ceph-mon[27950]: Upgrade: Updating mgr.smithi152.nlmwrx 2024-09-16T00:49:38.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:38 smithi053 ceph-mon[27950]: Deploying daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:49:39.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:39 smithi152 ceph-mon[33237]: pgmap v243: 65 pgs: 65 active+clean; 76 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-09-16T00:49:39.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:39 smithi053 ceph-mon[27950]: pgmap v243: 65 pgs: 65 active+clean; 76 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 207 op/s 2024-09-16T00:49:41.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:41.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:41.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:49:41.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:41 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:41.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:41 smithi152 ceph-mon[33237]: pgmap v244: 65 pgs: 65 active+clean; 89 MiB data, 452 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 200 op/s 2024-09-16T00:49:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:49:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:41 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:41 smithi053 ceph-mon[27950]: pgmap v244: 65 pgs: 65 active+clean; 89 MiB data, 452 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 200 op/s 2024-09-16T00:49:42.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 -- 172.21.15.53:0/1348368111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 msgr2=0x7fb2980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1348368111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb2980ff540 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb28800b0a0 tx=0x7fb28800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 -- 172.21.15.53:0/1348368111 shutdown_connections 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1348368111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb298100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1348368111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb2980ff540 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 -- 172.21.15.53:0/1348368111 >> 172.21.15.53:0/1348368111 conn(0x7fb2980fa780 msgr2=0x7fb2980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 -- 172.21.15.53:0/1348368111 shutdown_connections 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.099+0000 7fb29c97f700 1 -- 172.21.15.53:0/1348368111 wait complete. 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.100+0000 7fb29c97f700 1 Processor -- start 2024-09-16T00:49:42.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.100+0000 7fb29c97f700 1 -- start start 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.100+0000 7fb29c97f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb298197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.100+0000 7fb29c97f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb29c97f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2981987e0 con 0x7fb2980ff130 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb29c97f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298198950 con 0x7fb2981003d0 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:50614/0 (socket says 172.21.15.53:50614) 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 -- 172.21.15.53:0/1466403540 learned_addr learned my addr 172.21.15.53:0/1466403540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb29659c700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb298197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 -- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 msgr2=0x7fb298197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb298197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.101+0000 7fb28ffff700 1 -- 172.21.15.53:0/1466403540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288009d00 con 0x7fb2981003d0 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.102+0000 7fb28ffff700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d8d0 tx=0x7fb28000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.102+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb280009940 con 0x7fb2981003d0 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.102+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29819d3e0 con 0x7fb2981003d0 2024-09-16T00:49:42.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.102+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29819d930 con 0x7fb2981003d0 2024-09-16T00:49:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.103+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb280010460 con 0x7fb2981003d0 2024-09-16T00:49:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.103+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28000f5d0 con 0x7fb2981003d0 2024-09-16T00:49:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.104+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb278005320 con 0x7fb2981003d0 2024-09-16T00:49:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.105+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb280009aa0 con 0x7fb2981003d0 2024-09-16T00:49:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.106+0000 7fb28f7fe700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 0x7fb28406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.107+0000 7fb29659c700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 0x7fb28406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.107+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb28008b6f0 con 0x7fb2981003d0 2024-09-16T00:49:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.107+0000 7fb29659c700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 0x7fb28406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb288000f80 tx=0x7fb288006210 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.116+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb280055f30 con 0x7fb2981003d0 2024-09-16T00:49:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.525+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb278000bf0 con 0x7fb28406c680 2024-09-16T00:49:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.527+0000 7fb28f7fe700 1 -- 172.21.15.53:0/1466403540 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fb278000bf0 con 0x7fb28406c680 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 msgr2=0x7fb28406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 0x7fb28406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb288000f80 tx=0x7fb288006210 comp rx=0 tx=0).stop 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 msgr2=0x7fb2981981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb28000d8d0 tx=0x7fb28000dc90 comp rx=0 tx=0).stop 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 shutdown_connections 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7fb28406c680 0x7fb28406eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2980ff130 0x7fb298197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 --2- 172.21.15.53:0/1466403540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2981003d0 0x7fb2981981e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.529+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 >> 172.21.15.53:0/1466403540 conn(0x7fb2980fa780 msgr2=0x7fb298068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.530+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 shutdown_connections 2024-09-16T00:49:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.530+0000 7fb29c97f700 1 -- 172.21.15.53:0/1466403540 wait complete. 2024-09-16T00:49:42.540 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:49:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.646+0000 7f68021b6700 1 -- 172.21.15.53:0/1235234061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc103680 msgr2=0x7f67fc105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.646+0000 7f68021b6700 1 --2- 172.21.15.53:0/1235234061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc103680 0x7f67fc105a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009910 tx=0x7f67f0009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 -- 172.21.15.53:0/1235234061 shutdown_connections 2024-09-16T00:49:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 --2- 172.21.15.53:0/1235234061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc103680 0x7f67fc105a60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 --2- 172.21.15.53:0/1235234061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc100d60 0x7f67fc103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 -- 172.21.15.53:0/1235234061 >> 172.21.15.53:0/1235234061 conn(0x7f67fc0fa780 msgr2=0x7f67fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 -- 172.21.15.53:0/1235234061 shutdown_connections 2024-09-16T00:49:42.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 -- 172.21.15.53:0/1235234061 wait complete. 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 Processor -- start 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.647+0000 7f68021b6700 1 -- start start 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f68021b6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f68021b6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 0x7f67fc198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f68021b6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc198850 con 0x7f67fc100d60 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f68021b6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc19d260 con 0x7f67fc103680 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67fb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67fb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56576/0 (socket says 172.21.15.53:56576) 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67fb7fe700 1 -- 172.21.15.53:0/2297184348 learned_addr learned my addr 172.21.15.53:0/2297184348 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67faffd700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 0x7f67fc198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67faffd700 1 -- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 msgr2=0x7f67fc197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67faffd700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67faffd700 1 -- 172.21.15.53:0/2297184348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00095f0 con 0x7f67fc103680 2024-09-16T00:49:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.648+0000 7f67fb7fe700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:49:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f67faffd700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 0x7f67fc198230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009910 tx=0x7f67f000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f001d070 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc19d400 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f67f000f460 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67f0021640 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.649+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc19d8c0 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.650+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc0fc340 con 0x7f67fc103680 2024-09-16T00:49:42.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.651+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f67f0003a60 con 0x7f67fc103680 2024-09-16T00:49:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.652+0000 7f67f8ff9700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 0x7f67e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.652+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f67f008c910 con 0x7f67fc103680 2024-09-16T00:49:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.652+0000 7f67fb7fe700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 0x7f67e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:42.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.652+0000 7f67fb7fe700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 0x7f67e406eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67fc1991d0 tx=0x7f67ec007480 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.660+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f67f00570e0 con 0x7f67fc103680 2024-09-16T00:49:42.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.904+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67fc061190 con 0x7f67e406c680 2024-09-16T00:49:42.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.905+0000 7f67f8ff9700 1 -- 172.21.15.53:0/2297184348 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f67fc061190 con 0x7f67e406c680 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 msgr2=0x7f67e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 0x7f67e406eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f67fc1991d0 tx=0x7f67ec007480 comp rx=0 tx=0).stop 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 msgr2=0x7f67fc198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 0x7f67fc198230 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009910 tx=0x7f67f000bd70 comp rx=0 tx=0).stop 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 shutdown_connections 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f67e406c680 0x7f67e406eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67fc100d60 0x7f67fc197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 --2- 172.21.15.53:0/2297184348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67fc103680 0x7f67fc198230 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 >> 172.21.15.53:0/2297184348 conn(0x7f67fc0fa780 msgr2=0x7f67fc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 shutdown_connections 2024-09-16T00:49:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:42.907+0000 7f68021b6700 1 -- 172.21.15.53:0/2297184348 wait complete. 2024-09-16T00:49:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.028+0000 7f6395c75700 1 -- 172.21.15.53:0/4265992871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63900ff130 msgr2=0x7f63900ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.028+0000 7f6395c75700 1 --2- 172.21.15.53:0/4265992871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63900ff130 0x7f63900ff540 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6380009910 tx=0x7f6380009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.028+0000 7f6395c75700 1 -- 172.21.15.53:0/4265992871 shutdown_connections 2024-09-16T00:49:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 --2- 172.21.15.53:0/4265992871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63901003d0 0x7f6390100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 --2- 172.21.15.53:0/4265992871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63900ff130 0x7f63900ff540 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 -- 172.21.15.53:0/4265992871 >> 172.21.15.53:0/4265992871 conn(0x7f63900fa780 msgr2=0x7f63900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 -- 172.21.15.53:0/4265992871 shutdown_connections 2024-09-16T00:49:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 -- 172.21.15.53:0/4265992871 wait complete. 2024-09-16T00:49:43.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 Processor -- start 2024-09-16T00:49:43.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.029+0000 7f6395c75700 1 -- start start 2024-09-16T00:49:43.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f6395c75700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 0x7f63900690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f6395c75700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f6395c75700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639019ade0 con 0x7f63901003d0 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f6395c75700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639019af20 con 0x7f63900ff130 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56596/0 (socket says 172.21.15.53:56596) 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638effd700 1 -- 172.21.15.53:0/1468845890 learned_addr learned my addr 172.21.15.53:0/1468845890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638f7fe700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 0x7f63900690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638f7fe700 1 -- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 msgr2=0x7f639019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638f7fe700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638f7fe700 1 -- 172.21.15.53:0/1468845890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800095f0 con 0x7f63900ff130 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.030+0000 7f638effd700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f638f7fe700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 0x7f63900690a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6380000c00 tx=0x7f638000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f638001d070 con 0x7f63900ff130 2024-09-16T00:49:43.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6380005dc0 con 0x7f63900ff130 2024-09-16T00:49:43.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639019b1a0 con 0x7f63900ff130 2024-09-16T00:49:43.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6380021410 con 0x7f63900ff130 2024-09-16T00:49:43.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.031+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639019b630 con 0x7f63900ff130 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.032+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6390107c10 con 0x7f63900ff130 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.033+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f63800050d0 con 0x7f63900ff130 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.033+0000 7f638cff9700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 0x7f637806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.033+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f638008c9d0 con 0x7f63900ff130 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.033+0000 7f638effd700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 0x7f637806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.034+0000 7f638effd700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 0x7f637806eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6390069620 tx=0x7f6384009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.037+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f638005ab70 con 0x7f63900ff130 2024-09-16T00:49:43.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.309+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6390104d20 con 0x7f637806c680 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.320+0000 7f638cff9700 1 -- 172.21.15.53:0/1468845890 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3576 (secure 0 0 0) 0x7f6390104d20 con 0x7f637806c680 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (6m) 95s ago 7m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (7m) 95s ago 7m 7453k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (6m) 104s ago 6m 7155k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (7m) 95s ago 7m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (6m) 104s ago 6m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:49:43.321 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (6m) 95s ago 7m 84.2M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (2m) 95s ago 2m 17.4M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (118s) 95s ago 117s 16.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (2m) 104s ago 2m 13.0M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (115s) 104s ago 115s 11.5M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:9283,8765,8443 running (9m) 95s ago 9m 487M - 18.2.0 dc2bc1663786 308f181966ac 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 starting - - - - 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (9m) 95s ago 9m 44.1M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (6m) 104s ago 6m 36.1M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (7m) 95s ago 7m 15.8M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 104s ago 6m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (5m) 95s ago 5m 50.7M 3948M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (5m) 95s ago 5m 47.4M 3948M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (4m) 95s ago 4m 45.7M 3948M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:49:43.322 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (4m) 104s ago 4m 46.7M 4970M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:49:43.323 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (4m) 104s ago 4m 44.0M 4970M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:49:43.323 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (3m) 104s ago 3m 44.7M 4970M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:49:43.323 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (5m) 95s ago 7m 63.0M - 2.43.0 a07b618ecd1d 61cdcd6b91c6 2024-09-16T00:49:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 msgr2=0x7f637806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 0x7f637806eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6390069620 tx=0x7f6384009260 comp rx=0 tx=0).stop 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 msgr2=0x7f63900690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 0x7f63900690a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6380000c00 tx=0x7f638000fa00 comp rx=0 tx=0).stop 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 shutdown_connections 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f637806c680 0x7f637806eb30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63900ff130 0x7f63900690a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 --2- 172.21.15.53:0/1468845890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63901003d0 0x7f639019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.322+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 >> 172.21.15.53:0/1468845890 conn(0x7f63900fa780 msgr2=0x7f6390103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.323+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 shutdown_connections 2024-09-16T00:49:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.323+0000 7f6395c75700 1 -- 172.21.15.53:0/1468845890 wait complete. 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 -- 172.21.15.53:0/1481574075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 msgr2=0x7f4b8c100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 --2- 172.21.15.53:0/1481574075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c100660 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009910 tx=0x7f4b7c009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 -- 172.21.15.53:0/1481574075 shutdown_connections 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 --2- 172.21.15.53:0/1481574075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 --2- 172.21.15.53:0/1481574075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c100660 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 -- 172.21.15.53:0/1481574075 >> 172.21.15.53:0/1481574075 conn(0x7f4b8c0fb7e0 msgr2=0x7f4b8c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.437+0000 7f4b90b72700 1 -- 172.21.15.53:0/1481574075 shutdown_connections 2024-09-16T00:49:43.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.438+0000 7f4b90b72700 1 -- 172.21.15.53:0/1481574075 wait complete. 2024-09-16T00:49:43.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.438+0000 7f4b90b72700 1 Processor -- start 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.438+0000 7f4b90b72700 1 -- start start 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b90b72700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b90b72700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b90b72700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c196640 con 0x7f4b8c100250 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b90b72700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c196780 con 0x7f4b8c101450 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b8a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b8a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56614/0 (socket says 172.21.15.53:56614) 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b8a59c700 1 -- 172.21.15.53:0/2210549576 learned_addr learned my addr 172.21.15.53:0/2210549576 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b89d9b700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b89d9b700 1 -- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 msgr2=0x7f4b8c195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b89d9b700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.439+0000 7f4b89d9b700 1 -- 172.21.15.53:0/2210549576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0095f0 con 0x7f4b8c101450 2024-09-16T00:49:43.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b89d9b700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c196020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e970 tx=0x7f4b8000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8000c9d0 con 0x7f4b8c101450 2024-09-16T00:49:43.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b80010430 con 0x7f4b8c101450 2024-09-16T00:49:43.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b80018650 con 0x7f4b8c101450 2024-09-16T00:49:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c19b230 con 0x7f4b8c101450 2024-09-16T00:49:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.440+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c19b780 con 0x7f4b8c101450 2024-09-16T00:49:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.441+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c108da0 con 0x7f4b8c101450 2024-09-16T00:49:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.441+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4b800105a0 con 0x7f4b8c101450 2024-09-16T00:49:43.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.442+0000 7f4b7b7fe700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 0x7f4b7406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.442+0000 7f4b8a59c700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 0x7f4b7406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.442+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4b80014070 con 0x7f4b8c101450 2024-09-16T00:49:43.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.443+0000 7f4b8a59c700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 0x7f4b7406eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c006010 tx=0x7f4b7c005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.446+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4b80051720 con 0x7f4b8c101450 2024-09-16T00:49:43.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:43 smithi152 ceph-mon[33237]: pgmap v245: 65 pgs: 65 active+clean; 94 MiB data, 501 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 187 op/s 2024-09-16T00:49:43.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.784+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b8c108f90 con 0x7f4b8c101450 2024-09-16T00:49:43.785 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:43 smithi053 ceph-mon[27950]: pgmap v245: 65 pgs: 65 active+clean; 94 MiB data, 501 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 187 op/s 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.785+0000 7f4b7b7fe700 1 -- 172.21.15.53:0/2210549576 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f4b80059d10 con 0x7f4b8c101450 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:43.786 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:43.787 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:49:43.788 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:49:43.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 msgr2=0x7f4b7406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 0x7f4b7406eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c006010 tx=0x7f4b7c005a90 comp rx=0 tx=0).stop 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 msgr2=0x7f4b8c196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c196020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e970 tx=0x7f4b8000ec80 comp rx=0 tx=0).stop 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 shutdown_connections 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f4b7406c680 0x7f4b7406eb30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b8c100250 0x7f4b8c195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 --2- 172.21.15.53:0/2210549576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8c101450 0x7f4b8c196020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 >> 172.21.15.53:0/2210549576 conn(0x7f4b8c0fb7e0 msgr2=0x7f4b8c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:43.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 shutdown_connections 2024-09-16T00:49:43.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.788+0000 7f4b90b72700 1 -- 172.21.15.53:0/2210549576 wait complete. 2024-09-16T00:49:43.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 -- 172.21.15.53:0/3506030390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178100250 msgr2=0x7f8178100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 --2- 172.21.15.53:0/3506030390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178100250 0x7f8178100660 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8168009910 tx=0x7f8168009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 -- 172.21.15.53:0/3506030390 shutdown_connections 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 --2- 172.21.15.53:0/3506030390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178101450 0x7f81781018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 --2- 172.21.15.53:0/3506030390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178100250 0x7f8178100660 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 -- 172.21.15.53:0/3506030390 >> 172.21.15.53:0/3506030390 conn(0x7f81780fb7e0 msgr2=0x7f81780fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 -- 172.21.15.53:0/3506030390 shutdown_connections 2024-09-16T00:49:43.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.902+0000 7f817d87b700 1 -- 172.21.15.53:0/3506030390 wait complete. 2024-09-16T00:49:43.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 Processor -- start 2024-09-16T00:49:43.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 -- start start 2024-09-16T00:49:43.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178100250 0x7f8178074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178073680 con 0x7f8178101450 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f817d87b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780737c0 con 0x7f8178100250 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f81767fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f81767fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56626/0 (socket says 172.21.15.53:56626) 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f81767fc700 1 -- 172.21.15.53:0/321842211 learned_addr learned my addr 172.21.15.53:0/321842211 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.903+0000 7f8176ffd700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178100250 0x7f8178074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f81767fc700 1 -- 172.21.15.53:0/321842211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178100250 msgr2=0x7f8178074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f81767fc700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178100250 0x7f8178074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f81767fc700 1 -- 172.21.15.53:0/321842211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680095f0 con 0x7f8178101450 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f81767fc700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e920 tx=0x7f816c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c00c9d0 con 0x7f8178101450 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f816c010430 con 0x7f8178101450 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.904+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8178073aa0 con 0x7f8178101450 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.905+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c018650 con 0x7f8178101450 2024-09-16T00:49:43.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.905+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8178073f30 con 0x7f8178101450 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.906+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f816c0105a0 con 0x7f8178101450 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.906+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817804f2a0 con 0x7f8178101450 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.906+0000 7f817c879700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 0x7f816006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.907+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f816c014070 con 0x7f8178101450 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.907+0000 7f8176ffd700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 0x7f816006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:43.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.907+0000 7f8176ffd700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 0x7f816006e920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f816800b6f0 tx=0x7f8168005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:43.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:43.915+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f816c059f80 con 0x7f8178101450 2024-09-16T00:49:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.176+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f817819e2b0 con 0x7f8178101450 2024-09-16T00:49:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.177+0000 7f817c879700 1 -- 172.21.15.53:0/321842211 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f816c059b10 con 0x7f8178101450 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:49:44.178 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:49:44.179 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:49:44.180 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:44.181 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:49:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 msgr2=0x7f816006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 0x7f816006e920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f816800b6f0 tx=0x7f8168005940 comp rx=0 tx=0).stop 2024-09-16T00:49:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 msgr2=0x7f8178073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e920 tx=0x7f816c00ec30 comp rx=0 tx=0).stop 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 shutdown_connections 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f816006c470 0x7f816006e920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8178100250 0x7f8178074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 --2- 172.21.15.53:0/321842211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8178101450 0x7f8178073140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.180+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 >> 172.21.15.53:0/321842211 conn(0x7f81780fb7e0 msgr2=0x7f8178104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.181+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 shutdown_connections 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.181+0000 7f817d87b700 1 -- 172.21.15.53:0/321842211 wait complete. 2024-09-16T00:49:44.182 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 -- 172.21.15.53:0/41707871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 msgr2=0x7f186c100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 --2- 172.21.15.53:0/41707871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c100660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f185c009910 tx=0x7f185c009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 -- 172.21.15.53:0/41707871 shutdown_connections 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 --2- 172.21.15.53:0/41707871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 0x7f186c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 --2- 172.21.15.53:0/41707871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c100660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 -- 172.21.15.53:0/41707871 >> 172.21.15.53:0/41707871 conn(0x7f186c0fb7e0 msgr2=0x7f186c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 -- 172.21.15.53:0/41707871 shutdown_connections 2024-09-16T00:49:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.301+0000 7f1870fec700 1 -- 172.21.15.53:0/41707871 wait complete. 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.302+0000 7f1870fec700 1 Processor -- start 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.302+0000 7f1870fec700 1 -- start start 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f1870fec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f1870fec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 0x7f186c196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f1870fec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c196650 con 0x7f186c100250 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f1870fec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c196790 con 0x7f186c101450 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56648/0 (socket says 172.21.15.53:56648) 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 -- 172.21.15.53:0/3279201685 learned_addr learned my addr 172.21.15.53:0/3279201685 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:44.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f1869d9b700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 0x7f186c196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 -- 172.21.15.53:0/3279201685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 msgr2=0x7f186c196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 0x7f186c196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.303+0000 7f186a59c700 1 -- 172.21.15.53:0/3279201685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0095f0 con 0x7f186c100250 2024-09-16T00:49:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.304+0000 7f186a59c700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f185c006010 tx=0x7f185c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.305+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c01d070 con 0x7f186c100250 2024-09-16T00:49:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.305+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f185c00beb0 con 0x7f186c100250 2024-09-16T00:49:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.305+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c0226a0 con 0x7f186c100250 2024-09-16T00:49:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.305+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c072f80 con 0x7f186c100250 2024-09-16T00:49:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.306+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0733f0 con 0x7f186c100250 2024-09-16T00:49:44.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.309+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f185c0051d0 con 0x7f186c100250 2024-09-16T00:49:44.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.309+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c108da0 con 0x7f186c100250 2024-09-16T00:49:44.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.310+0000 7f185b7fe700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 0x7f185406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.310+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f185c08cb20 con 0x7f186c100250 2024-09-16T00:49:44.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.310+0000 7f1869d9b700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 0x7f185406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.311+0000 7f1869d9b700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 0x7f185406ebd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1860009bf0 tx=0x7f1860009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:44.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.315+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f185c05ae80 con 0x7f186c100250 2024-09-16T00:49:44.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.574+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 --> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f186c105da0 con 0x7f185406c720 2024-09-16T00:49:44.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.575+0000 7f185b7fe700 1 -- 172.21.15.53:0/3279201685 <== mgr.14213 v2:172.21.15.53:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f186c105da0 con 0x7f185406c720 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "", 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:49:44.577 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 msgr2=0x7f185406ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 0x7f185406ebd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1860009bf0 tx=0x7f1860009260 comp rx=0 tx=0).stop 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 msgr2=0x7f186c195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f185c006010 tx=0x7f185c00fab0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 shutdown_connections 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f185406c720 0x7f185406ebd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f186c100250 0x7f186c195af0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 --2- 172.21.15.53:0/3279201685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f186c101450 0x7f186c196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 >> 172.21.15.53:0/3279201685 conn(0x7f186c0fb7e0 msgr2=0x7f186c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:44.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 shutdown_connections 2024-09-16T00:49:44.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.578+0000 7f1870fec700 1 -- 172.21.15.53:0/3279201685 wait complete. 2024-09-16T00:49:44.605 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:44 smithi152 ceph-mon[33237]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:44 smithi152 ceph-mon[33237]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:44 smithi152 ceph-mon[33237]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:44 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2210549576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:49:44.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:44 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/321842211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:49:44.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 -- 172.21.15.53:0/2539019864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 msgr2=0x7f7b58105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 --2- 172.21.15.53:0/2539019864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b58105a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009910 tx=0x7f7b48009c20 comp rx=0 tx=0).stop 2024-09-16T00:49:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 -- 172.21.15.53:0/2539019864 shutdown_connections 2024-09-16T00:49:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 --2- 172.21.15.53:0/2539019864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b58105a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 --2- 172.21.15.53:0/2539019864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 0x7f7b58103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 -- 172.21.15.53:0/2539019864 >> 172.21.15.53:0/2539019864 conn(0x7f7b580fa700 msgr2=0x7f7b580fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:44.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:44 smithi053 ceph-mon[27950]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:44 smithi053 ceph-mon[27950]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:44 smithi053 ceph-mon[27950]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:44.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:44 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2210549576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:49:44.706 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:44 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/321842211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 -- 172.21.15.53:0/2539019864 shutdown_connections 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.705+0000 7f7b60033700 1 -- 172.21.15.53:0/2539019864 wait complete. 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 Processor -- start 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 -- start start 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 0x7f7b58100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580ff230 con 0x7f7b58103660 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b60033700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580ff370 con 0x7f7b58100d40 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b5d5ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b5d5ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56670/0 (socket says 172.21.15.53:56670) 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.706+0000 7f7b5d5ce700 1 -- 172.21.15.53:0/1474017851 learned_addr learned my addr 172.21.15.53:0/1474017851 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:49:44.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b5d5ce700 1 -- 172.21.15.53:0/1474017851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 msgr2=0x7f7b58100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b5ddcf700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 0x7f7b58100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b5d5ce700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 0x7f7b58100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b5d5ce700 1 -- 172.21.15.53:0/1474017851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480095f0 con 0x7f7b58103660 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b5d5ce700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000c00 tx=0x7f7b4800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b4801d070 con 0x7f7b58103660 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580ff5f0 con 0x7f7b58103660 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b48005dc0 con 0x7f7b58103660 2024-09-16T00:49:44.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b480226a0 con 0x7f7b58103660 2024-09-16T00:49:44.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.707+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580ffae0 con 0x7f7b58103660 2024-09-16T00:49:44.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.709+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5818fc70 con 0x7f7b58103660 2024-09-16T00:49:44.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.710+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7b48003680 con 0x7f7b58103660 2024-09-16T00:49:44.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.711+0000 7f7b4effd700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 0x7f7b4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:49:44.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.711+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7b4808cb50 con 0x7f7b58103660 2024-09-16T00:49:44.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.711+0000 7f7b5ddcf700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 0x7f7b4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:49:44.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.712+0000 7f7b5ddcf700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 0x7f7b4406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009b30 tx=0x7f7b54009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:49:44.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:44.719+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7b4805ae20 con 0x7f7b58103660 2024-09-16T00:49:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.087+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7b5802cc30 con 0x7f7b58103660 2024-09-16T00:49:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.087+0000 7f7b4effd700 1 -- 172.21.15.53:0/1474017851 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7b4800fba0 con 0x7f7b58103660 2024-09-16T00:49:45.088 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:49:45.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 msgr2=0x7f7b4406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:45.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 0x7f7b4406eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009b30 tx=0x7f7b54009260 comp rx=0 tx=0).stop 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 msgr2=0x7f7b580fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000c00 tx=0x7f7b4800f740 comp rx=0 tx=0).stop 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 shutdown_connections 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:6800/2,v1:172.21.15.53:6801/2] conn(0x7f7b4406c680 0x7f7b4406eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b58100d40 0x7f7b58100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 --2- 172.21.15.53:0/1474017851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b58103660 0x7f7b580fecf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 >> 172.21.15.53:0/1474017851 conn(0x7f7b580fa700 msgr2=0x7f7b580fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 shutdown_connections 2024-09-16T00:49:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:49:45.090+0000 7f7b60033700 1 -- 172.21.15.53:0/1474017851 wait complete. 2024-09-16T00:49:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:45 smithi152 ceph-mon[33237]: pgmap v246: 65 pgs: 65 active+clean; 122 MiB data, 593 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 496 op/s 2024-09-16T00:49:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:45 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1474017851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:49:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:45 smithi053 ceph-mon[27950]: pgmap v246: 65 pgs: 65 active+clean; 122 MiB data, 593 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 496 op/s 2024-09-16T00:49:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:45 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1474017851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:49:46.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:46.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:49:46.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:49:46.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:49:46.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:49:46.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:49:46.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:46 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:49:46.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:49:46.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:49:46.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:49:46.743 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:49:46.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:49:46.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:49:46.744 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:46 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:49:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:47 smithi152 ceph-mon[33237]: pgmap v247: 65 pgs: 65 active+clean; 146 MiB data, 712 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.1 MiB/s wr, 785 op/s 2024-09-16T00:49:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:47 smithi152 ceph-mon[33237]: mgrmap e20: smithi053.cjiiek(active, since 7m), standbys: smithi152.nlmwrx 2024-09-16T00:49:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:47 smithi053 ceph-mon[27950]: pgmap v247: 65 pgs: 65 active+clean; 146 MiB data, 712 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.1 MiB/s wr, 785 op/s 2024-09-16T00:49:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:47 smithi053 ceph-mon[27950]: mgrmap e20: smithi053.cjiiek(active, since 7m), standbys: smithi152.nlmwrx 2024-09-16T00:49:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:49 smithi053 ceph-mon[27950]: pgmap v248: 65 pgs: 65 active+clean; 147 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 748 op/s 2024-09-16T00:49:49.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:49 smithi152 ceph-mon[33237]: pgmap v248: 65 pgs: 65 active+clean; 147 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 6.3 MiB/s wr, 748 op/s 2024-09-16T00:49:51.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:51 smithi152 ceph-mon[33237]: pgmap v249: 65 pgs: 65 active+clean; 161 MiB data, 754 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-16T00:49:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:51 smithi053 ceph-mon[27950]: pgmap v249: 65 pgs: 65 active+clean; 161 MiB data, 754 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-16T00:49:52.869 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:52.870 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:52.870 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:52.870 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:52 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:52.870 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:52 smithi152 ceph-mon[33237]: pgmap v250: 65 pgs: 65 active+clean; 166 MiB data, 779 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 795 op/s 2024-09-16T00:49:53.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:53.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:53.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:53.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:52 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:49:53.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:52 smithi053 ceph-mon[27950]: pgmap v250: 65 pgs: 65 active+clean; 166 MiB data, 779 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 795 op/s 2024-09-16T00:49:54.244 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T00:49:54.255 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T00:49:54.255 INFO:tasks.workunit.client.1.smithi152.stderr:+ make 2024-09-16T00:49:55.508 INFO:tasks.workunit.client.1.smithi152.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T00:49:55.717 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:55 smithi152 ceph-mon[33237]: pgmap v251: 65 pgs: 65 active+clean; 170 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 729 op/s 2024-09-16T00:49:55.717 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:55 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:55.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:55 smithi053 ceph-mon[27950]: pgmap v251: 65 pgs: 65 active+clean; 170 MiB data, 802 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 729 op/s 2024-09-16T00:49:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:55 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:49:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:57 smithi053 ceph-mon[27950]: pgmap v252: 65 pgs: 65 active+clean; 174 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 413 op/s 2024-09-16T00:49:57.855 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:57 smithi152 ceph-mon[33237]: pgmap v252: 65 pgs: 65 active+clean; 174 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 413 op/s 2024-09-16T00:49:57.948 INFO:tasks.workunit.client.1.smithi152.stderr:++ readlink -f fsstress 2024-09-16T00:49:57.949 INFO:tasks.workunit.client.1.smithi152.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T00:49:57.949 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2024-09-16T00:49:57.949 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T00:49:57.949 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2024-09-16T00:49:57.950 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-16T00:49:57.950 INFO:tasks.workunit.client.1.smithi152.stderr:++ mktemp -d -p . 2024-09-16T00:49:57.951 INFO:tasks.workunit.client.1.smithi152.stderr:+ T=./tmp.nLu4CAjACW 2024-09-16T00:49:57.951 INFO:tasks.workunit.client.1.smithi152.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.nLu4CAjACW -l 1 -n 1000 -p 10 -v 2024-09-16T00:49:57.953 INFO:tasks.workunit.client.1.smithi152.stdout:seed = 1726549647 2024-09-16T00:49:57.958 INFO:tasks.workunit.client.1.smithi152.stdout:0/0: mknod c0 0 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/0: readlink - no filename 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/1: dread - no filename 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/2: dwrite - no filename 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/3: chown . 795 1 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/4: fdatasync - no filename 2024-09-16T00:49:57.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/5: write - no filename 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:2/6: chown . 110012884 1 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/0: mknod c0 0 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/1: truncate - no filename 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/2: chown c0 713081221 1 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/3: dread - no filename 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/0: getdents . 0 2024-09-16T00:49:57.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/1: read - no filename 2024-09-16T00:49:57.964 INFO:tasks.workunit.client.1.smithi152.stdout:2/7: creat f0 x:0 0 0 2024-09-16T00:49:57.964 INFO:tasks.workunit.client.1.smithi152.stdout:2/8: creat f1 x:0 0 0 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/9: read - f1 zero size 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/10: truncate f1 744447 0 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/11: dread - f0 zero size 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/12: creat f2 x:0 0 0 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/4: mknod c1 0 2024-09-16T00:49:57.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/5: rmdir - no directory 2024-09-16T00:49:57.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/0: link - no file 2024-09-16T00:49:57.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/1: dwrite - no filename 2024-09-16T00:49:57.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/2: rename - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/3: getdents . 0 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/4: write - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/5: truncate - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/6: fsync - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/7: write - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/8: write - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/9: dwrite - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/10: dread - no filename 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/11: chown . 119413217 1 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/12: getdents . 0 2024-09-16T00:49:57.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/13: dwrite - no filename 2024-09-16T00:49:57.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/2: symlink l0 0 2024-09-16T00:49:57.970 INFO:tasks.workunit.client.1.smithi152.stdout:1/6: unlink c0 0 2024-09-16T00:49:57.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/7: dread - no filename 2024-09-16T00:49:57.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/8: truncate - no filename 2024-09-16T00:49:57.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/9: chown c1 195432357 1 2024-09-16T00:49:57.971 INFO:tasks.workunit.client.1.smithi152.stdout:5/0: rename - no filename 2024-09-16T00:49:57.971 INFO:tasks.workunit.client.1.smithi152.stdout:5/1: chown . 244659 1 2024-09-16T00:49:57.972 INFO:tasks.workunit.client.1.smithi152.stdout:5/2: read - no filename 2024-09-16T00:49:57.972 INFO:tasks.workunit.client.1.smithi152.stdout:5/3: readlink - no filename 2024-09-16T00:49:57.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/14: mknod c0 0 2024-09-16T00:49:57.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/15: chown c0 40379 1 2024-09-16T00:49:57.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/16: write - no filename 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/17: dread - no filename 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/18: fdatasync - no filename 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/19: dwrite - no filename 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/3: link l0 l1 0 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/4: write - no filename 2024-09-16T00:49:57.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/5: write - no filename 2024-09-16T00:49:57.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/10: creat f2 x:0 0 0 2024-09-16T00:49:57.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/4: creat f0 x:0 0 0 2024-09-16T00:49:57.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/5: creat f1 x:0 0 0 2024-09-16T00:49:57.977 INFO:tasks.workunit.client.1.smithi152.stdout:4/20: creat f1 x:0 0 0 2024-09-16T00:49:57.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/6: stat l0 0 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/0: dread - no filename 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/1: link - no file 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/2: link - no file 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/3: chown . 21547608 1 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/4: dwrite - no filename 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/5: link - no file 2024-09-16T00:49:57.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/6: dwrite - no filename 2024-09-16T00:49:57.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/0: symlink l0 0 2024-09-16T00:49:57.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/1: write - no filename 2024-09-16T00:49:57.981 INFO:tasks.workunit.client.1.smithi152.stdout:5/6: mknod c2 0 2024-09-16T00:49:57.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/21: mkdir d2 0 2024-09-16T00:49:57.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/22: dread - f1 zero size 2024-09-16T00:49:57.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/23: write f1 [288058,86565] 0 2024-09-16T00:49:57.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/7: creat f2 x:0 0 0 2024-09-16T00:49:57.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/8: creat f3 x:0 0 0 2024-09-16T00:49:57.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/9: dread - f3 zero size 2024-09-16T00:49:57.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/10: dread - f2 zero size 2024-09-16T00:49:57.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/11: creat f4 x:0 0 0 2024-09-16T00:49:57.986 INFO:tasks.workunit.client.1.smithi152.stdout:6/2: mknod c1 0 2024-09-16T00:49:57.986 INFO:tasks.workunit.client.1.smithi152.stdout:4/24: dread f1 [0,4194304] 0 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/3: creat f2 x:0 0 0 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/12: stat l1 0 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/13: chown f2 7 1 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/14: dread - f3 zero size 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/15: fdatasync f2 0 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/16: creat f5 x:0 0 0 2024-09-16T00:49:57.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/17: creat f6 x:0 0 0 2024-09-16T00:49:57.999 INFO:tasks.workunit.client.1.smithi152.stdout:4/25: creat d2/f3 x:0 0 0 2024-09-16T00:49:58.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/4: symlink l3 0 2024-09-16T00:49:58.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/26: dread f1 [0,4194304] 0 2024-09-16T00:49:58.005 INFO:tasks.workunit.client.1.smithi152.stdout:9/0: mknod c0 0 2024-09-16T00:49:58.007 INFO:tasks.workunit.client.1.smithi152.stdout:9/1: mkdir d1 0 2024-09-16T00:49:58.007 INFO:tasks.workunit.client.1.smithi152.stdout:9/2: stat c0 0 2024-09-16T00:49:58.008 INFO:tasks.workunit.client.1.smithi152.stdout:9/3: truncate - no filename 2024-09-16T00:49:58.008 INFO:tasks.workunit.client.1.smithi152.stdout:9/4: fdatasync - no filename 2024-09-16T00:49:58.008 INFO:tasks.workunit.client.1.smithi152.stdout:9/5: dwrite - no filename 2024-09-16T00:49:58.008 INFO:tasks.workunit.client.1.smithi152.stdout:9/6: write - no filename 2024-09-16T00:49:58.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/7: unlink c0 0 2024-09-16T00:49:58.011 INFO:tasks.workunit.client.1.smithi152.stdout:9/8: symlink d1/l2 0 2024-09-16T00:49:58.011 INFO:tasks.workunit.client.1.smithi152.stdout:9/9: readlink d1/l2 0 2024-09-16T00:49:58.011 INFO:tasks.workunit.client.1.smithi152.stdout:9/10: dwrite - no filename 2024-09-16T00:49:58.011 INFO:tasks.workunit.client.1.smithi152.stdout:9/11: truncate - no filename 2024-09-16T00:49:58.013 INFO:tasks.workunit.client.1.smithi152.stdout:9/12: creat d1/f3 x:0 0 0 2024-09-16T00:49:58.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/18: dwrite f5 [0,4194304] 0 2024-09-16T00:49:58.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/19: fdatasync f2 0 2024-09-16T00:49:58.032 INFO:tasks.workunit.client.1.smithi152.stdout:4/27: dwrite f1 [0,4194304] 0 2024-09-16T00:49:58.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/13: dwrite d1/f3 [0,4194304] 0 2024-09-16T00:49:58.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/14: creat d1/f4 x:0 0 0 2024-09-16T00:49:58.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/15: read - d1/f4 zero size 2024-09-16T00:49:58.039 INFO:tasks.workunit.client.1.smithi152.stdout:3/20: dread f5 [0,4194304] 0 2024-09-16T00:49:58.040 INFO:tasks.workunit.client.1.smithi152.stdout:4/28: write f1 [341973,45219] 0 2024-09-16T00:49:58.041 INFO:tasks.workunit.client.1.smithi152.stdout:4/29: write f1 [3315196,34001] 0 2024-09-16T00:49:58.041 INFO:tasks.workunit.client.1.smithi152.stdout:9/16: mkdir d1/d5 0 2024-09-16T00:49:58.042 INFO:tasks.workunit.client.1.smithi152.stdout:3/21: dread f5 [0,4194304] 0 2024-09-16T00:49:58.043 INFO:tasks.workunit.client.1.smithi152.stdout:4/30: rename f1 to d2/f4 0 2024-09-16T00:49:58.045 INFO:tasks.workunit.client.1.smithi152.stdout:9/17: symlink d1/l6 0 2024-09-16T00:49:58.045 INFO:tasks.workunit.client.1.smithi152.stdout:9/18: truncate d1/f4 295607 0 2024-09-16T00:49:58.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/19: rename d1/d5 to d1/d7 0 2024-09-16T00:49:58.055 INFO:tasks.workunit.client.1.smithi152.stdout:9/20: rename d1/f4 to d1/f8 0 2024-09-16T00:49:58.055 INFO:tasks.workunit.client.1.smithi152.stdout:9/21: write d1/f8 [1021403,130567] 0 2024-09-16T00:49:58.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/22: symlink d1/l9 0 2024-09-16T00:49:58.062 INFO:tasks.workunit.client.1.smithi152.stdout:4/31: dwrite d2/f3 [0,4194304] 0 2024-09-16T00:49:58.066 INFO:tasks.workunit.client.1.smithi152.stdout:9/23: write d1/f3 [2874339,99769] 0 2024-09-16T00:49:58.066 INFO:tasks.workunit.client.1.smithi152.stdout:9/24: truncate d1/f3 4452270 0 2024-09-16T00:49:58.069 INFO:tasks.workunit.client.1.smithi152.stdout:4/32: dread d2/f4 [0,4194304] 0 2024-09-16T00:49:58.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/33: symlink d2/l5 0 2024-09-16T00:49:58.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/34: creat d2/f6 x:0 0 0 2024-09-16T00:49:58.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/35: write d2/f4 [2173919,120061] 0 2024-09-16T00:49:58.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/36: creat d2/f7 x:0 0 0 2024-09-16T00:49:58.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/37: write d2/f7 [133956,46176] 0 2024-09-16T00:49:58.078 INFO:tasks.workunit.client.1.smithi152.stdout:4/38: link d2/l5 d2/l8 0 2024-09-16T00:49:59.310 INFO:tasks.workunit.client.1.smithi152.stdout:5/7: getdents . 0 2024-09-16T00:49:59.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/8: symlink l3 0 2024-09-16T00:49:59.331 INFO:tasks.workunit.client.1.smithi152.stdout:5/9: dwrite f1 [0,4194304] 0 2024-09-16T00:49:59.335 INFO:tasks.workunit.client.1.smithi152.stdout:6/5: getdents . 0 2024-09-16T00:49:59.335 INFO:tasks.workunit.client.1.smithi152.stdout:6/6: getdents . 0 2024-09-16T00:49:59.335 INFO:tasks.workunit.client.1.smithi152.stdout:6/7: chown l3 567 1 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/8: rename l3 to l4 0 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/9: chown f2 119622 1 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/10: dread - f2 zero size 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:3/22: getdents . 0 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:3/23: dread - f3 zero size 2024-09-16T00:49:59.343 INFO:tasks.workunit.client.1.smithi152.stdout:3/24: chown f5 1441630 1 2024-09-16T00:49:59.345 INFO:tasks.workunit.client.1.smithi152.stdout:6/11: mknod c5 0 2024-09-16T00:49:59.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/12: rename l0 to l6 0 2024-09-16T00:49:59.361 INFO:tasks.workunit.client.1.smithi152.stdout:9/25: fsync d1/f3 0 2024-09-16T00:49:59.363 INFO:tasks.workunit.client.1.smithi152.stdout:9/26: rename d1/f3 to d1/fa 0 2024-09-16T00:49:59.363 INFO:tasks.workunit.client.1.smithi152.stdout:9/27: creat d1/fb x:0 0 0 2024-09-16T00:49:59.363 INFO:tasks.workunit.client.1.smithi152.stdout:9/28: fdatasync d1/fb 0 2024-09-16T00:49:59.364 INFO:tasks.workunit.client.1.smithi152.stdout:9/29: truncate d1/f8 2113082 0 2024-09-16T00:49:59.364 INFO:tasks.workunit.client.1.smithi152.stdout:6/13: dwrite f2 [0,4194304] 0 2024-09-16T00:49:59.369 INFO:tasks.workunit.client.1.smithi152.stdout:9/30: dread d1/fa [0,4194304] 0 2024-09-16T00:49:59.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/31: write d1/f8 [1343405,126843] 0 2024-09-16T00:49:59.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/32: write d1/fa [1476270,115917] 0 2024-09-16T00:49:59.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/33: chown d1/l2 311014522 1 2024-09-16T00:49:59.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/14: symlink l7 0 2024-09-16T00:49:59.435 INFO:tasks.workunit.client.1.smithi152.stdout:4/39: getdents d2 0 2024-09-16T00:49:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:49:59 smithi053 ceph-mon[27950]: pgmap v253: 65 pgs: 65 active+clean; 179 MiB data, 845 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 117 op/s 2024-09-16T00:49:59.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:49:59 smithi152 ceph-mon[33237]: pgmap v253: 65 pgs: 65 active+clean; 179 MiB data, 845 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 117 op/s 2024-09-16T00:50:00.386 INFO:tasks.workunit.client.1.smithi152.stdout:5/10: write f1 [4580187,46596] 0 2024-09-16T00:50:00.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/15: link l4 l8 0 2024-09-16T00:50:00.399 INFO:tasks.workunit.client.1.smithi152.stdout:4/40: write d2/f4 [4973340,16263] 0 2024-09-16T00:50:00.400 INFO:tasks.workunit.client.1.smithi152.stdout:6/16: write f2 [1951373,86648] 0 2024-09-16T00:50:00.403 INFO:tasks.workunit.client.1.smithi152.stdout:6/17: creat f9 x:0 0 0 2024-09-16T00:50:00.403 INFO:tasks.workunit.client.1.smithi152.stdout:6/18: creat fa x:0 0 0 2024-09-16T00:50:00.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/11: dwrite f0 [0,4194304] 0 2024-09-16T00:50:00.414 INFO:tasks.workunit.client.1.smithi152.stdout:6/19: dread f2 [0,4194304] 0 2024-09-16T00:50:00.415 INFO:tasks.workunit.client.1.smithi152.stdout:6/20: truncate fa 274962 0 2024-09-16T00:50:00.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/12: creat f4 x:0 0 0 2024-09-16T00:50:00.418 INFO:tasks.workunit.client.1.smithi152.stdout:6/21: mkdir db 0 2024-09-16T00:50:00.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/22: dread fa [0,4194304] 0 2024-09-16T00:50:00.420 INFO:tasks.workunit.client.1.smithi152.stdout:5/13: unlink l3 0 2024-09-16T00:50:00.420 INFO:tasks.workunit.client.1.smithi152.stdout:4/41: dwrite d2/f7 [0,4194304] 0 2024-09-16T00:50:00.421 INFO:tasks.workunit.client.1.smithi152.stdout:6/23: unlink l6 0 2024-09-16T00:50:00.425 INFO:tasks.workunit.client.1.smithi152.stdout:5/14: symlink l5 0 2024-09-16T00:50:00.425 INFO:tasks.workunit.client.1.smithi152.stdout:5/15: write f1 [4668812,94290] 0 2024-09-16T00:50:00.426 INFO:tasks.workunit.client.1.smithi152.stdout:4/42: creat d2/f9 x:0 0 0 2024-09-16T00:50:00.426 INFO:tasks.workunit.client.1.smithi152.stdout:4/43: stat d2 0 2024-09-16T00:50:00.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/44: dread - d2/f6 zero size 2024-09-16T00:50:00.427 INFO:tasks.workunit.client.1.smithi152.stdout:5/16: mkdir d6 0 2024-09-16T00:50:00.427 INFO:tasks.workunit.client.1.smithi152.stdout:5/17: readlink l5 0 2024-09-16T00:50:00.428 INFO:tasks.workunit.client.1.smithi152.stdout:4/45: truncate d2/f3 2737080 0 2024-09-16T00:50:00.428 INFO:tasks.workunit.client.1.smithi152.stdout:4/46: stat d2/f3 0 2024-09-16T00:50:00.428 INFO:tasks.workunit.client.1.smithi152.stdout:4/47: stat d2 0 2024-09-16T00:50:00.429 INFO:tasks.workunit.client.1.smithi152.stdout:5/18: symlink d6/l7 0 2024-09-16T00:50:00.429 INFO:tasks.workunit.client.1.smithi152.stdout:5/19: truncate f1 5102836 0 2024-09-16T00:50:00.430 INFO:tasks.workunit.client.1.smithi152.stdout:4/48: symlink d2/la 0 2024-09-16T00:50:00.430 INFO:tasks.workunit.client.1.smithi152.stdout:4/49: chown d2/f7 93 1 2024-09-16T00:50:00.432 INFO:tasks.workunit.client.1.smithi152.stdout:5/20: creat d6/f8 x:0 0 0 2024-09-16T00:50:00.439 INFO:tasks.workunit.client.1.smithi152.stdout:6/24: dwrite f2 [4194304,4194304] 0 2024-09-16T00:50:00.440 INFO:tasks.workunit.client.1.smithi152.stdout:6/25: dread fa [0,4194304] 0 2024-09-16T00:50:00.443 INFO:tasks.workunit.client.1.smithi152.stdout:6/26: creat db/fc x:0 0 0 2024-09-16T00:50:00.451 INFO:tasks.workunit.client.1.smithi152.stdout:6/27: dread f2 [4194304,4194304] 0 2024-09-16T00:50:00.451 INFO:tasks.workunit.client.1.smithi152.stdout:4/50: dwrite d2/f6 [0,4194304] 0 2024-09-16T00:50:00.454 INFO:tasks.workunit.client.1.smithi152.stdout:6/28: symlink db/ld 0 2024-09-16T00:50:00.454 INFO:tasks.workunit.client.1.smithi152.stdout:6/29: creat db/fe x:0 0 0 2024-09-16T00:50:00.454 INFO:tasks.workunit.client.1.smithi152.stdout:6/30: chown fa 0 1 2024-09-16T00:50:00.454 INFO:tasks.workunit.client.1.smithi152.stdout:6/31: write db/fe [752913,61659] 0 2024-09-16T00:50:00.455 INFO:tasks.workunit.client.1.smithi152.stdout:6/32: write db/fc [97169,28681] 0 2024-09-16T00:50:00.457 INFO:tasks.workunit.client.1.smithi152.stdout:4/51: write d2/f6 [2277813,124679] 0 2024-09-16T00:50:00.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/52: mkdir d2/db 0 2024-09-16T00:50:00.465 INFO:tasks.workunit.client.1.smithi152.stdout:4/53: dread d2/f7 [0,4194304] 0 2024-09-16T00:50:00.466 INFO:tasks.workunit.client.1.smithi152.stdout:4/54: write d2/f6 [2599469,15618] 0 2024-09-16T00:50:00.481 INFO:tasks.workunit.client.1.smithi152.stdout:4/55: dwrite d2/f4 [0,4194304] 0 2024-09-16T00:50:00.481 INFO:tasks.workunit.client.1.smithi152.stdout:4/56: creat d2/fc x:0 0 0 2024-09-16T00:50:00.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/57: link d2/l8 d2/db/ld 0 2024-09-16T00:50:00.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/58: fdatasync d2/f4 0 2024-09-16T00:50:00.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/59: stat d2/la 0 2024-09-16T00:50:00.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/60: creat d2/fe x:0 0 0 2024-09-16T00:50:00.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/61: chown c0 434060 1 2024-09-16T00:50:00.485 INFO:tasks.workunit.client.1.smithi152.stdout:4/62: link d2/la d2/db/lf 0 2024-09-16T00:50:00.486 INFO:tasks.workunit.client.1.smithi152.stdout:4/63: unlink d2/f9 0 2024-09-16T00:50:00.487 INFO:tasks.workunit.client.1.smithi152.stdout:4/64: mkdir d2/d10 0 2024-09-16T00:50:00.488 INFO:tasks.workunit.client.1.smithi152.stdout:4/65: symlink d2/l11 0 2024-09-16T00:50:00.494 INFO:tasks.workunit.client.1.smithi152.stdout:4/66: dread d2/f4 [0,4194304] 0 2024-09-16T00:50:00.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/67: chown d2 77796215 1 2024-09-16T00:50:00.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:00 smithi152 ceph-mon[33237]: overall HEALTH_OK 2024-09-16T00:50:00.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/68: truncate d2/f7 1337952 0 2024-09-16T00:50:00.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/69: stat d2/f3 0 2024-09-16T00:50:00.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/70: creat d2/db/f12 x:0 0 0 2024-09-16T00:50:00.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/33: rmdir db 39 2024-09-16T00:50:00.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/34: write db/fe [1119410,56157] 0 2024-09-16T00:50:00.782 INFO:tasks.workunit.client.1.smithi152.stdout:4/71: dwrite d2/f6 [4194304,4194304] 0 2024-09-16T00:50:00.783 INFO:tasks.workunit.client.1.smithi152.stdout:4/72: readlink d2/db/ld 0 2024-09-16T00:50:00.783 INFO:tasks.workunit.client.1.smithi152.stdout:6/35: dwrite db/fc [0,4194304] 0 2024-09-16T00:50:00.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/36: symlink db/lf 0 2024-09-16T00:50:00.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/37: write db/fe [1172523,113193] 0 2024-09-16T00:50:00.805 INFO:tasks.workunit.client.1.smithi152.stdout:6/38: dwrite db/fe [0,4194304] 0 2024-09-16T00:50:00.806 INFO:tasks.workunit.client.1.smithi152.stdout:6/39: read fa [75187,26360] 0 2024-09-16T00:50:00.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/40: mknod db/c10 0 2024-09-16T00:50:00.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/41: stat db/fe 0 2024-09-16T00:50:00.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:00 smithi053 ceph-mon[27950]: overall HEALTH_OK 2024-09-16T00:50:00.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/73: getdents d2/db 0 2024-09-16T00:50:00.918 INFO:tasks.workunit.client.1.smithi152.stdout:4/74: creat d2/db/f13 x:0 0 0 2024-09-16T00:50:01.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/75: truncate d2/f4 4358790 0 2024-09-16T00:50:01.093 INFO:tasks.workunit.client.1.smithi152.stdout:4/76: dwrite d2/f7 [0,4194304] 0 2024-09-16T00:50:01.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/77: dread d2/f4 [0,4194304] 0 2024-09-16T00:50:01.241 INFO:tasks.workunit.client.1.smithi152.stdout:4/78: rmdir d2 39 2024-09-16T00:50:01.242 INFO:tasks.workunit.client.1.smithi152.stdout:4/79: getdents d2/db 0 2024-09-16T00:50:01.245 INFO:tasks.workunit.client.1.smithi152.stdout:4/80: symlink d2/l14 0 2024-09-16T00:50:01.251 INFO:tasks.workunit.client.1.smithi152.stdout:4/81: read d2/f3 [2684750,22652] 0 2024-09-16T00:50:01.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/82: dwrite d2/f6 [8388608,4194304] 0 2024-09-16T00:50:01.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/83: fdatasync d2/db/f13 0 2024-09-16T00:50:01.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/84: truncate d2/f3 3244588 0 2024-09-16T00:50:01.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/85: creat d2/db/f15 x:0 0 0 2024-09-16T00:50:01.272 INFO:tasks.workunit.client.1.smithi152.stdout:4/86: creat d2/f16 x:0 0 0 2024-09-16T00:50:01.287 INFO:tasks.workunit.client.1.smithi152.stdout:4/87: dwrite d2/f6 [4194304,4194304] 0 2024-09-16T00:50:01.287 INFO:tasks.workunit.client.1.smithi152.stdout:4/88: dread - d2/fe zero size 2024-09-16T00:50:01.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/89: dwrite d2/f4 [0,4194304] 0 2024-09-16T00:50:01.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/90: chown d2/l11 37728684 1 2024-09-16T00:50:01.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/91: truncate d2/f7 4571611 0 2024-09-16T00:50:01.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/92: truncate d2/fc 526918 0 2024-09-16T00:50:01.321 INFO:tasks.workunit.client.1.smithi152.stdout:4/93: dwrite d2/f3 [0,4194304] 0 2024-09-16T00:50:01.321 INFO:tasks.workunit.client.1.smithi152.stdout:4/94: write d2/f3 [4781526,24503] 0 2024-09-16T00:50:01.325 INFO:tasks.workunit.client.1.smithi152.stdout:4/95: symlink d2/l17 0 2024-09-16T00:50:01.327 INFO:tasks.workunit.client.1.smithi152.stdout:4/96: mkdir d2/d10/d18 0 2024-09-16T00:50:01.327 INFO:tasks.workunit.client.1.smithi152.stdout:4/97: dread - d2/db/f12 zero size 2024-09-16T00:50:01.329 INFO:tasks.workunit.client.1.smithi152.stdout:4/98: rmdir d2/d10/d18 0 2024-09-16T00:50:01.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/99: truncate d2/f6 6094178 0 2024-09-16T00:50:01.503 INFO:tasks.workunit.client.1.smithi152.stdout:4/100: symlink d2/d10/l19 0 2024-09-16T00:50:01.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/101: mkdir d2/d10/d1a 0 2024-09-16T00:50:01.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/102: chown d2/l8 426006275 1 2024-09-16T00:50:01.509 INFO:tasks.workunit.client.1.smithi152.stdout:4/103: mknod d2/db/c1b 0 2024-09-16T00:50:01.509 INFO:tasks.workunit.client.1.smithi152.stdout:4/104: write d2/f4 [4678937,7300] 0 2024-09-16T00:50:01.509 INFO:tasks.workunit.client.1.smithi152.stdout:4/105: readlink d2/l17 0 2024-09-16T00:50:01.512 INFO:tasks.workunit.client.1.smithi152.stdout:4/106: rmdir d2/d10 39 2024-09-16T00:50:01.529 INFO:tasks.workunit.client.1.smithi152.stdout:4/107: dwrite d2/db/f13 [0,4194304] 0 2024-09-16T00:50:01.552 INFO:tasks.workunit.client.1.smithi152.stdout:4/108: dwrite d2/fe [0,4194304] 0 2024-09-16T00:50:01.559 INFO:tasks.workunit.client.1.smithi152.stdout:4/109: rename d2/db/f13 to d2/d10/f1c 0 2024-09-16T00:50:01.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/110: dwrite d2/fc [0,4194304] 0 2024-09-16T00:50:01.720 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:01 smithi053 ceph-mon[27950]: pgmap v254: 65 pgs: 65 active+clean; 220 MiB data, 948 MiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 6.4 MiB/s wr, 385 op/s 2024-09-16T00:50:01.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/111: rmdir d2 39 2024-09-16T00:50:01.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/112: fsync d2/f4 0 2024-09-16T00:50:01.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:01 smithi152 ceph-mon[33237]: pgmap v254: 65 pgs: 65 active+clean; 220 MiB data, 948 MiB used, 535 GiB / 536 GiB avail; 4.2 MiB/s rd, 6.4 MiB/s wr, 385 op/s 2024-09-16T00:50:02.875 INFO:tasks.workunit.client.1.smithi152.stdout:4/113: creat d2/db/f1d x:0 0 0 2024-09-16T00:50:02.897 INFO:tasks.workunit.client.1.smithi152.stdout:4/114: dwrite d2/db/f1d [0,4194304] 0 2024-09-16T00:50:02.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/115: mkdir d2/d1e 0 2024-09-16T00:50:02.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/116: symlink d2/d10/l1f 0 2024-09-16T00:50:02.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/117: chown d2/d10/l1f 1 1 2024-09-16T00:50:02.901 INFO:tasks.workunit.client.1.smithi152.stdout:4/118: readlink d2/db/ld 0 2024-09-16T00:50:02.902 INFO:tasks.workunit.client.1.smithi152.stdout:4/119: mkdir d2/d20 0 2024-09-16T00:50:02.902 INFO:tasks.workunit.client.1.smithi152.stdout:4/120: chown d2/l11 2 1 2024-09-16T00:50:02.903 INFO:tasks.workunit.client.1.smithi152.stdout:4/121: chown d2/d1e 197936325 1 2024-09-16T00:50:02.905 INFO:tasks.workunit.client.1.smithi152.stdout:4/122: mknod d2/db/c21 0 2024-09-16T00:50:02.930 INFO:tasks.workunit.client.1.smithi152.stdout:4/123: dwrite d2/fc [0,4194304] 0 2024-09-16T00:50:02.935 INFO:tasks.workunit.client.1.smithi152.stdout:4/124: link d2/db/lf d2/db/l22 0 2024-09-16T00:50:02.938 INFO:tasks.workunit.client.1.smithi152.stdout:4/125: rmdir d2/d20 0 2024-09-16T00:50:02.938 INFO:tasks.workunit.client.1.smithi152.stdout:4/126: read d2/f6 [1529946,86720] 0 2024-09-16T00:50:02.944 INFO:tasks.workunit.client.1.smithi152.stdout:4/127: write d2/db/f1d [2614086,125303] 0 2024-09-16T00:50:02.947 INFO:tasks.workunit.client.1.smithi152.stdout:4/128: creat d2/d10/f23 x:0 0 0 2024-09-16T00:50:02.961 INFO:tasks.workunit.client.1.smithi152.stdout:4/129: dwrite d2/f4 [0,4194304] 0 2024-09-16T00:50:02.979 INFO:tasks.workunit.client.1.smithi152.stdout:4/130: dwrite d2/d10/f23 [0,4194304] 0 2024-09-16T00:50:02.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/131: dwrite d2/f3 [0,4194304] 0 2024-09-16T00:50:02.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/132: chown d2/l11 359 1 2024-09-16T00:50:02.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/133: creat d2/d10/f24 x:0 0 0 2024-09-16T00:50:02.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/134: fsync d2/f16 0 2024-09-16T00:50:03.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/135: symlink d2/l25 0 2024-09-16T00:50:03.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/136: rename d2/d10/l1f to d2/d10/d1a/l26 0 2024-09-16T00:50:03.006 INFO:tasks.workunit.client.1.smithi152.stdout:4/137: mknod d2/d10/d1a/c27 0 2024-09-16T00:50:03.009 INFO:tasks.workunit.client.1.smithi152.stdout:4/138: mkdir d2/d1e/d28 0 2024-09-16T00:50:03.549 INFO:tasks.workunit.client.1.smithi152.stdout:4/139: rename d2/d10 to d2/d1e/d28/d29 0 2024-09-16T00:50:03.551 INFO:tasks.workunit.client.1.smithi152.stdout:4/140: rename d2/db/ld to d2/db/l2a 0 2024-09-16T00:50:03.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/141: link d2/l17 d2/db/l2b 0 2024-09-16T00:50:03.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/142: write d2/f16 [42054,60527] 0 2024-09-16T00:50:03.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/143: creat d2/db/f2c x:0 0 0 2024-09-16T00:50:03.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/144: write d2/d1e/d28/d29/f23 [4403472,4330] 0 2024-09-16T00:50:03.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/145: fdatasync d2/f7 0 2024-09-16T00:50:03.555 INFO:tasks.workunit.client.1.smithi152.stdout:4/146: rename d2/d1e/d28/d29/d1a/l26 to d2/d1e/d28/l2d 0 2024-09-16T00:50:03.556 INFO:tasks.workunit.client.1.smithi152.stdout:4/147: creat d2/d1e/d28/d29/d1a/f2e x:0 0 0 2024-09-16T00:50:03.569 INFO:tasks.workunit.client.1.smithi152.stdout:4/148: dwrite d2/d1e/d28/d29/f1c [4194304,4194304] 0 2024-09-16T00:50:03.570 INFO:tasks.workunit.client.1.smithi152.stdout:4/149: truncate d2/fc 191701 0 2024-09-16T00:50:03.571 INFO:tasks.workunit.client.1.smithi152.stdout:4/150: truncate d2/f6 1133237 0 2024-09-16T00:50:03.572 INFO:tasks.workunit.client.1.smithi152.stdout:4/151: mknod d2/d1e/d28/c2f 0 2024-09-16T00:50:03.573 INFO:tasks.workunit.client.1.smithi152.stdout:4/152: creat d2/d1e/d28/f30 x:0 0 0 2024-09-16T00:50:03.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/153: dread d2/fe [0,4194304] 0 2024-09-16T00:50:03.584 INFO:tasks.workunit.client.1.smithi152.stdout:4/154: creat d2/d1e/d28/d29/d1a/f31 x:0 0 0 2024-09-16T00:50:03.584 INFO:tasks.workunit.client.1.smithi152.stdout:4/155: chown d2/db/c1b 142 1 2024-09-16T00:50:03.586 INFO:tasks.workunit.client.1.smithi152.stdout:4/156: mkdir d2/d1e/d28/d29/d32 0 2024-09-16T00:50:03.587 INFO:tasks.workunit.client.1.smithi152.stdout:4/157: unlink d2/l5 0 2024-09-16T00:50:03.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/158: mknod d2/d1e/d28/d29/d32/c33 0 2024-09-16T00:50:03.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/159: dread - d2/db/f15 zero size 2024-09-16T00:50:03.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/160: dread - d2/d1e/d28/f30 zero size 2024-09-16T00:50:03.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/161: dread - d2/db/f12 zero size 2024-09-16T00:50:03.591 INFO:tasks.workunit.client.1.smithi152.stdout:4/162: creat d2/d1e/d28/d29/f34 x:0 0 0 2024-09-16T00:50:03.598 INFO:tasks.workunit.client.1.smithi152.stdout:4/163: fdatasync d2/db/f1d 0 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:2/13: sync 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:2/14: chown f2 3 1 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:6/42: sync 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:1/11: sync 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:7/7: sync 2024-09-16T00:50:03.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/21: sync 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/0: sync 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:9/34: sync 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:1/12: dread - f2 zero size 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/1: fsync - no filename 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:1/13: dread - f2 zero size 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:3/25: sync 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/1: sync 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/2: write - no filename 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:9/35: creat d1/fc x:0 0 0 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:2/15: write f1 [515107,52035] 0 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:2/16: creat f3 x:0 0 0 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:9/36: write d1/f8 [1740171,40560] 0 2024-09-16T00:50:03.601 INFO:tasks.workunit.client.1.smithi152.stdout:4/164: unlink d2/db/f12 0 2024-09-16T00:50:03.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/43: creat db/f11 x:0 0 0 2024-09-16T00:50:03.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/44: read - db/f11 zero size 2024-09-16T00:50:03.604 INFO:tasks.workunit.client.1.smithi152.stdout:2/17: dread f1 [0,4194304] 0 2024-09-16T00:50:03.604 INFO:tasks.workunit.client.1.smithi152.stdout:2/18: truncate f3 97227 0 2024-09-16T00:50:03.606 INFO:tasks.workunit.client.1.smithi152.stdout:5/22: rename c2 to d6/c9 0 2024-09-16T00:50:03.610 INFO:tasks.workunit.client.1.smithi152.stdout:7/8: symlink l0 0 2024-09-16T00:50:03.610 INFO:tasks.workunit.client.1.smithi152.stdout:7/9: stat l0 0 2024-09-16T00:50:03.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/14: mknod c3 0 2024-09-16T00:50:03.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/15: chown c1 66210 1 2024-09-16T00:50:03.618 INFO:tasks.workunit.client.1.smithi152.stdout:8/2: creat f0 x:0 0 0 2024-09-16T00:50:03.618 INFO:tasks.workunit.client.1.smithi152.stdout:8/3: stat f0 0 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/26: creat f7 x:0 0 0 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/27: readlink l1 0 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/28: read - f3 zero size 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/29: truncate f2 366794 0 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/30: fsync f3 0 2024-09-16T00:50:03.620 INFO:tasks.workunit.client.1.smithi152.stdout:0/3: getdents . 0 2024-09-16T00:50:03.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/4: dread - no filename 2024-09-16T00:50:03.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/31: dread f2 [0,4194304] 0 2024-09-16T00:50:03.623 INFO:tasks.workunit.client.1.smithi152.stdout:9/37: truncate d1/fa 4138123 0 2024-09-16T00:50:03.628 INFO:tasks.workunit.client.1.smithi152.stdout:2/19: mkdir d4 0 2024-09-16T00:50:03.629 INFO:tasks.workunit.client.1.smithi152.stdout:2/20: read f3 [45985,47213] 0 2024-09-16T00:50:03.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/32: dread f5 [0,4194304] 0 2024-09-16T00:50:03.630 INFO:tasks.workunit.client.1.smithi152.stdout:2/21: write f1 [948531,56948] 0 2024-09-16T00:50:03.630 INFO:tasks.workunit.client.1.smithi152.stdout:3/33: creat f8 x:0 0 0 2024-09-16T00:50:03.630 INFO:tasks.workunit.client.1.smithi152.stdout:2/22: getdents d4 0 2024-09-16T00:50:03.632 INFO:tasks.workunit.client.1.smithi152.stdout:5/23: dwrite f4 [0,4194304] 0 2024-09-16T00:50:03.632 INFO:tasks.workunit.client.1.smithi152.stdout:1/16: dwrite f2 [0,4194304] 0 2024-09-16T00:50:03.637 INFO:tasks.workunit.client.1.smithi152.stdout:7/10: creat f1 x:0 0 0 2024-09-16T00:50:03.642 INFO:tasks.workunit.client.1.smithi152.stdout:0/5: creat f1 x:0 0 0 2024-09-16T00:50:03.642 INFO:tasks.workunit.client.1.smithi152.stdout:0/6: creat f2 x:0 0 0 2024-09-16T00:50:03.645 INFO:tasks.workunit.client.1.smithi152.stdout:9/38: creat d1/d7/fd x:0 0 0 2024-09-16T00:50:03.653 INFO:tasks.workunit.client.1.smithi152.stdout:2/23: unlink f3 0 2024-09-16T00:50:03.653 INFO:tasks.workunit.client.1.smithi152.stdout:2/24: chown f1 1351237 1 2024-09-16T00:50:03.654 INFO:tasks.workunit.client.1.smithi152.stdout:3/34: dwrite f3 [0,4194304] 0 2024-09-16T00:50:03.654 INFO:tasks.workunit.client.1.smithi152.stdout:3/35: dread - f7 zero size 2024-09-16T00:50:03.656 INFO:tasks.workunit.client.1.smithi152.stdout:5/24: dwrite f1 [0,4194304] 0 2024-09-16T00:50:03.656 INFO:tasks.workunit.client.1.smithi152.stdout:5/25: fsync f0 0 2024-09-16T00:50:03.656 INFO:tasks.workunit.client.1.smithi152.stdout:4/165: getdents d2/db 0 2024-09-16T00:50:03.659 INFO:tasks.workunit.client.1.smithi152.stdout:2/25: dread f1 [0,4194304] 0 2024-09-16T00:50:03.659 INFO:tasks.workunit.client.1.smithi152.stdout:7/11: dwrite f1 [0,4194304] 0 2024-09-16T00:50:03.674 INFO:tasks.workunit.client.1.smithi152.stdout:8/4: getdents . 0 2024-09-16T00:50:03.675 INFO:tasks.workunit.client.1.smithi152.stdout:8/5: truncate f0 463051 0 2024-09-16T00:50:03.675 INFO:tasks.workunit.client.1.smithi152.stdout:8/6: chown f0 981 1 2024-09-16T00:50:03.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/36: dwrite f5 [0,4194304] 0 2024-09-16T00:50:03.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/37: write f7 [669032,104808] 0 2024-09-16T00:50:03.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/38: truncate f4 385568 0 2024-09-16T00:50:03.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/26: dwrite d6/f8 [0,4194304] 0 2024-09-16T00:50:03.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/27: fdatasync f1 0 2024-09-16T00:50:03.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/28: write f0 [65536,47946] 0 2024-09-16T00:50:03.680 INFO:tasks.workunit.client.1.smithi152.stdout:9/39: symlink d1/le 0 2024-09-16T00:50:03.680 INFO:tasks.workunit.client.1.smithi152.stdout:9/40: creat d1/ff x:0 0 0 2024-09-16T00:50:03.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/166: rmdir d2 39 2024-09-16T00:50:03.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/26: creat d4/f5 x:0 0 0 2024-09-16T00:50:03.697 INFO:tasks.workunit.client.1.smithi152.stdout:8/7: rename f0 to f1 0 2024-09-16T00:50:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:03 smithi152 ceph-mon[33237]: pgmap v255: 65 pgs: 65 active+clean; 241 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 513 op/s 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/8: dread f1 [0,4194304] 0 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/9: write f1 [1396054,121440] 0 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/10: chown f1 653 1 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/11: readlink - no filename 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/12: chown f1 0 1 2024-09-16T00:50:03.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/13: write f1 [706498,62816] 0 2024-09-16T00:50:03.701 INFO:tasks.workunit.client.1.smithi152.stdout:3/39: symlink l9 0 2024-09-16T00:50:03.701 INFO:tasks.workunit.client.1.smithi152.stdout:3/40: chown l0 468 1 2024-09-16T00:50:03.703 INFO:tasks.workunit.client.1.smithi152.stdout:1/17: truncate f2 18427 0 2024-09-16T00:50:03.703 INFO:tasks.workunit.client.1.smithi152.stdout:1/18: chown c1 830 1 2024-09-16T00:50:03.712 INFO:tasks.workunit.client.1.smithi152.stdout:9/41: symlink d1/l10 0 2024-09-16T00:50:03.717 INFO:tasks.workunit.client.1.smithi152.stdout:2/27: link f0 d4/f6 0 2024-09-16T00:50:03.722 INFO:tasks.workunit.client.1.smithi152.stdout:3/41: dwrite f2 [0,4194304] 0 2024-09-16T00:50:03.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/167: write d2/f7 [3289273,86310] 0 2024-09-16T00:50:03.728 INFO:tasks.workunit.client.1.smithi152.stdout:8/14: symlink l2 0 2024-09-16T00:50:03.735 INFO:tasks.workunit.client.1.smithi152.stdout:7/12: dwrite f1 [4194304,4194304] 0 2024-09-16T00:50:03.735 INFO:tasks.workunit.client.1.smithi152.stdout:7/13: creat f2 x:0 0 0 2024-09-16T00:50:03.736 INFO:tasks.workunit.client.1.smithi152.stdout:3/42: unlink f4 0 2024-09-16T00:50:03.736 INFO:tasks.workunit.client.1.smithi152.stdout:3/43: chown f8 548 1 2024-09-16T00:50:03.736 INFO:tasks.workunit.client.1.smithi152.stdout:3/44: creat fa x:0 0 0 2024-09-16T00:50:03.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/19: write f2 [709887,41194] 0 2024-09-16T00:50:03.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/28: rename d4/f5 to d4/f7 0 2024-09-16T00:50:03.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/29: write f0 [797917,28117] 0 2024-09-16T00:50:03.748 INFO:tasks.workunit.client.1.smithi152.stdout:7/14: rename f1 to f3 0 2024-09-16T00:50:03.751 INFO:tasks.workunit.client.1.smithi152.stdout:1/20: link c3 c4 0 2024-09-16T00:50:03.755 INFO:tasks.workunit.client.1.smithi152.stdout:8/15: getdents . 0 2024-09-16T00:50:03.757 INFO:tasks.workunit.client.1.smithi152.stdout:3/45: dwrite f5 [4194304,4194304] 0 2024-09-16T00:50:03.762 INFO:tasks.workunit.client.1.smithi152.stdout:1/21: link c1 c5 0 2024-09-16T00:50:03.773 INFO:tasks.workunit.client.1.smithi152.stdout:3/46: rename l0 to lb 0 2024-09-16T00:50:03.773 INFO:tasks.workunit.client.1.smithi152.stdout:3/47: chown f8 822806833 1 2024-09-16T00:50:03.774 INFO:tasks.workunit.client.1.smithi152.stdout:1/22: stat c3 0 2024-09-16T00:50:03.777 INFO:tasks.workunit.client.1.smithi152.stdout:4/168: dwrite d2/db/f1d [4194304,4194304] 0 2024-09-16T00:50:03.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/48: mkdir dc 0 2024-09-16T00:50:03.778 INFO:tasks.workunit.client.1.smithi152.stdout:7/15: fsync f3 0 2024-09-16T00:50:03.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/23: rename c4 to c6 0 2024-09-16T00:50:03.785 INFO:tasks.workunit.client.1.smithi152.stdout:1/24: dread f2 [0,4194304] 0 2024-09-16T00:50:03.785 INFO:tasks.workunit.client.1.smithi152.stdout:1/25: write f2 [1694944,32799] 0 2024-09-16T00:50:03.786 INFO:tasks.workunit.client.1.smithi152.stdout:8/16: dwrite f1 [0,4194304] 0 2024-09-16T00:50:03.787 INFO:tasks.workunit.client.1.smithi152.stdout:3/49: mknod dc/cd 0 2024-09-16T00:50:03.788 INFO:tasks.workunit.client.1.smithi152.stdout:4/169: creat d2/d1e/f35 x:0 0 0 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/26: unlink f2 0 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/27: dwrite - no filename 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/28: rmdir - no directory 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/29: dwrite - no filename 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/30: dwrite - no filename 2024-09-16T00:50:03.791 INFO:tasks.workunit.client.1.smithi152.stdout:1/31: write - no filename 2024-09-16T00:50:03.797 INFO:tasks.workunit.client.1.smithi152.stdout:3/50: truncate f7 391368 0 2024-09-16T00:50:03.799 INFO:tasks.workunit.client.1.smithi152.stdout:1/32: rename c5 to c7 0 2024-09-16T00:50:03.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/51: truncate f2 1627921 0 2024-09-16T00:50:03.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/33: mknod c8 0 2024-09-16T00:50:03.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/34: mkdir d9 0 2024-09-16T00:50:03.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/35: dwrite - no filename 2024-09-16T00:50:03.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/36: dread - no filename 2024-09-16T00:50:03.811 INFO:tasks.workunit.client.1.smithi152.stdout:1/37: mkdir d9/da 0 2024-09-16T00:50:03.813 INFO:tasks.workunit.client.1.smithi152.stdout:1/38: creat d9/da/fb x:0 0 0 2024-09-16T00:50:03.813 INFO:tasks.workunit.client.1.smithi152.stdout:1/39: mknod d9/cc 0 2024-09-16T00:50:03.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:03 smithi053 ceph-mon[27950]: pgmap v255: 65 pgs: 65 active+clean; 241 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 7.3 MiB/s wr, 513 op/s 2024-09-16T00:50:03.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/52: dwrite f5 [0,4194304] 0 2024-09-16T00:50:03.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/53: chown f6 0 1 2024-09-16T00:50:03.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/54: fsync f5 0 2024-09-16T00:50:03.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/55: read - f6 zero size 2024-09-16T00:50:03.836 INFO:tasks.workunit.client.1.smithi152.stdout:3/56: dwrite f8 [0,4194304] 0 2024-09-16T00:50:03.839 INFO:tasks.workunit.client.1.smithi152.stdout:3/57: creat dc/fe x:0 0 0 2024-09-16T00:50:03.839 INFO:tasks.workunit.client.1.smithi152.stdout:3/58: fdatasync f8 0 2024-09-16T00:50:03.840 INFO:tasks.workunit.client.1.smithi152.stdout:3/59: stat l1 0 2024-09-16T00:50:03.840 INFO:tasks.workunit.client.1.smithi152.stdout:3/60: creat dc/ff x:0 0 0 2024-09-16T00:50:03.863 INFO:tasks.workunit.client.1.smithi152.stdout:7/16: dwrite f2 [0,4194304] 0 2024-09-16T00:50:03.865 INFO:tasks.workunit.client.1.smithi152.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-16T00:50:03.872 INFO:tasks.workunit.client.1.smithi152.stdout:7/17: write f3 [4145859,111778] 0 2024-09-16T00:50:03.872 INFO:tasks.workunit.client.1.smithi152.stdout:7/18: creat f4 x:0 0 0 2024-09-16T00:50:03.876 INFO:tasks.workunit.client.1.smithi152.stdout:7/19: mknod c5 0 2024-09-16T00:50:03.876 INFO:tasks.workunit.client.1.smithi152.stdout:7/20: creat f6 x:0 0 0 2024-09-16T00:50:03.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/21: link f4 f7 0 2024-09-16T00:50:03.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/22: link f4 f8 0 2024-09-16T00:50:03.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/23: write f6 [932034,53005] 0 2024-09-16T00:50:03.897 INFO:tasks.workunit.client.1.smithi152.stdout:1/40: getdents d9/da 0 2024-09-16T00:50:03.899 INFO:tasks.workunit.client.1.smithi152.stdout:1/41: creat d9/fd x:0 0 0 2024-09-16T00:50:03.900 INFO:tasks.workunit.client.1.smithi152.stdout:7/24: dwrite f6 [0,4194304] 0 2024-09-16T00:50:03.902 INFO:tasks.workunit.client.1.smithi152.stdout:1/42: symlink d9/da/le 0 2024-09-16T00:50:03.902 INFO:tasks.workunit.client.1.smithi152.stdout:1/43: truncate d9/fd 140209 0 2024-09-16T00:50:03.903 INFO:tasks.workunit.client.1.smithi152.stdout:1/44: chown d9/cc 1 1 2024-09-16T00:50:03.903 INFO:tasks.workunit.client.1.smithi152.stdout:1/45: read d9/fd [86851,125201] 0 2024-09-16T00:50:03.907 INFO:tasks.workunit.client.1.smithi152.stdout:7/25: mkdir d9 0 2024-09-16T00:50:03.907 INFO:tasks.workunit.client.1.smithi152.stdout:7/26: write f8 [992402,71419] 0 2024-09-16T00:50:03.910 INFO:tasks.workunit.client.1.smithi152.stdout:1/46: unlink d9/da/fb 0 2024-09-16T00:50:03.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/47: truncate d9/fd 639540 0 2024-09-16T00:50:03.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/27: unlink f6 0 2024-09-16T00:50:03.919 INFO:tasks.workunit.client.1.smithi152.stdout:1/48: mkdir d9/da/df 0 2024-09-16T00:50:03.920 INFO:tasks.workunit.client.1.smithi152.stdout:1/49: write d9/fd [466052,8116] 0 2024-09-16T00:50:03.920 INFO:tasks.workunit.client.1.smithi152.stdout:1/50: write d9/fd [285395,91018] 0 2024-09-16T00:50:03.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/28: dread f8 [0,4194304] 0 2024-09-16T00:50:03.922 INFO:tasks.workunit.client.1.smithi152.stdout:1/51: symlink d9/da/df/l10 0 2024-09-16T00:50:03.922 INFO:tasks.workunit.client.1.smithi152.stdout:1/52: read d9/fd [102974,116116] 0 2024-09-16T00:50:03.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/29: link l0 d9/la 0 2024-09-16T00:50:03.926 INFO:tasks.workunit.client.1.smithi152.stdout:7/30: dread f4 [0,4194304] 0 2024-09-16T00:50:03.928 INFO:tasks.workunit.client.1.smithi152.stdout:1/53: creat d9/da/df/f11 x:0 0 0 2024-09-16T00:50:03.928 INFO:tasks.workunit.client.1.smithi152.stdout:1/54: read - d9/da/df/f11 zero size 2024-09-16T00:50:03.931 INFO:tasks.workunit.client.1.smithi152.stdout:7/31: creat d9/fb x:0 0 0 2024-09-16T00:50:03.938 INFO:tasks.workunit.client.1.smithi152.stdout:1/55: symlink d9/l12 0 2024-09-16T00:50:03.940 INFO:tasks.workunit.client.1.smithi152.stdout:7/32: dread f2 [0,4194304] 0 2024-09-16T00:50:03.940 INFO:tasks.workunit.client.1.smithi152.stdout:1/56: mknod d9/da/c13 0 2024-09-16T00:50:03.942 INFO:tasks.workunit.client.1.smithi152.stdout:7/33: symlink d9/lc 0 2024-09-16T00:50:03.953 INFO:tasks.workunit.client.1.smithi152.stdout:3/61: fsync dc/ff 0 2024-09-16T00:50:03.970 INFO:tasks.workunit.client.1.smithi152.stdout:1/57: dwrite d9/fd [0,4194304] 0 2024-09-16T00:50:03.970 INFO:tasks.workunit.client.1.smithi152.stdout:7/34: dwrite f8 [0,4194304] 0 2024-09-16T00:50:03.971 INFO:tasks.workunit.client.1.smithi152.stdout:7/35: creat d9/fd x:0 0 0 2024-09-16T00:50:03.972 INFO:tasks.workunit.client.1.smithi152.stdout:3/62: dwrite f7 [0,4194304] 0 2024-09-16T00:50:03.972 INFO:tasks.workunit.client.1.smithi152.stdout:7/36: symlink d9/le 0 2024-09-16T00:50:03.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/63: mkdir dc/d10 0 2024-09-16T00:50:03.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/64: chown f8 0 1 2024-09-16T00:50:03.981 INFO:tasks.workunit.client.1.smithi152.stdout:1/58: dread d9/fd [0,4194304] 0 2024-09-16T00:50:03.981 INFO:tasks.workunit.client.1.smithi152.stdout:1/59: dread - d9/da/df/f11 zero size 2024-09-16T00:50:03.983 INFO:tasks.workunit.client.1.smithi152.stdout:1/60: mknod d9/da/c14 0 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/61: symlink d9/l15 0 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/62: chown c1 80031989 1 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/63: fdatasync d9/da/df/f11 0 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/64: chown d9/da/c13 90158 1 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/65: dread - d9/da/df/f11 zero size 2024-09-16T00:50:03.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/66: creat d9/f16 x:0 0 0 2024-09-16T00:50:03.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/65: dread f5 [4194304,4194304] 0 2024-09-16T00:50:03.988 INFO:tasks.workunit.client.1.smithi152.stdout:7/37: dwrite f4 [0,4194304] 0 2024-09-16T00:50:03.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/18: truncate f1 4124998 0 2024-09-16T00:50:03.995 INFO:tasks.workunit.client.1.smithi152.stdout:3/66: read f7 [1936864,94619] 0 2024-09-16T00:50:04.008 INFO:tasks.workunit.client.1.smithi152.stdout:3/67: dwrite dc/fe [0,4194304] 0 2024-09-16T00:50:04.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/68: write fa [526657,37110] 0 2024-09-16T00:50:04.010 INFO:tasks.workunit.client.1.smithi152.stdout:3/69: fdatasync f3 0 2024-09-16T00:50:04.014 INFO:tasks.workunit.client.1.smithi152.stdout:3/70: mknod dc/c11 0 2024-09-16T00:50:04.014 INFO:tasks.workunit.client.1.smithi152.stdout:3/71: getdents dc/d10 0 2024-09-16T00:50:04.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/72: link dc/cd dc/c12 0 2024-09-16T00:50:04.019 INFO:tasks.workunit.client.1.smithi152.stdout:3/73: chown dc/fe 1323 1 2024-09-16T00:50:04.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/67: getdents d9/da 0 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/45: sync 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:9/42: sync 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:5/29: sync 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:2/30: sync 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/170: sync 2024-09-16T00:50:04.107 INFO:tasks.workunit.client.1.smithi152.stdout:0/7: sync 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/43: readlink d1/le 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/30: chown d6/c9 15583 1 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/19: write f1 [4728659,53283] 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/44: write d1/f8 [2189194,29087] 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/31: creat d6/fa x:0 0 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:4/171: creat d2/d1e/f36 x:0 0 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/45: dread - d1/d7/fd zero size 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:0/8: write f2 [868392,17301] 0 2024-09-16T00:50:04.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/32: creat d6/fb x:0 0 0 2024-09-16T00:50:04.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/46: mkdir db/d12 0 2024-09-16T00:50:04.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/47: creat db/f13 x:0 0 0 2024-09-16T00:50:04.114 INFO:tasks.workunit.client.1.smithi152.stdout:8/20: rename f1 to f3 0 2024-09-16T00:50:04.117 INFO:tasks.workunit.client.1.smithi152.stdout:6/48: dread f2 [4194304,4194304] 0 2024-09-16T00:50:04.118 INFO:tasks.workunit.client.1.smithi152.stdout:4/172: dread d2/f6 [0,4194304] 0 2024-09-16T00:50:04.118 INFO:tasks.workunit.client.1.smithi152.stdout:4/173: creat d2/d1e/f37 x:0 0 0 2024-09-16T00:50:04.119 INFO:tasks.workunit.client.1.smithi152.stdout:0/9: unlink f2 0 2024-09-16T00:50:04.126 INFO:tasks.workunit.client.1.smithi152.stdout:1/68: dwrite d9/f16 [0,4194304] 0 2024-09-16T00:50:04.126 INFO:tasks.workunit.client.1.smithi152.stdout:1/69: chown d9/da/df/f11 128422684 1 2024-09-16T00:50:04.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/46: dwrite d1/f8 [0,4194304] 0 2024-09-16T00:50:04.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/21: mknod c4 0 2024-09-16T00:50:04.131 INFO:tasks.workunit.client.1.smithi152.stdout:6/49: creat db/d12/f14 x:0 0 0 2024-09-16T00:50:04.131 INFO:tasks.workunit.client.1.smithi152.stdout:6/50: write fa [535094,124193] 0 2024-09-16T00:50:04.132 INFO:tasks.workunit.client.1.smithi152.stdout:6/51: chown db/c10 3095 1 2024-09-16T00:50:04.135 INFO:tasks.workunit.client.1.smithi152.stdout:4/174: creat d2/db/f38 x:0 0 0 2024-09-16T00:50:04.135 INFO:tasks.workunit.client.1.smithi152.stdout:4/175: read - d2/d1e/d28/d29/f34 zero size 2024-09-16T00:50:04.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/10: mkdir d3 0 2024-09-16T00:50:04.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/11: write f1 [526977,55463] 0 2024-09-16T00:50:04.137 INFO:tasks.workunit.client.1.smithi152.stdout:8/22: write f3 [77273,7270] 0 2024-09-16T00:50:04.137 INFO:tasks.workunit.client.1.smithi152.stdout:8/23: read f3 [2223200,127562] 0 2024-09-16T00:50:04.138 INFO:tasks.workunit.client.1.smithi152.stdout:8/24: read f3 [4752360,101172] 0 2024-09-16T00:50:04.138 INFO:tasks.workunit.client.1.smithi152.stdout:5/33: rename d6/fa to d6/fc 0 2024-09-16T00:50:04.147 INFO:tasks.workunit.client.1.smithi152.stdout:5/34: dread f0 [0,4194304] 0 2024-09-16T00:50:04.148 INFO:tasks.workunit.client.1.smithi152.stdout:0/12: rename f1 to d3/f4 0 2024-09-16T00:50:04.150 INFO:tasks.workunit.client.1.smithi152.stdout:8/25: mknod c5 0 2024-09-16T00:50:04.152 INFO:tasks.workunit.client.1.smithi152.stdout:5/35: link d6/c9 d6/cd 0 2024-09-16T00:50:04.152 INFO:tasks.workunit.client.1.smithi152.stdout:5/36: creat d6/fe x:0 0 0 2024-09-16T00:50:04.153 INFO:tasks.workunit.client.1.smithi152.stdout:5/37: fdatasync f0 0 2024-09-16T00:50:04.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/52: dwrite db/fe [0,4194304] 0 2024-09-16T00:50:04.155 INFO:tasks.workunit.client.1.smithi152.stdout:0/13: link c0 d3/c5 0 2024-09-16T00:50:04.157 INFO:tasks.workunit.client.1.smithi152.stdout:4/176: write d2/f3 [3590597,46380] 0 2024-09-16T00:50:04.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/26: creat f6 x:0 0 0 2024-09-16T00:50:04.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/27: rmdir - no directory 2024-09-16T00:50:04.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/28: write f6 [280037,52532] 0 2024-09-16T00:50:04.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/29: truncate f3 5219451 0 2024-09-16T00:50:04.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/30: readlink l2 0 2024-09-16T00:50:04.167 INFO:tasks.workunit.client.1.smithi152.stdout:8/31: dread f3 [4194304,4194304] 0 2024-09-16T00:50:04.167 INFO:tasks.workunit.client.1.smithi152.stdout:8/32: chown c4 160251 1 2024-09-16T00:50:04.167 INFO:tasks.workunit.client.1.smithi152.stdout:0/14: mkdir d3/d6 0 2024-09-16T00:50:04.167 INFO:tasks.workunit.client.1.smithi152.stdout:5/38: dwrite f1 [0,4194304] 0 2024-09-16T00:50:04.167 INFO:tasks.workunit.client.1.smithi152.stdout:5/39: creat d6/ff x:0 0 0 2024-09-16T00:50:04.168 INFO:tasks.workunit.client.1.smithi152.stdout:0/15: mknod d3/c7 0 2024-09-16T00:50:04.173 INFO:tasks.workunit.client.1.smithi152.stdout:5/40: symlink d6/l10 0 2024-09-16T00:50:04.173 INFO:tasks.workunit.client.1.smithi152.stdout:5/41: write d6/fc [942377,31104] 0 2024-09-16T00:50:04.176 INFO:tasks.workunit.client.1.smithi152.stdout:4/177: rename d2/d1e/d28/d29/d1a to d2/db/d39 0 2024-09-16T00:50:04.181 INFO:tasks.workunit.client.1.smithi152.stdout:4/178: symlink d2/d1e/d28/d29/l3a 0 2024-09-16T00:50:04.181 INFO:tasks.workunit.client.1.smithi152.stdout:4/179: chown d2/db/d39/f31 143431479 1 2024-09-16T00:50:04.181 INFO:tasks.workunit.client.1.smithi152.stdout:4/180: dread - d2/d1e/d28/d29/f24 zero size 2024-09-16T00:50:04.183 INFO:tasks.workunit.client.1.smithi152.stdout:4/181: write d2/fe [5169863,93108] 0 2024-09-16T00:50:04.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/182: creat d2/db/d39/f3b x:0 0 0 2024-09-16T00:50:04.199 INFO:tasks.workunit.client.1.smithi152.stdout:8/33: dwrite f3 [0,4194304] 0 2024-09-16T00:50:04.204 INFO:tasks.workunit.client.1.smithi152.stdout:5/42: dwrite d6/ff [0,4194304] 0 2024-09-16T00:50:04.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/34: dread f6 [0,4194304] 0 2024-09-16T00:50:04.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/35: fdatasync f3 0 2024-09-16T00:50:04.207 INFO:tasks.workunit.client.1.smithi152.stdout:4/183: dwrite d2/db/d39/f2e [0,4194304] 0 2024-09-16T00:50:04.207 INFO:tasks.workunit.client.1.smithi152.stdout:4/184: chown d2/db/d39/f31 17024 1 2024-09-16T00:50:04.220 INFO:tasks.workunit.client.1.smithi152.stdout:4/185: dwrite d2/f6 [0,4194304] 0 2024-09-16T00:50:04.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/43: mknod d6/c11 0 2024-09-16T00:50:04.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/44: write d6/fb [284484,118690] 0 2024-09-16T00:50:04.227 INFO:tasks.workunit.client.1.smithi152.stdout:8/36: link f3 f7 0 2024-09-16T00:50:04.227 INFO:tasks.workunit.client.1.smithi152.stdout:8/37: readlink l2 0 2024-09-16T00:50:04.232 INFO:tasks.workunit.client.1.smithi152.stdout:4/186: mkdir d2/db/d39/d3c 0 2024-09-16T00:50:04.235 INFO:tasks.workunit.client.1.smithi152.stdout:8/38: unlink l2 0 2024-09-16T00:50:04.238 INFO:tasks.workunit.client.1.smithi152.stdout:5/45: dwrite f1 [4194304,4194304] 0 2024-09-16T00:50:04.238 INFO:tasks.workunit.client.1.smithi152.stdout:5/46: stat d6/l10 0 2024-09-16T00:50:04.239 INFO:tasks.workunit.client.1.smithi152.stdout:8/39: unlink f6 0 2024-09-16T00:50:04.241 INFO:tasks.workunit.client.1.smithi152.stdout:4/187: symlink d2/l3d 0 2024-09-16T00:50:04.241 INFO:tasks.workunit.client.1.smithi152.stdout:6/53: getdents db 0 2024-09-16T00:50:04.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/47: mknod d6/c12 0 2024-09-16T00:50:04.251 INFO:tasks.workunit.client.1.smithi152.stdout:4/188: write d2/f16 [5860,41191] 0 2024-09-16T00:50:04.251 INFO:tasks.workunit.client.1.smithi152.stdout:5/48: write f0 [3765604,105721] 0 2024-09-16T00:50:04.252 INFO:tasks.workunit.client.1.smithi152.stdout:6/54: creat db/f15 x:0 0 0 2024-09-16T00:50:04.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/70: write d9/f16 [5229641,116213] 0 2024-09-16T00:50:04.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/71: dread - d9/da/df/f11 zero size 2024-09-16T00:50:04.256 INFO:tasks.workunit.client.1.smithi152.stdout:6/55: dread f2 [0,4194304] 0 2024-09-16T00:50:04.257 INFO:tasks.workunit.client.1.smithi152.stdout:0/16: fsync d3/f4 0 2024-09-16T00:50:04.257 INFO:tasks.workunit.client.1.smithi152.stdout:0/17: stat d3/d6 0 2024-09-16T00:50:04.258 INFO:tasks.workunit.client.1.smithi152.stdout:4/189: read d2/f6 [325102,9013] 0 2024-09-16T00:50:04.258 INFO:tasks.workunit.client.1.smithi152.stdout:4/190: chown d2/d1e/d28/d29 1937 1 2024-09-16T00:50:04.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/49: mknod d6/c13 0 2024-09-16T00:50:04.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/50: stat l5 0 2024-09-16T00:50:04.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/51: creat d6/f14 x:0 0 0 2024-09-16T00:50:04.262 INFO:tasks.workunit.client.1.smithi152.stdout:1/72: write d9/f16 [3045664,97952] 0 2024-09-16T00:50:04.263 INFO:tasks.workunit.client.1.smithi152.stdout:6/56: dread - db/f11 zero size 2024-09-16T00:50:04.265 INFO:tasks.workunit.client.1.smithi152.stdout:0/18: mkdir d3/d6/d8 0 2024-09-16T00:50:04.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/73: dread d9/fd [0,4194304] 0 2024-09-16T00:50:04.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/19: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:04.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/20: write d3/f4 [788931,86161] 0 2024-09-16T00:50:04.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/21: write d3/f4 [1509549,9954] 0 2024-09-16T00:50:04.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/22: write d3/f4 [1386055,126443] 0 2024-09-16T00:50:04.269 INFO:tasks.workunit.client.1.smithi152.stdout:5/52: symlink d6/l15 0 2024-09-16T00:50:04.273 INFO:tasks.workunit.client.1.smithi152.stdout:4/191: write d2/f4 [946782,57281] 0 2024-09-16T00:50:04.275 INFO:tasks.workunit.client.0.smithi053.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T00:50:04.275 INFO:tasks.workunit.client.0.smithi053.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T00:50:04.275 INFO:tasks.workunit.client.0.smithi053.stderr:+ make 2024-09-16T00:50:04.276 INFO:tasks.workunit.client.1.smithi152.stdout:0/23: creat d3/d6/f9 x:0 0 0 2024-09-16T00:50:04.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/57: dread db/fe [0,4194304] 0 2024-09-16T00:50:04.279 INFO:tasks.workunit.client.1.smithi152.stdout:1/74: rmdir d9 39 2024-09-16T00:50:04.281 INFO:tasks.workunit.client.1.smithi152.stdout:0/24: symlink d3/d6/la 0 2024-09-16T00:50:04.281 INFO:tasks.workunit.client.1.smithi152.stdout:4/192: write d2/db/d39/f2e [3031513,30213] 0 2024-09-16T00:50:04.286 INFO:tasks.workunit.client.1.smithi152.stdout:0/25: creat d3/fb x:0 0 0 2024-09-16T00:50:04.288 INFO:tasks.workunit.client.1.smithi152.stdout:4/193: symlink d2/db/d39/l3e 0 2024-09-16T00:50:04.292 INFO:tasks.workunit.client.1.smithi152.stdout:6/58: rmdir db/d12 39 2024-09-16T00:50:04.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/26: fdatasync d3/f4 0 2024-09-16T00:50:04.293 INFO:tasks.workunit.client.1.smithi152.stdout:1/75: dwrite d9/fd [0,4194304] 0 2024-09-16T00:50:04.295 INFO:tasks.workunit.client.1.smithi152.stdout:4/194: dread d2/f3 [0,4194304] 0 2024-09-16T00:50:04.297 INFO:tasks.workunit.client.1.smithi152.stdout:1/76: rename c1 to d9/c17 0 2024-09-16T00:50:04.299 INFO:tasks.workunit.client.1.smithi152.stdout:6/59: symlink db/l16 0 2024-09-16T00:50:04.299 INFO:tasks.workunit.client.1.smithi152.stdout:6/60: dread - f9 zero size 2024-09-16T00:50:04.301 INFO:tasks.workunit.client.1.smithi152.stdout:1/77: stat c6 0 2024-09-16T00:50:04.301 INFO:tasks.workunit.client.1.smithi152.stdout:8/40: truncate f7 1700512 0 2024-09-16T00:50:04.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/195: dread d2/db/d39/f2e [0,4194304] 0 2024-09-16T00:50:04.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/196: chown d2/d1e/d28 43 1 2024-09-16T00:50:04.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/197: write d2/db/f1d [1018834,90648] 0 2024-09-16T00:50:04.302 INFO:tasks.workunit.client.1.smithi152.stdout:4/198: read - d2/db/d39/f31 zero size 2024-09-16T00:50:04.304 INFO:tasks.workunit.client.1.smithi152.stdout:6/61: symlink db/d12/l17 0 2024-09-16T00:50:04.305 INFO:tasks.workunit.client.1.smithi152.stdout:1/78: symlink d9/da/l18 0 2024-09-16T00:50:04.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/79: creat d9/f19 x:0 0 0 2024-09-16T00:50:04.313 INFO:tasks.workunit.client.1.smithi152.stdout:6/62: truncate db/fc 2010748 0 2024-09-16T00:50:04.327 INFO:tasks.workunit.client.1.smithi152.stdout:4/199: dwrite d2/d1e/d28/f30 [0,4194304] 0 2024-09-16T00:50:04.333 INFO:tasks.workunit.client.1.smithi152.stdout:0/27: dwrite d3/fb [0,4194304] 0 2024-09-16T00:50:04.333 INFO:tasks.workunit.client.1.smithi152.stdout:0/28: creat d3/fc x:0 0 0 2024-09-16T00:50:04.333 INFO:tasks.workunit.client.1.smithi152.stdout:0/29: read - d3/d6/f9 zero size 2024-09-16T00:50:04.333 INFO:tasks.workunit.client.1.smithi152.stdout:4/200: mknod d2/c3f 0 2024-09-16T00:50:04.335 INFO:tasks.workunit.client.1.smithi152.stdout:7/38: sync 2024-09-16T00:50:04.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/80: dwrite d9/fd [0,4194304] 0 2024-09-16T00:50:04.339 INFO:tasks.workunit.client.1.smithi152.stdout:3/74: sync 2024-09-16T00:50:04.339 INFO:tasks.workunit.client.1.smithi152.stdout:0/30: symlink d3/d6/ld 0 2024-09-16T00:50:04.339 INFO:tasks.workunit.client.1.smithi152.stdout:0/31: fsync d3/f4 0 2024-09-16T00:50:04.339 INFO:tasks.workunit.client.1.smithi152.stdout:0/32: chown d3/d6/la 594494 1 2024-09-16T00:50:04.340 INFO:tasks.workunit.client.1.smithi152.stdout:0/33: truncate d3/d6/f9 908753 0 2024-09-16T00:50:04.341 INFO:tasks.workunit.client.1.smithi152.stdout:6/63: dwrite fa [0,4194304] 0 2024-09-16T00:50:04.345 INFO:tasks.workunit.client.1.smithi152.stdout:0/34: symlink d3/le 0 2024-09-16T00:50:04.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/35: write d3/fc [351465,51678] 0 2024-09-16T00:50:04.351 INFO:tasks.workunit.client.1.smithi152.stdout:6/64: creat db/f18 x:0 0 0 2024-09-16T00:50:04.351 INFO:tasks.workunit.client.1.smithi152.stdout:6/65: stat c5 0 2024-09-16T00:50:04.351 INFO:tasks.workunit.client.1.smithi152.stdout:6/66: dread - f9 zero size 2024-09-16T00:50:04.351 INFO:tasks.workunit.client.1.smithi152.stdout:6/67: truncate f9 40235 0 2024-09-16T00:50:04.352 INFO:tasks.workunit.client.1.smithi152.stdout:4/201: dwrite d2/d1e/d28/d29/f34 [0,4194304] 0 2024-09-16T00:50:04.354 INFO:tasks.workunit.client.1.smithi152.stdout:5/53: truncate f0 86878 0 2024-09-16T00:50:04.355 INFO:tasks.workunit.client.1.smithi152.stdout:0/36: unlink d3/c7 0 2024-09-16T00:50:04.355 INFO:tasks.workunit.client.1.smithi152.stdout:0/37: chown d3/d6/la 1 1 2024-09-16T00:50:04.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/38: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:04.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/39: stat d3/d6/la 0 2024-09-16T00:50:04.359 INFO:tasks.workunit.client.1.smithi152.stdout:3/75: dwrite f5 [0,4194304] 0 2024-09-16T00:50:04.359 INFO:tasks.workunit.client.1.smithi152.stdout:3/76: dread - dc/ff zero size 2024-09-16T00:50:04.360 INFO:tasks.workunit.client.1.smithi152.stdout:6/68: link fa db/f19 0 2024-09-16T00:50:04.361 INFO:tasks.workunit.client.1.smithi152.stdout:0/40: creat d3/d6/d8/ff x:0 0 0 2024-09-16T00:50:04.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/41: readlink d3/d6/ld 0 2024-09-16T00:50:04.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/42: truncate d3/d6/d8/ff 298457 0 2024-09-16T00:50:04.365 INFO:tasks.workunit.client.1.smithi152.stdout:6/69: creat db/d12/f1a x:0 0 0 2024-09-16T00:50:04.365 INFO:tasks.workunit.client.1.smithi152.stdout:4/202: write d2/d1e/d28/f30 [3571603,26106] 0 2024-09-16T00:50:04.365 INFO:tasks.workunit.client.1.smithi152.stdout:4/203: chown d2/f6 989238 1 2024-09-16T00:50:04.365 INFO:tasks.workunit.client.1.smithi152.stdout:4/204: truncate d2/f16 108374 0 2024-09-16T00:50:04.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/54: getdents d6 0 2024-09-16T00:50:04.368 INFO:tasks.workunit.client.1.smithi152.stdout:5/55: read d6/fc [718762,46822] 0 2024-09-16T00:50:04.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/70: dread f2 [0,4194304] 0 2024-09-16T00:50:04.372 INFO:tasks.workunit.client.1.smithi152.stdout:5/56: mkdir d6/d16 0 2024-09-16T00:50:04.373 INFO:tasks.workunit.client.1.smithi152.stdout:5/57: symlink d6/d16/l17 0 2024-09-16T00:50:04.379 INFO:tasks.workunit.client.1.smithi152.stdout:5/58: unlink f1 0 2024-09-16T00:50:04.383 INFO:tasks.workunit.client.1.smithi152.stdout:5/59: mknod d6/d16/c18 0 2024-09-16T00:50:04.385 INFO:tasks.workunit.client.1.smithi152.stdout:3/77: dwrite f8 [0,4194304] 0 2024-09-16T00:50:04.385 INFO:tasks.workunit.client.1.smithi152.stdout:3/78: readlink l9 0 2024-09-16T00:50:04.387 INFO:tasks.workunit.client.1.smithi152.stdout:1/81: rename d9/c17 to d9/c1a 0 2024-09-16T00:50:04.388 INFO:tasks.workunit.client.1.smithi152.stdout:0/43: dwrite d3/d6/d8/ff [0,4194304] 0 2024-09-16T00:50:04.389 INFO:tasks.workunit.client.1.smithi152.stdout:5/60: symlink d6/d16/l19 0 2024-09-16T00:50:04.390 INFO:tasks.workunit.client.1.smithi152.stdout:4/205: dwrite d2/d1e/f35 [0,4194304] 0 2024-09-16T00:50:04.391 INFO:tasks.workunit.client.1.smithi152.stdout:6/71: dwrite db/d12/f14 [0,4194304] 0 2024-09-16T00:50:04.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/47: sync 2024-09-16T00:50:04.395 INFO:tasks.workunit.client.1.smithi152.stdout:2/31: sync 2024-09-16T00:50:04.395 INFO:tasks.workunit.client.1.smithi152.stdout:0/44: mknod d3/d6/c10 0 2024-09-16T00:50:04.396 INFO:tasks.workunit.client.1.smithi152.stdout:4/206: dread d2/f3 [0,4194304] 0 2024-09-16T00:50:04.397 INFO:tasks.workunit.client.1.smithi152.stdout:5/61: rename d6/f14 to d6/f1a 0 2024-09-16T00:50:04.404 INFO:tasks.workunit.client.1.smithi152.stdout:0/45: dread d3/d6/d8/ff [0,4194304] 0 2024-09-16T00:50:04.406 INFO:tasks.workunit.client.1.smithi152.stdout:0/46: dread d3/fc [0,4194304] 0 2024-09-16T00:50:04.407 INFO:tasks.workunit.client.1.smithi152.stdout:4/207: dread d2/f16 [0,4194304] 0 2024-09-16T00:50:04.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/32: mknod d4/c8 0 2024-09-16T00:50:04.409 INFO:tasks.workunit.client.1.smithi152.stdout:0/47: dread d3/fc [0,4194304] 0 2024-09-16T00:50:04.409 INFO:tasks.workunit.client.1.smithi152.stdout:0/48: write d3/f4 [1246270,43476] 0 2024-09-16T00:50:04.409 INFO:tasks.workunit.client.1.smithi152.stdout:0/49: truncate d3/d6/f9 1569103 0 2024-09-16T00:50:04.409 INFO:tasks.workunit.client.1.smithi152.stdout:9/48: symlink d1/l11 0 2024-09-16T00:50:04.409 INFO:tasks.workunit.client.1.smithi152.stdout:9/49: read d1/fa [3691708,68651] 0 2024-09-16T00:50:04.410 INFO:tasks.workunit.client.1.smithi152.stdout:5/62: mkdir d6/d1b 0 2024-09-16T00:50:04.414 INFO:tasks.workunit.client.1.smithi152.stdout:2/33: unlink f1 0 2024-09-16T00:50:04.415 INFO:tasks.workunit.client.1.smithi152.stdout:2/34: fdatasync f2 0 2024-09-16T00:50:04.415 INFO:tasks.workunit.client.1.smithi152.stdout:2/35: truncate f0 950902 0 2024-09-16T00:50:04.416 INFO:tasks.workunit.client.1.smithi152.stdout:0/50: mknod d3/c11 0 2024-09-16T00:50:04.417 INFO:tasks.workunit.client.1.smithi152.stdout:2/36: dread d4/f6 [0,4194304] 0 2024-09-16T00:50:04.418 INFO:tasks.workunit.client.1.smithi152.stdout:2/37: creat d4/f9 x:0 0 0 2024-09-16T00:50:04.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/63: symlink d6/d16/l1c 0 2024-09-16T00:50:04.420 INFO:tasks.workunit.client.1.smithi152.stdout:1/82: dwrite d9/f16 [0,4194304] 0 2024-09-16T00:50:04.423 INFO:tasks.workunit.client.1.smithi152.stdout:4/208: symlink d2/db/l40 0 2024-09-16T00:50:04.423 INFO:tasks.workunit.client.1.smithi152.stdout:4/209: stat d2/d1e/d28 0 2024-09-16T00:50:04.427 INFO:tasks.workunit.client.1.smithi152.stdout:0/51: write d3/fb [1797829,24620] 0 2024-09-16T00:50:04.428 INFO:tasks.workunit.client.1.smithi152.stdout:2/38: rename d4/f6 to d4/fa 0 2024-09-16T00:50:04.428 INFO:tasks.workunit.client.1.smithi152.stdout:2/39: fdatasync f2 0 2024-09-16T00:50:04.428 INFO:tasks.workunit.client.1.smithi152.stdout:2/40: readlink - no filename 2024-09-16T00:50:04.429 INFO:tasks.workunit.client.1.smithi152.stdout:1/83: creat d9/da/df/f1b x:0 0 0 2024-09-16T00:50:04.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/84: read d9/f16 [4730123,121361] 0 2024-09-16T00:50:04.436 INFO:tasks.workunit.client.1.smithi152.stdout:2/41: mknod d4/cb 0 2024-09-16T00:50:04.437 INFO:tasks.workunit.client.1.smithi152.stdout:2/42: stat d4 0 2024-09-16T00:50:04.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/210: mkdir d2/d41 0 2024-09-16T00:50:04.443 INFO:tasks.workunit.client.1.smithi152.stdout:8/41: dwrite f7 [0,4194304] 0 2024-09-16T00:50:04.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/43: mknod d4/cc 0 2024-09-16T00:50:04.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/211: mknod d2/d1e/c42 0 2024-09-16T00:50:04.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/212: read - d2/db/d39/f31 zero size 2024-09-16T00:50:04.448 INFO:tasks.workunit.client.1.smithi152.stdout:4/213: rename d2/d1e/c42 to d2/d1e/c43 0 2024-09-16T00:50:04.452 INFO:tasks.workunit.client.1.smithi152.stdout:8/42: dread f7 [0,4194304] 0 2024-09-16T00:50:04.452 INFO:tasks.workunit.client.1.smithi152.stdout:4/214: mkdir d2/db/d44 0 2024-09-16T00:50:04.452 INFO:tasks.workunit.client.1.smithi152.stdout:4/215: write d2/f4 [903466,94810] 0 2024-09-16T00:50:04.452 INFO:tasks.workunit.client.1.smithi152.stdout:4/216: chown d2/d1e/d28/d29/f34 9376403 1 2024-09-16T00:50:04.456 INFO:tasks.workunit.client.1.smithi152.stdout:9/50: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:04.456 INFO:tasks.workunit.client.1.smithi152.stdout:5/64: dwrite d6/fe [0,4194304] 0 2024-09-16T00:50:04.456 INFO:tasks.workunit.client.1.smithi152.stdout:1/85: dwrite d9/f16 [4194304,4194304] 0 2024-09-16T00:50:04.457 INFO:tasks.workunit.client.1.smithi152.stdout:8/43: write f3 [3408337,8957] 0 2024-09-16T00:50:04.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/72: dwrite db/f13 [0,4194304] 0 2024-09-16T00:50:04.465 INFO:tasks.workunit.client.1.smithi152.stdout:5/65: unlink d6/d16/l17 0 2024-09-16T00:50:04.465 INFO:tasks.workunit.client.1.smithi152.stdout:5/66: chown d6/d16/c18 651113 1 2024-09-16T00:50:04.465 INFO:tasks.workunit.client.1.smithi152.stdout:5/67: rename d6/d16 to d6/d16/d1d 22 2024-09-16T00:50:04.465 INFO:tasks.workunit.client.1.smithi152.stdout:5/68: chown d6/d16/c18 0 1 2024-09-16T00:50:04.468 INFO:tasks.workunit.client.1.smithi152.stdout:1/86: creat d9/da/f1c x:0 0 0 2024-09-16T00:50:04.471 INFO:tasks.workunit.client.1.smithi152.stdout:9/51: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:04.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/52: truncate d3/d6/d8/ff 1594725 0 2024-09-16T00:50:04.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/69: creat d6/f1e x:0 0 0 2024-09-16T00:50:04.486 INFO:tasks.workunit.client.1.smithi152.stdout:1/87: rename d9/da/df/f1b to d9/da/f1d 0 2024-09-16T00:50:04.488 INFO:tasks.workunit.client.1.smithi152.stdout:6/73: mknod db/c1b 0 2024-09-16T00:50:04.489 INFO:tasks.workunit.client.1.smithi152.stdout:6/74: truncate db/d12/f14 5218176 0 2024-09-16T00:50:04.489 INFO:tasks.workunit.client.1.smithi152.stdout:9/52: dwrite d1/ff [0,4194304] 0 2024-09-16T00:50:04.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/70: mkdir d6/d16/d1f 0 2024-09-16T00:50:04.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/71: creat d6/f20 x:0 0 0 2024-09-16T00:50:04.498 INFO:tasks.workunit.client.1.smithi152.stdout:9/53: rename d1/f8 to d1/f12 0 2024-09-16T00:50:04.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/53: truncate d3/fc 108519 0 2024-09-16T00:50:04.501 INFO:tasks.workunit.client.1.smithi152.stdout:5/72: creat d6/d16/d1f/f21 x:0 0 0 2024-09-16T00:50:04.501 INFO:tasks.workunit.client.1.smithi152.stdout:5/73: fsync d6/f1a 0 2024-09-16T00:50:04.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/74: readlink d6/l10 0 2024-09-16T00:50:04.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/75: creat d6/d16/d1f/f22 x:0 0 0 2024-09-16T00:50:04.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/76: write d6/fb [594266,99399] 0 2024-09-16T00:50:04.503 INFO:tasks.workunit.client.1.smithi152.stdout:5/77: fdatasync d6/fb 0 2024-09-16T00:50:04.503 INFO:tasks.workunit.client.1.smithi152.stdout:5/78: stat d6/d1b 0 2024-09-16T00:50:04.503 INFO:tasks.workunit.client.1.smithi152.stdout:5/79: fdatasync d6/f20 0 2024-09-16T00:50:04.507 INFO:tasks.workunit.client.1.smithi152.stdout:9/54: dread d1/f12 [0,4194304] 0 2024-09-16T00:50:04.512 INFO:tasks.workunit.client.0.smithi053.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T00:50:04.513 INFO:tasks.workunit.client.1.smithi152.stdout:9/55: mkdir d1/d7/d13 0 2024-09-16T00:50:04.513 INFO:tasks.workunit.client.1.smithi152.stdout:2/44: rmdir d4 39 2024-09-16T00:50:04.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/56: mkdir d1/d14 0 2024-09-16T00:50:04.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/57: fsync d1/fb 0 2024-09-16T00:50:04.516 INFO:tasks.workunit.client.1.smithi152.stdout:2/45: symlink d4/ld 0 2024-09-16T00:50:04.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/46: unlink f0 0 2024-09-16T00:50:04.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/47: chown d4/f7 0 1 2024-09-16T00:50:04.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/48: write d4/f9 [607813,121648] 0 2024-09-16T00:50:04.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/49: chown d4/f7 3570 1 2024-09-16T00:50:04.518 INFO:tasks.workunit.client.1.smithi152.stdout:2/50: creat d4/fe x:0 0 0 2024-09-16T00:50:04.518 INFO:tasks.workunit.client.1.smithi152.stdout:2/51: dread - d4/fe zero size 2024-09-16T00:50:04.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/58: dread d1/f12 [0,4194304] 0 2024-09-16T00:50:04.520 INFO:tasks.workunit.client.1.smithi152.stdout:2/52: mknod d4/cf 0 2024-09-16T00:50:04.521 INFO:tasks.workunit.client.1.smithi152.stdout:5/80: dwrite f4 [0,4194304] 0 2024-09-16T00:50:04.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/59: mknod d1/d7/d13/c15 0 2024-09-16T00:50:04.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/60: readlink d1/l6 0 2024-09-16T00:50:04.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/61: dread - d1/d7/fd zero size 2024-09-16T00:50:04.522 INFO:tasks.workunit.client.1.smithi152.stdout:2/53: mknod d4/c10 0 2024-09-16T00:50:04.525 INFO:tasks.workunit.client.1.smithi152.stdout:5/81: creat d6/d16/f23 x:0 0 0 2024-09-16T00:50:04.525 INFO:tasks.workunit.client.1.smithi152.stdout:5/82: creat d6/d16/f24 x:0 0 0 2024-09-16T00:50:04.525 INFO:tasks.workunit.client.1.smithi152.stdout:9/62: truncate d1/f12 525832 0 2024-09-16T00:50:04.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/63: chown d1/l2 561368197 1 2024-09-16T00:50:04.530 INFO:tasks.workunit.client.1.smithi152.stdout:2/54: mknod d4/c11 0 2024-09-16T00:50:04.535 INFO:tasks.workunit.client.1.smithi152.stdout:9/64: unlink d1/l10 0 2024-09-16T00:50:04.536 INFO:tasks.workunit.client.1.smithi152.stdout:1/88: getdents d9/da/df 0 2024-09-16T00:50:04.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/89: rename d9/fd to d9/da/df/f1e 0 2024-09-16T00:50:04.540 INFO:tasks.workunit.client.1.smithi152.stdout:6/75: rmdir db 39 2024-09-16T00:50:04.540 INFO:tasks.workunit.client.1.smithi152.stdout:6/76: chown db/f13 9 1 2024-09-16T00:50:04.542 INFO:tasks.workunit.client.1.smithi152.stdout:5/83: dwrite f0 [0,4194304] 0 2024-09-16T00:50:04.542 INFO:tasks.workunit.client.1.smithi152.stdout:5/84: readlink d6/d16/l19 0 2024-09-16T00:50:04.547 INFO:tasks.workunit.client.1.smithi152.stdout:0/54: truncate d3/fc 1111953 0 2024-09-16T00:50:04.547 INFO:tasks.workunit.client.1.smithi152.stdout:0/55: creat d3/f12 x:0 0 0 2024-09-16T00:50:04.547 INFO:tasks.workunit.client.1.smithi152.stdout:0/56: write d3/f4 [2375598,41680] 0 2024-09-16T00:50:04.548 INFO:tasks.workunit.client.1.smithi152.stdout:1/90: write d9/f16 [3286331,106163] 0 2024-09-16T00:50:04.548 INFO:tasks.workunit.client.1.smithi152.stdout:1/91: chown c6 113 1 2024-09-16T00:50:04.548 INFO:tasks.workunit.client.1.smithi152.stdout:1/92: truncate d9/da/f1c 575382 0 2024-09-16T00:50:04.549 INFO:tasks.workunit.client.1.smithi152.stdout:5/85: getdents d6 0 2024-09-16T00:50:04.550 INFO:tasks.workunit.client.1.smithi152.stdout:0/57: mknod d3/d6/c13 0 2024-09-16T00:50:04.550 INFO:tasks.workunit.client.1.smithi152.stdout:0/58: read d3/f4 [1042145,109666] 0 2024-09-16T00:50:04.550 INFO:tasks.workunit.client.1.smithi152.stdout:0/59: fdatasync d3/f12 0 2024-09-16T00:50:04.550 INFO:tasks.workunit.client.1.smithi152.stdout:0/60: chown d3/fc 11689317 1 2024-09-16T00:50:04.551 INFO:tasks.workunit.client.1.smithi152.stdout:1/93: rmdir d9/da/df 39 2024-09-16T00:50:04.552 INFO:tasks.workunit.client.1.smithi152.stdout:5/86: link d6/l15 d6/d16/d1f/l25 0 2024-09-16T00:50:04.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/77: dwrite db/f15 [0,4194304] 0 2024-09-16T00:50:04.554 INFO:tasks.workunit.client.1.smithi152.stdout:0/61: truncate d3/d6/f9 1347315 0 2024-09-16T00:50:04.555 INFO:tasks.workunit.client.1.smithi152.stdout:7/39: sync 2024-09-16T00:50:04.557 INFO:tasks.workunit.client.1.smithi152.stdout:1/94: unlink d9/l12 0 2024-09-16T00:50:04.557 INFO:tasks.workunit.client.1.smithi152.stdout:1/95: readlink d9/l15 0 2024-09-16T00:50:04.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/87: dread f4 [0,4194304] 0 2024-09-16T00:50:04.563 INFO:tasks.workunit.client.1.smithi152.stdout:7/40: dread f7 [0,4194304] 0 2024-09-16T00:50:04.563 INFO:tasks.workunit.client.1.smithi152.stdout:7/41: creat d9/ff x:0 0 0 2024-09-16T00:50:04.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/78: mkdir db/d12/d1c 0 2024-09-16T00:50:04.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/79: dread - db/f11 zero size 2024-09-16T00:50:04.570 INFO:tasks.workunit.client.1.smithi152.stdout:5/88: dread f0 [0,4194304] 0 2024-09-16T00:50:04.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/80: mknod db/d12/c1d 0 2024-09-16T00:50:04.579 INFO:tasks.workunit.client.1.smithi152.stdout:5/89: mknod d6/d16/d1f/c26 0 2024-09-16T00:50:04.579 INFO:tasks.workunit.client.1.smithi152.stdout:9/65: rmdir d1 39 2024-09-16T00:50:04.579 INFO:tasks.workunit.client.1.smithi152.stdout:9/66: fsync d1/fa 0 2024-09-16T00:50:04.582 INFO:tasks.workunit.client.1.smithi152.stdout:6/81: creat db/f1e x:0 0 0 2024-09-16T00:50:04.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/96: rename d9/da/df/l10 to d9/da/df/l1f 0 2024-09-16T00:50:04.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/97: mknod d9/c20 0 2024-09-16T00:50:04.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/98: dread - d9/f19 zero size 2024-09-16T00:50:04.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/99: creat d9/f21 x:0 0 0 2024-09-16T00:50:04.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/79: sync 2024-09-16T00:50:04.590 INFO:tasks.workunit.client.1.smithi152.stdout:7/42: fsync d9/ff 0 2024-09-16T00:50:04.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/43: mkdir d9/d10 0 2024-09-16T00:50:04.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/44: dread - d9/fb zero size 2024-09-16T00:50:04.594 INFO:tasks.workunit.client.1.smithi152.stdout:5/90: getdents d6/d16/d1f 0 2024-09-16T00:50:04.594 INFO:tasks.workunit.client.1.smithi152.stdout:5/91: write d6/f1a [782810,65969] 0 2024-09-16T00:50:04.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/45: link d9/lc d9/d10/l11 0 2024-09-16T00:50:04.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/46: dread - d9/fd zero size 2024-09-16T00:50:04.601 INFO:tasks.workunit.client.1.smithi152.stdout:7/47: creat d9/d10/f12 x:0 0 0 2024-09-16T00:50:04.601 INFO:tasks.workunit.client.1.smithi152.stdout:7/48: creat d9/f13 x:0 0 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/92: write d6/fe [1773361,33991] 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/93: fdatasync d6/fb 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/94: write d6/fc [1340048,33443] 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/95: dread - d6/d16/f23 zero size 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/96: creat d6/d16/f27 x:0 0 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/97: readlink d6/l15 0 2024-09-16T00:50:04.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/98: readlink l5 0 2024-09-16T00:50:04.611 INFO:tasks.workunit.client.1.smithi152.stdout:6/82: dwrite db/fe [0,4194304] 0 2024-09-16T00:50:04.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/80: dwrite dc/ff [0,4194304] 0 2024-09-16T00:50:04.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/100: dwrite d9/da/f1d [0,4194304] 0 2024-09-16T00:50:04.614 INFO:tasks.workunit.client.1.smithi152.stdout:5/99: dread d6/f1a [0,4194304] 0 2024-09-16T00:50:04.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/49: rmdir d9/d10 39 2024-09-16T00:50:04.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/50: chown d9/d10 630 1 2024-09-16T00:50:04.621 INFO:tasks.workunit.client.1.smithi152.stdout:1/101: symlink d9/l22 0 2024-09-16T00:50:04.621 INFO:tasks.workunit.client.1.smithi152.stdout:5/100: creat d6/d1b/f28 x:0 0 0 2024-09-16T00:50:04.622 INFO:tasks.workunit.client.1.smithi152.stdout:3/81: write f3 [1989340,70429] 0 2024-09-16T00:50:04.623 INFO:tasks.workunit.client.1.smithi152.stdout:6/83: rename db/lf to db/d12/l1f 0 2024-09-16T00:50:04.623 INFO:tasks.workunit.client.1.smithi152.stdout:7/51: mknod d9/c14 0 2024-09-16T00:50:04.624 INFO:tasks.workunit.client.1.smithi152.stdout:1/102: mkdir d9/d23 0 2024-09-16T00:50:04.626 INFO:tasks.workunit.client.1.smithi152.stdout:5/101: creat d6/d16/d1f/f29 x:0 0 0 2024-09-16T00:50:04.626 INFO:tasks.workunit.client.1.smithi152.stdout:5/102: truncate d6/f20 57903 0 2024-09-16T00:50:04.628 INFO:tasks.workunit.client.1.smithi152.stdout:3/82: truncate f2 2638 0 2024-09-16T00:50:04.629 INFO:tasks.workunit.client.1.smithi152.stdout:6/84: mkdir db/d12/d20 0 2024-09-16T00:50:04.632 INFO:tasks.workunit.client.1.smithi152.stdout:3/83: symlink dc/l13 0 2024-09-16T00:50:04.633 INFO:tasks.workunit.client.1.smithi152.stdout:3/84: chown f6 892793125 1 2024-09-16T00:50:04.633 INFO:tasks.workunit.client.1.smithi152.stdout:3/85: write fa [1315985,65367] 0 2024-09-16T00:50:04.633 INFO:tasks.workunit.client.1.smithi152.stdout:3/86: fdatasync dc/ff 0 2024-09-16T00:50:04.635 INFO:tasks.workunit.client.1.smithi152.stdout:6/85: creat db/d12/d20/f21 x:0 0 0 2024-09-16T00:50:04.639 INFO:tasks.workunit.client.1.smithi152.stdout:5/103: getdents d6/d1b 0 2024-09-16T00:50:04.642 INFO:tasks.workunit.client.1.smithi152.stdout:3/87: dread dc/fe [0,4194304] 0 2024-09-16T00:50:04.642 INFO:tasks.workunit.client.1.smithi152.stdout:6/86: mkdir db/d12/d1c/d22 0 2024-09-16T00:50:04.642 INFO:tasks.workunit.client.1.smithi152.stdout:6/87: chown c5 256432807 1 2024-09-16T00:50:04.642 INFO:tasks.workunit.client.1.smithi152.stdout:6/88: fsync db/d12/f14 0 2024-09-16T00:50:04.643 INFO:tasks.workunit.client.1.smithi152.stdout:5/104: creat d6/f2a x:0 0 0 2024-09-16T00:50:04.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/88: mknod dc/d10/c14 0 2024-09-16T00:50:04.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/89: fdatasync f5 0 2024-09-16T00:50:04.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/90: write f3 [1450077,112549] 0 2024-09-16T00:50:04.645 INFO:tasks.workunit.client.1.smithi152.stdout:6/89: mkdir db/d12/d23 0 2024-09-16T00:50:04.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/90: link db/fe db/d12/d1c/d22/f24 0 2024-09-16T00:50:04.650 INFO:tasks.workunit.client.1.smithi152.stdout:6/91: link l4 db/d12/d1c/l25 0 2024-09-16T00:50:04.653 INFO:tasks.workunit.client.1.smithi152.stdout:6/92: rename db/d12/l1f to db/l26 0 2024-09-16T00:50:04.655 INFO:tasks.workunit.client.1.smithi152.stdout:6/93: symlink db/l27 0 2024-09-16T00:50:04.656 INFO:tasks.workunit.client.1.smithi152.stdout:7/52: dwrite d9/fd [0,4194304] 0 2024-09-16T00:50:04.657 INFO:tasks.workunit.client.1.smithi152.stdout:6/94: mkdir db/d28 0 2024-09-16T00:50:04.657 INFO:tasks.workunit.client.1.smithi152.stdout:3/91: dread dc/ff [0,4194304] 0 2024-09-16T00:50:04.658 INFO:tasks.workunit.client.1.smithi152.stdout:3/92: chown dc/d10/c14 375583 1 2024-09-16T00:50:04.658 INFO:tasks.workunit.client.1.smithi152.stdout:1/103: dwrite d9/da/df/f1e [4194304,4194304] 0 2024-09-16T00:50:04.661 INFO:tasks.workunit.client.1.smithi152.stdout:3/93: link dc/fe dc/f15 0 2024-09-16T00:50:04.667 INFO:tasks.workunit.client.1.smithi152.stdout:7/53: dread f3 [4194304,4194304] 0 2024-09-16T00:50:04.667 INFO:tasks.workunit.client.1.smithi152.stdout:7/54: chown d9/d10/l11 585 1 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:6/95: read db/f15 [1324407,82736] 0 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:6/96: chown db/l27 24558 1 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:6/97: write f2 [9038873,21829] 0 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/55: mknod d9/c15 0 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/56: chown f4 0 1 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:6/98: write f9 [445628,59876] 0 2024-09-16T00:50:04.672 INFO:tasks.workunit.client.1.smithi152.stdout:1/104: dread d9/da/df/f1e [4194304,4194304] 0 2024-09-16T00:50:04.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/57: creat d9/d10/f16 x:0 0 0 2024-09-16T00:50:04.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/58: creat d9/d10/f17 x:0 0 0 2024-09-16T00:50:04.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/59: write d9/fb [866633,111061] 0 2024-09-16T00:50:04.676 INFO:tasks.workunit.client.1.smithi152.stdout:1/105: symlink d9/d23/l24 0 2024-09-16T00:50:04.676 INFO:tasks.workunit.client.1.smithi152.stdout:5/105: dwrite d6/fe [4194304,4194304] 0 2024-09-16T00:50:04.680 INFO:tasks.workunit.client.1.smithi152.stdout:1/106: truncate d9/da/f1d 3258778 0 2024-09-16T00:50:04.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/106: mkdir d6/d1b/d2b 0 2024-09-16T00:50:04.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/107: chown d6/c13 59 1 2024-09-16T00:50:04.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/108: dread - d6/f2a zero size 2024-09-16T00:50:04.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/109: chown d6/d16/d1f/f22 1225 1 2024-09-16T00:50:04.684 INFO:tasks.workunit.client.1.smithi152.stdout:1/107: unlink d9/da/df/l1f 0 2024-09-16T00:50:04.685 INFO:tasks.workunit.client.1.smithi152.stdout:1/108: rmdir d9/d23 39 2024-09-16T00:50:04.687 INFO:tasks.workunit.client.1.smithi152.stdout:1/109: rename d9/d23/l24 to d9/da/l25 0 2024-09-16T00:50:04.689 INFO:tasks.workunit.client.1.smithi152.stdout:7/60: dwrite d9/f13 [0,4194304] 0 2024-09-16T00:50:04.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/61: mknod d9/c18 0 2024-09-16T00:50:04.695 INFO:tasks.workunit.client.1.smithi152.stdout:5/110: write d6/f8 [604132,61388] 0 2024-09-16T00:50:04.696 INFO:tasks.workunit.client.1.smithi152.stdout:7/62: write d9/fb [601124,113283] 0 2024-09-16T00:50:04.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/111: symlink d6/d1b/l2c 0 2024-09-16T00:50:04.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/112: dread - d6/d16/d1f/f21 zero size 2024-09-16T00:50:04.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/113: stat f0 0 2024-09-16T00:50:04.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/114: dread - d6/d16/f27 zero size 2024-09-16T00:50:04.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/115: truncate d6/fe 8497574 0 2024-09-16T00:50:04.705 INFO:tasks.workunit.client.1.smithi152.stdout:5/116: write d6/d16/f23 [1012974,59607] 0 2024-09-16T00:50:04.705 INFO:tasks.workunit.client.1.smithi152.stdout:5/117: creat d6/f2d x:0 0 0 2024-09-16T00:50:04.705 INFO:tasks.workunit.client.1.smithi152.stdout:1/110: dwrite d9/da/f1c [0,4194304] 0 2024-09-16T00:50:04.705 INFO:tasks.workunit.client.1.smithi152.stdout:1/111: write d9/f19 [189229,83803] 0 2024-09-16T00:50:04.705 INFO:tasks.workunit.client.1.smithi152.stdout:1/112: readlink d9/da/le 0 2024-09-16T00:50:04.711 INFO:tasks.workunit.client.1.smithi152.stdout:1/113: rename c7 to d9/d23/c26 0 2024-09-16T00:50:04.712 INFO:tasks.workunit.client.1.smithi152.stdout:7/63: dwrite d9/d10/f12 [0,4194304] 0 2024-09-16T00:50:04.715 INFO:tasks.workunit.client.1.smithi152.stdout:7/64: unlink d9/ff 0 2024-09-16T00:50:04.717 INFO:tasks.workunit.client.1.smithi152.stdout:1/114: link d9/da/f1d d9/da/df/f27 0 2024-09-16T00:50:04.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/118: getdents d6/d1b 0 2024-09-16T00:50:04.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/119: creat d6/d16/d1f/f2e x:0 0 0 2024-09-16T00:50:04.720 INFO:tasks.workunit.client.1.smithi152.stdout:7/65: rename d9/lc to d9/d10/l19 0 2024-09-16T00:50:04.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/66: mknod d9/d10/c1a 0 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/67: truncate f7 3211111 0 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/68: creat d9/f1b x:0 0 0 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/69: chown d9/d10 782 1 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/70: chown d9 0 1 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/71: write d9/d10/f17 [1042609,53122] 0 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/72: chown d9/d10/l19 1101 1 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/73: readlink l0 0 2024-09-16T00:50:04.724 INFO:tasks.workunit.client.1.smithi152.stdout:7/74: stat d9/fb 0 2024-09-16T00:50:04.725 INFO:tasks.workunit.client.1.smithi152.stdout:7/75: symlink d9/l1c 0 2024-09-16T00:50:04.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/76: rename d9/d10/c1a to d9/c1d 0 2024-09-16T00:50:04.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/77: symlink d9/d10/l1e 0 2024-09-16T00:50:04.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/78: creat d9/f1f x:0 0 0 2024-09-16T00:50:04.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/79: stat d9/f13 0 2024-09-16T00:50:04.732 INFO:tasks.workunit.client.1.smithi152.stdout:7/80: symlink d9/d10/l20 0 2024-09-16T00:50:04.739 INFO:tasks.workunit.client.1.smithi152.stdout:3/94: dread f2 [0,4194304] 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:3/95: mknod dc/c16 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/115: dwrite d9/da/f1c [0,4194304] 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/116: fdatasync d9/f16 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/117: stat c6 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:5/120: dwrite d6/fe [0,4194304] 0 2024-09-16T00:50:04.779 INFO:tasks.workunit.client.1.smithi152.stdout:5/121: dread d6/f20 [0,4194304] 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:1/118: mknod d9/da/df/c28 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:5/122: rename d6/f2a to d6/d1b/d2b/f2f 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:5/123: creat d6/f30 x:0 0 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/81: getdents d9/d10 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/82: rename d9/le to d9/l21 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/83: rename d9/d10/l19 to d9/l22 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/84: creat d9/f23 x:0 0 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/99: dwrite db/f18 [0,4194304] 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/100: stat c1 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/85: mknod d9/c24 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/86: fsync d9/fd 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/87: link d9/f1b d9/f25 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/101: getdents db/d12/d20 0 2024-09-16T00:50:04.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/88: symlink d9/l26 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/89: fsync d9/d10/f12 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/90: fsync f7 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/91: chown d9/f25 12 1 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:6/102: dread db/f15 [0,4194304] 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/124: dwrite d6/f2d [0,4194304] 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:1/119: dwrite d9/f19 [0,4194304] 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:6/103: truncate f2 3355467 0 2024-09-16T00:50:04.781 INFO:tasks.workunit.client.1.smithi152.stdout:6/104: dread - db/d12/d20/f21 zero size 2024-09-16T00:50:04.785 INFO:tasks.workunit.client.1.smithi152.stdout:5/125: getdents d6/d1b/d2b 0 2024-09-16T00:50:04.786 INFO:tasks.workunit.client.1.smithi152.stdout:5/126: fsync d6/fc 0 2024-09-16T00:50:04.786 INFO:tasks.workunit.client.1.smithi152.stdout:5/127: read - d6/d1b/d2b/f2f zero size 2024-09-16T00:50:04.786 INFO:tasks.workunit.client.1.smithi152.stdout:5/128: dread - d6/d16/d1f/f2e zero size 2024-09-16T00:50:04.786 INFO:tasks.workunit.client.1.smithi152.stdout:6/105: symlink db/d28/l29 0 2024-09-16T00:50:04.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/129: rename d6/d1b/f28 to d6/d1b/d2b/f31 0 2024-09-16T00:50:04.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/130: chown d6/d1b/d2b/f31 393586 1 2024-09-16T00:50:04.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/131: creat d6/f32 x:0 0 0 2024-09-16T00:50:04.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/132: dread - d6/d16/f24 zero size 2024-09-16T00:50:04.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/133: readlink l5 0 2024-09-16T00:50:04.793 INFO:tasks.workunit.client.1.smithi152.stdout:8/44: sync 2024-09-16T00:50:04.794 INFO:tasks.workunit.client.1.smithi152.stdout:4/217: sync 2024-09-16T00:50:04.794 INFO:tasks.workunit.client.1.smithi152.stdout:2/55: sync 2024-09-16T00:50:04.794 INFO:tasks.workunit.client.1.smithi152.stdout:8/45: creat f8 x:0 0 0 2024-09-16T00:50:04.799 INFO:tasks.workunit.client.1.smithi152.stdout:4/218: mkdir d2/d1e/d28/d45 0 2024-09-16T00:50:04.801 INFO:tasks.workunit.client.1.smithi152.stdout:2/56: rename d4/c10 to d4/c12 0 2024-09-16T00:50:04.801 INFO:tasks.workunit.client.1.smithi152.stdout:8/46: dread f7 [0,4194304] 0 2024-09-16T00:50:04.802 INFO:tasks.workunit.client.1.smithi152.stdout:0/62: sync 2024-09-16T00:50:04.802 INFO:tasks.workunit.client.1.smithi152.stdout:9/67: sync 2024-09-16T00:50:04.803 INFO:tasks.workunit.client.1.smithi152.stdout:1/120: dwrite d9/f19 [0,4194304] 0 2024-09-16T00:50:04.803 INFO:tasks.workunit.client.1.smithi152.stdout:1/121: write d9/da/df/f27 [3277919,46321] 0 2024-09-16T00:50:04.804 INFO:tasks.workunit.client.1.smithi152.stdout:7/92: dwrite f2 [0,4194304] 0 2024-09-16T00:50:04.804 INFO:tasks.workunit.client.1.smithi152.stdout:9/68: symlink d1/l16 0 2024-09-16T00:50:04.805 INFO:tasks.workunit.client.1.smithi152.stdout:0/63: dread d3/d6/d8/ff [0,4194304] 0 2024-09-16T00:50:04.807 INFO:tasks.workunit.client.1.smithi152.stdout:1/122: unlink d9/da/l25 0 2024-09-16T00:50:04.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/123: dread - d9/f21 zero size 2024-09-16T00:50:04.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/57: unlink d4/fe 0 2024-09-16T00:50:04.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/58: dread - f2 zero size 2024-09-16T00:50:04.814 INFO:tasks.workunit.client.1.smithi152.stdout:7/93: mkdir d9/d10/d27 0 2024-09-16T00:50:04.817 INFO:tasks.workunit.client.1.smithi152.stdout:9/69: mkdir d1/d7/d17 0 2024-09-16T00:50:04.817 INFO:tasks.workunit.client.1.smithi152.stdout:9/70: getdents d1/d14 0 2024-09-16T00:50:04.819 INFO:tasks.workunit.client.1.smithi152.stdout:2/59: write d4/f9 [1338513,34816] 0 2024-09-16T00:50:04.820 INFO:tasks.workunit.client.1.smithi152.stdout:5/134: dread f4 [0,4194304] 0 2024-09-16T00:50:04.821 INFO:tasks.workunit.client.1.smithi152.stdout:0/64: dread d3/fb [0,4194304] 0 2024-09-16T00:50:04.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/71: creat d1/d7/f18 x:0 0 0 2024-09-16T00:50:04.822 INFO:tasks.workunit.client.1.smithi152.stdout:2/60: creat d4/f13 x:0 0 0 2024-09-16T00:50:04.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/47: dread f3 [0,4194304] 0 2024-09-16T00:50:04.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/48: truncate f8 689926 0 2024-09-16T00:50:04.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/49: stat c5 0 2024-09-16T00:50:04.824 INFO:tasks.workunit.client.1.smithi152.stdout:5/135: rename f4 to d6/d16/f33 0 2024-09-16T00:50:04.826 INFO:tasks.workunit.client.1.smithi152.stdout:0/65: mknod d3/d6/d8/c14 0 2024-09-16T00:50:04.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/61: readlink d4/ld 0 2024-09-16T00:50:04.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/62: readlink d4/ld 0 2024-09-16T00:50:04.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/136: mknod d6/d16/c34 0 2024-09-16T00:50:04.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/137: dread - d6/d16/f27 zero size 2024-09-16T00:50:04.831 INFO:tasks.workunit.client.1.smithi152.stdout:4/219: dwrite d2/d1e/d28/f30 [4194304,4194304] 0 2024-09-16T00:50:04.831 INFO:tasks.workunit.client.1.smithi152.stdout:4/220: write d2/d1e/f37 [699504,48488] 0 2024-09-16T00:50:04.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/66: rename d3/d6/c10 to d3/c15 0 2024-09-16T00:50:04.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/67: chown d3/f4 11460 1 2024-09-16T00:50:04.837 INFO:tasks.workunit.client.1.smithi152.stdout:0/68: rename d3/f4 to d3/f16 0 2024-09-16T00:50:04.839 INFO:tasks.workunit.client.1.smithi152.stdout:2/63: rename d4/c8 to d4/c14 0 2024-09-16T00:50:04.839 INFO:tasks.workunit.client.1.smithi152.stdout:2/64: readlink d4/ld 0 2024-09-16T00:50:04.841 INFO:tasks.workunit.client.1.smithi152.stdout:5/138: dread d6/d16/f33 [0,4194304] 0 2024-09-16T00:50:04.842 INFO:tasks.workunit.client.1.smithi152.stdout:2/65: creat d4/f15 x:0 0 0 2024-09-16T00:50:04.842 INFO:tasks.workunit.client.1.smithi152.stdout:2/66: read - d4/f13 zero size 2024-09-16T00:50:04.850 INFO:tasks.workunit.client.1.smithi152.stdout:0/69: dread d3/fb [0,4194304] 0 2024-09-16T00:50:04.855 INFO:tasks.workunit.client.1.smithi152.stdout:1/124: dwrite d9/da/df/f11 [0,4194304] 0 2024-09-16T00:50:04.856 INFO:tasks.workunit.client.1.smithi152.stdout:1/125: creat d9/f29 x:0 0 0 2024-09-16T00:50:04.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/50: dwrite f8 [0,4194304] 0 2024-09-16T00:50:04.858 INFO:tasks.workunit.client.1.smithi152.stdout:4/221: dwrite d2/f7 [0,4194304] 0 2024-09-16T00:50:04.861 INFO:tasks.workunit.client.1.smithi152.stdout:4/222: read d2/fe [4580851,95555] 0 2024-09-16T00:50:04.861 INFO:tasks.workunit.client.1.smithi152.stdout:1/126: creat d9/d23/f2a x:0 0 0 2024-09-16T00:50:04.861 INFO:tasks.workunit.client.1.smithi152.stdout:1/127: truncate d9/da/f1d 4251564 0 2024-09-16T00:50:04.861 INFO:tasks.workunit.client.1.smithi152.stdout:1/128: dread - d9/f29 zero size 2024-09-16T00:50:04.863 INFO:tasks.workunit.client.1.smithi152.stdout:1/129: creat d9/da/df/f2b x:0 0 0 2024-09-16T00:50:04.864 INFO:tasks.workunit.client.1.smithi152.stdout:8/51: dread f3 [0,4194304] 0 2024-09-16T00:50:04.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/223: mkdir d2/d1e/d28/d29/d32/d46 0 2024-09-16T00:50:04.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/52: rename c5 to c9 0 2024-09-16T00:50:04.868 INFO:tasks.workunit.client.1.smithi152.stdout:8/53: symlink la 0 2024-09-16T00:50:04.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/130: dread d9/f16 [0,4194304] 0 2024-09-16T00:50:04.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/139: dwrite d6/d16/f27 [0,4194304] 0 2024-09-16T00:50:04.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/54: symlink lb 0 2024-09-16T00:50:04.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/55: fdatasync f8 0 2024-09-16T00:50:04.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/70: dwrite d3/f12 [0,4194304] 0 2024-09-16T00:50:04.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/71: creat d3/d6/f17 x:0 0 0 2024-09-16T00:50:04.871 INFO:tasks.workunit.client.1.smithi152.stdout:1/131: creat d9/da/df/f2c x:0 0 0 2024-09-16T00:50:04.871 INFO:tasks.workunit.client.1.smithi152.stdout:1/132: creat d9/f2d x:0 0 0 2024-09-16T00:50:04.872 INFO:tasks.workunit.client.1.smithi152.stdout:0/72: write d3/f16 [1940380,53203] 0 2024-09-16T00:50:04.874 INFO:tasks.workunit.client.1.smithi152.stdout:2/67: fsync d4/f15 0 2024-09-16T00:50:04.874 INFO:tasks.workunit.client.1.smithi152.stdout:4/224: write d2/d1e/d28/d29/f23 [3175628,74532] 0 2024-09-16T00:50:04.874 INFO:tasks.workunit.client.1.smithi152.stdout:2/68: write f2 [396751,69848] 0 2024-09-16T00:50:04.875 INFO:tasks.workunit.client.1.smithi152.stdout:5/140: link d6/d16/d1f/l25 d6/d16/d1f/l35 0 2024-09-16T00:50:04.875 INFO:tasks.workunit.client.1.smithi152.stdout:5/141: read d6/fc [125111,3629] 0 2024-09-16T00:50:04.880 INFO:tasks.workunit.client.1.smithi152.stdout:8/56: mknod cc 0 2024-09-16T00:50:04.886 INFO:tasks.workunit.client.1.smithi152.stdout:0/73: mknod d3/d6/c18 0 2024-09-16T00:50:04.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/225: chown d2/l8 66993861 1 2024-09-16T00:50:04.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/226: fdatasync d2/d1e/d28/d29/f34 0 2024-09-16T00:50:04.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/69: write d4/f7 [509338,84603] 0 2024-09-16T00:50:04.888 INFO:tasks.workunit.client.1.smithi152.stdout:2/70: read d4/f7 [404771,28102] 0 2024-09-16T00:50:04.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/71: dread - d4/f13 zero size 2024-09-16T00:50:04.889 INFO:tasks.workunit.client.1.smithi152.stdout:5/142: link d6/fe d6/d16/f36 0 2024-09-16T00:50:04.889 INFO:tasks.workunit.client.1.smithi152.stdout:8/57: truncate f7 4172846 0 2024-09-16T00:50:04.890 INFO:tasks.workunit.client.1.smithi152.stdout:1/133: truncate d9/da/df/f11 1521459 0 2024-09-16T00:50:04.892 INFO:tasks.workunit.client.1.smithi152.stdout:0/74: rename d3/f12 to d3/f19 0 2024-09-16T00:50:04.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/96: sync 2024-09-16T00:50:04.894 INFO:tasks.workunit.client.1.smithi152.stdout:4/227: creat d2/db/f47 x:0 0 0 2024-09-16T00:50:04.894 INFO:tasks.workunit.client.1.smithi152.stdout:4/228: chown d2/d1e/d28/d29/d32/c33 11859879 1 2024-09-16T00:50:04.894 INFO:tasks.workunit.client.1.smithi152.stdout:4/229: getdents d2/d1e/d28/d45 0 2024-09-16T00:50:04.897 INFO:tasks.workunit.client.1.smithi152.stdout:5/143: creat d6/d1b/d2b/f37 x:0 0 0 2024-09-16T00:50:04.900 INFO:tasks.workunit.client.1.smithi152.stdout:1/134: symlink d9/d23/l2e 0 2024-09-16T00:50:04.900 INFO:tasks.workunit.client.1.smithi152.stdout:1/135: dread - d9/f21 zero size 2024-09-16T00:50:04.900 INFO:tasks.workunit.client.1.smithi152.stdout:1/136: creat d9/d23/f2f x:0 0 0 2024-09-16T00:50:04.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/230: creat d2/db/d39/d3c/f48 x:0 0 0 2024-09-16T00:50:04.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/231: write d2/d1e/f35 [5182612,124698] 0 2024-09-16T00:50:04.907 INFO:tasks.workunit.client.1.smithi152.stdout:1/137: dread d9/da/f1d [0,4194304] 0 2024-09-16T00:50:04.913 INFO:tasks.workunit.client.1.smithi152.stdout:1/138: dread d9/da/df/f1e [4194304,4194304] 0 2024-09-16T00:50:04.913 INFO:tasks.workunit.client.1.smithi152.stdout:5/144: unlink d6/l10 0 2024-09-16T00:50:04.916 INFO:tasks.workunit.client.1.smithi152.stdout:0/75: getdents d3 0 2024-09-16T00:50:04.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/72: rename d4/fa to d4/f16 0 2024-09-16T00:50:04.922 INFO:tasks.workunit.client.1.smithi152.stdout:1/139: creat d9/da/df/f30 x:0 0 0 2024-09-16T00:50:04.922 INFO:tasks.workunit.client.1.smithi152.stdout:1/140: truncate d9/da/df/f27 5048518 0 2024-09-16T00:50:04.924 INFO:tasks.workunit.client.1.smithi152.stdout:8/58: truncate f7 1474484 0 2024-09-16T00:50:04.925 INFO:tasks.workunit.client.1.smithi152.stdout:0/76: mknod d3/d6/d8/c1a 0 2024-09-16T00:50:04.928 INFO:tasks.workunit.client.1.smithi152.stdout:4/232: rename d2/db/f15 to d2/d1e/d28/d29/d32/d46/f49 0 2024-09-16T00:50:04.928 INFO:tasks.workunit.client.1.smithi152.stdout:4/233: dread - d2/d1e/d28/d29/d32/d46/f49 zero size 2024-09-16T00:50:04.928 INFO:tasks.workunit.client.1.smithi152.stdout:4/234: dread - d2/db/f47 zero size 2024-09-16T00:50:04.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/77: dread d3/d6/d8/ff [0,4194304] 0 2024-09-16T00:50:04.929 INFO:tasks.workunit.client.1.smithi152.stdout:0/78: chown d3/d6/d8/c1a 226216 1 2024-09-16T00:50:04.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/73: chown d4/cf 68516274 1 2024-09-16T00:50:04.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/145: rmdir d6/d1b/d2b 39 2024-09-16T00:50:04.931 INFO:tasks.workunit.client.0.smithi053.stderr:++ readlink -f fsstress 2024-09-16T00:50:04.932 INFO:tasks.workunit.client.0.smithi053.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T00:50:04.932 INFO:tasks.workunit.client.0.smithi053.stderr:+ popd 2024-09-16T00:50:04.932 INFO:tasks.workunit.client.0.smithi053.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T00:50:04.933 INFO:tasks.workunit.client.0.smithi053.stderr:+ popd 2024-09-16T00:50:04.933 INFO:tasks.workunit.client.0.smithi053.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-16T00:50:04.933 INFO:tasks.workunit.client.0.smithi053.stderr:++ mktemp -d -p . 2024-09-16T00:50:04.934 INFO:tasks.workunit.client.1.smithi152.stdout:8/59: mkdir dd 0 2024-09-16T00:50:04.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/235: creat d2/d1e/d28/d29/f4a x:0 0 0 2024-09-16T00:50:04.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/236: chown d2/fe 42 1 2024-09-16T00:50:04.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/79: symlink d3/l1b 0 2024-09-16T00:50:04.936 INFO:tasks.workunit.client.0.smithi053.stderr:+ T=./tmp.0I73QLF5OY 2024-09-16T00:50:04.936 INFO:tasks.workunit.client.0.smithi053.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.0I73QLF5OY -l 1 -n 1000 -p 10 -v 2024-09-16T00:50:04.937 INFO:tasks.workunit.client.1.smithi152.stdout:5/146: symlink d6/d16/l38 0 2024-09-16T00:50:04.938 INFO:tasks.workunit.client.1.smithi152.stdout:1/141: dwrite d9/d23/f2a [0,4194304] 0 2024-09-16T00:50:04.939 INFO:tasks.workunit.client.0.smithi053.stdout:seed = 1726601511 2024-09-16T00:50:04.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/80: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:04.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/81: creat d3/d6/d8/f1c x:0 0 0 2024-09-16T00:50:04.940 INFO:tasks.workunit.client.1.smithi152.stdout:8/60: mkdir dd/de 0 2024-09-16T00:50:04.941 INFO:tasks.workunit.client.1.smithi152.stdout:4/237: symlink d2/d1e/d28/d29/d32/l4b 0 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/0: stat - no entries 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/1: rmdir - no directory 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/2: dwrite - no filename 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/3: fsync - no filename 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/4: dread - no filename 2024-09-16T00:50:04.946 INFO:tasks.workunit.client.0.smithi053.stdout:0/5: rename - no filename 2024-09-16T00:50:04.952 INFO:tasks.workunit.client.0.smithi053.stdout:2/0: read - no filename 2024-09-16T00:50:04.952 INFO:tasks.workunit.client.0.smithi053.stdout:2/1: stat - no entries 2024-09-16T00:50:04.952 INFO:tasks.workunit.client.0.smithi053.stdout:2/2: truncate - no filename 2024-09-16T00:50:04.953 INFO:tasks.workunit.client.1.smithi152.stdout:1/142: mkdir d9/d23/d31 0 2024-09-16T00:50:04.954 INFO:tasks.workunit.client.0.smithi053.stdout:1/0: symlink l0 0 2024-09-16T00:50:04.954 INFO:tasks.workunit.client.0.smithi053.stdout:1/1: chown l0 60 1 2024-09-16T00:50:04.954 INFO:tasks.workunit.client.0.smithi053.stdout:1/2: dread - no filename 2024-09-16T00:50:04.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/61: dwrite f8 [0,4194304] 0 2024-09-16T00:50:04.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/62: write f3 [1694462,81245] 0 2024-09-16T00:50:04.959 INFO:tasks.workunit.client.1.smithi152.stdout:0/82: mkdir d3/d6/d8/d1d 0 2024-09-16T00:50:04.959 INFO:tasks.workunit.client.1.smithi152.stdout:0/83: write d3/d6/d8/f1c [340839,59991] 0 2024-09-16T00:50:04.963 INFO:tasks.workunit.client.0.smithi053.stdout:1/3: mknod c1 0 2024-09-16T00:50:04.963 INFO:tasks.workunit.client.0.smithi053.stdout:1/4: fsync - no filename 2024-09-16T00:50:04.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/238: unlink d2/d1e/f36 0 2024-09-16T00:50:04.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/239: dread - d2/db/d39/f3b zero size 2024-09-16T00:50:04.978 INFO:tasks.workunit.client.0.smithi053.stdout:1/5: creat f2 x:0 0 0 2024-09-16T00:50:04.985 INFO:tasks.workunit.client.0.smithi053.stdout:1/6: symlink l3 0 2024-09-16T00:50:04.985 INFO:tasks.workunit.client.0.smithi053.stdout:1/7: write f2 [104174,69832] 0 2024-09-16T00:50:04.993 INFO:tasks.workunit.client.1.smithi152.stdout:6/106: sync 2024-09-16T00:50:04.993 INFO:tasks.workunit.client.1.smithi152.stdout:7/94: sync 2024-09-16T00:50:04.993 INFO:tasks.workunit.client.1.smithi152.stdout:5/147: rmdir d6 39 2024-09-16T00:50:04.998 INFO:tasks.workunit.client.1.smithi152.stdout:1/143: link d9/da/l18 d9/d23/d31/l32 0 2024-09-16T00:50:04.998 INFO:tasks.workunit.client.1.smithi152.stdout:1/144: fsync d9/da/df/f2b 0 2024-09-16T00:50:05.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/63: link f8 dd/ff 0 2024-09-16T00:50:05.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/240: rmdir d2/db/d39 39 2024-09-16T00:50:05.003 INFO:tasks.workunit.client.1.smithi152.stdout:6/107: rename db/f13 to db/d12/d1c/d22/f2a 0 2024-09-16T00:50:05.003 INFO:tasks.workunit.client.1.smithi152.stdout:6/108: readlink l8 0 2024-09-16T00:50:05.007 INFO:tasks.workunit.client.1.smithi152.stdout:7/95: creat d9/d10/d27/f28 x:0 0 0 2024-09-16T00:50:05.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/148: creat d6/d16/f39 x:0 0 0 2024-09-16T00:50:05.007 INFO:tasks.workunit.client.1.smithi152.stdout:7/96: chown d9/c18 532232783 1 2024-09-16T00:50:05.008 INFO:tasks.workunit.client.1.smithi152.stdout:1/145: symlink d9/d23/d31/l33 0 2024-09-16T00:50:05.009 INFO:tasks.workunit.client.1.smithi152.stdout:8/64: rmdir dd 39 2024-09-16T00:50:05.012 INFO:tasks.workunit.client.1.smithi152.stdout:4/241: truncate d2/db/d39/f2e 301573 0 2024-09-16T00:50:05.014 INFO:tasks.workunit.client.1.smithi152.stdout:6/109: link db/d12/c1d db/d12/d1c/d22/c2b 0 2024-09-16T00:50:05.017 INFO:tasks.workunit.client.1.smithi152.stdout:8/65: rename lb to dd/de/l10 0 2024-09-16T00:50:05.020 INFO:tasks.workunit.client.1.smithi152.stdout:8/66: mknod dd/de/c11 0 2024-09-16T00:50:05.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/146: write d9/da/f1d [1888173,28381] 0 2024-09-16T00:50:05.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/147: fdatasync d9/f21 0 2024-09-16T00:50:05.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/148: fdatasync d9/da/df/f11 0 2024-09-16T00:50:05.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/149: fsync d9/da/df/f2c 0 2024-09-16T00:50:05.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/84: dwrite d3/f16 [0,4194304] 0 2024-09-16T00:50:05.136 INFO:tasks.workunit.client.1.smithi152.stdout:0/85: chown d3/l1b 238334 1 2024-09-16T00:50:05.182 INFO:tasks.workunit.client.1.smithi152.stdout:4/242: dwrite d2/d1e/d28/d29/f4a [0,4194304] 0 2024-09-16T00:50:05.204 INFO:tasks.workunit.client.1.smithi152.stdout:7/97: read f8 [752451,2003] 0 2024-09-16T00:50:05.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/243: read d2/fc [29084,46117] 0 2024-09-16T00:50:05.275 INFO:tasks.workunit.client.1.smithi152.stdout:4/244: unlink d2/la 0 2024-09-16T00:50:05.275 INFO:tasks.workunit.client.1.smithi152.stdout:4/245: dread - d2/db/f38 zero size 2024-09-16T00:50:05.278 INFO:tasks.workunit.client.1.smithi152.stdout:8/67: write f8 [1513773,44310] 0 2024-09-16T00:50:05.278 INFO:tasks.workunit.client.1.smithi152.stdout:8/68: read dd/ff [1594424,23278] 0 2024-09-16T00:50:05.278 INFO:tasks.workunit.client.1.smithi152.stdout:8/69: chown dd/de/c11 1133743 1 2024-09-16T00:50:05.305 INFO:tasks.workunit.client.1.smithi152.stdout:5/149: dread d6/ff [0,4194304] 0 2024-09-16T00:50:05.308 INFO:tasks.workunit.client.1.smithi152.stdout:5/150: mknod d6/d1b/c3a 0 2024-09-16T00:50:05.308 INFO:tasks.workunit.client.1.smithi152.stdout:5/151: chown d6/d16/f23 8881 1 2024-09-16T00:50:05.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/152: mknod d6/d16/c3b 0 2024-09-16T00:50:05.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/153: dread - d6/f1e zero size 2024-09-16T00:50:05.423 INFO:tasks.workunit.client.1.smithi152.stdout:6/110: dwrite db/f18 [0,4194304] 0 2024-09-16T00:50:05.431 INFO:tasks.workunit.client.1.smithi152.stdout:6/111: mkdir db/d28/d2c 0 2024-09-16T00:50:05.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/150: dwrite d9/f2d [0,4194304] 0 2024-09-16T00:50:05.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/151: stat d9/da/df/f2c 0 2024-09-16T00:50:05.594 INFO:tasks.workunit.client.1.smithi152.stdout:5/154: dwrite d6/f1a [0,4194304] 0 2024-09-16T00:50:05.620 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: pgmap v256: 65 pgs: 65 active+clean; 310 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 16 MiB/s wr, 504 op/s 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr fail", "who": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "mgr fail", "who": "smithi053.cjiiek"}]': finished 2024-09-16T00:50:05.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: mgrmap e21: smithi152.nlmwrx(active, starting, since 0.00691125s) 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:50:05.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: Manager daemon smithi152.nlmwrx is now available 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:50:05.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/trash_purge_schedule"}]: dispatch 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:05 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/trash_purge_schedule"}]: dispatch 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: pgmap v256: 65 pgs: 65 active+clean; 310 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 16 MiB/s wr, 504 op/s 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:50:05.624 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr fail", "who": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: osdmap e47: 6 total, 6 up, 6 in 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.14213 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "mgr fail", "who": "smithi053.cjiiek"}]': finished 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: mgrmap e21: smithi152.nlmwrx(active, starting, since 0.00691125s) 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:50:05.625 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: Manager daemon smithi152.nlmwrx is now available 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:05.626 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:05.627 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:05.627 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:50:05.627 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:50:05.627 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/trash_purge_schedule"}]: dispatch 2024-09-16T00:50:05.627 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:05 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.nlmwrx/trash_purge_schedule"}]: dispatch 2024-09-16T00:50:05.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/152: dread d9/f16 [4194304,4194304] 0 2024-09-16T00:50:05.639 INFO:tasks.workunit.client.1.smithi152.stdout:5/155: dread d6/fb [0,4194304] 0 2024-09-16T00:50:05.639 INFO:tasks.workunit.client.1.smithi152.stdout:5/156: read d6/fc [1361103,21538] 0 2024-09-16T00:50:05.640 INFO:tasks.workunit.client.1.smithi152.stdout:6/112: dwrite fa [0,4194304] 0 2024-09-16T00:50:05.642 INFO:tasks.workunit.client.1.smithi152.stdout:1/153: mknod d9/d23/d31/c34 0 2024-09-16T00:50:05.646 INFO:tasks.workunit.client.1.smithi152.stdout:5/157: rmdir d6/d1b 39 2024-09-16T00:50:05.646 INFO:tasks.workunit.client.1.smithi152.stdout:5/158: chown d6/c13 99 1 2024-09-16T00:50:05.646 INFO:tasks.workunit.client.1.smithi152.stdout:5/159: dread - d6/d16/f39 zero size 2024-09-16T00:50:05.651 INFO:tasks.workunit.client.1.smithi152.stdout:6/113: read db/fe [1270227,75116] 0 2024-09-16T00:50:05.655 INFO:tasks.workunit.client.1.smithi152.stdout:1/154: rename d9/l15 to d9/da/df/l35 0 2024-09-16T00:50:05.656 INFO:tasks.workunit.client.1.smithi152.stdout:1/155: creat d9/f36 x:0 0 0 2024-09-16T00:50:05.656 INFO:tasks.workunit.client.1.smithi152.stdout:1/156: dread - d9/f21 zero size 2024-09-16T00:50:05.656 INFO:tasks.workunit.client.1.smithi152.stdout:1/157: creat d9/f37 x:0 0 0 2024-09-16T00:50:05.667 INFO:tasks.workunit.client.1.smithi152.stdout:1/158: mkdir d9/d23/d31/d38 0 2024-09-16T00:50:05.667 INFO:tasks.workunit.client.1.smithi152.stdout:1/159: truncate d9/da/df/f2b 939963 0 2024-09-16T00:50:05.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/160: dwrite d6/f30 [0,4194304] 0 2024-09-16T00:50:05.683 INFO:tasks.workunit.client.1.smithi152.stdout:5/161: readlink d6/l7 0 2024-09-16T00:50:05.683 INFO:tasks.workunit.client.1.smithi152.stdout:5/162: dread - d6/d16/f39 zero size 2024-09-16T00:50:05.700 INFO:tasks.workunit.client.1.smithi152.stdout:5/163: dwrite d6/d1b/d2b/f2f [0,4194304] 0 2024-09-16T00:50:05.715 INFO:tasks.workunit.client.0.smithi053.stdout:1/8: dread f2 [0,4194304] 0 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:4/0: truncate - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:5/0: truncate - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:5/1: stat - no entries 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:5/2: readlink - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:5/3: dread - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:5/4: write - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:8/0: readlink - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:8/1: dwrite - no filename 2024-09-16T00:50:05.723 INFO:tasks.workunit.client.0.smithi053.stdout:7/0: rmdir - no directory 2024-09-16T00:50:05.726 INFO:tasks.workunit.client.1.smithi152.stdout:5/164: dwrite d6/d16/d1f/f21 [0,4194304] 0 2024-09-16T00:50:05.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/165: creat d6/d1b/f3c x:0 0 0 2024-09-16T00:50:05.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/166: stat d6/d1b/d2b/f37 0 2024-09-16T00:50:05.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/167: mknod d6/d16/c3d 0 2024-09-16T00:50:05.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/168: stat d6/fe 0 2024-09-16T00:50:05.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/169: chown d6/d1b 6 1 2024-09-16T00:50:05.743 INFO:tasks.workunit.client.1.smithi152.stdout:9/72: sync 2024-09-16T00:50:05.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/97: sync 2024-09-16T00:50:05.743 INFO:tasks.workunit.client.1.smithi152.stdout:2/74: sync 2024-09-16T00:50:05.746 INFO:tasks.workunit.client.1.smithi152.stdout:5/170: write d6/d16/f33 [2023175,119491] 0 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:0/86: dwrite d3/fc [0,4194304] 0 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:0/87: creat d3/d6/f1e x:0 0 0 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/171: write d6/d16/d1f/f22 [223468,89002] 0 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:0/88: chown d3/l1b 0 1 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:0/89: creat d3/d6/f1f x:0 0 0 2024-09-16T00:50:05.747 INFO:tasks.workunit.client.1.smithi152.stdout:9/73: creat d1/d7/d13/f19 x:0 0 0 2024-09-16T00:50:05.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/90: dread d3/f19 [0,4194304] 0 2024-09-16T00:50:05.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/74: dread d1/fa [0,4194304] 0 2024-09-16T00:50:05.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/75: fdatasync d1/f12 0 2024-09-16T00:50:05.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/76: readlink d1/le 0 2024-09-16T00:50:05.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/77: readlink d1/le 0 2024-09-16T00:50:05.761 INFO:tasks.workunit.client.1.smithi152.stdout:5/172: creat d6/d16/d1f/f3e x:0 0 0 2024-09-16T00:50:05.761 INFO:tasks.workunit.client.1.smithi152.stdout:5/173: chown d6/cd 1 1 2024-09-16T00:50:05.761 INFO:tasks.workunit.client.1.smithi152.stdout:5/174: dread - d6/d16/d1f/f2e zero size 2024-09-16T00:50:05.763 INFO:tasks.workunit.client.1.smithi152.stdout:2/75: mkdir d4/d17 0 2024-09-16T00:50:05.763 INFO:tasks.workunit.client.1.smithi152.stdout:2/76: fdatasync d4/f7 0 2024-09-16T00:50:05.766 INFO:tasks.workunit.client.1.smithi152.stdout:0/91: creat d3/d6/d8/d1d/f20 x:0 0 0 2024-09-16T00:50:05.767 INFO:tasks.workunit.client.1.smithi152.stdout:0/92: dread - d3/d6/f1e zero size 2024-09-16T00:50:05.767 INFO:tasks.workunit.client.1.smithi152.stdout:7/98: dwrite d9/f1b [0,4194304] 0 2024-09-16T00:50:05.767 INFO:tasks.workunit.client.1.smithi152.stdout:1/160: dwrite d9/da/f1c [4194304,4194304] 0 2024-09-16T00:50:05.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/78: symlink d1/l1a 0 2024-09-16T00:50:05.770 INFO:tasks.workunit.client.1.smithi152.stdout:5/175: rename d6/d1b/l2c to d6/d1b/d2b/l3f 0 2024-09-16T00:50:05.772 INFO:tasks.workunit.client.1.smithi152.stdout:2/77: mknod d4/d17/c18 0 2024-09-16T00:50:05.774 INFO:tasks.workunit.client.1.smithi152.stdout:0/93: creat d3/f21 x:0 0 0 2024-09-16T00:50:05.774 INFO:tasks.workunit.client.1.smithi152.stdout:0/94: chown d3/c11 3857971 1 2024-09-16T00:50:05.779 INFO:tasks.workunit.client.1.smithi152.stdout:7/99: symlink d9/l29 0 2024-09-16T00:50:05.781 INFO:tasks.workunit.client.1.smithi152.stdout:1/161: creat d9/d23/d31/d38/f39 x:0 0 0 2024-09-16T00:50:05.783 INFO:tasks.workunit.client.1.smithi152.stdout:9/79: creat d1/d7/f1b x:0 0 0 2024-09-16T00:50:05.785 INFO:tasks.workunit.client.1.smithi152.stdout:5/176: creat d6/f40 x:0 0 0 2024-09-16T00:50:05.792 INFO:tasks.workunit.client.1.smithi152.stdout:1/162: creat d9/d23/d31/f3a x:0 0 0 2024-09-16T00:50:05.792 INFO:tasks.workunit.client.1.smithi152.stdout:1/163: creat d9/d23/f3b x:0 0 0 2024-09-16T00:50:05.795 INFO:tasks.workunit.client.1.smithi152.stdout:5/177: mknod d6/d16/d1f/c41 0 2024-09-16T00:50:05.796 INFO:tasks.workunit.client.1.smithi152.stdout:7/100: dwrite d9/f13 [0,4194304] 0 2024-09-16T00:50:05.798 INFO:tasks.workunit.client.1.smithi152.stdout:2/78: mkdir d4/d19 0 2024-09-16T00:50:05.800 INFO:tasks.workunit.client.1.smithi152.stdout:2/79: dread d4/f16 [0,4194304] 0 2024-09-16T00:50:05.803 INFO:tasks.workunit.client.1.smithi152.stdout:5/178: link d6/d16/l38 d6/d16/l42 0 2024-09-16T00:50:05.805 INFO:tasks.workunit.client.1.smithi152.stdout:9/80: dwrite d1/ff [0,4194304] 0 2024-09-16T00:50:05.805 INFO:tasks.workunit.client.1.smithi152.stdout:9/81: chown d1/l6 126110304 1 2024-09-16T00:50:05.807 INFO:tasks.workunit.client.1.smithi152.stdout:7/101: mkdir d9/d10/d27/d2a 0 2024-09-16T00:50:05.811 INFO:tasks.workunit.client.1.smithi152.stdout:5/179: link d6/d16/l19 d6/d16/l43 0 2024-09-16T00:50:05.811 INFO:tasks.workunit.client.1.smithi152.stdout:5/180: creat d6/f44 x:0 0 0 2024-09-16T00:50:05.811 INFO:tasks.workunit.client.1.smithi152.stdout:5/181: stat d6/fc 0 2024-09-16T00:50:05.811 INFO:tasks.workunit.client.1.smithi152.stdout:5/182: creat d6/d16/f45 x:0 0 0 2024-09-16T00:50:05.811 INFO:tasks.workunit.client.1.smithi152.stdout:5/183: dread - d6/f32 zero size 2024-09-16T00:50:05.812 INFO:tasks.workunit.client.1.smithi152.stdout:5/184: write d6/f2d [4563401,7541] 0 2024-09-16T00:50:05.812 INFO:tasks.workunit.client.1.smithi152.stdout:5/185: write d6/fb [353448,27279] 0 2024-09-16T00:50:05.813 INFO:tasks.workunit.client.1.smithi152.stdout:9/82: rename d1/d7/d17 to d1/d7/d13/d1c 0 2024-09-16T00:50:05.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/186: mknod d6/d16/c46 0 2024-09-16T00:50:05.827 INFO:tasks.workunit.client.1.smithi152.stdout:7/102: rename d9/d10/l11 to d9/d10/d27/l2b 0 2024-09-16T00:50:05.827 INFO:tasks.workunit.client.1.smithi152.stdout:7/103: getdents d9/d10/d27/d2a 0 2024-09-16T00:50:05.827 INFO:tasks.workunit.client.1.smithi152.stdout:7/104: truncate d9/f1f 232068 0 2024-09-16T00:50:05.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/83: mknod d1/d7/c1d 0 2024-09-16T00:50:05.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/84: chown d1/d7/d13 341602 1 2024-09-16T00:50:05.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/80: rename d4/cb to d4/c1a 0 2024-09-16T00:50:05.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/81: dread - d4/f13 zero size 2024-09-16T00:50:05.832 INFO:tasks.workunit.client.1.smithi152.stdout:5/187: rename d6/d1b/d2b/f37 to d6/d1b/d2b/f47 0 2024-09-16T00:50:05.832 INFO:tasks.workunit.client.1.smithi152.stdout:5/188: write d6/d1b/d2b/f31 [294043,5724] 0 2024-09-16T00:50:05.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/105: link d9/l21 d9/l2c 0 2024-09-16T00:50:05.835 INFO:tasks.workunit.client.1.smithi152.stdout:7/106: read f4 [1556441,110908] 0 2024-09-16T00:50:05.836 INFO:tasks.workunit.client.1.smithi152.stdout:2/82: symlink d4/d17/l1b 0 2024-09-16T00:50:05.836 INFO:tasks.workunit.client.1.smithi152.stdout:2/83: stat d4/f16 0 2024-09-16T00:50:05.841 INFO:tasks.workunit.client.1.smithi152.stdout:5/189: dread d6/f1a [0,4194304] 0 2024-09-16T00:50:05.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/85: dwrite d1/d7/f1b [0,4194304] 0 2024-09-16T00:50:05.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/86: chown d1/l16 12 1 2024-09-16T00:50:05.845 INFO:tasks.workunit.client.1.smithi152.stdout:2/84: link d4/cc d4/c1c 0 2024-09-16T00:50:05.847 INFO:tasks.workunit.client.1.smithi152.stdout:2/85: dread f2 [0,4194304] 0 2024-09-16T00:50:05.847 INFO:tasks.workunit.client.1.smithi152.stdout:7/107: write d9/f13 [826877,24344] 0 2024-09-16T00:50:05.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/87: rename d1/l1a to d1/d7/d13/d1c/l1e 0 2024-09-16T00:50:05.855 INFO:tasks.workunit.client.1.smithi152.stdout:9/88: rename d1/l6 to d1/d7/l1f 0 2024-09-16T00:50:05.857 INFO:tasks.workunit.client.1.smithi152.stdout:9/89: creat d1/d7/f20 x:0 0 0 2024-09-16T00:50:05.857 INFO:tasks.workunit.client.1.smithi152.stdout:9/90: chown d1/d7/d13/f19 5474305 1 2024-09-16T00:50:05.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/91: creat d1/d7/f21 x:0 0 0 2024-09-16T00:50:05.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/92: chown d1/d7/f21 2370 1 2024-09-16T00:50:05.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/93: write d1/d7/fd [219093,73941] 0 2024-09-16T00:50:05.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/86: dwrite d4/f13 [0,4194304] 0 2024-09-16T00:50:05.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/87: fdatasync d4/f7 0 2024-09-16T00:50:05.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/108: dwrite d9/fd [4194304,4194304] 0 2024-09-16T00:50:05.880 INFO:tasks.workunit.client.1.smithi152.stdout:7/109: fdatasync d9/f25 0 2024-09-16T00:50:05.882 INFO:tasks.workunit.client.1.smithi152.stdout:9/94: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:05.882 INFO:tasks.workunit.client.1.smithi152.stdout:9/95: readlink d1/d7/d13/d1c/l1e 0 2024-09-16T00:50:05.885 INFO:tasks.workunit.client.1.smithi152.stdout:8/70: truncate f8 3364045 0 2024-09-16T00:50:05.886 INFO:tasks.workunit.client.1.smithi152.stdout:2/88: creat d4/d17/f1d x:0 0 0 2024-09-16T00:50:05.889 INFO:tasks.workunit.client.1.smithi152.stdout:7/110: unlink d9/f13 0 2024-09-16T00:50:05.892 INFO:tasks.workunit.client.1.smithi152.stdout:9/96: rename d1/fa to d1/d7/d13/d1c/f22 0 2024-09-16T00:50:05.892 INFO:tasks.workunit.client.1.smithi152.stdout:9/97: chown d1/l16 10301 1 2024-09-16T00:50:05.893 INFO:tasks.workunit.client.1.smithi152.stdout:2/89: mknod d4/d19/c1e 0 2024-09-16T00:50:05.893 INFO:tasks.workunit.client.1.smithi152.stdout:2/90: stat d4/d19 0 2024-09-16T00:50:05.893 INFO:tasks.workunit.client.1.smithi152.stdout:2/91: truncate d4/f7 1601514 0 2024-09-16T00:50:05.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/111: symlink d9/d10/d27/d2a/l2d 0 2024-09-16T00:50:05.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/112: write d9/d10/f12 [5062315,2490] 0 2024-09-16T00:50:05.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/113: fsync f7 0 2024-09-16T00:50:05.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/114: readlink d9/l22 0 2024-09-16T00:50:05.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/115: fdatasync d9/f1b 0 2024-09-16T00:50:05.897 INFO:tasks.workunit.client.1.smithi152.stdout:8/71: rename f7 to dd/de/f12 0 2024-09-16T00:50:05.899 INFO:tasks.workunit.client.1.smithi152.stdout:9/98: mkdir d1/d7/d13/d1c/d23 0 2024-09-16T00:50:05.904 INFO:tasks.workunit.client.1.smithi152.stdout:9/99: symlink d1/d7/d13/d1c/l24 0 2024-09-16T00:50:05.906 INFO:tasks.workunit.client.1.smithi152.stdout:2/92: mknod d4/c1f 0 2024-09-16T00:50:05.908 INFO:tasks.workunit.client.1.smithi152.stdout:2/93: mkdir d4/d19/d20 0 2024-09-16T00:50:05.908 INFO:tasks.workunit.client.1.smithi152.stdout:2/94: chown d4/f16 3412106 1 2024-09-16T00:50:05.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/95: write d4/f15 [817561,7678] 0 2024-09-16T00:50:05.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/96: fdatasync d4/f9 0 2024-09-16T00:50:05.910 INFO:tasks.workunit.client.1.smithi152.stdout:2/97: mknod d4/d19/c21 0 2024-09-16T00:50:05.910 INFO:tasks.workunit.client.1.smithi152.stdout:2/98: getdents d4/d19/d20 0 2024-09-16T00:50:05.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/99: mknod d4/c22 0 2024-09-16T00:50:05.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/100: creat d4/d17/f23 x:0 0 0 2024-09-16T00:50:05.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/101: write d4/f15 [1150352,108024] 0 2024-09-16T00:50:05.919 INFO:tasks.workunit.client.1.smithi152.stdout:2/102: dread - d4/d17/f23 zero size 2024-09-16T00:50:05.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/100: dwrite d1/d7/d13/d1c/f22 [0,4194304] 0 2024-09-16T00:50:05.924 INFO:tasks.workunit.client.1.smithi152.stdout:9/101: chown d1/l2 934 1 2024-09-16T00:50:05.924 INFO:tasks.workunit.client.1.smithi152.stdout:9/102: fdatasync d1/fb 0 2024-09-16T00:50:05.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/103: mknod d4/c24 0 2024-09-16T00:50:05.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/103: link d1/fb d1/f25 0 2024-09-16T00:50:05.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/104: creat d4/d19/f25 x:0 0 0 2024-09-16T00:50:05.930 INFO:tasks.workunit.client.1.smithi152.stdout:9/104: mkdir d1/d7/d13/d1c/d23/d26 0 2024-09-16T00:50:05.933 INFO:tasks.workunit.client.1.smithi152.stdout:9/105: unlink d1/d7/d13/f19 0 2024-09-16T00:50:05.934 INFO:tasks.workunit.client.1.smithi152.stdout:9/106: dread d1/f12 [0,4194304] 0 2024-09-16T00:50:05.937 INFO:tasks.workunit.client.1.smithi152.stdout:2/105: write d4/f13 [3918176,28735] 0 2024-09-16T00:50:05.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/106: rename d4/ld to d4/d17/l26 0 2024-09-16T00:50:05.943 INFO:tasks.workunit.client.1.smithi152.stdout:9/107: write d1/d7/d13/d1c/f22 [563460,53386] 0 2024-09-16T00:50:05.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/108: dread d1/ff [0,4194304] 0 2024-09-16T00:50:06.175 INFO:tasks.workunit.client.0.smithi053.stdout:1/9: symlink l4 0 2024-09-16T00:50:06.177 INFO:tasks.workunit.client.0.smithi053.stdout:3/0: creat f0 x:0 0 0 2024-09-16T00:50:06.178 INFO:tasks.workunit.client.0.smithi053.stdout:3/1: write f0 [68537,27174] 0 2024-09-16T00:50:06.179 INFO:tasks.workunit.client.0.smithi053.stdout:4/1: mkdir d0 0 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/0: symlink l0 0 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/1: dwrite - no filename 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/2: write - no filename 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/3: write - no filename 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/4: dwrite - no filename 2024-09-16T00:50:06.180 INFO:tasks.workunit.client.0.smithi053.stdout:6/5: dwrite - no filename 2024-09-16T00:50:06.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/5: creat f0 x:0 0 0 2024-09-16T00:50:06.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/6: chown f0 2016712677 1 2024-09-16T00:50:06.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/7: read - f0 zero size 2024-09-16T00:50:06.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/8: write f0 [287624,83425] 0 2024-09-16T00:50:06.183 INFO:tasks.workunit.client.0.smithi053.stdout:8/2: symlink l0 0 2024-09-16T00:50:06.183 INFO:tasks.workunit.client.0.smithi053.stdout:8/3: write - no filename 2024-09-16T00:50:06.183 INFO:tasks.workunit.client.0.smithi053.stdout:8/4: dread - no filename 2024-09-16T00:50:06.184 INFO:tasks.workunit.client.0.smithi053.stdout:3/2: dread f0 [0,4194304] 0 2024-09-16T00:50:06.184 INFO:tasks.workunit.client.0.smithi053.stdout:3/3: write f0 [324834,44988] 0 2024-09-16T00:50:06.185 INFO:tasks.workunit.client.0.smithi053.stdout:9/0: creat f0 x:0 0 0 2024-09-16T00:50:06.185 INFO:tasks.workunit.client.0.smithi053.stdout:9/1: creat f1 x:0 0 0 2024-09-16T00:50:06.186 INFO:tasks.workunit.client.0.smithi053.stdout:7/1: creat f0 x:0 0 0 2024-09-16T00:50:06.200 INFO:tasks.workunit.client.0.smithi053.stdout:1/10: mkdir d5 0 2024-09-16T00:50:06.203 INFO:tasks.workunit.client.0.smithi053.stdout:4/2: creat d0/f1 x:0 0 0 2024-09-16T00:50:06.204 INFO:tasks.workunit.client.0.smithi053.stdout:6/6: mkdir d1 0 2024-09-16T00:50:06.204 INFO:tasks.workunit.client.0.smithi053.stdout:6/7: readlink l0 0 2024-09-16T00:50:06.204 INFO:tasks.workunit.client.0.smithi053.stdout:6/8: dwrite - no filename 2024-09-16T00:50:06.204 INFO:tasks.workunit.client.0.smithi053.stdout:6/9: dread - no filename 2024-09-16T00:50:06.204 INFO:tasks.workunit.client.0.smithi053.stdout:6/10: dwrite - no filename 2024-09-16T00:50:06.205 INFO:tasks.workunit.client.0.smithi053.stdout:5/9: dwrite f0 [0,4194304] 0 2024-09-16T00:50:06.205 INFO:tasks.workunit.client.0.smithi053.stdout:8/5: link l0 l1 0 2024-09-16T00:50:06.207 INFO:tasks.workunit.client.0.smithi053.stdout:3/4: mkdir d1 0 2024-09-16T00:50:06.209 INFO:tasks.workunit.client.0.smithi053.stdout:7/2: unlink f0 0 2024-09-16T00:50:06.209 INFO:tasks.workunit.client.0.smithi053.stdout:7/3: fdatasync - no filename 2024-09-16T00:50:06.209 INFO:tasks.workunit.client.0.smithi053.stdout:7/4: dread - no filename 2024-09-16T00:50:06.210 INFO:tasks.workunit.client.0.smithi053.stdout:1/11: mknod d5/c6 0 2024-09-16T00:50:06.210 INFO:tasks.workunit.client.0.smithi053.stdout:1/12: truncate f2 868927 0 2024-09-16T00:50:06.210 INFO:tasks.workunit.client.0.smithi053.stdout:1/13: write f2 [1357058,3352] 0 2024-09-16T00:50:06.210 INFO:tasks.workunit.client.0.smithi053.stdout:3/5: dread f0 [0,4194304] 0 2024-09-16T00:50:06.211 INFO:tasks.workunit.client.0.smithi053.stdout:4/3: mkdir d0/d2 0 2024-09-16T00:50:06.211 INFO:tasks.workunit.client.0.smithi053.stdout:3/6: dread f0 [0,4194304] 0 2024-09-16T00:50:06.212 INFO:tasks.workunit.client.0.smithi053.stdout:3/7: write f0 [608279,100550] 0 2024-09-16T00:50:06.212 INFO:tasks.workunit.client.0.smithi053.stdout:6/11: creat d1/f2 x:0 0 0 2024-09-16T00:50:06.215 INFO:tasks.workunit.client.0.smithi053.stdout:5/10: mknod c1 0 2024-09-16T00:50:06.217 INFO:tasks.workunit.client.0.smithi053.stdout:8/6: link l1 l2 0 2024-09-16T00:50:06.217 INFO:tasks.workunit.client.0.smithi053.stdout:8/7: chown l0 242168843 1 2024-09-16T00:50:06.217 INFO:tasks.workunit.client.0.smithi053.stdout:8/8: fdatasync - no filename 2024-09-16T00:50:06.217 INFO:tasks.workunit.client.0.smithi053.stdout:8/9: dwrite - no filename 2024-09-16T00:50:06.217 INFO:tasks.workunit.client.0.smithi053.stdout:8/10: chown l1 3098505 1 2024-09-16T00:50:06.220 INFO:tasks.workunit.client.0.smithi053.stdout:1/14: mkdir d5/d7 0 2024-09-16T00:50:06.223 INFO:tasks.workunit.client.0.smithi053.stdout:8/11: creat f3 x:0 0 0 2024-09-16T00:50:06.223 INFO:tasks.workunit.client.0.smithi053.stdout:8/12: fdatasync f3 0 2024-09-16T00:50:06.223 INFO:tasks.workunit.client.0.smithi053.stdout:8/13: creat f4 x:0 0 0 2024-09-16T00:50:06.225 INFO:tasks.workunit.client.0.smithi053.stdout:1/15: unlink l0 0 2024-09-16T00:50:06.229 INFO:tasks.workunit.client.0.smithi053.stdout:8/14: symlink l5 0 2024-09-16T00:50:06.232 INFO:tasks.workunit.client.0.smithi053.stdout:5/11: dread f0 [0,4194304] 0 2024-09-16T00:50:06.234 INFO:tasks.workunit.client.0.smithi053.stdout:5/12: link c1 c2 0 2024-09-16T00:50:06.240 INFO:tasks.workunit.client.0.smithi053.stdout:1/16: dread f2 [0,4194304] 0 2024-09-16T00:50:06.240 INFO:tasks.workunit.client.0.smithi053.stdout:1/17: write f2 [2268173,56291] 0 2024-09-16T00:50:06.240 INFO:tasks.workunit.client.0.smithi053.stdout:6/12: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:06.241 INFO:tasks.workunit.client.0.smithi053.stdout:3/8: dwrite f0 [0,4194304] 0 2024-09-16T00:50:06.241 INFO:tasks.workunit.client.0.smithi053.stdout:5/13: write f0 [3878724,72054] 0 2024-09-16T00:50:06.241 INFO:tasks.workunit.client.0.smithi053.stdout:1/18: symlink d5/d7/l8 0 2024-09-16T00:50:06.241 INFO:tasks.workunit.client.0.smithi053.stdout:1/19: read f2 [2018998,8603] 0 2024-09-16T00:50:06.244 INFO:tasks.workunit.client.1.smithi152.stdout:0/95: fsync d3/d6/d8/d1d/f20 0 2024-09-16T00:50:06.245 INFO:tasks.workunit.client.0.smithi053.stdout:1/20: write f2 [1042091,107010] 0 2024-09-16T00:50:06.245 INFO:tasks.workunit.client.0.smithi053.stdout:6/13: symlink d1/l3 0 2024-09-16T00:50:06.245 INFO:tasks.workunit.client.0.smithi053.stdout:6/14: chown d1 1 1 2024-09-16T00:50:06.248 INFO:tasks.workunit.client.1.smithi152.stdout:0/96: mknod d3/d6/c22 0 2024-09-16T00:50:06.248 INFO:tasks.workunit.client.0.smithi053.stdout:3/9: creat d1/f2 x:0 0 0 2024-09-16T00:50:06.249 INFO:tasks.workunit.client.0.smithi053.stdout:5/14: dread f0 [0,4194304] 0 2024-09-16T00:50:06.251 INFO:tasks.workunit.client.1.smithi152.stdout:0/97: mkdir d3/d6/d8/d1d/d23 0 2024-09-16T00:50:06.251 INFO:tasks.workunit.client.1.smithi152.stdout:0/98: stat d3/d6/d8/c14 0 2024-09-16T00:50:06.254 INFO:tasks.workunit.client.1.smithi152.stdout:7/116: write d9/f25 [4351772,16449] 0 2024-09-16T00:50:06.254 INFO:tasks.workunit.client.1.smithi152.stdout:7/117: stat d9/fd 0 2024-09-16T00:50:06.255 INFO:tasks.workunit.client.0.smithi053.stdout:5/15: dread f0 [0,4194304] 0 2024-09-16T00:50:06.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/118: truncate f2 801789 0 2024-09-16T00:50:06.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/119: fdatasync d9/f1f 0 2024-09-16T00:50:06.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/120: dread - d9/d10/d27/f28 zero size 2024-09-16T00:50:06.265 INFO:tasks.workunit.client.1.smithi152.stdout:0/99: dwrite d3/d6/f9 [0,4194304] 0 2024-09-16T00:50:06.265 INFO:tasks.workunit.client.1.smithi152.stdout:0/100: fdatasync d3/d6/d8/d1d/f20 0 2024-09-16T00:50:06.268 INFO:tasks.workunit.client.1.smithi152.stdout:0/101: truncate d3/fc 1712351 0 2024-09-16T00:50:06.270 INFO:tasks.workunit.client.1.smithi152.stdout:0/102: creat d3/d6/d8/d1d/d23/f24 x:0 0 0 2024-09-16T00:50:06.270 INFO:tasks.workunit.client.1.smithi152.stdout:0/103: chown d3/d6/f1f 9675 1 2024-09-16T00:50:06.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/121: dwrite f4 [0,4194304] 0 2024-09-16T00:50:06.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/122: dread f3 [0,4194304] 0 2024-09-16T00:50:06.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/123: read d9/fb [549914,105229] 0 2024-09-16T00:50:06.294 INFO:tasks.workunit.client.1.smithi152.stdout:4/246: rmdir d2 39 2024-09-16T00:50:06.296 INFO:tasks.workunit.client.1.smithi152.stdout:4/247: mknod d2/d1e/d28/d29/d32/d46/c4c 0 2024-09-16T00:50:06.305 INFO:tasks.workunit.client.1.smithi152.stdout:9/109: rename d1/d7/d13/d1c/f22 to d1/d7/d13/f27 0 2024-09-16T00:50:06.305 INFO:tasks.workunit.client.1.smithi152.stdout:9/110: stat d1/d7 0 2024-09-16T00:50:06.305 INFO:tasks.workunit.client.1.smithi152.stdout:9/111: chown d1/d7/d13/d1c/l1e 1447892 1 2024-09-16T00:50:06.306 INFO:tasks.workunit.client.1.smithi152.stdout:4/248: write d2/d1e/f35 [92060,25099] 0 2024-09-16T00:50:06.308 INFO:tasks.workunit.client.1.smithi152.stdout:4/249: mknod d2/db/c4d 0 2024-09-16T00:50:06.311 INFO:tasks.workunit.client.1.smithi152.stdout:4/250: link d2/db/l2b d2/d1e/d28/d29/d32/d46/l4e 0 2024-09-16T00:50:06.312 INFO:tasks.workunit.client.1.smithi152.stdout:4/251: truncate d2/d1e/d28/d29/f34 182352 0 2024-09-16T00:50:06.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/252: creat d2/db/f4f x:0 0 0 2024-09-16T00:50:06.316 INFO:tasks.workunit.client.1.smithi152.stdout:4/253: creat d2/db/d44/f50 x:0 0 0 2024-09-16T00:50:06.317 INFO:tasks.workunit.client.1.smithi152.stdout:4/254: chown d2/db/l2a 28 1 2024-09-16T00:50:06.322 INFO:tasks.workunit.client.1.smithi152.stdout:9/112: dwrite d1/f12 [0,4194304] 0 2024-09-16T00:50:06.323 INFO:tasks.workunit.client.1.smithi152.stdout:9/113: unlink d1/d7/f21 0 2024-09-16T00:50:06.328 INFO:tasks.workunit.client.1.smithi152.stdout:2/107: getdents d4/d19 0 2024-09-16T00:50:06.328 INFO:tasks.workunit.client.1.smithi152.stdout:2/108: chown d4/d17/l26 3769665 1 2024-09-16T00:50:06.331 INFO:tasks.workunit.client.1.smithi152.stdout:2/109: rename d4/f13 to d4/d19/f27 0 2024-09-16T00:50:06.331 INFO:tasks.workunit.client.1.smithi152.stdout:2/110: chown d4/c1f 91 1 2024-09-16T00:50:06.332 INFO:tasks.workunit.client.1.smithi152.stdout:2/111: write d4/f9 [1051590,109893] 0 2024-09-16T00:50:06.350 INFO:tasks.workunit.client.1.smithi152.stdout:9/114: dwrite d1/d7/f18 [0,4194304] 0 2024-09-16T00:50:06.351 INFO:tasks.workunit.client.1.smithi152.stdout:4/255: dwrite d2/db/d39/f3b [0,4194304] 0 2024-09-16T00:50:06.351 INFO:tasks.workunit.client.1.smithi152.stdout:4/256: read d2/d1e/f35 [1563968,51776] 0 2024-09-16T00:50:06.351 INFO:tasks.workunit.client.1.smithi152.stdout:2/112: fsync d4/f9 0 2024-09-16T00:50:06.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/115: unlink d1/f25 0 2024-09-16T00:50:06.357 INFO:tasks.workunit.client.1.smithi152.stdout:4/257: symlink d2/d1e/d28/l51 0 2024-09-16T00:50:06.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/113: mkdir d4/d19/d20/d28 0 2024-09-16T00:50:06.358 INFO:tasks.workunit.client.1.smithi152.stdout:9/116: rmdir d1/d7/d13/d1c 39 2024-09-16T00:50:06.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/258: mknod d2/db/d44/c52 0 2024-09-16T00:50:06.360 INFO:tasks.workunit.client.1.smithi152.stdout:4/259: readlink d2/d1e/d28/d29/d32/d46/l4e 0 2024-09-16T00:50:06.375 INFO:tasks.workunit.client.1.smithi152.stdout:9/117: dwrite d1/d7/f20 [0,4194304] 0 2024-09-16T00:50:06.375 INFO:tasks.workunit.client.1.smithi152.stdout:9/118: fsync d1/fc 0 2024-09-16T00:50:06.466 INFO:tasks.workunit.client.1.smithi152.stdout:9/119: mknod d1/d7/c28 0 2024-09-16T00:50:06.475 INFO:tasks.workunit.client.1.smithi152.stdout:9/120: write d1/d7/f1b [2179178,32674] 0 2024-09-16T00:50:06.479 INFO:tasks.workunit.client.1.smithi152.stdout:9/121: link d1/le d1/d7/d13/d1c/d23/l29 0 2024-09-16T00:50:06.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/122: mkdir d1/d7/d13/d1c/d2a 0 2024-09-16T00:50:06.533 INFO:tasks.workunit.client.0.smithi053.stdout:9/2: getdents . 0 2024-09-16T00:50:06.533 INFO:tasks.workunit.client.0.smithi053.stdout:9/3: chown f1 2 1 2024-09-16T00:50:06.533 INFO:tasks.workunit.client.0.smithi053.stdout:7/5: getdents . 0 2024-09-16T00:50:06.534 INFO:tasks.workunit.client.0.smithi053.stdout:7/6: mkdir d1 0 2024-09-16T00:50:06.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/7: truncate - no filename 2024-09-16T00:50:06.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/8: write - no filename 2024-09-16T00:50:06.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/9: getdents d1 0 2024-09-16T00:50:06.535 INFO:tasks.workunit.client.0.smithi053.stdout:4/4: getdents d0 0 2024-09-16T00:50:06.536 INFO:tasks.workunit.client.0.smithi053.stdout:7/10: creat d1/f2 x:0 0 0 2024-09-16T00:50:06.537 INFO:tasks.workunit.client.0.smithi053.stdout:4/5: rmdir d0 39 2024-09-16T00:50:06.537 INFO:tasks.workunit.client.0.smithi053.stdout:4/6: fdatasync d0/f1 0 2024-09-16T00:50:06.537 INFO:tasks.workunit.client.0.smithi053.stdout:4/7: chown d0/f1 265477077 1 2024-09-16T00:50:06.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/11: mkdir d1/d3 0 2024-09-16T00:50:06.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/12: rename d1 to d1/d3/d4 22 2024-09-16T00:50:06.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/13: write d1/f2 [1048438,52718] 0 2024-09-16T00:50:06.541 INFO:tasks.workunit.client.0.smithi053.stdout:4/8: symlink d0/l3 0 2024-09-16T00:50:06.542 INFO:tasks.workunit.client.0.smithi053.stdout:7/14: creat d1/d3/f5 x:0 0 0 2024-09-16T00:50:06.543 INFO:tasks.workunit.client.0.smithi053.stdout:7/15: rename d1/d3 to d1/d3/d6 22 2024-09-16T00:50:06.543 INFO:tasks.workunit.client.0.smithi053.stdout:7/16: chown d1/d3 1 1 2024-09-16T00:50:06.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/9: link d0/l3 d0/l4 0 2024-09-16T00:50:06.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/10: readlink d0/l4 0 2024-09-16T00:50:06.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/11: truncate d0/f1 766667 0 2024-09-16T00:50:06.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/12: dread d0/f1 [0,4194304] 0 2024-09-16T00:50:06.546 INFO:tasks.workunit.client.0.smithi053.stdout:8/15: getdents . 0 2024-09-16T00:50:06.547 INFO:tasks.workunit.client.0.smithi053.stdout:9/4: dwrite f1 [0,4194304] 0 2024-09-16T00:50:06.555 INFO:tasks.workunit.client.0.smithi053.stdout:9/5: write f1 [2030315,83637] 0 2024-09-16T00:50:06.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/6: rename f0 to f2 0 2024-09-16T00:50:06.559 INFO:tasks.workunit.client.0.smithi053.stdout:1/21: truncate f2 541503 0 2024-09-16T00:50:06.561 INFO:tasks.workunit.client.0.smithi053.stdout:5/16: truncate f0 2234646 0 2024-09-16T00:50:06.561 INFO:tasks.workunit.client.0.smithi053.stdout:5/17: readlink - no filename 2024-09-16T00:50:06.562 INFO:tasks.workunit.client.0.smithi053.stdout:1/22: mkdir d5/d9 0 2024-09-16T00:50:06.564 INFO:tasks.workunit.client.0.smithi053.stdout:3/10: truncate f0 1042620 0 2024-09-16T00:50:06.565 INFO:tasks.workunit.client.0.smithi053.stdout:5/18: mkdir d3 0 2024-09-16T00:50:06.565 INFO:tasks.workunit.client.0.smithi053.stdout:7/17: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:06.568 INFO:tasks.workunit.client.0.smithi053.stdout:8/16: dwrite f3 [0,4194304] 0 2024-09-16T00:50:06.571 INFO:tasks.workunit.client.0.smithi053.stdout:7/18: mknod d1/d3/c7 0 2024-09-16T00:50:06.582 INFO:tasks.workunit.client.0.smithi053.stdout:8/17: dread f3 [0,4194304] 0 2024-09-16T00:50:06.584 INFO:tasks.workunit.client.0.smithi053.stdout:8/18: symlink l6 0 2024-09-16T00:50:06.584 INFO:tasks.workunit.client.0.smithi053.stdout:8/19: truncate f4 980420 0 2024-09-16T00:50:06.584 INFO:tasks.workunit.client.0.smithi053.stdout:8/20: dread f4 [0,4194304] 0 2024-09-16T00:50:06.586 INFO:tasks.workunit.client.1.smithi152.stdout:8/72: truncate dd/ff 2756467 0 2024-09-16T00:50:06.586 INFO:tasks.workunit.client.1.smithi152.stdout:8/73: chown f3 70741 1 2024-09-16T00:50:06.591 INFO:tasks.workunit.client.1.smithi152.stdout:9/123: rmdir d1/d7/d13 39 2024-09-16T00:50:06.592 INFO:tasks.workunit.client.1.smithi152.stdout:9/124: truncate d1/ff 2764734 0 2024-09-16T00:50:06.593 INFO:tasks.workunit.client.1.smithi152.stdout:9/125: mkdir d1/d7/d13/d1c/d23/d2b 0 2024-09-16T00:50:06.594 INFO:tasks.workunit.client.1.smithi152.stdout:9/126: creat d1/d7/d13/f2c x:0 0 0 2024-09-16T00:50:06.595 INFO:tasks.workunit.client.1.smithi152.stdout:9/127: mknod d1/d7/d13/c2d 0 2024-09-16T00:50:06.596 INFO:tasks.workunit.client.1.smithi152.stdout:9/128: mkdir d1/d14/d2e 0 2024-09-16T00:50:06.597 INFO:tasks.workunit.client.1.smithi152.stdout:9/129: creat d1/d7/d13/d1c/f2f x:0 0 0 2024-09-16T00:50:06.597 INFO:tasks.workunit.client.1.smithi152.stdout:9/130: dread - d1/d7/d13/d1c/f2f zero size 2024-09-16T00:50:06.598 INFO:tasks.workunit.client.0.smithi053.stdout:4/13: getdents d0 0 2024-09-16T00:50:06.598 INFO:tasks.workunit.client.0.smithi053.stdout:4/14: write d0/f1 [1704470,3500] 0 2024-09-16T00:50:06.599 INFO:tasks.workunit.client.1.smithi152.stdout:9/131: mkdir d1/d7/d13/d1c/d23/d26/d30 0 2024-09-16T00:50:06.601 INFO:tasks.workunit.client.0.smithi053.stdout:4/15: rename d0/f1 to d0/f5 0 2024-09-16T00:50:06.602 INFO:tasks.workunit.client.1.smithi152.stdout:9/132: rename d1/f12 to d1/f31 0 2024-09-16T00:50:06.606 INFO:tasks.workunit.client.0.smithi053.stdout:3/11: link f0 d1/f3 0 2024-09-16T00:50:06.606 INFO:tasks.workunit.client.0.smithi053.stdout:3/12: chown d1 1800208387 1 2024-09-16T00:50:06.608 INFO:tasks.workunit.client.0.smithi053.stdout:3/13: mknod d1/c4 0 2024-09-16T00:50:06.609 INFO:tasks.workunit.client.0.smithi053.stdout:7/19: truncate d1/d3/f5 2292286 0 2024-09-16T00:50:06.611 INFO:tasks.workunit.client.0.smithi053.stdout:8/21: getdents . 0 2024-09-16T00:50:06.611 INFO:tasks.workunit.client.0.smithi053.stdout:8/22: rmdir - no directory 2024-09-16T00:50:06.613 INFO:tasks.workunit.client.0.smithi053.stdout:8/23: creat f7 x:0 0 0 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/114: sync 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:5/190: sync 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:3/98: sync 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:2/114: sync 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/164: sync 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/115: truncate db/d12/d20/f21 548036 0 2024-09-16T00:50:06.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/116: stat l7 0 2024-09-16T00:50:06.615 INFO:tasks.workunit.client.1.smithi152.stdout:7/124: sync 2024-09-16T00:50:06.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/191: rmdir d6/d1b/d2b 39 2024-09-16T00:50:06.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/192: truncate d6/d16/d1f/f22 847593 0 2024-09-16T00:50:06.617 INFO:tasks.workunit.client.0.smithi053.stdout:8/24: rename f7 to f8 0 2024-09-16T00:50:06.619 INFO:tasks.workunit.client.1.smithi152.stdout:2/115: link d4/c1f d4/d19/d20/c29 0 2024-09-16T00:50:06.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/165: symlink d9/l3c 0 2024-09-16T00:50:06.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/166: creat d9/d23/f3d x:0 0 0 2024-09-16T00:50:06.622 INFO:tasks.workunit.client.1.smithi152.stdout:6/117: creat db/d12/d20/f2d x:0 0 0 2024-09-16T00:50:06.622 INFO:tasks.workunit.client.1.smithi152.stdout:6/118: write db/f15 [7553,2] 0 2024-09-16T00:50:06.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/125: symlink d9/l2e 0 2024-09-16T00:50:06.625 INFO:tasks.workunit.client.0.smithi053.stdout:4/16: link d0/f5 d0/f6 0 2024-09-16T00:50:06.627 INFO:tasks.workunit.client.1.smithi152.stdout:5/193: mknod d6/d1b/c48 0 2024-09-16T00:50:06.627 INFO:tasks.workunit.client.1.smithi152.stdout:5/194: fdatasync d6/d16/f33 0 2024-09-16T00:50:06.629 INFO:tasks.workunit.client.0.smithi053.stdout:8/25: rename f3 to f9 0 2024-09-16T00:50:06.631 INFO:tasks.workunit.client.1.smithi152.stdout:3/99: dwrite f3 [0,4194304] 0 2024-09-16T00:50:06.632 INFO:tasks.workunit.client.0.smithi053.stdout:4/17: chown d0/l3 5773938 1 2024-09-16T00:50:06.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/119: symlink db/d12/d1c/l2e 0 2024-09-16T00:50:06.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/120: truncate db/f18 5174294 0 2024-09-16T00:50:06.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/121: read - db/f1e zero size 2024-09-16T00:50:06.641 INFO:tasks.workunit.client.0.smithi053.stdout:8/26: unlink f4 0 2024-09-16T00:50:06.642 INFO:tasks.workunit.client.1.smithi152.stdout:5/195: symlink d6/l49 0 2024-09-16T00:50:06.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/100: dwrite dc/fe [0,4194304] 0 2024-09-16T00:50:06.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/101: write dc/ff [4315767,67239] 0 2024-09-16T00:50:06.645 INFO:tasks.workunit.client.0.smithi053.stdout:4/18: creat d0/d2/f7 x:0 0 0 2024-09-16T00:50:06.646 INFO:tasks.workunit.client.0.smithi053.stdout:8/27: readlink l5 0 2024-09-16T00:50:06.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/116: rmdir d4 39 2024-09-16T00:50:06.648 INFO:tasks.workunit.client.0.smithi053.stdout:4/19: creat d0/f8 x:0 0 0 2024-09-16T00:50:06.649 INFO:tasks.workunit.client.0.smithi053.stdout:4/20: chown d0/l3 1751 1 2024-09-16T00:50:06.649 INFO:tasks.workunit.client.0.smithi053.stdout:4/21: chown d0/l3 457621652 1 2024-09-16T00:50:06.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/122: symlink db/d12/d20/l2f 0 2024-09-16T00:50:06.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/123: stat db/d12/d20/f2d 0 2024-09-16T00:50:06.651 INFO:tasks.workunit.client.0.smithi053.stdout:4/22: unlink d0/f6 0 2024-09-16T00:50:06.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/102: mkdir dc/d10/d17 0 2024-09-16T00:50:06.653 INFO:tasks.workunit.client.0.smithi053.stdout:4/23: mknod d0/d2/c9 0 2024-09-16T00:50:06.655 INFO:tasks.workunit.client.1.smithi152.stdout:6/124: unlink db/l27 0 2024-09-16T00:50:06.655 INFO:tasks.workunit.client.1.smithi152.stdout:6/125: fsync db/d12/d1c/d22/f24 0 2024-09-16T00:50:06.655 INFO:tasks.workunit.client.0.smithi053.stdout:8/28: rename l0 to la 0 2024-09-16T00:50:06.656 INFO:tasks.workunit.client.1.smithi152.stdout:5/196: getdents d6/d16/d1f 0 2024-09-16T00:50:06.657 INFO:tasks.workunit.client.1.smithi152.stdout:3/103: mknod dc/c18 0 2024-09-16T00:50:06.658 INFO:tasks.workunit.client.1.smithi152.stdout:3/104: write f2 [333971,25087] 0 2024-09-16T00:50:06.659 INFO:tasks.workunit.client.1.smithi152.stdout:6/126: mkdir db/d12/d30 0 2024-09-16T00:50:06.659 INFO:tasks.workunit.client.1.smithi152.stdout:6/127: write db/d12/f1a [92653,126945] 0 2024-09-16T00:50:06.659 INFO:tasks.workunit.client.0.smithi053.stdout:4/24: mkdir d0/da 0 2024-09-16T00:50:06.661 INFO:tasks.workunit.client.1.smithi152.stdout:5/197: mknod d6/d1b/d2b/c4a 0 2024-09-16T00:50:06.661 INFO:tasks.workunit.client.1.smithi152.stdout:3/105: mkdir dc/d10/d17/d19 0 2024-09-16T00:50:06.662 INFO:tasks.workunit.client.1.smithi152.stdout:3/106: rmdir dc/d10 39 2024-09-16T00:50:06.663 INFO:tasks.workunit.client.1.smithi152.stdout:3/107: rename fa to dc/f1a 0 2024-09-16T00:50:06.663 INFO:tasks.workunit.client.1.smithi152.stdout:3/108: chown dc/d10 585 1 2024-09-16T00:50:06.664 INFO:tasks.workunit.client.1.smithi152.stdout:3/109: link dc/cd dc/d10/d17/c1b 0 2024-09-16T00:50:06.674 INFO:tasks.workunit.client.1.smithi152.stdout:3/110: read dc/f15 [3098631,70821] 0 2024-09-16T00:50:06.674 INFO:tasks.workunit.client.1.smithi152.stdout:3/111: chown l1 842 1 2024-09-16T00:50:06.675 INFO:tasks.workunit.client.0.smithi053.stdout:8/29: getdents . 0 2024-09-16T00:50:06.675 INFO:tasks.workunit.client.0.smithi053.stdout:8/30: write f8 [380437,19076] 0 2024-09-16T00:50:06.681 INFO:tasks.workunit.client.1.smithi152.stdout:6/128: dwrite db/d12/d1c/d22/f24 [4194304,4194304] 0 2024-09-16T00:50:06.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/198: dwrite d6/fe [8388608,4194304] 0 2024-09-16T00:50:06.683 INFO:tasks.workunit.client.1.smithi152.stdout:6/129: rename db/f15 to db/f31 0 2024-09-16T00:50:06.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/130: truncate db/f19 3046454 0 2024-09-16T00:50:06.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/199: getdents d6/d1b 0 2024-09-16T00:50:06.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/200: dread - d6/d16/f39 zero size 2024-09-16T00:50:06.685 INFO:tasks.workunit.client.1.smithi152.stdout:5/201: mknod d6/d1b/d2b/c4b 0 2024-09-16T00:50:06.688 INFO:tasks.workunit.client.1.smithi152.stdout:5/202: dread d6/d16/f23 [0,4194304] 0 2024-09-16T00:50:06.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/203: mknod d6/c4c 0 2024-09-16T00:50:06.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/204: creat d6/d16/f4d x:0 0 0 2024-09-16T00:50:06.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/205: unlink d6/d16/f24 0 2024-09-16T00:50:06.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/206: chown d6/d16/f33 935814 1 2024-09-16T00:50:06.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/207: getdents d6/d16/d1f 0 2024-09-16T00:50:06.692 INFO:tasks.workunit.client.1.smithi152.stdout:5/208: write d6/d16/f23 [199575,125285] 0 2024-09-16T00:50:06.693 INFO:tasks.workunit.client.1.smithi152.stdout:5/209: creat d6/d1b/d2b/f4e x:0 0 0 2024-09-16T00:50:06.694 INFO:tasks.workunit.client.1.smithi152.stdout:5/210: creat d6/d1b/f4f x:0 0 0 2024-09-16T00:50:06.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/112: dwrite f8 [4194304,4194304] 0 2024-09-16T00:50:06.696 INFO:tasks.workunit.client.1.smithi152.stdout:6/131: fdatasync db/f31 0 2024-09-16T00:50:06.696 INFO:tasks.workunit.client.1.smithi152.stdout:6/132: read - db/f1e zero size 2024-09-16T00:50:06.696 INFO:tasks.workunit.client.1.smithi152.stdout:5/211: mkdir d6/d1b/d2b/d50 0 2024-09-16T00:50:06.696 INFO:tasks.workunit.client.1.smithi152.stdout:5/212: dread - d6/d16/d1f/f2e zero size 2024-09-16T00:50:06.699 INFO:tasks.workunit.client.1.smithi152.stdout:5/213: symlink d6/d16/d1f/l51 0 2024-09-16T00:50:06.702 INFO:tasks.workunit.client.1.smithi152.stdout:5/214: mkdir d6/d1b/d2b/d52 0 2024-09-16T00:50:06.710 INFO:tasks.workunit.client.1.smithi152.stdout:6/133: truncate db/d12/d1c/d22/f24 897623 0 2024-09-16T00:50:06.716 INFO:tasks.workunit.client.1.smithi152.stdout:6/134: dread db/f19 [0,4194304] 0 2024-09-16T00:50:06.717 INFO:tasks.workunit.client.1.smithi152.stdout:3/113: dwrite f2 [0,4194304] 0 2024-09-16T00:50:06.736 INFO:tasks.workunit.client.1.smithi152.stdout:6/135: dwrite db/d12/d20/f21 [0,4194304] 0 2024-09-16T00:50:06.738 INFO:tasks.workunit.client.1.smithi152.stdout:6/136: readlink db/ld 0 2024-09-16T00:50:06.738 INFO:tasks.workunit.client.1.smithi152.stdout:6/137: getdents db/d28/d2c 0 2024-09-16T00:50:06.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/138: creat db/d28/f32 x:0 0 0 2024-09-16T00:50:06.742 INFO:tasks.workunit.client.1.smithi152.stdout:6/139: write fa [1689226,5285] 0 2024-09-16T00:50:06.743 INFO:tasks.workunit.client.1.smithi152.stdout:6/140: mkdir db/d12/d1c/d22/d33 0 2024-09-16T00:50:06.743 INFO:tasks.workunit.client.1.smithi152.stdout:6/141: getdents db/d12/d1c 0 2024-09-16T00:50:06.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/167: write d9/da/df/f1e [5375452,62299] 0 2024-09-16T00:50:06.756 INFO:tasks.workunit.client.0.smithi053.stdout:8/31: fsync f8 0 2024-09-16T00:50:06.761 INFO:tasks.workunit.client.1.smithi152.stdout:1/168: mkdir d9/d3e 0 2024-09-16T00:50:06.761 INFO:tasks.workunit.client.1.smithi152.stdout:1/169: readlink d9/da/le 0 2024-09-16T00:50:06.766 INFO:tasks.workunit.client.1.smithi152.stdout:1/170: truncate d9/da/df/f27 2944069 0 2024-09-16T00:50:06.766 INFO:tasks.workunit.client.1.smithi152.stdout:5/215: dread d6/f8 [0,4194304] 0 2024-09-16T00:50:06.766 INFO:tasks.workunit.client.1.smithi152.stdout:5/216: chown d6/d1b/d2b/f31 1 1 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.1.smithi152.stdout:6/142: dwrite db/f1e [0,4194304] 0 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.1.smithi152.stdout:6/143: fdatasync db/f18 0 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.0.smithi053.stdout:9/7: dwrite f2 [0,4194304] 0 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.0.smithi053.stdout:3/14: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.0.smithi053.stdout:7/20: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:06.768 INFO:tasks.workunit.client.0.smithi053.stdout:8/32: rename f9 to fb 0 2024-09-16T00:50:06.771 INFO:tasks.workunit.client.1.smithi152.stdout:5/217: symlink d6/l53 0 2024-09-16T00:50:06.772 INFO:tasks.workunit.client.1.smithi152.stdout:2/117: dwrite f2 [0,4194304] 0 2024-09-16T00:50:06.773 INFO:tasks.workunit.client.1.smithi152.stdout:0/104: write d3/fc [268648,25532] 0 2024-09-16T00:50:06.776 INFO:tasks.workunit.client.1.smithi152.stdout:7/126: dwrite d9/f1b [0,4194304] 0 2024-09-16T00:50:06.776 INFO:tasks.workunit.client.1.smithi152.stdout:4/260: dread d2/d1e/d28/d29/f34 [0,4194304] 0 2024-09-16T00:50:06.777 INFO:tasks.workunit.client.0.smithi053.stdout:9/8: creat f3 x:0 0 0 2024-09-16T00:50:06.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/114: dwrite f8 [0,4194304] 0 2024-09-16T00:50:06.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/115: chown f7 2521316 1 2024-09-16T00:50:06.782 INFO:tasks.workunit.client.1.smithi152.stdout:6/144: mknod db/d12/d1c/c34 0 2024-09-16T00:50:06.782 INFO:tasks.workunit.client.1.smithi152.stdout:6/145: write db/d12/f1a [741931,128040] 0 2024-09-16T00:50:06.783 INFO:tasks.workunit.client.1.smithi152.stdout:6/146: write f2 [2131001,20324] 0 2024-09-16T00:50:06.783 INFO:tasks.workunit.client.1.smithi152.stdout:2/118: write f2 [2332981,95825] 0 2024-09-16T00:50:06.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/171: symlink d9/da/df/l3f 0 2024-09-16T00:50:06.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/172: chown d9/f29 0 1 2024-09-16T00:50:06.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/173: creat d9/d23/f40 x:0 0 0 2024-09-16T00:50:06.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/174: stat d9/l22 0 2024-09-16T00:50:06.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/175: read - d9/d23/f2f zero size 2024-09-16T00:50:06.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/127: write d9/d10/f12 [481160,43888] 0 2024-09-16T00:50:06.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/128: dread - d9/d10/f16 zero size 2024-09-16T00:50:06.788 INFO:tasks.workunit.client.0.smithi053.stdout:3/15: mkdir d1/d5 0 2024-09-16T00:50:06.791 INFO:tasks.workunit.client.0.smithi053.stdout:7/21: symlink d1/l8 0 2024-09-16T00:50:06.794 INFO:tasks.workunit.client.0.smithi053.stdout:3/16: write d1/f3 [875521,81498] 0 2024-09-16T00:50:06.795 INFO:tasks.workunit.client.0.smithi053.stdout:8/33: creat fc x:0 0 0 2024-09-16T00:50:06.798 INFO:tasks.workunit.client.0.smithi053.stdout:1/23: truncate f2 345299 0 2024-09-16T00:50:06.800 INFO:tasks.workunit.client.0.smithi053.stdout:7/22: truncate d1/f2 799949 0 2024-09-16T00:50:06.805 INFO:tasks.workunit.client.0.smithi053.stdout:8/34: creat fd x:0 0 0 2024-09-16T00:50:06.805 INFO:tasks.workunit.client.0.smithi053.stdout:8/35: readlink l5 0 2024-09-16T00:50:06.805 INFO:tasks.workunit.client.0.smithi053.stdout:8/36: rmdir - no directory 2024-09-16T00:50:06.807 INFO:tasks.workunit.client.0.smithi053.stdout:1/24: creat d5/d7/fa x:0 0 0 2024-09-16T00:50:06.807 INFO:tasks.workunit.client.0.smithi053.stdout:1/25: chown d5/c6 0 1 2024-09-16T00:50:06.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/147: dwrite db/fc [0,4194304] 0 2024-09-16T00:50:06.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/148: stat db/f11 0 2024-09-16T00:50:06.811 INFO:tasks.workunit.client.1.smithi152.stdout:1/176: dwrite d9/da/df/f2b [0,4194304] 0 2024-09-16T00:50:06.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/149: write db/d28/f32 [816389,6518] 0 2024-09-16T00:50:06.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/150: stat db/d12/d1c/l2e 0 2024-09-16T00:50:06.812 INFO:tasks.workunit.client.1.smithi152.stdout:6/151: chown db/d12/d1c/l2e 8404 1 2024-09-16T00:50:06.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/9: dwrite f3 [0,4194304] 0 2024-09-16T00:50:06.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/37: link l2 le 0 2024-09-16T00:50:06.822 INFO:tasks.workunit.client.0.smithi053.stdout:8/38: mknod cf 0 2024-09-16T00:50:06.825 INFO:tasks.workunit.client.1.smithi152.stdout:4/261: link d2/d1e/d28/d29/d32/d46/f49 d2/db/d44/f53 0 2024-09-16T00:50:06.826 INFO:tasks.workunit.client.1.smithi152.stdout:1/177: dread d9/da/df/f2b [0,4194304] 0 2024-09-16T00:50:06.827 INFO:tasks.workunit.client.1.smithi152.stdout:3/116: rmdir dc/d10/d17/d19 0 2024-09-16T00:50:06.829 INFO:tasks.workunit.client.0.smithi053.stdout:7/23: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:06.830 INFO:tasks.workunit.client.0.smithi053.stdout:9/10: dread f2 [0,4194304] 0 2024-09-16T00:50:06.830 INFO:tasks.workunit.client.0.smithi053.stdout:9/11: creat f4 x:0 0 0 2024-09-16T00:50:06.834 INFO:tasks.workunit.client.0.smithi053.stdout:8/39: mkdir d10 0 2024-09-16T00:50:06.836 INFO:tasks.workunit.client.1.smithi152.stdout:2/119: creat d4/d19/d20/d28/f2a x:0 0 0 2024-09-16T00:50:06.840 INFO:tasks.workunit.client.0.smithi053.stdout:3/17: truncate f0 20169 0 2024-09-16T00:50:06.842 INFO:tasks.workunit.client.0.smithi053.stdout:9/12: rename f3 to f5 0 2024-09-16T00:50:06.842 INFO:tasks.workunit.client.0.smithi053.stdout:9/13: write f4 [934648,93086] 0 2024-09-16T00:50:06.843 INFO:tasks.workunit.client.1.smithi152.stdout:7/129: mknod d9/c2f 0 2024-09-16T00:50:06.844 INFO:tasks.workunit.client.0.smithi053.stdout:8/40: mknod d10/c11 0 2024-09-16T00:50:06.848 INFO:tasks.workunit.client.1.smithi152.stdout:4/262: dwrite d2/d1e/d28/d29/f34 [0,4194304] 0 2024-09-16T00:50:06.850 INFO:tasks.workunit.client.0.smithi053.stdout:8/41: mknod d10/c12 0 2024-09-16T00:50:06.851 INFO:tasks.workunit.client.0.smithi053.stdout:7/24: dread d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:06.851 INFO:tasks.workunit.client.0.smithi053.stdout:7/25: stat d1/d3/c7 0 2024-09-16T00:50:06.851 INFO:tasks.workunit.client.0.smithi053.stdout:7/26: write d1/f2 [1487223,26536] 0 2024-09-16T00:50:06.851 INFO:tasks.workunit.client.0.smithi053.stdout:7/27: creat d1/d3/f9 x:0 0 0 2024-09-16T00:50:06.855 INFO:tasks.workunit.client.0.smithi053.stdout:1/26: dwrite f2 [0,4194304] 0 2024-09-16T00:50:06.855 INFO:tasks.workunit.client.0.smithi053.stdout:1/27: truncate d5/d7/fa 956551 0 2024-09-16T00:50:06.858 INFO:tasks.workunit.client.0.smithi053.stdout:7/28: link d1/d3/c7 d1/ca 0 2024-09-16T00:50:06.860 INFO:tasks.workunit.client.1.smithi152.stdout:0/105: rmdir d3/d6/d8/d1d 39 2024-09-16T00:50:06.860 INFO:tasks.workunit.client.1.smithi152.stdout:0/106: write d3/d6/d8/d1d/d23/f24 [885058,97858] 0 2024-09-16T00:50:06.860 INFO:tasks.workunit.client.1.smithi152.stdout:0/107: write d3/fb [4721593,53003] 0 2024-09-16T00:50:06.862 INFO:tasks.workunit.client.0.smithi053.stdout:1/28: symlink d5/lb 0 2024-09-16T00:50:06.866 INFO:tasks.workunit.client.0.smithi053.stdout:1/29: mknod d5/cc 0 2024-09-16T00:50:06.867 INFO:tasks.workunit.client.1.smithi152.stdout:6/152: mknod db/d12/c35 0 2024-09-16T00:50:06.868 INFO:tasks.workunit.client.1.smithi152.stdout:6/153: fdatasync db/d28/f32 0 2024-09-16T00:50:06.869 INFO:tasks.workunit.client.1.smithi152.stdout:8/74: truncate dd/ff 1530441 0 2024-09-16T00:50:06.872 INFO:tasks.workunit.client.1.smithi152.stdout:3/117: mkdir dc/d10/d17/d1c 0 2024-09-16T00:50:06.875 INFO:tasks.workunit.client.0.smithi053.stdout:3/18: read f0 [14831,77404] 0 2024-09-16T00:50:06.875 INFO:tasks.workunit.client.0.smithi053.stdout:3/19: fdatasync d1/f2 0 2024-09-16T00:50:06.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/120: creat d4/d19/f2b x:0 0 0 2024-09-16T00:50:06.878 INFO:tasks.workunit.client.1.smithi152.stdout:7/130: mkdir d9/d10/d30 0 2024-09-16T00:50:06.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/263: dwrite d2/fe [4194304,4194304] 0 2024-09-16T00:50:06.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/108: mkdir d3/d6/d8/d1d/d23/d25 0 2024-09-16T00:50:06.883 INFO:tasks.workunit.client.1.smithi152.stdout:8/75: truncate f3 1018822 0 2024-09-16T00:50:06.884 INFO:tasks.workunit.client.1.smithi152.stdout:3/118: truncate f2 1434377 0 2024-09-16T00:50:06.886 INFO:tasks.workunit.client.1.smithi152.stdout:7/131: mkdir d9/d31 0 2024-09-16T00:50:06.887 INFO:tasks.workunit.client.0.smithi053.stdout:1/30: write f2 [3347037,18878] 0 2024-09-16T00:50:06.888 INFO:tasks.workunit.client.0.smithi053.stdout:1/31: write d5/d7/fa [1509452,122015] 0 2024-09-16T00:50:06.888 INFO:tasks.workunit.client.1.smithi152.stdout:6/154: dwrite db/f19 [0,4194304] 0 2024-09-16T00:50:06.889 INFO:tasks.workunit.client.0.smithi053.stdout:9/14: dwrite f2 [4194304,4194304] 0 2024-09-16T00:50:06.889 INFO:tasks.workunit.client.0.smithi053.stdout:3/20: dread d1/f3 [0,4194304] 0 2024-09-16T00:50:06.889 INFO:tasks.workunit.client.0.smithi053.stdout:3/21: truncate f0 246385 0 2024-09-16T00:50:06.890 INFO:tasks.workunit.client.1.smithi152.stdout:4/264: rmdir d2/d1e 39 2024-09-16T00:50:06.890 INFO:tasks.workunit.client.1.smithi152.stdout:4/265: chown d2/d1e/d28/d29/f4a 0 1 2024-09-16T00:50:06.890 INFO:tasks.workunit.client.1.smithi152.stdout:4/266: stat d2/fe 0 2024-09-16T00:50:06.891 INFO:tasks.workunit.client.0.smithi053.stdout:7/29: dread d1/f2 [0,4194304] 0 2024-09-16T00:50:06.892 INFO:tasks.workunit.client.1.smithi152.stdout:0/109: creat d3/d6/d8/d1d/f26 x:0 0 0 2024-09-16T00:50:06.894 INFO:tasks.workunit.client.0.smithi053.stdout:8/42: dwrite f8 [0,4194304] 0 2024-09-16T00:50:06.894 INFO:tasks.workunit.client.0.smithi053.stdout:8/43: chown l1 236 1 2024-09-16T00:50:06.894 INFO:tasks.workunit.client.0.smithi053.stdout:8/44: chown l1 2474657 1 2024-09-16T00:50:06.896 INFO:tasks.workunit.client.0.smithi053.stdout:1/32: mkdir d5/dd 0 2024-09-16T00:50:06.897 INFO:tasks.workunit.client.1.smithi152.stdout:2/121: dwrite d4/d17/f23 [0,4194304] 0 2024-09-16T00:50:06.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/132: dread d9/fd [0,4194304] 0 2024-09-16T00:50:06.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/133: stat d9/l2e 0 2024-09-16T00:50:06.897 INFO:tasks.workunit.client.1.smithi152.stdout:8/76: creat dd/de/f13 x:0 0 0 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:9/15: dread f4 [0,4194304] 0 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:9/16: write f4 [1721050,61525] 0 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:9/17: chown f5 61 1 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:9/18: readlink - no filename 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:7/30: write d1/d3/f5 [3341129,42478] 0 2024-09-16T00:50:06.900 INFO:tasks.workunit.client.0.smithi053.stdout:7/31: rename d1 to d1/db 22 2024-09-16T00:50:06.901 INFO:tasks.workunit.client.0.smithi053.stdout:7/32: chown d1/d3/f9 403 1 2024-09-16T00:50:06.901 INFO:tasks.workunit.client.1.smithi152.stdout:3/119: mknod dc/d10/d17/d1c/c1d 0 2024-09-16T00:50:06.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/33: fdatasync d5/d7/fa 0 2024-09-16T00:50:06.903 INFO:tasks.workunit.client.0.smithi053.stdout:3/22: creat d1/d5/f6 x:0 0 0 2024-09-16T00:50:06.906 INFO:tasks.workunit.client.0.smithi053.stdout:9/19: dread f2 [0,4194304] 0 2024-09-16T00:50:06.906 INFO:tasks.workunit.client.0.smithi053.stdout:9/20: creat f6 x:0 0 0 2024-09-16T00:50:06.906 INFO:tasks.workunit.client.0.smithi053.stdout:9/21: chown f6 509373 1 2024-09-16T00:50:06.907 INFO:tasks.workunit.client.1.smithi152.stdout:9/133: sync 2024-09-16T00:50:06.908 INFO:tasks.workunit.client.1.smithi152.stdout:9/134: chown d1/fc 10794972 1 2024-09-16T00:50:06.912 INFO:tasks.workunit.client.0.smithi053.stdout:7/33: unlink d1/d3/f9 0 2024-09-16T00:50:06.915 INFO:tasks.workunit.client.0.smithi053.stdout:3/23: rename d1/f3 to d1/d5/f7 0 2024-09-16T00:50:06.915 INFO:tasks.workunit.client.0.smithi053.stdout:8/45: dwrite fd [0,4194304] 0 2024-09-16T00:50:06.915 INFO:tasks.workunit.client.0.smithi053.stdout:8/46: readlink l5 0 2024-09-16T00:50:06.920 INFO:tasks.workunit.client.0.smithi053.stdout:9/22: unlink f1 0 2024-09-16T00:50:06.920 INFO:tasks.workunit.client.0.smithi053.stdout:9/23: rmdir - no directory 2024-09-16T00:50:06.921 INFO:tasks.workunit.client.0.smithi053.stdout:9/24: write f4 [2668902,123544] 0 2024-09-16T00:50:06.921 INFO:tasks.workunit.client.0.smithi053.stdout:9/25: readlink - no filename 2024-09-16T00:50:06.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/122: truncate d4/f9 370959 0 2024-09-16T00:50:06.923 INFO:tasks.workunit.client.0.smithi053.stdout:3/24: truncate d1/f2 3677931 0 2024-09-16T00:50:06.926 INFO:tasks.workunit.client.0.smithi053.stdout:1/34: dwrite f2 [0,4194304] 0 2024-09-16T00:50:06.926 INFO:tasks.workunit.client.0.smithi053.stdout:1/35: chown d5/dd 955548 1 2024-09-16T00:50:06.926 INFO:tasks.workunit.client.0.smithi053.stdout:1/36: chown c1 4 1 2024-09-16T00:50:06.926 INFO:tasks.workunit.client.0.smithi053.stdout:1/37: chown d5 10137 1 2024-09-16T00:50:06.927 INFO:tasks.workunit.client.1.smithi152.stdout:7/134: rename d9/la to d9/d10/d27/l32 0 2024-09-16T00:50:06.927 INFO:tasks.workunit.client.1.smithi152.stdout:7/135: fdatasync d9/f25 0 2024-09-16T00:50:06.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/77: mknod dd/de/c14 0 2024-09-16T00:50:06.934 INFO:tasks.workunit.client.1.smithi152.stdout:3/120: unlink dc/c16 0 2024-09-16T00:50:06.938 INFO:tasks.workunit.client.1.smithi152.stdout:9/135: mkdir d1/d14/d32 0 2024-09-16T00:50:06.938 INFO:tasks.workunit.client.1.smithi152.stdout:9/136: write d1/f31 [4909394,69555] 0 2024-09-16T00:50:06.940 INFO:tasks.workunit.client.0.smithi053.stdout:9/26: mknod c7 0 2024-09-16T00:50:06.940 INFO:tasks.workunit.client.0.smithi053.stdout:9/27: dread - f6 zero size 2024-09-16T00:50:06.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/155: getdents db 0 2024-09-16T00:50:06.943 INFO:tasks.workunit.client.0.smithi053.stdout:7/34: dread d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:06.945 INFO:tasks.workunit.client.0.smithi053.stdout:8/47: rename l6 to d10/l13 0 2024-09-16T00:50:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Migrating agent root cert to cert store 2024-09-16T00:50:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Migrating agent root key to cert store 2024-09-16T00:50:06.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Checking for cert/key for grafana.smithi053 2024-09-16T00:50:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Migrating grafana.smithi053 cert to cert store 2024-09-16T00:50:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Migrating grafana.smithi053 key to cert store 2024-09-16T00:50:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: mgrmap e22: smithi152.nlmwrx(active, since 1.01233s) 2024-09-16T00:50:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: pgmap v3: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:06.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:06 smithi152 ceph-mon[33237]: Deploying cephadm binary to smithi152 2024-09-16T00:50:06.947 INFO:tasks.workunit.client.1.smithi152.stdout:4/267: link d2/db/c4d d2/db/c54 0 2024-09-16T00:50:06.948 INFO:tasks.workunit.client.0.smithi053.stdout:9/28: mkdir d8 0 2024-09-16T00:50:06.949 INFO:tasks.workunit.client.1.smithi152.stdout:9/137: write d1/d7/f20 [458790,49497] 0 2024-09-16T00:50:06.949 INFO:tasks.workunit.client.1.smithi152.stdout:9/138: fsync d1/d7/f1b 0 2024-09-16T00:50:06.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/136: mknod d9/d10/d27/c33 0 2024-09-16T00:50:06.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/137: chown d9/d10/d27/f28 141247666 1 2024-09-16T00:50:06.952 INFO:tasks.workunit.client.1.smithi152.stdout:8/78: mkdir dd/d15 0 2024-09-16T00:50:06.953 INFO:tasks.workunit.client.0.smithi053.stdout:1/38: dwrite d5/d7/fa [0,4194304] 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/121: symlink dc/d10/d17/d1c/l1e 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/122: chown dc/d10 4368 1 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/123: stat dc/ff 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/124: fsync f7 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:2/123: dwrite d4/d17/f1d [0,4194304] 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:2/124: write f2 [3894289,36627] 0 2024-09-16T00:50:06.956 INFO:tasks.workunit.client.1.smithi152.stdout:2/125: chown d4/f9 3838824 1 2024-09-16T00:50:06.957 INFO:tasks.workunit.client.0.smithi053.stdout:8/48: dread f8 [0,4194304] 0 2024-09-16T00:50:06.957 INFO:tasks.workunit.client.0.smithi053.stdout:8/49: chown f8 231347931 1 2024-09-16T00:50:06.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/156: unlink l8 0 2024-09-16T00:50:06.963 INFO:tasks.workunit.client.0.smithi053.stdout:3/25: rmdir d1 39 2024-09-16T00:50:06.963 INFO:tasks.workunit.client.0.smithi053.stdout:3/26: write d1/d5/f6 [587923,43955] 0 2024-09-16T00:50:06.965 INFO:tasks.workunit.client.1.smithi152.stdout:6/157: dread f2 [0,4194304] 0 2024-09-16T00:50:06.965 INFO:tasks.workunit.client.1.smithi152.stdout:6/158: chown db/fe 0 1 2024-09-16T00:50:06.965 INFO:tasks.workunit.client.1.smithi152.stdout:6/159: creat db/d12/d20/f36 x:0 0 0 2024-09-16T00:50:06.965 INFO:tasks.workunit.client.1.smithi152.stdout:6/160: chown db/f31 48598373 1 2024-09-16T00:50:06.965 INFO:tasks.workunit.client.1.smithi152.stdout:6/161: readlink l7 0 2024-09-16T00:50:06.966 INFO:tasks.workunit.client.0.smithi053.stdout:9/29: rename c7 to d8/c9 0 2024-09-16T00:50:06.966 INFO:tasks.workunit.client.0.smithi053.stdout:9/30: readlink - no filename 2024-09-16T00:50:06.966 INFO:tasks.workunit.client.0.smithi053.stdout:9/31: readlink - no filename 2024-09-16T00:50:06.971 INFO:tasks.workunit.client.1.smithi152.stdout:9/139: rename d1/d7/f1b to d1/d14/f33 0 2024-09-16T00:50:06.971 INFO:tasks.workunit.client.0.smithi053.stdout:1/39: mkdir d5/dd/de 0 2024-09-16T00:50:06.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/79: dwrite dd/ff [0,4194304] 0 2024-09-16T00:50:06.973 INFO:tasks.workunit.client.1.smithi152.stdout:7/138: symlink d9/d10/d27/l34 0 2024-09-16T00:50:06.974 INFO:tasks.workunit.client.0.smithi053.stdout:7/35: getdents d1 0 2024-09-16T00:50:06.974 INFO:tasks.workunit.client.0.smithi053.stdout:7/36: fdatasync d1/d3/f5 0 2024-09-16T00:50:06.975 INFO:tasks.workunit.client.1.smithi152.stdout:5/218: sync 2024-09-16T00:50:06.976 INFO:tasks.workunit.client.0.smithi053.stdout:7/37: read d1/f2 [464813,33828] 0 2024-09-16T00:50:06.976 INFO:tasks.workunit.client.0.smithi053.stdout:7/38: chown d1/l8 2724982 1 2024-09-16T00:50:06.976 INFO:tasks.workunit.client.0.smithi053.stdout:3/27: creat d1/d5/f8 x:0 0 0 2024-09-16T00:50:06.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/125: mkdir dc/d10/d17/d1c/d1f 0 2024-09-16T00:50:06.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/126: read dc/fe [1320205,81677] 0 2024-09-16T00:50:06.979 INFO:tasks.workunit.client.0.smithi053.stdout:8/50: dwrite fd [0,4194304] 0 2024-09-16T00:50:06.979 INFO:tasks.workunit.client.0.smithi053.stdout:8/51: readlink l2 0 2024-09-16T00:50:06.979 INFO:tasks.workunit.client.0.smithi053.stdout:8/52: fdatasync fc 0 2024-09-16T00:50:06.983 INFO:tasks.workunit.client.0.smithi053.stdout:3/28: dread d1/f2 [0,4194304] 0 2024-09-16T00:50:06.983 INFO:tasks.workunit.client.0.smithi053.stdout:3/29: write f0 [834792,66253] 0 2024-09-16T00:50:06.983 INFO:tasks.workunit.client.0.smithi053.stdout:3/30: chown d1/d5/f6 229382 1 2024-09-16T00:50:06.984 INFO:tasks.workunit.client.1.smithi152.stdout:2/126: mkdir d4/d19/d20/d28/d2c 0 2024-09-16T00:50:06.985 INFO:tasks.workunit.client.0.smithi053.stdout:7/39: unlink d1/d3/c7 0 2024-09-16T00:50:06.988 INFO:tasks.workunit.client.0.smithi053.stdout:8/53: unlink d10/c11 0 2024-09-16T00:50:06.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/162: unlink c1 0 2024-09-16T00:50:06.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/163: chown db/fc 250 1 2024-09-16T00:50:06.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/164: chown db/l26 44 1 2024-09-16T00:50:06.998 INFO:tasks.workunit.client.0.smithi053.stdout:9/32: link d8/c9 d8/ca 0 2024-09-16T00:50:06.999 INFO:tasks.workunit.client.0.smithi053.stdout:7/40: mknod d1/cc 0 2024-09-16T00:50:07.003 INFO:tasks.workunit.client.1.smithi152.stdout:8/80: creat dd/f16 x:0 0 0 2024-09-16T00:50:07.005 INFO:tasks.workunit.client.1.smithi152.stdout:7/139: creat d9/d10/d27/d2a/f35 x:0 0 0 2024-09-16T00:50:07.008 INFO:tasks.workunit.client.0.smithi053.stdout:7/41: rename d1/f2 to d1/fd 0 2024-09-16T00:50:07.008 INFO:tasks.workunit.client.0.smithi053.stdout:7/42: fdatasync d1/fd 0 2024-09-16T00:50:07.012 INFO:tasks.workunit.client.1.smithi152.stdout:5/219: rename d6/d1b/d2b/d52 to d6/d1b/d54 0 2024-09-16T00:50:07.012 INFO:tasks.workunit.client.1.smithi152.stdout:2/127: dwrite d4/f7 [0,4194304] 0 2024-09-16T00:50:07.013 INFO:tasks.workunit.client.1.smithi152.stdout:3/127: truncate dc/ff 1405120 0 2024-09-16T00:50:07.013 INFO:tasks.workunit.client.0.smithi053.stdout:3/31: dwrite f0 [0,4194304] 0 2024-09-16T00:50:07.013 INFO:tasks.workunit.client.0.smithi053.stdout:8/54: dwrite f8 [0,4194304] 0 2024-09-16T00:50:07.014 INFO:tasks.workunit.client.0.smithi053.stdout:7/43: symlink d1/d3/le 0 2024-09-16T00:50:07.015 INFO:tasks.workunit.client.1.smithi152.stdout:6/165: creat db/d12/d1c/f37 x:0 0 0 2024-09-16T00:50:07.016 INFO:tasks.workunit.client.0.smithi053.stdout:9/33: dread f4 [0,4194304] 0 2024-09-16T00:50:07.016 INFO:tasks.workunit.client.0.smithi053.stdout:9/34: fdatasync f2 0 2024-09-16T00:50:07.016 INFO:tasks.workunit.client.0.smithi053.stdout:9/35: truncate f6 760616 0 2024-09-16T00:50:07.016 INFO:tasks.workunit.client.0.smithi053.stdout:9/36: readlink - no filename 2024-09-16T00:50:07.017 INFO:tasks.workunit.client.0.smithi053.stdout:9/37: write f4 [1377599,97888] 0 2024-09-16T00:50:07.017 INFO:tasks.workunit.client.0.smithi053.stdout:3/32: unlink d1/d5/f7 0 2024-09-16T00:50:07.017 INFO:tasks.workunit.client.0.smithi053.stdout:3/33: write d1/d5/f8 [537944,48734] 0 2024-09-16T00:50:07.017 INFO:tasks.workunit.client.0.smithi053.stdout:3/34: chown f0 15 1 2024-09-16T00:50:07.018 INFO:tasks.workunit.client.1.smithi152.stdout:9/140: rmdir d1/d7/d13/d1c 39 2024-09-16T00:50:07.018 INFO:tasks.workunit.client.1.smithi152.stdout:9/141: write d1/d7/d13/f27 [1676953,47162] 0 2024-09-16T00:50:07.018 INFO:tasks.workunit.client.1.smithi152.stdout:9/142: dread - d1/fc zero size 2024-09-16T00:50:07.019 INFO:tasks.workunit.client.0.smithi053.stdout:8/55: creat d10/f14 x:0 0 0 2024-09-16T00:50:07.022 INFO:tasks.workunit.client.1.smithi152.stdout:7/140: link d9/d10/f17 d9/d10/f36 0 2024-09-16T00:50:07.022 INFO:tasks.workunit.client.1.smithi152.stdout:7/141: write f2 [1834447,11721] 0 2024-09-16T00:50:07.023 INFO:tasks.workunit.client.1.smithi152.stdout:7/142: chown d9/d10/d27/f28 489603881 1 2024-09-16T00:50:07.023 INFO:tasks.workunit.client.1.smithi152.stdout:7/143: creat d9/f37 x:0 0 0 2024-09-16T00:50:07.023 INFO:tasks.workunit.client.0.smithi053.stdout:7/44: symlink d1/lf 0 2024-09-16T00:50:07.023 INFO:tasks.workunit.client.0.smithi053.stdout:7/45: stat d1/d3/le 0 2024-09-16T00:50:07.024 INFO:tasks.workunit.client.1.smithi152.stdout:6/166: write db/d12/f14 [2132129,9495] 0 2024-09-16T00:50:07.027 INFO:tasks.workunit.client.1.smithi152.stdout:8/81: dwrite dd/de/f12 [0,4194304] 0 2024-09-16T00:50:07.027 INFO:tasks.workunit.client.1.smithi152.stdout:5/220: mknod d6/d1b/d54/c55 0 2024-09-16T00:50:07.027 INFO:tasks.workunit.client.0.smithi053.stdout:1/40: truncate d5/d7/fa 2324263 0 2024-09-16T00:50:07.028 INFO:tasks.workunit.client.0.smithi053.stdout:3/35: truncate d1/f2 3264801 0 2024-09-16T00:50:07.029 INFO:tasks.workunit.client.0.smithi053.stdout:9/38: getdents d8 0 2024-09-16T00:50:07.029 INFO:tasks.workunit.client.0.smithi053.stdout:9/39: stat f2 0 2024-09-16T00:50:07.033 INFO:tasks.workunit.client.0.smithi053.stdout:8/56: link d10/f14 d10/f15 0 2024-09-16T00:50:07.035 INFO:tasks.workunit.client.0.smithi053.stdout:7/46: mkdir d1/d3/d10 0 2024-09-16T00:50:07.041 INFO:tasks.workunit.client.0.smithi053.stdout:1/41: creat d5/d9/ff x:0 0 0 2024-09-16T00:50:07.041 INFO:tasks.workunit.client.0.smithi053.stdout:1/42: readlink l3 0 2024-09-16T00:50:07.044 INFO:tasks.workunit.client.0.smithi053.stdout:3/36: symlink d1/d5/l9 0 2024-09-16T00:50:07.044 INFO:tasks.workunit.client.0.smithi053.stdout:3/37: fdatasync f0 0 2024-09-16T00:50:07.046 INFO:tasks.workunit.client.0.smithi053.stdout:8/57: symlink d10/l16 0 2024-09-16T00:50:07.050 INFO:tasks.workunit.client.1.smithi152.stdout:9/143: rename d1/d14/d2e to d1/d7/d13/d1c/d2a/d34 0 2024-09-16T00:50:07.050 INFO:tasks.workunit.client.0.smithi053.stdout:7/47: rmdir d1 39 2024-09-16T00:50:07.052 INFO:tasks.workunit.client.0.smithi053.stdout:9/40: dwrite f2 [8388608,4194304] 0 2024-09-16T00:50:07.056 INFO:tasks.workunit.client.1.smithi152.stdout:1/178: sync 2024-09-16T00:50:07.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/167: creat db/d12/d1c/d22/d33/f38 x:0 0 0 2024-09-16T00:50:07.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/168: write db/f18 [6112077,124449] 0 2024-09-16T00:50:07.059 INFO:tasks.workunit.client.0.smithi053.stdout:7/48: write d1/d3/f5 [2848004,110320] 0 2024-09-16T00:50:07.062 INFO:tasks.workunit.client.0.smithi053.stdout:8/58: dwrite f8 [4194304,4194304] 0 2024-09-16T00:50:07.062 INFO:tasks.workunit.client.0.smithi053.stdout:9/41: creat d8/fb x:0 0 0 2024-09-16T00:50:07.065 INFO:tasks.workunit.client.0.smithi053.stdout:3/38: rmdir d1/d5 39 2024-09-16T00:50:07.067 INFO:tasks.workunit.client.1.smithi152.stdout:8/82: mknod dd/d15/c17 0 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Migrating agent root cert to cert store 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Migrating agent root key to cert store 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Checking for cert/key for grafana.smithi053 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Migrating grafana.smithi053 cert to cert store 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Migrating grafana.smithi053 key to cert store 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: mgrmap e22: smithi152.nlmwrx(active, since 1.01233s) 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: pgmap v3: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:07.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:06 smithi053 ceph-mon[27950]: Deploying cephadm binary to smithi152 2024-09-16T00:50:07.070 INFO:tasks.workunit.client.1.smithi152.stdout:5/221: creat d6/d16/d1f/f56 x:0 0 0 2024-09-16T00:50:07.071 INFO:tasks.workunit.client.0.smithi053.stdout:7/49: write d1/fd [2056937,78576] 0 2024-09-16T00:50:07.072 INFO:tasks.workunit.client.1.smithi152.stdout:2/128: getdents d4/d19 0 2024-09-16T00:50:07.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/110: sync 2024-09-16T00:50:07.075 INFO:tasks.workunit.client.1.smithi152.stdout:4/268: sync 2024-09-16T00:50:07.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/111: dread - d3/d6/f1f zero size 2024-09-16T00:50:07.077 INFO:tasks.workunit.client.0.smithi053.stdout:9/42: rename f5 to d8/fc 0 2024-09-16T00:50:07.078 INFO:tasks.workunit.client.0.smithi053.stdout:9/43: chown d8/ca 3193341 1 2024-09-16T00:50:07.080 INFO:tasks.workunit.client.1.smithi152.stdout:8/83: write dd/ff [764703,110455] 0 2024-09-16T00:50:07.081 INFO:tasks.workunit.client.1.smithi152.stdout:7/144: rename d9/c2f to d9/d31/c38 0 2024-09-16T00:50:07.081 INFO:tasks.workunit.client.1.smithi152.stdout:7/145: fsync d9/d10/d27/d2a/f35 0 2024-09-16T00:50:07.087 INFO:tasks.workunit.client.1.smithi152.stdout:9/144: creat d1/d14/d32/f35 x:0 0 0 2024-09-16T00:50:07.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/222: dwrite d6/f32 [0,4194304] 0 2024-09-16T00:50:07.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/223: chown d6/d1b/c48 2996 1 2024-09-16T00:50:07.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/224: readlink d6/l53 0 2024-09-16T00:50:07.091 INFO:tasks.workunit.client.1.smithi152.stdout:6/169: rmdir db/d12/d30 0 2024-09-16T00:50:07.091 INFO:tasks.workunit.client.1.smithi152.stdout:6/170: write db/d12/f14 [2607219,24902] 0 2024-09-16T00:50:07.091 INFO:tasks.workunit.client.1.smithi152.stdout:6/171: write db/fe [1043177,35767] 0 2024-09-16T00:50:07.094 INFO:tasks.workunit.client.1.smithi152.stdout:2/129: rmdir d4/d19 39 2024-09-16T00:50:07.100 INFO:tasks.workunit.client.1.smithi152.stdout:4/269: mknod d2/d1e/c55 0 2024-09-16T00:50:07.100 INFO:tasks.workunit.client.1.smithi152.stdout:8/84: dread f8 [0,4194304] 0 2024-09-16T00:50:07.100 INFO:tasks.workunit.client.0.smithi053.stdout:3/39: read f0 [1434906,82886] 0 2024-09-16T00:50:07.101 INFO:tasks.workunit.client.0.smithi053.stdout:9/44: truncate d8/fc 1352230 0 2024-09-16T00:50:07.102 INFO:tasks.workunit.client.0.smithi053.stdout:3/40: dread d1/d5/f6 [0,4194304] 0 2024-09-16T00:50:07.106 INFO:tasks.workunit.client.0.smithi053.stdout:7/50: mknod d1/c11 0 2024-09-16T00:50:07.106 INFO:tasks.workunit.client.0.smithi053.stdout:7/51: write d1/d3/f5 [2025441,121259] 0 2024-09-16T00:50:07.106 INFO:tasks.workunit.client.0.smithi053.stdout:7/52: read d1/d3/f5 [2920578,45852] 0 2024-09-16T00:50:07.106 INFO:tasks.workunit.client.0.smithi053.stdout:7/53: read d1/d3/f5 [1993144,120882] 0 2024-09-16T00:50:07.108 INFO:tasks.workunit.client.1.smithi152.stdout:0/112: dwrite d3/fc [0,4194304] 0 2024-09-16T00:50:07.108 INFO:tasks.workunit.client.1.smithi152.stdout:7/146: dwrite d9/fb [0,4194304] 0 2024-09-16T00:50:07.108 INFO:tasks.workunit.client.1.smithi152.stdout:0/113: creat d3/d6/d8/f27 x:0 0 0 2024-09-16T00:50:07.109 INFO:tasks.workunit.client.0.smithi053.stdout:8/59: truncate fd 1326279 0 2024-09-16T00:50:07.116 INFO:tasks.workunit.client.0.smithi053.stdout:9/45: mkdir d8/dd 0 2024-09-16T00:50:07.117 INFO:tasks.workunit.client.1.smithi152.stdout:5/225: dwrite d6/f8 [0,4194304] 0 2024-09-16T00:50:07.117 INFO:tasks.workunit.client.1.smithi152.stdout:5/226: write d6/d16/f45 [546852,119873] 0 2024-09-16T00:50:07.118 INFO:tasks.workunit.client.0.smithi053.stdout:3/41: symlink d1/d5/la 0 2024-09-16T00:50:07.123 INFO:tasks.workunit.client.0.smithi053.stdout:7/54: chown d1/cc 83492 1 2024-09-16T00:50:07.125 INFO:tasks.workunit.client.0.smithi053.stdout:9/46: mknod d8/ce 0 2024-09-16T00:50:07.130 INFO:tasks.workunit.client.0.smithi053.stdout:3/42: unlink f0 0 2024-09-16T00:50:07.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/43: write d1/d5/f6 [457729,39680] 0 2024-09-16T00:50:07.134 INFO:tasks.workunit.client.1.smithi152.stdout:4/270: dwrite d2/f7 [0,4194304] 0 2024-09-16T00:50:07.136 INFO:tasks.workunit.client.0.smithi053.stdout:7/55: unlink d1/fd 0 2024-09-16T00:50:07.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/130: dwrite d4/f15 [0,4194304] 0 2024-09-16T00:50:07.139 INFO:tasks.workunit.client.0.smithi053.stdout:9/47: rmdir d8/dd 0 2024-09-16T00:50:07.139 INFO:tasks.workunit.client.0.smithi053.stdout:9/48: write f6 [414191,42818] 0 2024-09-16T00:50:07.140 INFO:tasks.workunit.client.0.smithi053.stdout:9/49: write f6 [7880,2857] 0 2024-09-16T00:50:07.142 INFO:tasks.workunit.client.0.smithi053.stdout:9/50: symlink d8/lf 0 2024-09-16T00:50:07.142 INFO:tasks.workunit.client.1.smithi152.stdout:7/147: mknod d9/d10/d27/d2a/c39 0 2024-09-16T00:50:07.144 INFO:tasks.workunit.client.0.smithi053.stdout:9/51: symlink d8/l10 0 2024-09-16T00:50:07.145 INFO:tasks.workunit.client.1.smithi152.stdout:0/114: mknod d3/d6/d8/d1d/d23/c28 0 2024-09-16T00:50:07.145 INFO:tasks.workunit.client.1.smithi152.stdout:0/115: chown d3/l1b 45554 1 2024-09-16T00:50:07.147 INFO:tasks.workunit.client.0.smithi053.stdout:8/60: dwrite d10/f15 [0,4194304] 0 2024-09-16T00:50:07.148 INFO:tasks.workunit.client.1.smithi152.stdout:4/271: creat d2/f56 x:0 0 0 2024-09-16T00:50:07.153 INFO:tasks.workunit.client.1.smithi152.stdout:8/85: dwrite dd/ff [0,4194304] 0 2024-09-16T00:50:07.153 INFO:tasks.workunit.client.1.smithi152.stdout:9/145: dwrite d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:07.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/131: creat d4/d17/f2d x:0 0 0 2024-09-16T00:50:07.158 INFO:tasks.workunit.client.0.smithi053.stdout:8/61: mknod d10/c17 0 2024-09-16T00:50:07.159 INFO:tasks.workunit.client.0.smithi053.stdout:9/52: dwrite d8/fc [0,4194304] 0 2024-09-16T00:50:07.159 INFO:tasks.workunit.client.0.smithi053.stdout:9/53: creat d8/f11 x:0 0 0 2024-09-16T00:50:07.159 INFO:tasks.workunit.client.0.smithi053.stdout:9/54: readlink d8/l10 0 2024-09-16T00:50:07.160 INFO:tasks.workunit.client.1.smithi152.stdout:7/148: stat d9/d10/d27/l2b 0 2024-09-16T00:50:07.160 INFO:tasks.workunit.client.1.smithi152.stdout:7/149: write f4 [4225195,41684] 0 2024-09-16T00:50:07.162 INFO:tasks.workunit.client.1.smithi152.stdout:0/116: truncate d3/d6/d8/ff 1271412 0 2024-09-16T00:50:07.167 INFO:tasks.workunit.client.0.smithi053.stdout:8/62: rename d10/l16 to d10/l18 0 2024-09-16T00:50:07.168 INFO:tasks.workunit.client.1.smithi152.stdout:4/272: dwrite d2/db/d39/d3c/f48 [0,4194304] 0 2024-09-16T00:50:07.168 INFO:tasks.workunit.client.1.smithi152.stdout:4/273: read d2/f4 [1858129,25715] 0 2024-09-16T00:50:07.168 INFO:tasks.workunit.client.1.smithi152.stdout:4/274: truncate d2/f16 514087 0 2024-09-16T00:50:07.168 INFO:tasks.workunit.client.1.smithi152.stdout:1/179: rename d9/d23 to d9/d3e/d41 0 2024-09-16T00:50:07.168 INFO:tasks.workunit.client.1.smithi152.stdout:1/180: write d9/da/df/f30 [583701,61414] 0 2024-09-16T00:50:07.173 INFO:tasks.workunit.client.1.smithi152.stdout:0/117: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:07.173 INFO:tasks.workunit.client.1.smithi152.stdout:7/150: dread d9/fd [4194304,4194304] 0 2024-09-16T00:50:07.174 INFO:tasks.workunit.client.1.smithi152.stdout:7/151: dread - d9/f23 zero size 2024-09-16T00:50:07.174 INFO:tasks.workunit.client.1.smithi152.stdout:7/152: chown d9/l21 365355082 1 2024-09-16T00:50:07.174 INFO:tasks.workunit.client.1.smithi152.stdout:7/153: chown d9/d10/d27/d2a 11796 1 2024-09-16T00:50:07.176 INFO:tasks.workunit.client.1.smithi152.stdout:8/86: creat dd/d15/f18 x:0 0 0 2024-09-16T00:50:07.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/132: dwrite d4/d19/f2b [0,4194304] 0 2024-09-16T00:50:07.177 INFO:tasks.workunit.client.1.smithi152.stdout:9/146: mknod d1/d7/d13/d1c/d23/c36 0 2024-09-16T00:50:07.179 INFO:tasks.workunit.client.0.smithi053.stdout:8/63: read d10/f15 [3000336,75953] 0 2024-09-16T00:50:07.180 INFO:tasks.workunit.client.0.smithi053.stdout:7/56: truncate d1/d3/f5 4178170 0 2024-09-16T00:50:07.185 INFO:tasks.workunit.client.0.smithi053.stdout:8/64: rename fd to d10/f19 0 2024-09-16T00:50:07.186 INFO:tasks.workunit.client.0.smithi053.stdout:9/55: dwrite f6 [0,4194304] 0 2024-09-16T00:50:07.186 INFO:tasks.workunit.client.0.smithi053.stdout:9/56: creat d8/f12 x:0 0 0 2024-09-16T00:50:07.188 INFO:tasks.workunit.client.1.smithi152.stdout:6/172: rename db/f11 to db/d28/f39 0 2024-09-16T00:50:07.189 INFO:tasks.workunit.client.1.smithi152.stdout:1/181: creat d9/da/df/f42 x:0 0 0 2024-09-16T00:50:07.190 INFO:tasks.workunit.client.1.smithi152.stdout:0/118: creat d3/d6/d8/d1d/d23/d25/f29 x:0 0 0 2024-09-16T00:50:07.192 INFO:tasks.workunit.client.1.smithi152.stdout:7/154: mkdir d9/d10/d27/d2a/d3a 0 2024-09-16T00:50:07.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/227: rename d6/d1b to d6/d57 0 2024-09-16T00:50:07.195 INFO:tasks.workunit.client.0.smithi053.stdout:9/57: mkdir d8/d13 0 2024-09-16T00:50:07.196 INFO:tasks.workunit.client.1.smithi152.stdout:0/119: dread d3/d6/d8/d1d/d23/f24 [0,4194304] 0 2024-09-16T00:50:07.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/147: dwrite d1/d7/fd [0,4194304] 0 2024-09-16T00:50:07.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/148: creat d1/d7/d13/f37 x:0 0 0 2024-09-16T00:50:07.197 INFO:tasks.workunit.client.1.smithi152.stdout:8/87: symlink dd/d15/l19 0 2024-09-16T00:50:07.198 INFO:tasks.workunit.client.0.smithi053.stdout:8/65: rename d10/l18 to d10/l1a 0 2024-09-16T00:50:07.200 INFO:tasks.workunit.client.1.smithi152.stdout:1/182: write d9/f2d [1724971,127094] 0 2024-09-16T00:50:07.201 INFO:tasks.workunit.client.0.smithi053.stdout:9/58: mknod d8/d13/c14 0 2024-09-16T00:50:07.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/128: sync 2024-09-16T00:50:07.205 INFO:tasks.workunit.client.0.smithi053.stdout:8/66: symlink d10/l1b 0 2024-09-16T00:50:07.206 INFO:tasks.workunit.client.1.smithi152.stdout:2/133: symlink d4/d19/d20/l2e 0 2024-09-16T00:50:07.209 INFO:tasks.workunit.client.0.smithi053.stdout:8/67: mkdir d10/d1c 0 2024-09-16T00:50:07.210 INFO:tasks.workunit.client.0.smithi053.stdout:9/59: write d8/fc [1982353,68619] 0 2024-09-16T00:50:07.210 INFO:tasks.workunit.client.0.smithi053.stdout:9/60: chown d8/ca 0 1 2024-09-16T00:50:07.210 INFO:tasks.workunit.client.0.smithi053.stdout:9/61: dread - d8/f12 zero size 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.0.smithi053.stdout:9/62: chown d8/fb 52767 1 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.0.smithi053.stdout:9/63: fdatasync d8/f11 0 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.0.smithi053.stdout:9/64: stat d8/ce 0 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/173: mkdir db/d12/d23/d3a 0 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/174: rename db/d12 to db/d12/d23/d3b 22 2024-09-16T00:50:07.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/175: dread - db/d12/d1c/d22/d33/f38 zero size 2024-09-16T00:50:07.214 INFO:tasks.workunit.client.1.smithi152.stdout:5/228: dwrite d6/d16/f36 [8388608,4194304] 0 2024-09-16T00:50:07.215 INFO:tasks.workunit.client.0.smithi053.stdout:9/65: mknod d8/d13/c15 0 2024-09-16T00:50:07.215 INFO:tasks.workunit.client.0.smithi053.stdout:9/66: creat d8/f16 x:0 0 0 2024-09-16T00:50:07.215 INFO:tasks.workunit.client.0.smithi053.stdout:9/67: creat d8/f17 x:0 0 0 2024-09-16T00:50:07.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/68: write f4 [2206520,8974] 0 2024-09-16T00:50:07.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/69: dread - d8/f11 zero size 2024-09-16T00:50:07.218 INFO:tasks.workunit.client.0.smithi053.stdout:8/68: dread fb [0,4194304] 0 2024-09-16T00:50:07.218 INFO:tasks.workunit.client.1.smithi152.stdout:0/120: mkdir d3/d6/d8/d1d/d23/d25/d2a 0 2024-09-16T00:50:07.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/176: read db/f18 [3835156,28385] 0 2024-09-16T00:50:07.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/149: symlink d1/l38 0 2024-09-16T00:50:07.227 INFO:tasks.workunit.client.1.smithi152.stdout:8/88: truncate f3 3289041 0 2024-09-16T00:50:07.229 INFO:tasks.workunit.client.0.smithi053.stdout:7/57: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:07.231 INFO:tasks.workunit.client.1.smithi152.stdout:1/183: link d9/da/f1d d9/d3e/d41/d31/d38/f43 0 2024-09-16T00:50:07.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/129: mknod dc/d10/d17/d1c/d1f/c20 0 2024-09-16T00:50:07.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/130: rename dc to dc/d21 22 2024-09-16T00:50:07.233 INFO:tasks.workunit.client.1.smithi152.stdout:2/134: symlink d4/d17/l2f 0 2024-09-16T00:50:07.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/275: rmdir d2/d1e/d28/d45 0 2024-09-16T00:50:07.235 INFO:tasks.workunit.client.0.smithi053.stdout:8/69: getdents d10 0 2024-09-16T00:50:07.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/135: dread d4/f9 [0,4194304] 0 2024-09-16T00:50:07.236 INFO:tasks.workunit.client.1.smithi152.stdout:7/155: getdents d9/d10/d27 0 2024-09-16T00:50:07.237 INFO:tasks.workunit.client.1.smithi152.stdout:5/229: mknod d6/d57/d2b/c58 0 2024-09-16T00:50:07.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/70: link f8 d10/f1d 0 2024-09-16T00:50:07.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/71: chown d10 729886501 1 2024-09-16T00:50:07.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/72: fsync fc 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/121: creat d3/d6/d8/d1d/d23/d25/d2a/f2b x:0 0 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/122: read - d3/d6/d8/d1d/f20 zero size 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/123: chown d3/d6/d8/d1d/d23/d25 4600373 1 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/124: fdatasync d3/d6/f1e 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/125: creat d3/d6/d8/f2c x:0 0 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/126: write d3/fb [581307,54326] 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/127: readlink d3/d6/la 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/128: creat d3/d6/d8/d1d/d23/d25/d2a/f2d x:0 0 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/129: write d3/d6/d8/d1d/d23/d25/d2a/f2b [889408,62957] 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/130: write d3/f21 [1010927,1614] 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/131: truncate d3/d6/d8/ff 1356552 0 2024-09-16T00:50:07.241 INFO:tasks.workunit.client.1.smithi152.stdout:4/276: dread d2/d1e/d28/f30 [0,4194304] 0 2024-09-16T00:50:07.242 INFO:tasks.workunit.client.1.smithi152.stdout:6/177: link db/fc db/d28/f3c 0 2024-09-16T00:50:07.242 INFO:tasks.workunit.client.0.smithi053.stdout:8/73: chown d10/c17 274 1 2024-09-16T00:50:07.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/156: fsync f7 0 2024-09-16T00:50:07.244 INFO:tasks.workunit.client.1.smithi152.stdout:9/150: link d1/ff d1/d7/d13/d1c/d2a/d34/f39 0 2024-09-16T00:50:07.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/89: mkdir dd/d15/d1a 0 2024-09-16T00:50:07.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/90: rename dd to dd/d15/d1a/d1b 22 2024-09-16T00:50:07.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/91: write dd/de/f13 [145856,52112] 0 2024-09-16T00:50:07.247 INFO:tasks.workunit.client.0.smithi053.stdout:7/58: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:07.249 INFO:tasks.workunit.client.1.smithi152.stdout:1/184: creat d9/d3e/d41/d31/f44 x:0 0 0 2024-09-16T00:50:07.251 INFO:tasks.workunit.client.0.smithi053.stdout:9/70: truncate f4 960551 0 2024-09-16T00:50:07.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/131: mkdir dc/d10/d17/d1c/d1f/d22 0 2024-09-16T00:50:07.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/132: chown dc/d10/d17/d1c/d1f 602 1 2024-09-16T00:50:07.253 INFO:tasks.workunit.client.0.smithi053.stdout:8/74: link f8 d10/f1e 0 2024-09-16T00:50:07.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/136: mknod d4/d17/c30 0 2024-09-16T00:50:07.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/137: stat d4/d19/f27 0 2024-09-16T00:50:07.257 INFO:tasks.workunit.client.1.smithi152.stdout:5/230: symlink d6/l59 0 2024-09-16T00:50:07.258 INFO:tasks.workunit.client.0.smithi053.stdout:7/59: mknod d1/d3/d10/c12 0 2024-09-16T00:50:07.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/151: dwrite d1/d7/f18 [4194304,4194304] 0 2024-09-16T00:50:07.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/152: chown d1/d7/f18 142208093 1 2024-09-16T00:50:07.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/153: write d1/d7/d13/f2c [132141,30590] 0 2024-09-16T00:50:07.260 INFO:tasks.workunit.client.0.smithi053.stdout:9/71: symlink d8/l18 0 2024-09-16T00:50:07.265 INFO:tasks.workunit.client.0.smithi053.stdout:9/72: mkdir d8/d19 0 2024-09-16T00:50:07.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/132: mkdir d3/d6/d2e 0 2024-09-16T00:50:07.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/133: dread - d3/d6/d8/d1d/f20 zero size 2024-09-16T00:50:07.271 INFO:tasks.workunit.client.1.smithi152.stdout:4/277: creat d2/d1e/d28/f57 x:0 0 0 2024-09-16T00:50:07.271 INFO:tasks.workunit.client.1.smithi152.stdout:4/278: fdatasync d2/d1e/d28/f30 0 2024-09-16T00:50:07.273 INFO:tasks.workunit.client.0.smithi053.stdout:9/73: mkdir d8/d13/d1a 0 2024-09-16T00:50:07.273 INFO:tasks.workunit.client.0.smithi053.stdout:9/74: chown d8/d19 34540701 1 2024-09-16T00:50:07.273 INFO:tasks.workunit.client.0.smithi053.stdout:9/75: getdents d8/d19 0 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/178: creat db/d12/f3d x:0 0 0 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/179: creat db/d12/d20/f3e x:0 0 0 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/180: creat db/d12/d1c/f3f x:0 0 0 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/181: chown db/d28/f39 5 1 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/182: write db/d12/d1c/d22/f24 [528569,106786] 0 2024-09-16T00:50:07.275 INFO:tasks.workunit.client.0.smithi053.stdout:7/60: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:07.277 INFO:tasks.workunit.client.0.smithi053.stdout:9/76: creat d8/d13/d1a/f1b x:0 0 0 2024-09-16T00:50:07.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/157: creat d9/d10/d30/f3b x:0 0 0 2024-09-16T00:50:07.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/158: write d9/d10/f16 [894555,43178] 0 2024-09-16T00:50:07.282 INFO:tasks.workunit.client.1.smithi152.stdout:8/92: symlink dd/d15/d1a/l1c 0 2024-09-16T00:50:07.285 INFO:tasks.workunit.client.1.smithi152.stdout:1/185: rmdir d9/d3e/d41/d31/d38 39 2024-09-16T00:50:07.287 INFO:tasks.workunit.client.0.smithi053.stdout:7/61: symlink d1/l13 0 2024-09-16T00:50:07.289 INFO:tasks.workunit.client.1.smithi152.stdout:3/133: creat dc/d10/d17/d1c/f23 x:0 0 0 2024-09-16T00:50:07.292 INFO:tasks.workunit.client.1.smithi152.stdout:1/186: dread d9/f16 [0,4194304] 0 2024-09-16T00:50:07.293 INFO:tasks.workunit.client.1.smithi152.stdout:2/138: creat d4/d19/d20/d28/d2c/f31 x:0 0 0 2024-09-16T00:50:07.293 INFO:tasks.workunit.client.1.smithi152.stdout:2/139: write f2 [2539032,48604] 0 2024-09-16T00:50:07.294 INFO:tasks.workunit.client.0.smithi053.stdout:7/62: mkdir d1/d3/d10/d14 0 2024-09-16T00:50:07.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/231: creat d6/d57/d2b/d50/f5a x:0 0 0 2024-09-16T00:50:07.298 INFO:tasks.workunit.client.1.smithi152.stdout:9/154: unlink d1/d7/fd 0 2024-09-16T00:50:07.298 INFO:tasks.workunit.client.1.smithi152.stdout:9/155: write d1/d7/d13/d1c/f2f [454434,71767] 0 2024-09-16T00:50:07.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/156: read d1/d14/f33 [3160205,17910] 0 2024-09-16T00:50:07.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/157: write d1/d7/d13/f37 [782582,129811] 0 2024-09-16T00:50:07.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/158: write d1/d14/f33 [4761194,123597] 0 2024-09-16T00:50:07.300 INFO:tasks.workunit.client.1.smithi152.stdout:6/183: dwrite db/d12/f14 [0,4194304] 0 2024-09-16T00:50:07.301 INFO:tasks.workunit.client.1.smithi152.stdout:4/279: link d2/d1e/d28/f57 d2/db/d39/d3c/f58 0 2024-09-16T00:50:07.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/75: truncate d10/f1e 5171018 0 2024-09-16T00:50:07.306 INFO:tasks.workunit.client.1.smithi152.stdout:7/159: mkdir d9/d10/d27/d2a/d3c 0 2024-09-16T00:50:07.307 INFO:tasks.workunit.client.1.smithi152.stdout:7/160: write d9/f1f [1269295,129824] 0 2024-09-16T00:50:07.310 INFO:tasks.workunit.client.0.smithi053.stdout:8/76: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:07.311 INFO:tasks.workunit.client.1.smithi152.stdout:3/134: mkdir dc/d10/d17/d1c/d1f/d24 0 2024-09-16T00:50:07.313 INFO:tasks.workunit.client.0.smithi053.stdout:8/77: unlink fc 0 2024-09-16T00:50:07.315 INFO:tasks.workunit.client.0.smithi053.stdout:8/78: symlink d10/d1c/l1f 0 2024-09-16T00:50:07.316 INFO:tasks.workunit.client.1.smithi152.stdout:2/140: creat d4/d19/d20/f32 x:0 0 0 2024-09-16T00:50:07.316 INFO:tasks.workunit.client.1.smithi152.stdout:2/141: creat d4/d17/f33 x:0 0 0 2024-09-16T00:50:07.317 INFO:tasks.workunit.client.0.smithi053.stdout:8/79: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:07.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/232: mknod d6/c5b 0 2024-09-16T00:50:07.318 INFO:tasks.workunit.client.1.smithi152.stdout:9/159: mknod d1/c3a 0 2024-09-16T00:50:07.318 INFO:tasks.workunit.client.1.smithi152.stdout:9/160: chown d1/d7/d13/f37 1 1 2024-09-16T00:50:07.319 INFO:tasks.workunit.client.1.smithi152.stdout:0/134: getdents d3/d6/d8 0 2024-09-16T00:50:07.319 INFO:tasks.workunit.client.1.smithi152.stdout:5/233: dread d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:07.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/234: fdatasync d6/f2d 0 2024-09-16T00:50:07.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/235: fdatasync d6/f40 0 2024-09-16T00:50:07.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/236: write d6/d16/f39 [238057,13863] 0 2024-09-16T00:50:07.320 INFO:tasks.workunit.client.0.smithi053.stdout:8/80: link d10/f19 d10/f20 0 2024-09-16T00:50:07.321 INFO:tasks.workunit.client.0.smithi053.stdout:7/63: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:07.321 INFO:tasks.workunit.client.0.smithi053.stdout:7/64: chown d1/d3/le 2560152 1 2024-09-16T00:50:07.322 INFO:tasks.workunit.client.0.smithi053.stdout:8/81: write d10/f14 [801145,120711] 0 2024-09-16T00:50:07.322 INFO:tasks.workunit.client.1.smithi152.stdout:1/187: dwrite d9/d3e/d41/f3d [0,4194304] 0 2024-09-16T00:50:07.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/161: rmdir d9/d10/d27 39 2024-09-16T00:50:07.326 INFO:tasks.workunit.client.1.smithi152.stdout:3/135: symlink dc/l25 0 2024-09-16T00:50:07.329 INFO:tasks.workunit.client.0.smithi053.stdout:7/65: mkdir d1/d3/d10/d14/d15 0 2024-09-16T00:50:07.329 INFO:tasks.workunit.client.0.smithi053.stdout:7/66: chown d1/d3/d10/c12 8 1 2024-09-16T00:50:07.329 INFO:tasks.workunit.client.1.smithi152.stdout:7/162: write f2 [873070,26244] 0 2024-09-16T00:50:07.334 INFO:tasks.workunit.client.1.smithi152.stdout:2/142: mkdir d4/d19/d20/d34 0 2024-09-16T00:50:07.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/143: chown d4/d17/c30 649228 1 2024-09-16T00:50:07.337 INFO:tasks.workunit.client.0.smithi053.stdout:8/82: mkdir d10/d21 0 2024-09-16T00:50:07.339 INFO:tasks.workunit.client.1.smithi152.stdout:3/136: write f2 [368256,107978] 0 2024-09-16T00:50:07.340 INFO:tasks.workunit.client.1.smithi152.stdout:9/161: dwrite d1/d7/d13/d1c/d2a/d34/f39 [0,4194304] 0 2024-09-16T00:50:07.340 INFO:tasks.workunit.client.1.smithi152.stdout:9/162: chown d1/d7/d13/d1c/d23/d2b 1933045 1 2024-09-16T00:50:07.340 INFO:tasks.workunit.client.1.smithi152.stdout:9/163: chown d1 63382204 1 2024-09-16T00:50:07.340 INFO:tasks.workunit.client.1.smithi152.stdout:9/164: write d1/d7/d13/f37 [1411801,96006] 0 2024-09-16T00:50:07.340 INFO:tasks.workunit.client.0.smithi053.stdout:8/83: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:07.343 INFO:tasks.workunit.client.1.smithi152.stdout:4/280: dwrite d2/db/f47 [0,4194304] 0 2024-09-16T00:50:07.344 INFO:tasks.workunit.client.0.smithi053.stdout:8/84: symlink d10/d21/l22 0 2024-09-16T00:50:07.346 INFO:tasks.workunit.client.0.smithi053.stdout:8/85: read d10/f20 [1078078,14940] 0 2024-09-16T00:50:07.350 INFO:tasks.workunit.client.1.smithi152.stdout:9/165: write d1/d7/d13/d1c/d2a/d34/f39 [2903199,44084] 0 2024-09-16T00:50:07.350 INFO:tasks.workunit.client.1.smithi152.stdout:9/166: truncate d1/d7/d13/f2c 1157728 0 2024-09-16T00:50:07.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/135: rename d3/d6/f9 to d3/d6/f2f 0 2024-09-16T00:50:07.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/136: fdatasync d3/f16 0 2024-09-16T00:50:07.356 INFO:tasks.workunit.client.1.smithi152.stdout:1/188: mknod d9/d3e/d41/d31/c45 0 2024-09-16T00:50:07.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/163: symlink d9/d31/l3d 0 2024-09-16T00:50:07.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/164: truncate d9/f37 658368 0 2024-09-16T00:50:07.359 INFO:tasks.workunit.client.1.smithi152.stdout:3/137: creat dc/d10/d17/f26 x:0 0 0 2024-09-16T00:50:07.361 INFO:tasks.workunit.client.1.smithi152.stdout:4/281: creat d2/db/d39/f59 x:0 0 0 2024-09-16T00:50:07.362 INFO:tasks.workunit.client.1.smithi152.stdout:9/167: rename d1/l2 to d1/l3b 0 2024-09-16T00:50:07.363 INFO:tasks.workunit.client.1.smithi152.stdout:0/137: link d3/d6/la d3/d6/d8/d1d/d23/d25/d2a/l30 0 2024-09-16T00:50:07.364 INFO:tasks.workunit.client.1.smithi152.stdout:7/165: symlink d9/l3e 0 2024-09-16T00:50:07.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/138: mkdir dc/d10/d17/d27 0 2024-09-16T00:50:07.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/139: chown dc/ff 171 1 2024-09-16T00:50:07.369 INFO:tasks.workunit.client.1.smithi152.stdout:2/144: dwrite d4/d17/f2d [0,4194304] 0 2024-09-16T00:50:07.369 INFO:tasks.workunit.client.1.smithi152.stdout:2/145: dread - d4/d19/d20/f32 zero size 2024-09-16T00:50:07.369 INFO:tasks.workunit.client.1.smithi152.stdout:4/282: unlink d2/f7 0 2024-09-16T00:50:07.369 INFO:tasks.workunit.client.1.smithi152.stdout:7/166: rename d9/d10/d27/d2a/c39 to d9/d10/d27/d2a/d3c/c3f 0 2024-09-16T00:50:07.370 INFO:tasks.workunit.client.0.smithi053.stdout:7/67: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:07.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/237: dwrite d6/d57/f3c [0,4194304] 0 2024-09-16T00:50:07.371 INFO:tasks.workunit.client.1.smithi152.stdout:0/138: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:07.371 INFO:tasks.workunit.client.1.smithi152.stdout:0/139: chown d3/d6/d8/d1d/f20 9 1 2024-09-16T00:50:07.371 INFO:tasks.workunit.client.1.smithi152.stdout:0/140: fsync d3/d6/f1e 0 2024-09-16T00:50:07.371 INFO:tasks.workunit.client.1.smithi152.stdout:0/141: dread - d3/d6/f1f zero size 2024-09-16T00:50:07.371 INFO:tasks.workunit.client.1.smithi152.stdout:3/140: truncate f5 779670 0 2024-09-16T00:50:07.373 INFO:tasks.workunit.client.1.smithi152.stdout:2/146: dread d4/f9 [0,4194304] 0 2024-09-16T00:50:07.373 INFO:tasks.workunit.client.1.smithi152.stdout:2/147: truncate d4/f7 4349066 0 2024-09-16T00:50:07.373 INFO:tasks.workunit.client.1.smithi152.stdout:3/141: dread dc/f1a [0,4194304] 0 2024-09-16T00:50:07.375 INFO:tasks.workunit.client.1.smithi152.stdout:7/167: dread d9/d10/f12 [0,4194304] 0 2024-09-16T00:50:07.375 INFO:tasks.workunit.client.1.smithi152.stdout:7/168: chown d9/f25 1109537236 1 2024-09-16T00:50:07.379 INFO:tasks.workunit.client.1.smithi152.stdout:5/238: dread d6/d16/f23 [0,4194304] 0 2024-09-16T00:50:07.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/142: mknod d3/d6/c31 0 2024-09-16T00:50:07.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/143: read - d3/d6/d8/d1d/f20 zero size 2024-09-16T00:50:07.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/144: truncate d3/d6/d8/d1d/d23/d25/f29 741603 0 2024-09-16T00:50:07.388 INFO:tasks.workunit.client.1.smithi152.stdout:7/169: dread d9/f25 [0,4194304] 0 2024-09-16T00:50:07.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/239: dread d6/f1a [0,4194304] 0 2024-09-16T00:50:07.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/240: creat d6/d57/d2b/d50/f5c x:0 0 0 2024-09-16T00:50:07.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/241: fsync d6/d16/f36 0 2024-09-16T00:50:07.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/242: write d6/d16/d1f/f2e [655090,60887] 0 2024-09-16T00:50:07.394 INFO:tasks.workunit.client.1.smithi152.stdout:2/148: truncate f2 2024674 0 2024-09-16T00:50:07.395 INFO:tasks.workunit.client.1.smithi152.stdout:7/170: mknod d9/d10/d27/d2a/c40 0 2024-09-16T00:50:07.396 INFO:tasks.workunit.client.1.smithi152.stdout:9/168: dwrite d1/d7/d13/d1c/d2a/d34/f39 [4194304,4194304] 0 2024-09-16T00:50:07.398 INFO:tasks.workunit.client.1.smithi152.stdout:4/283: dwrite d2/db/f1d [4194304,4194304] 0 2024-09-16T00:50:07.398 INFO:tasks.workunit.client.1.smithi152.stdout:4/284: dread - d2/db/d44/f50 zero size 2024-09-16T00:50:07.398 INFO:tasks.workunit.client.1.smithi152.stdout:4/285: write d2/d1e/d28/f57 [428205,45248] 0 2024-09-16T00:50:07.400 INFO:tasks.workunit.client.1.smithi152.stdout:7/171: unlink d9/fb 0 2024-09-16T00:50:07.403 INFO:tasks.workunit.client.1.smithi152.stdout:2/149: rmdir d4/d19/d20/d28 39 2024-09-16T00:50:07.403 INFO:tasks.workunit.client.1.smithi152.stdout:5/243: dread d6/f8 [0,4194304] 0 2024-09-16T00:50:07.404 INFO:tasks.workunit.client.1.smithi152.stdout:7/172: mkdir d9/d10/d30/d41 0 2024-09-16T00:50:07.406 INFO:tasks.workunit.client.1.smithi152.stdout:5/244: mknod d6/d57/c5d 0 2024-09-16T00:50:07.406 INFO:tasks.workunit.client.1.smithi152.stdout:5/245: dread - d6/d57/d2b/d50/f5c zero size 2024-09-16T00:50:07.406 INFO:tasks.workunit.client.1.smithi152.stdout:5/246: chown d6/d16/d1f/f29 516877462 1 2024-09-16T00:50:07.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/286: dread d2/f6 [0,4194304] 0 2024-09-16T00:50:07.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/173: creat d9/d10/d27/d2a/d3c/f42 x:0 0 0 2024-09-16T00:50:07.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/150: mknod d4/c35 0 2024-09-16T00:50:07.410 INFO:tasks.workunit.client.1.smithi152.stdout:5/247: unlink d6/d16/d1f/f29 0 2024-09-16T00:50:07.411 INFO:tasks.workunit.client.1.smithi152.stdout:7/174: mknod d9/d10/d27/d2a/c43 0 2024-09-16T00:50:07.411 INFO:tasks.workunit.client.1.smithi152.stdout:7/175: chown l0 1245208851 1 2024-09-16T00:50:07.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/169: dwrite d1/d7/f18 [0,4194304] 0 2024-09-16T00:50:07.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/170: stat d1/ff 0 2024-09-16T00:50:07.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/171: stat d1/d7/d13/d1c/d23 0 2024-09-16T00:50:07.413 INFO:tasks.workunit.client.1.smithi152.stdout:2/151: link d4/c24 d4/d19/d20/d28/d2c/c36 0 2024-09-16T00:50:07.413 INFO:tasks.workunit.client.1.smithi152.stdout:2/152: dread - d4/d19/d20/d28/d2c/f31 zero size 2024-09-16T00:50:07.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/248: symlink d6/d57/d2b/d50/l5e 0 2024-09-16T00:50:07.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/249: creat d6/f5f x:0 0 0 2024-09-16T00:50:07.416 INFO:tasks.workunit.client.1.smithi152.stdout:7/176: rmdir d9/d10/d27 39 2024-09-16T00:50:07.416 INFO:tasks.workunit.client.1.smithi152.stdout:7/177: creat d9/d10/d27/d2a/d3c/f44 x:0 0 0 2024-09-16T00:50:07.416 INFO:tasks.workunit.client.1.smithi152.stdout:7/178: write f3 [1145614,72955] 0 2024-09-16T00:50:07.417 INFO:tasks.workunit.client.1.smithi152.stdout:9/172: mkdir d1/d14/d3c 0 2024-09-16T00:50:07.420 INFO:tasks.workunit.client.1.smithi152.stdout:5/250: creat d6/d57/d54/f60 x:0 0 0 2024-09-16T00:50:07.422 INFO:tasks.workunit.client.1.smithi152.stdout:7/179: mknod d9/d10/d27/d2a/d3c/c45 0 2024-09-16T00:50:07.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/153: dread d4/f7 [0,4194304] 0 2024-09-16T00:50:07.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/173: creat d1/d7/d13/d1c/d23/f3d x:0 0 0 2024-09-16T00:50:07.424 INFO:tasks.workunit.client.1.smithi152.stdout:7/180: mkdir d9/d10/d30/d41/d46 0 2024-09-16T00:50:07.427 INFO:tasks.workunit.client.1.smithi152.stdout:2/154: creat d4/d19/d20/d28/d2c/f37 x:0 0 0 2024-09-16T00:50:07.429 INFO:tasks.workunit.client.1.smithi152.stdout:7/181: mknod d9/d31/c47 0 2024-09-16T00:50:07.430 INFO:tasks.workunit.client.1.smithi152.stdout:5/251: read d6/d16/d1f/f21 [2634098,75221] 0 2024-09-16T00:50:07.430 INFO:tasks.workunit.client.1.smithi152.stdout:4/287: dwrite d2/fc [0,4194304] 0 2024-09-16T00:50:07.431 INFO:tasks.workunit.client.1.smithi152.stdout:2/155: rename d4/d17/f2d to d4/d17/f38 0 2024-09-16T00:50:07.432 INFO:tasks.workunit.client.1.smithi152.stdout:3/142: getdents dc/d10/d17 0 2024-09-16T00:50:07.434 INFO:tasks.workunit.client.1.smithi152.stdout:7/182: symlink d9/d10/d27/d2a/d3c/l48 0 2024-09-16T00:50:07.437 INFO:tasks.workunit.client.1.smithi152.stdout:5/252: unlink d6/d16/d1f/c41 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:2/156: mknod d4/d19/d20/d28/c39 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:2/157: write d4/f9 [612574,82456] 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:9/174: dwrite d1/f31 [0,4194304] 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:9/175: write d1/d7/f20 [3298740,25375] 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:2/158: creat d4/d17/f3a x:0 0 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:2/159: write d4/d19/f25 [907323,103775] 0 2024-09-16T00:50:07.440 INFO:tasks.workunit.client.1.smithi152.stdout:2/160: write d4/d19/d20/d28/f2a [288808,107139] 0 2024-09-16T00:50:07.441 INFO:tasks.workunit.client.1.smithi152.stdout:7/183: mkdir d9/d10/d30/d41/d49 0 2024-09-16T00:50:07.444 INFO:tasks.workunit.client.1.smithi152.stdout:5/253: symlink d6/d57/d2b/d50/l61 0 2024-09-16T00:50:07.451 INFO:tasks.workunit.client.1.smithi152.stdout:3/143: dwrite f8 [8388608,4194304] 0 2024-09-16T00:50:07.451 INFO:tasks.workunit.client.1.smithi152.stdout:4/288: dwrite d2/d1e/d28/d29/f34 [0,4194304] 0 2024-09-16T00:50:07.451 INFO:tasks.workunit.client.1.smithi152.stdout:9/176: rename d1/d7/d13/c2d to d1/d7/d13/d1c/d23/c3e 0 2024-09-16T00:50:07.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/254: symlink d6/d57/d54/l62 0 2024-09-16T00:50:07.455 INFO:tasks.workunit.client.1.smithi152.stdout:2/161: dwrite d4/f15 [4194304,4194304] 0 2024-09-16T00:50:07.456 INFO:tasks.workunit.client.1.smithi152.stdout:2/162: truncate d4/d19/d20/f32 273277 0 2024-09-16T00:50:07.456 INFO:tasks.workunit.client.1.smithi152.stdout:2/163: creat d4/d17/f3b x:0 0 0 2024-09-16T00:50:07.456 INFO:tasks.workunit.client.1.smithi152.stdout:2/164: chown d4/d19/d20/d28/f2a 8 1 2024-09-16T00:50:07.461 INFO:tasks.workunit.client.1.smithi152.stdout:7/184: dread f3 [0,4194304] 0 2024-09-16T00:50:07.462 INFO:tasks.workunit.client.1.smithi152.stdout:7/185: chown d9/d10/d27/d2a/d3a 4 1 2024-09-16T00:50:07.463 INFO:tasks.workunit.client.1.smithi152.stdout:9/177: rename d1/d7/f20 to d1/d7/d13/d1c/d23/d26/d30/f3f 0 2024-09-16T00:50:07.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/186: dread d9/d10/f17 [0,4194304] 0 2024-09-16T00:50:07.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/187: creat d9/d10/d30/f4a x:0 0 0 2024-09-16T00:50:07.475 INFO:tasks.workunit.client.1.smithi152.stdout:4/289: mknod d2/db/c5a 0 2024-09-16T00:50:07.479 INFO:tasks.workunit.client.1.smithi152.stdout:9/178: symlink d1/d14/d32/l40 0 2024-09-16T00:50:07.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/255: dwrite d6/d16/f33 [0,4194304] 0 2024-09-16T00:50:07.481 INFO:tasks.workunit.client.1.smithi152.stdout:2/165: dwrite d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:07.481 INFO:tasks.workunit.client.1.smithi152.stdout:2/166: readlink d4/d19/d20/l2e 0 2024-09-16T00:50:07.483 INFO:tasks.workunit.client.1.smithi152.stdout:4/290: unlink d2/f3 0 2024-09-16T00:50:07.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/256: dread d6/d16/f45 [0,4194304] 0 2024-09-16T00:50:07.487 INFO:tasks.workunit.client.1.smithi152.stdout:2/167: unlink d4/d19/c21 0 2024-09-16T00:50:07.488 INFO:tasks.workunit.client.1.smithi152.stdout:2/168: write d4/d19/d20/d28/d2c/f37 [632767,108426] 0 2024-09-16T00:50:07.489 INFO:tasks.workunit.client.1.smithi152.stdout:4/291: creat d2/d1e/d28/d29/d32/d46/f5b x:0 0 0 2024-09-16T00:50:07.489 INFO:tasks.workunit.client.1.smithi152.stdout:4/292: chown d2/f56 45736 1 2024-09-16T00:50:07.489 INFO:tasks.workunit.client.1.smithi152.stdout:9/179: write d1/d7/d13/f27 [1195987,4411] 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/257: symlink d6/d57/d2b/d50/l63 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/258: write d6/d16/f4d [569172,31066] 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:4/293: read d2/d1e/f35 [4336470,76255] 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:4/294: write d2/d1e/d28/d29/d32/d46/f5b [947403,37379] 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:4/295: truncate d2/db/f47 5188489 0 2024-09-16T00:50:07.491 INFO:tasks.workunit.client.1.smithi152.stdout:9/180: rmdir d1/d7/d13/d1c/d23/d26 39 2024-09-16T00:50:07.492 INFO:tasks.workunit.client.1.smithi152.stdout:9/181: dread - d1/d7/d13/d1c/d23/f3d zero size 2024-09-16T00:50:07.493 INFO:tasks.workunit.client.1.smithi152.stdout:5/259: mkdir d6/d57/d2b/d50/d64 0 2024-09-16T00:50:07.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/296: creat d2/d1e/d28/d29/f5c x:0 0 0 2024-09-16T00:50:07.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/182: mknod d1/c41 0 2024-09-16T00:50:07.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/183: stat d1/l11 0 2024-09-16T00:50:07.499 INFO:tasks.workunit.client.1.smithi152.stdout:5/260: mkdir d6/d16/d1f/d65 0 2024-09-16T00:50:07.501 INFO:tasks.workunit.client.1.smithi152.stdout:9/184: symlink d1/d7/l42 0 2024-09-16T00:50:07.501 INFO:tasks.workunit.client.1.smithi152.stdout:9/185: fsync d1/d14/d32/f35 0 2024-09-16T00:50:07.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/261: rmdir d6/d57 39 2024-09-16T00:50:07.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/262: chown d6/d57/c48 236617 1 2024-09-16T00:50:07.504 INFO:tasks.workunit.client.1.smithi152.stdout:9/186: creat d1/d14/f43 x:0 0 0 2024-09-16T00:50:07.504 INFO:tasks.workunit.client.1.smithi152.stdout:9/187: write d1/d14/f43 [390885,19584] 0 2024-09-16T00:50:07.504 INFO:tasks.workunit.client.1.smithi152.stdout:5/263: write d6/d16/f45 [339808,120321] 0 2024-09-16T00:50:07.505 INFO:tasks.workunit.client.1.smithi152.stdout:9/188: link d1/d7/d13/d1c/f2f d1/f44 0 2024-09-16T00:50:07.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/297: write d2/db/d39/d3c/f48 [1792273,70973] 0 2024-09-16T00:50:07.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/298: dread - d2/db/d44/f53 zero size 2024-09-16T00:50:07.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/299: readlink d2/d1e/d28/l2d 0 2024-09-16T00:50:07.507 INFO:tasks.workunit.client.1.smithi152.stdout:4/300: symlink d2/db/d39/d3c/l5d 0 2024-09-16T00:50:07.509 INFO:tasks.workunit.client.1.smithi152.stdout:2/169: dwrite d4/d19/f2b [0,4194304] 0 2024-09-16T00:50:07.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/301: rename d2/d1e/f35 to d2/d1e/f5e 0 2024-09-16T00:50:07.514 INFO:tasks.workunit.client.1.smithi152.stdout:4/302: dread d2/d1e/d28/f57 [0,4194304] 0 2024-09-16T00:50:07.514 INFO:tasks.workunit.client.1.smithi152.stdout:4/303: chown d2/d1e/d28/d29 6372 1 2024-09-16T00:50:07.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/189: dread d1/ff [4194304,4194304] 0 2024-09-16T00:50:07.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/190: mknod d1/d14/d32/c45 0 2024-09-16T00:50:07.524 INFO:tasks.workunit.client.1.smithi152.stdout:5/264: dwrite d6/fc [0,4194304] 0 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/191: write d1/d7/d13/d1c/d2a/d34/f39 [6586104,75880] 0 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/170: rmdir d4/d17 39 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/192: fdatasync d1/fb 0 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/171: stat d4/d17/f33 0 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/172: chown d4/d19/d20/d28 6143 1 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/193: write d1/d14/d32/f35 [817037,27102] 0 2024-09-16T00:50:07.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/194: truncate d1/d7/d13/d1c/d23/f3d 884022 0 2024-09-16T00:50:07.528 INFO:tasks.workunit.client.1.smithi152.stdout:5/265: mkdir d6/d57/d2b/d50/d66 0 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:5/266: symlink d6/d57/d2b/l67 0 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:5/267: write d6/d57/d54/f60 [841242,120941] 0 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:5/268: fdatasync d6/f8 0 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:5/269: rename d6/d16 to d6/d16/d1f/d65/d68 22 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:8/93: sync 2024-09-16T00:50:07.534 INFO:tasks.workunit.client.1.smithi152.stdout:1/189: sync 2024-09-16T00:50:07.535 INFO:tasks.workunit.client.1.smithi152.stdout:9/195: write d1/f31 [3946613,109016] 0 2024-09-16T00:50:07.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/94: rename dd/d15/l19 to dd/l1d 0 2024-09-16T00:50:07.536 INFO:tasks.workunit.client.1.smithi152.stdout:5/270: creat d6/d16/d1f/d65/f69 x:0 0 0 2024-09-16T00:50:07.537 INFO:tasks.workunit.client.1.smithi152.stdout:6/184: sync 2024-09-16T00:50:07.538 INFO:tasks.workunit.client.1.smithi152.stdout:9/196: dread d1/d14/f43 [0,4194304] 0 2024-09-16T00:50:07.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/190: creat d9/da/df/f46 x:0 0 0 2024-09-16T00:50:07.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/191: fsync d9/da/df/f2b 0 2024-09-16T00:50:07.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/192: chown d9/da/f1d 507065992 1 2024-09-16T00:50:07.541 INFO:tasks.workunit.client.1.smithi152.stdout:9/197: mknod d1/d7/d13/d1c/d2a/d34/c46 0 2024-09-16T00:50:07.541 INFO:tasks.workunit.client.1.smithi152.stdout:9/198: write d1/d14/d32/f35 [1007656,41872] 0 2024-09-16T00:50:07.544 INFO:tasks.workunit.client.1.smithi152.stdout:1/193: creat d9/da/df/f47 x:0 0 0 2024-09-16T00:50:07.544 INFO:tasks.workunit.client.1.smithi152.stdout:1/194: chown d9/d3e/d41/f2f 20 1 2024-09-16T00:50:07.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/185: dread fa [0,4194304] 0 2024-09-16T00:50:07.545 INFO:tasks.workunit.client.1.smithi152.stdout:9/199: stat d1/l3b 0 2024-09-16T00:50:07.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/173: dwrite d4/d19/d20/d28/d2c/f37 [0,4194304] 0 2024-09-16T00:50:07.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/174: chown d4/d19/d20/d34 5761414 1 2024-09-16T00:50:07.548 INFO:tasks.workunit.client.1.smithi152.stdout:2/175: mknod d4/d19/d20/d28/d2c/c3c 0 2024-09-16T00:50:07.550 INFO:tasks.workunit.client.1.smithi152.stdout:8/95: write f8 [3921950,84672] 0 2024-09-16T00:50:07.550 INFO:tasks.workunit.client.1.smithi152.stdout:9/200: mkdir d1/d7/d13/d1c/d23/d47 0 2024-09-16T00:50:07.551 INFO:tasks.workunit.client.1.smithi152.stdout:1/195: getdents d9/d3e/d41/d31 0 2024-09-16T00:50:07.553 INFO:tasks.workunit.client.1.smithi152.stdout:1/196: mkdir d9/d3e/d41/d31/d48 0 2024-09-16T00:50:07.554 INFO:tasks.workunit.client.1.smithi152.stdout:6/186: dread db/d12/d20/f21 [0,4194304] 0 2024-09-16T00:50:07.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/187: write db/f19 [2462698,130591] 0 2024-09-16T00:50:07.558 INFO:tasks.workunit.client.1.smithi152.stdout:1/197: rename d9/f2d to d9/d3e/f49 0 2024-09-16T00:50:07.559 INFO:tasks.workunit.client.1.smithi152.stdout:9/201: dread d1/d14/d32/f35 [0,4194304] 0 2024-09-16T00:50:07.560 INFO:tasks.workunit.client.1.smithi152.stdout:6/188: unlink db/f19 0 2024-09-16T00:50:07.561 INFO:tasks.workunit.client.1.smithi152.stdout:4/304: truncate d2/d1e/d28/d29/d32/d46/f5b 734107 0 2024-09-16T00:50:07.563 INFO:tasks.workunit.client.1.smithi152.stdout:9/202: dread d1/d14/f43 [0,4194304] 0 2024-09-16T00:50:07.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/198: mkdir d9/d3e/d41/d31/d48/d4a 0 2024-09-16T00:50:07.563 INFO:tasks.workunit.client.1.smithi152.stdout:6/189: creat db/f40 x:0 0 0 2024-09-16T00:50:07.564 INFO:tasks.workunit.client.1.smithi152.stdout:6/190: getdents db/d12/d23/d3a 0 2024-09-16T00:50:07.564 INFO:tasks.workunit.client.1.smithi152.stdout:5/271: dwrite f0 [0,4194304] 0 2024-09-16T00:50:07.564 INFO:tasks.workunit.client.1.smithi152.stdout:8/96: dread dd/de/f12 [0,4194304] 0 2024-09-16T00:50:07.565 INFO:tasks.workunit.client.1.smithi152.stdout:4/305: unlink d2/db/d39/f2e 0 2024-09-16T00:50:07.567 INFO:tasks.workunit.client.1.smithi152.stdout:6/191: truncate db/d12/d1c/d22/f2a 1635671 0 2024-09-16T00:50:07.567 INFO:tasks.workunit.client.1.smithi152.stdout:6/192: read db/fe [592121,46779] 0 2024-09-16T00:50:07.568 INFO:tasks.workunit.client.1.smithi152.stdout:8/97: creat dd/d15/d1a/f1e x:0 0 0 2024-09-16T00:50:07.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/98: creat dd/f1f x:0 0 0 2024-09-16T00:50:07.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/99: creat dd/d15/f20 x:0 0 0 2024-09-16T00:50:07.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/100: readlink dd/de/l10 0 2024-09-16T00:50:07.573 INFO:tasks.workunit.client.1.smithi152.stdout:5/272: symlink d6/d57/d2b/d50/l6a 0 2024-09-16T00:50:07.573 INFO:tasks.workunit.client.1.smithi152.stdout:5/273: readlink d6/d57/d2b/l67 0 2024-09-16T00:50:07.573 INFO:tasks.workunit.client.1.smithi152.stdout:4/306: chown d2/db/l22 63796702 1 2024-09-16T00:50:07.576 INFO:tasks.workunit.client.1.smithi152.stdout:5/274: creat d6/d57/d2b/f6b x:0 0 0 2024-09-16T00:50:07.576 INFO:tasks.workunit.client.1.smithi152.stdout:6/193: rmdir db/d12/d1c/d22/d33 39 2024-09-16T00:50:07.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/194: dread - db/d12/d20/f36 zero size 2024-09-16T00:50:07.577 INFO:tasks.workunit.client.1.smithi152.stdout:5/275: dread d6/d16/f39 [0,4194304] 0 2024-09-16T00:50:07.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/195: symlink db/d12/d1c/l41 0 2024-09-16T00:50:07.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/196: creat db/d28/f42 x:0 0 0 2024-09-16T00:50:07.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/197: write db/f40 [781430,61383] 0 2024-09-16T00:50:07.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/276: mkdir d6/d16/d1f/d6c 0 2024-09-16T00:50:07.583 INFO:tasks.workunit.client.1.smithi152.stdout:5/277: symlink d6/d57/d2b/d50/l6d 0 2024-09-16T00:50:07.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/203: rename d1/d7/d13/d1c/d23 to d1/d7/d13/d1c/d2a/d48 0 2024-09-16T00:50:07.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/199: dwrite d9/d3e/d41/f40 [0,4194304] 0 2024-09-16T00:50:07.586 INFO:tasks.workunit.client.1.smithi152.stdout:2/176: dwrite d4/d17/f3b [0,4194304] 0 2024-09-16T00:50:07.586 INFO:tasks.workunit.client.1.smithi152.stdout:2/177: stat d4/d19/d20/d28/c39 0 2024-09-16T00:50:07.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/307: rename d2/d1e/d28/d29/d32/d46/c4c to d2/d1e/c5f 0 2024-09-16T00:50:07.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/308: read - d2/db/d44/f53 zero size 2024-09-16T00:50:07.592 INFO:tasks.workunit.client.1.smithi152.stdout:9/204: unlink d1/c41 0 2024-09-16T00:50:07.592 INFO:tasks.workunit.client.1.smithi152.stdout:9/205: creat d1/d14/d32/f49 x:0 0 0 2024-09-16T00:50:07.592 INFO:tasks.workunit.client.1.smithi152.stdout:9/206: truncate d1/d14/f43 1376947 0 2024-09-16T00:50:07.599 INFO:tasks.workunit.client.1.smithi152.stdout:1/200: read d9/d3e/d41/f3d [3115324,3716] 0 2024-09-16T00:50:07.601 INFO:tasks.workunit.client.1.smithi152.stdout:4/309: dread d2/db/d39/f3b [0,4194304] 0 2024-09-16T00:50:07.602 INFO:tasks.workunit.client.1.smithi152.stdout:5/278: dwrite d6/d57/d2b/f31 [0,4194304] 0 2024-09-16T00:50:07.604 INFO:tasks.workunit.client.1.smithi152.stdout:8/101: rmdir dd/d15/d1a 39 2024-09-16T00:50:07.605 INFO:tasks.workunit.client.1.smithi152.stdout:8/102: creat dd/de/f21 x:0 0 0 2024-09-16T00:50:07.613 INFO:tasks.workunit.client.1.smithi152.stdout:2/178: symlink d4/d19/d20/d28/l3d 0 2024-09-16T00:50:07.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/310: write d2/d1e/d28/d29/f1c [3815520,60801] 0 2024-09-16T00:50:07.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/311: chown d2/db/d39/d3c/l5d 0 1 2024-09-16T00:50:07.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/312: fdatasync d2/f6 0 2024-09-16T00:50:07.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/313: write d2/db/d44/f50 [387130,24534] 0 2024-09-16T00:50:07.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/201: unlink d9/da/f1c 0 2024-09-16T00:50:07.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/207: dwrite d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:07.627 INFO:tasks.workunit.client.1.smithi152.stdout:1/202: mkdir d9/d3e/d4b 0 2024-09-16T00:50:07.629 INFO:tasks.workunit.client.1.smithi152.stdout:1/203: getdents d9/d3e/d41/d31/d38 0 2024-09-16T00:50:07.629 INFO:tasks.workunit.client.1.smithi152.stdout:8/103: dwrite dd/ff [0,4194304] 0 2024-09-16T00:50:07.629 INFO:tasks.workunit.client.1.smithi152.stdout:1/204: chown d9/da/df/l35 444377059 1 2024-09-16T00:50:07.631 INFO:tasks.workunit.client.1.smithi152.stdout:3/144: sync 2024-09-16T00:50:07.631 INFO:tasks.workunit.client.1.smithi152.stdout:3/145: write dc/d10/d17/f26 [1038598,345] 0 2024-09-16T00:50:07.631 INFO:tasks.workunit.client.1.smithi152.stdout:3/146: write dc/d10/d17/f26 [1987536,94320] 0 2024-09-16T00:50:07.632 INFO:tasks.workunit.client.1.smithi152.stdout:4/314: write d2/d1e/d28/d29/f34 [509308,124666] 0 2024-09-16T00:50:07.632 INFO:tasks.workunit.client.1.smithi152.stdout:7/188: sync 2024-09-16T00:50:07.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/145: sync 2024-09-16T00:50:07.633 INFO:tasks.workunit.client.1.smithi152.stdout:9/208: dread d1/d7/d13/d1c/d2a/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:07.633 INFO:tasks.workunit.client.1.smithi152.stdout:5/279: dwrite d6/d57/d2b/f2f [4194304,4194304] 0 2024-09-16T00:50:07.633 INFO:tasks.workunit.client.1.smithi152.stdout:9/209: stat d1/d7/d13/d1c/d2a/d34/f39 0 2024-09-16T00:50:07.634 INFO:tasks.workunit.client.1.smithi152.stdout:0/146: symlink d3/d6/d8/d1d/d23/d25/d2a/l32 0 2024-09-16T00:50:07.637 INFO:tasks.workunit.client.1.smithi152.stdout:0/147: unlink d3/fb 0 2024-09-16T00:50:07.637 INFO:tasks.workunit.client.1.smithi152.stdout:0/148: readlink d3/le 0 2024-09-16T00:50:07.637 INFO:tasks.workunit.client.1.smithi152.stdout:4/315: write d2/d1e/d28/f57 [360423,96161] 0 2024-09-16T00:50:07.637 INFO:tasks.workunit.client.1.smithi152.stdout:4/316: write d2/db/f1d [209148,13033] 0 2024-09-16T00:50:07.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/189: dread d9/f37 [0,4194304] 0 2024-09-16T00:50:07.638 INFO:tasks.workunit.client.1.smithi152.stdout:4/317: mknod d2/d1e/d28/d29/d32/d46/c60 0 2024-09-16T00:50:07.640 INFO:tasks.workunit.client.1.smithi152.stdout:0/149: dread d3/f21 [0,4194304] 0 2024-09-16T00:50:07.640 INFO:tasks.workunit.client.1.smithi152.stdout:0/150: write d3/d6/d8/f27 [67743,85045] 0 2024-09-16T00:50:07.640 INFO:tasks.workunit.client.1.smithi152.stdout:4/318: symlink d2/d1e/d28/d29/d32/l61 0 2024-09-16T00:50:07.643 INFO:tasks.workunit.client.1.smithi152.stdout:4/319: mknod d2/d1e/d28/d29/d32/c62 0 2024-09-16T00:50:07.643 INFO:tasks.workunit.client.1.smithi152.stdout:4/320: write d2/db/d39/d3c/f48 [2701574,44068] 0 2024-09-16T00:50:07.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/205: read d9/d3e/d41/f40 [4002456,96879] 0 2024-09-16T00:50:07.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/206: readlink d9/da/l18 0 2024-09-16T00:50:07.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/207: write d9/d3e/d41/f3d [1001842,58168] 0 2024-09-16T00:50:07.647 INFO:tasks.workunit.client.1.smithi152.stdout:1/208: getdents d9/d3e/d41/d31/d48 0 2024-09-16T00:50:07.650 INFO:tasks.workunit.client.1.smithi152.stdout:7/190: write d9/fd [3336375,125737] 0 2024-09-16T00:50:07.655 INFO:tasks.workunit.client.1.smithi152.stdout:0/151: read d3/fc [3413893,106802] 0 2024-09-16T00:50:07.655 INFO:tasks.workunit.client.1.smithi152.stdout:0/152: dread - d3/d6/f17 zero size 2024-09-16T00:50:07.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/191: rename d9/d10/d27/d2a/d3a to d9/d10/d27/d4b 0 2024-09-16T00:50:07.656 INFO:tasks.workunit.client.1.smithi152.stdout:2/179: dwrite d4/f9 [0,4194304] 0 2024-09-16T00:50:07.658 INFO:tasks.workunit.client.1.smithi152.stdout:7/192: mknod d9/d10/d30/d41/c4c 0 2024-09-16T00:50:07.658 INFO:tasks.workunit.client.1.smithi152.stdout:7/193: dread - d9/d10/d30/f3b zero size 2024-09-16T00:50:07.658 INFO:tasks.workunit.client.1.smithi152.stdout:4/321: dread d2/db/f47 [0,4194304] 0 2024-09-16T00:50:07.663 INFO:tasks.workunit.client.1.smithi152.stdout:7/194: creat d9/d10/f4d x:0 0 0 2024-09-16T00:50:07.663 INFO:tasks.workunit.client.1.smithi152.stdout:4/322: symlink d2/d1e/d28/l63 0 2024-09-16T00:50:07.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/195: symlink d9/d10/l4e 0 2024-09-16T00:50:07.667 INFO:tasks.workunit.client.1.smithi152.stdout:4/323: creat d2/d1e/f64 x:0 0 0 2024-09-16T00:50:07.668 INFO:tasks.workunit.client.1.smithi152.stdout:7/196: rmdir d9/d10/d30/d41/d49 0 2024-09-16T00:50:07.668 INFO:tasks.workunit.client.1.smithi152.stdout:4/324: mknod d2/d1e/d28/d29/d32/c65 0 2024-09-16T00:50:07.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/180: write d4/d17/f1d [2893687,1170] 0 2024-09-16T00:50:07.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/197: link f8 d9/d10/d27/d2a/f4f 0 2024-09-16T00:50:07.671 INFO:tasks.workunit.client.1.smithi152.stdout:2/181: mkdir d4/d17/d3e 0 2024-09-16T00:50:07.672 INFO:tasks.workunit.client.1.smithi152.stdout:4/325: link d2/fe d2/db/f66 0 2024-09-16T00:50:07.674 INFO:tasks.workunit.client.1.smithi152.stdout:2/182: dread f2 [0,4194304] 0 2024-09-16T00:50:07.678 INFO:tasks.workunit.client.1.smithi152.stdout:2/183: mkdir d4/d19/d3f 0 2024-09-16T00:50:07.678 INFO:tasks.workunit.client.1.smithi152.stdout:2/184: chown f2 12 1 2024-09-16T00:50:07.680 INFO:tasks.workunit.client.1.smithi152.stdout:5/280: dwrite f0 [4194304,4194304] 0 2024-09-16T00:50:07.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/104: dwrite dd/d15/d1a/f1e [0,4194304] 0 2024-09-16T00:50:07.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/105: chown f8 25 1 2024-09-16T00:50:07.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/106: creat dd/de/f22 x:0 0 0 2024-09-16T00:50:07.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/147: dwrite dc/f1a [0,4194304] 0 2024-09-16T00:50:07.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/148: chown dc/d10/c14 1 1 2024-09-16T00:50:07.682 INFO:tasks.workunit.client.1.smithi152.stdout:9/210: dwrite d1/f31 [0,4194304] 0 2024-09-16T00:50:07.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/153: dwrite d3/f21 [0,4194304] 0 2024-09-16T00:50:07.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/154: chown d3/f19 1064855157 1 2024-09-16T00:50:07.688 INFO:tasks.workunit.client.1.smithi152.stdout:7/198: dwrite d9/f37 [0,4194304] 0 2024-09-16T00:50:07.688 INFO:tasks.workunit.client.1.smithi152.stdout:7/199: read - d9/d10/d27/d2a/f35 zero size 2024-09-16T00:50:07.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/185: write d4/f7 [3475680,78668] 0 2024-09-16T00:50:07.691 INFO:tasks.workunit.client.1.smithi152.stdout:0/155: dread d3/d6/d8/d1d/d23/d25/d2a/f2b [0,4194304] 0 2024-09-16T00:50:07.691 INFO:tasks.workunit.client.1.smithi152.stdout:8/107: mkdir dd/d23 0 2024-09-16T00:50:07.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/211: creat d1/d7/f4a x:0 0 0 2024-09-16T00:50:07.701 INFO:tasks.workunit.client.1.smithi152.stdout:2/186: dread d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:07.701 INFO:tasks.workunit.client.1.smithi152.stdout:2/187: stat d4/f15 0 2024-09-16T00:50:07.706 INFO:tasks.workunit.client.1.smithi152.stdout:5/281: rmdir d6 39 2024-09-16T00:50:07.706 INFO:tasks.workunit.client.1.smithi152.stdout:8/108: write dd/d15/d1a/f1e [211781,102244] 0 2024-09-16T00:50:07.712 INFO:tasks.workunit.client.1.smithi152.stdout:7/200: unlink d9/d10/f17 0 2024-09-16T00:50:07.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/212: rename d1/d7/d13/c15 to d1/d14/c4b 0 2024-09-16T00:50:07.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/213: read d1/d7/d13/d1c/d2a/d48/d26/d30/f3f [1423854,120481] 0 2024-09-16T00:50:07.721 INFO:tasks.workunit.client.1.smithi152.stdout:9/214: write d1/fc [834705,59662] 0 2024-09-16T00:50:07.721 INFO:tasks.workunit.client.1.smithi152.stdout:9/215: write d1/d7/d13/d1c/d2a/d48/f3d [62065,62926] 0 2024-09-16T00:50:07.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/209: dwrite d9/d3e/d41/f3d [0,4194304] 0 2024-09-16T00:50:07.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/149: dwrite dc/fe [0,4194304] 0 2024-09-16T00:50:07.722 INFO:tasks.workunit.client.1.smithi152.stdout:2/188: unlink d4/d19/d20/c29 0 2024-09-16T00:50:07.723 INFO:tasks.workunit.client.1.smithi152.stdout:0/156: dwrite d3/d6/d8/d1d/d23/d25/d2a/f2d [0,4194304] 0 2024-09-16T00:50:07.724 INFO:tasks.workunit.client.1.smithi152.stdout:5/282: mkdir d6/d57/d2b/d50/d6e 0 2024-09-16T00:50:07.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/210: write d9/da/df/f2b [697981,37432] 0 2024-09-16T00:50:07.727 INFO:tasks.workunit.client.1.smithi152.stdout:8/109: link dd/d15/f20 dd/d23/f24 0 2024-09-16T00:50:07.727 INFO:tasks.workunit.client.1.smithi152.stdout:8/110: chown dd 827603 1 2024-09-16T00:50:07.731 INFO:tasks.workunit.client.1.smithi152.stdout:7/201: dwrite d9/fd [4194304,4194304] 0 2024-09-16T00:50:07.732 INFO:tasks.workunit.client.1.smithi152.stdout:9/216: symlink d1/d14/d32/l4c 0 2024-09-16T00:50:07.735 INFO:tasks.workunit.client.1.smithi152.stdout:2/189: mknod d4/d19/c40 0 2024-09-16T00:50:07.739 INFO:tasks.workunit.client.1.smithi152.stdout:3/150: dwrite f8 [0,4194304] 0 2024-09-16T00:50:07.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/283: unlink d6/d57/d2b/c4b 0 2024-09-16T00:50:07.740 INFO:tasks.workunit.client.1.smithi152.stdout:5/284: fsync d6/d57/d2b/d50/f5a 0 2024-09-16T00:50:07.740 INFO:tasks.workunit.client.1.smithi152.stdout:5/285: chown d6/d57/d2b/d50/f5a 11259534 1 2024-09-16T00:50:07.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/151: write dc/d10/d17/f26 [188276,108436] 0 2024-09-16T00:50:07.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/152: chown dc/d10/d17/d1c/d1f/c20 145085 1 2024-09-16T00:50:07.743 INFO:tasks.workunit.client.1.smithi152.stdout:1/211: unlink d9/l3c 0 2024-09-16T00:50:07.744 INFO:tasks.workunit.client.1.smithi152.stdout:8/111: mkdir dd/d25 0 2024-09-16T00:50:07.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/202: read f3 [7051703,33331] 0 2024-09-16T00:50:07.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/203: fsync d9/d10/d27/d2a/d3c/f42 0 2024-09-16T00:50:07.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/204: truncate d9/d10/f12 5697046 0 2024-09-16T00:50:07.746 INFO:tasks.workunit.client.1.smithi152.stdout:2/190: link d4/d19/f25 d4/d17/f41 0 2024-09-16T00:50:07.747 INFO:tasks.workunit.client.1.smithi152.stdout:0/157: dwrite d3/d6/d8/d1d/f20 [0,4194304] 0 2024-09-16T00:50:07.748 INFO:tasks.workunit.client.1.smithi152.stdout:9/217: dwrite d1/ff [8388608,4194304] 0 2024-09-16T00:50:07.748 INFO:tasks.workunit.client.1.smithi152.stdout:9/218: read d1/d7/d13/d1c/d2a/d48/f3d [291410,28213] 0 2024-09-16T00:50:07.749 INFO:tasks.workunit.client.1.smithi152.stdout:1/212: dread d9/d3e/d41/d31/d38/f43 [0,4194304] 0 2024-09-16T00:50:07.750 INFO:tasks.workunit.client.1.smithi152.stdout:1/213: chown c6 84 1 2024-09-16T00:50:07.750 INFO:tasks.workunit.client.1.smithi152.stdout:1/214: write d9/d3e/d41/f2f [319744,57751] 0 2024-09-16T00:50:07.750 INFO:tasks.workunit.client.1.smithi152.stdout:8/112: mkdir dd/d26 0 2024-09-16T00:50:07.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/191: symlink d4/d19/d20/l42 0 2024-09-16T00:50:07.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/192: readlink d4/d17/l2f 0 2024-09-16T00:50:07.759 INFO:tasks.workunit.client.1.smithi152.stdout:0/158: rename c0 to d3/c33 0 2024-09-16T00:50:07.759 INFO:tasks.workunit.client.1.smithi152.stdout:0/159: write d3/d6/d8/ff [1878249,79065] 0 2024-09-16T00:50:07.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/198: sync 2024-09-16T00:50:07.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/199: stat db/c1b 0 2024-09-16T00:50:07.763 INFO:tasks.workunit.client.1.smithi152.stdout:7/205: dwrite d9/d10/f36 [0,4194304] 0 2024-09-16T00:50:07.774 INFO:tasks.workunit.client.1.smithi152.stdout:7/206: write d9/f1b [457209,80145] 0 2024-09-16T00:50:07.774 INFO:tasks.workunit.client.1.smithi152.stdout:1/215: truncate d9/d3e/f49 720554 0 2024-09-16T00:50:07.775 INFO:tasks.workunit.client.1.smithi152.stdout:1/216: chown d9/l22 410 1 2024-09-16T00:50:07.775 INFO:tasks.workunit.client.1.smithi152.stdout:1/217: write d9/da/df/f27 [1167311,127797] 0 2024-09-16T00:50:07.775 INFO:tasks.workunit.client.1.smithi152.stdout:8/113: symlink dd/l27 0 2024-09-16T00:50:07.776 INFO:tasks.workunit.client.1.smithi152.stdout:0/160: dwrite d3/f21 [0,4194304] 0 2024-09-16T00:50:07.776 INFO:tasks.workunit.client.1.smithi152.stdout:2/193: symlink d4/d17/d3e/l43 0 2024-09-16T00:50:07.782 INFO:tasks.workunit.client.1.smithi152.stdout:9/219: rename d1/d7/f4a to d1/d7/d13/d1c/d2a/d48/d2b/f4d 0 2024-09-16T00:50:07.785 INFO:tasks.workunit.client.1.smithi152.stdout:6/200: mkdir db/d12/d1c/d22/d43 0 2024-09-16T00:50:07.785 INFO:tasks.workunit.client.1.smithi152.stdout:6/201: stat f2 0 2024-09-16T00:50:07.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/153: truncate dc/d10/d17/f26 1721826 0 2024-09-16T00:50:07.792 INFO:tasks.workunit.client.1.smithi152.stdout:1/218: mknod d9/d3e/d41/d31/d38/c4c 0 2024-09-16T00:50:07.794 INFO:tasks.workunit.client.1.smithi152.stdout:0/161: symlink d3/d6/d2e/l34 0 2024-09-16T00:50:07.794 INFO:tasks.workunit.client.1.smithi152.stdout:9/220: dread d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:07.794 INFO:tasks.workunit.client.1.smithi152.stdout:9/221: truncate d1/fc 1143788 0 2024-09-16T00:50:07.801 INFO:tasks.workunit.client.1.smithi152.stdout:0/162: symlink d3/d6/d8/l35 0 2024-09-16T00:50:07.801 INFO:tasks.workunit.client.1.smithi152.stdout:0/163: chown d3/d6/d8/d1d/f20 1612095 1 2024-09-16T00:50:07.804 INFO:tasks.workunit.client.1.smithi152.stdout:2/194: mkdir d4/d44 0 2024-09-16T00:50:07.805 INFO:tasks.workunit.client.1.smithi152.stdout:7/207: getdents d9/d10/d27/d2a 0 2024-09-16T00:50:07.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/154: dread f7 [0,4194304] 0 2024-09-16T00:50:07.807 INFO:tasks.workunit.client.1.smithi152.stdout:2/195: mknod d4/d19/d20/d28/c45 0 2024-09-16T00:50:07.808 INFO:tasks.workunit.client.1.smithi152.stdout:2/196: write d4/f7 [1181955,43604] 0 2024-09-16T00:50:07.808 INFO:tasks.workunit.client.1.smithi152.stdout:2/197: creat d4/d19/d20/d28/d2c/f46 x:0 0 0 2024-09-16T00:50:07.808 INFO:tasks.workunit.client.1.smithi152.stdout:2/198: creat d4/d19/d20/f47 x:0 0 0 2024-09-16T00:50:07.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/222: rename d1/d7/d13/d1c/d2a to d1/d4e 0 2024-09-16T00:50:07.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/223: chown d1/d7/d13/f27 10907 1 2024-09-16T00:50:07.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/114: dwrite dd/de/f12 [0,4194304] 0 2024-09-16T00:50:07.815 INFO:tasks.workunit.client.1.smithi152.stdout:1/219: dwrite d9/da/df/f11 [0,4194304] 0 2024-09-16T00:50:07.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/115: chown c4 7 1 2024-09-16T00:50:07.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/116: truncate dd/de/f21 332884 0 2024-09-16T00:50:07.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/117: write dd/d23/f24 [359782,130261] 0 2024-09-16T00:50:07.816 INFO:tasks.workunit.client.1.smithi152.stdout:0/164: rename d3/d6/d8/d1d/d23/d25/f29 to d3/d6/d8/d1d/f36 0 2024-09-16T00:50:07.817 INFO:tasks.workunit.client.1.smithi152.stdout:9/224: mkdir d1/d4e/d48/d26/d30/d4f 0 2024-09-16T00:50:07.819 INFO:tasks.workunit.client.1.smithi152.stdout:7/208: creat d9/d10/d30/d41/f50 x:0 0 0 2024-09-16T00:50:07.819 INFO:tasks.workunit.client.1.smithi152.stdout:7/209: fdatasync f2 0 2024-09-16T00:50:07.819 INFO:tasks.workunit.client.1.smithi152.stdout:4/326: sync 2024-09-16T00:50:07.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/155: dread dc/f1a [0,4194304] 0 2024-09-16T00:50:07.821 INFO:tasks.workunit.client.1.smithi152.stdout:6/202: dwrite db/d12/d20/f3e [0,4194304] 0 2024-09-16T00:50:07.821 INFO:tasks.workunit.client.1.smithi152.stdout:6/203: chown db/d12/d23/d3a 0 1 2024-09-16T00:50:07.821 INFO:tasks.workunit.client.1.smithi152.stdout:6/204: stat db/d28 0 2024-09-16T00:50:07.821 INFO:tasks.workunit.client.1.smithi152.stdout:6/205: creat db/d12/f44 x:0 0 0 2024-09-16T00:50:07.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/118: creat dd/d26/f28 x:0 0 0 2024-09-16T00:50:07.822 INFO:tasks.workunit.client.1.smithi152.stdout:0/165: rmdir d3/d6/d2e 39 2024-09-16T00:50:07.824 INFO:tasks.workunit.client.1.smithi152.stdout:9/225: truncate d1/f31 947816 0 2024-09-16T00:50:07.824 INFO:tasks.workunit.client.1.smithi152.stdout:9/226: chown d1/d7/d13/d1c/l24 7520 1 2024-09-16T00:50:07.826 INFO:tasks.workunit.client.1.smithi152.stdout:7/210: symlink d9/l51 0 2024-09-16T00:50:07.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/156: creat dc/d10/d17/d1c/d1f/d22/f28 x:0 0 0 2024-09-16T00:50:07.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/157: fdatasync dc/fe 0 2024-09-16T00:50:07.829 INFO:tasks.workunit.client.1.smithi152.stdout:2/199: dwrite d4/d17/f33 [0,4194304] 0 2024-09-16T00:50:07.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/206: link db/d28/f3c db/f45 0 2024-09-16T00:50:07.834 INFO:tasks.workunit.client.1.smithi152.stdout:0/166: dread d3/d6/d8/d1d/d23/d25/d2a/f2d [0,4194304] 0 2024-09-16T00:50:07.835 INFO:tasks.workunit.client.1.smithi152.stdout:8/119: mkdir dd/d26/d29 0 2024-09-16T00:50:07.842 INFO:tasks.workunit.client.1.smithi152.stdout:3/158: mknod dc/d10/d17/d1c/c29 0 2024-09-16T00:50:07.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/167: link d3/d6/c18 d3/d6/d8/c37 0 2024-09-16T00:50:07.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/168: write d3/d6/d8/d1d/d23/d25/d2a/f2b [1700750,124043] 0 2024-09-16T00:50:07.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/227: read d1/fb [422427,5719] 0 2024-09-16T00:50:07.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/228: fsync d1/d7/d13/d1c/f2f 0 2024-09-16T00:50:07.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/229: chown d1/f44 170 1 2024-09-16T00:50:07.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/169: mknod d3/d6/c38 0 2024-09-16T00:50:07.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/170: write d3/d6/d8/f27 [888735,41462] 0 2024-09-16T00:50:07.852 INFO:tasks.workunit.client.1.smithi152.stdout:7/211: link d9/d10/l1e d9/d10/l52 0 2024-09-16T00:50:07.855 INFO:tasks.workunit.client.1.smithi152.stdout:0/171: rename d3/d6/d8/l35 to d3/d6/d2e/l39 0 2024-09-16T00:50:07.857 INFO:tasks.workunit.client.1.smithi152.stdout:9/230: rmdir d1/d14/d32 39 2024-09-16T00:50:07.857 INFO:tasks.workunit.client.1.smithi152.stdout:9/231: fdatasync d1/d4e/d48/d2b/f4d 0 2024-09-16T00:50:07.858 INFO:tasks.workunit.client.1.smithi152.stdout:9/232: write d1/d14/f33 [4184483,125146] 0 2024-09-16T00:50:07.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/327: dwrite d2/d1e/f5e [4194304,4194304] 0 2024-09-16T00:50:07.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/328: write d2/d1e/f64 [873673,6645] 0 2024-09-16T00:50:07.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/329: chown d2/d1e/d28/l2d 59 1 2024-09-16T00:50:07.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/330: dread - d2/d1e/d28/d29/f5c zero size 2024-09-16T00:50:07.861 INFO:tasks.workunit.client.1.smithi152.stdout:1/220: dwrite d9/f37 [0,4194304] 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/172: rename d3/d6/d8/d1d/d23/d25/d2a/l32 to d3/d6/d8/d1d/d23/d25/l3a 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/173: chown d3/d6/c18 2898128 1 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/200: dwrite d4/d19/d20/f32 [0,4194304] 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/201: write f2 [2186335,58721] 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/202: stat d4/d19/d20/f47 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:6/207: dwrite db/d12/d1c/d22/f24 [0,4194304] 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/174: dread d3/d6/d8/f1c [0,4194304] 0 2024-09-16T00:50:07.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/159: fsync dc/d10/d17/d1c/d1f/d22/f28 0 2024-09-16T00:50:07.863 INFO:tasks.workunit.client.1.smithi152.stdout:7/212: rmdir d9/d10/d30 39 2024-09-16T00:50:07.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/331: mknod d2/d1e/c67 0 2024-09-16T00:50:07.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/332: write d2/d1e/f64 [1519008,98643] 0 2024-09-16T00:50:07.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/333: stat d2/d1e/d28/d29/f34 0 2024-09-16T00:50:07.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/221: mknod d9/d3e/d41/c4d 0 2024-09-16T00:50:07.873 INFO:tasks.workunit.client.1.smithi152.stdout:9/233: rename d1/d4e/d48/d47 to d1/d4e/d48/d26/d30/d4f/d50 0 2024-09-16T00:50:07.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/234: dread d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:07.887 INFO:tasks.workunit.client.1.smithi152.stdout:6/208: link db/d12/d1c/d22/d33/f38 db/d12/d20/f46 0 2024-09-16T00:50:07.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/160: creat dc/d10/d17/d1c/d1f/f2a x:0 0 0 2024-09-16T00:50:07.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/161: creat dc/d10/d17/d1c/d1f/f2b x:0 0 0 2024-09-16T00:50:07.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/162: readlink l1 0 2024-09-16T00:50:07.889 INFO:tasks.workunit.client.1.smithi152.stdout:7/213: dread - d9/d10/d30/d41/f50 zero size 2024-09-16T00:50:07.891 INFO:tasks.workunit.client.1.smithi152.stdout:4/334: write d2/db/f2c [891504,52244] 0 2024-09-16T00:50:07.891 INFO:tasks.workunit.client.1.smithi152.stdout:4/335: fdatasync d2/f16 0 2024-09-16T00:50:07.891 INFO:tasks.workunit.client.1.smithi152.stdout:4/336: read d2/d1e/d28/d29/f34 [4124177,39457] 0 2024-09-16T00:50:07.891 INFO:tasks.workunit.client.1.smithi152.stdout:4/337: creat d2/db/d44/f68 x:0 0 0 2024-09-16T00:50:07.892 INFO:tasks.workunit.client.1.smithi152.stdout:1/222: creat d9/d3e/d41/f4e x:0 0 0 2024-09-16T00:50:07.892 INFO:tasks.workunit.client.1.smithi152.stdout:1/223: fsync d9/da/df/f1e 0 2024-09-16T00:50:07.892 INFO:tasks.workunit.client.1.smithi152.stdout:9/235: link d1/d14/c4b d1/d4e/c51 0 2024-09-16T00:50:07.893 INFO:tasks.workunit.client.1.smithi152.stdout:6/209: truncate db/fc 1285581 0 2024-09-16T00:50:07.893 INFO:tasks.workunit.client.1.smithi152.stdout:6/210: chown db/d12/d20/f21 0 1 2024-09-16T00:50:07.896 INFO:tasks.workunit.client.1.smithi152.stdout:3/163: mkdir dc/d10/d17/d1c/d1f/d22/d2c 0 2024-09-16T00:50:07.896 INFO:tasks.workunit.client.1.smithi152.stdout:3/164: creat dc/f2d x:0 0 0 2024-09-16T00:50:07.896 INFO:tasks.workunit.client.1.smithi152.stdout:3/165: chown f6 13567 1 2024-09-16T00:50:07.897 INFO:tasks.workunit.client.1.smithi152.stdout:4/338: rmdir d2/d1e/d28/d29/d32 39 2024-09-16T00:50:07.897 INFO:tasks.workunit.client.1.smithi152.stdout:6/211: dread db/d12/d1c/d22/f2a [0,4194304] 0 2024-09-16T00:50:07.899 INFO:tasks.workunit.client.1.smithi152.stdout:9/236: symlink d1/d4e/d48/d26/l52 0 2024-09-16T00:50:07.899 INFO:tasks.workunit.client.1.smithi152.stdout:9/237: write d1/fb [871007,58102] 0 2024-09-16T00:50:07.900 INFO:tasks.workunit.client.1.smithi152.stdout:3/166: stat dc/c12 0 2024-09-16T00:50:07.900 INFO:tasks.workunit.client.1.smithi152.stdout:3/167: write f6 [560089,53644] 0 2024-09-16T00:50:07.902 INFO:tasks.workunit.client.1.smithi152.stdout:2/203: dwrite d4/d17/f1d [0,4194304] 0 2024-09-16T00:50:07.904 INFO:tasks.workunit.client.1.smithi152.stdout:3/168: link f2 dc/d10/d17/d1c/d1f/d22/d2c/f2e 0 2024-09-16T00:50:07.904 INFO:tasks.workunit.client.1.smithi152.stdout:0/175: dwrite d3/d6/d8/f1c [0,4194304] 0 2024-09-16T00:50:07.904 INFO:tasks.workunit.client.1.smithi152.stdout:0/176: fdatasync d3/f19 0 2024-09-16T00:50:07.904 INFO:tasks.workunit.client.1.smithi152.stdout:7/214: write f8 [1102421,19404] 0 2024-09-16T00:50:07.910 INFO:tasks.workunit.client.1.smithi152.stdout:1/224: write d9/f16 [8065752,49345] 0 2024-09-16T00:50:07.910 INFO:tasks.workunit.client.1.smithi152.stdout:2/204: write d4/f16 [445910,110324] 0 2024-09-16T00:50:07.911 INFO:tasks.workunit.client.1.smithi152.stdout:0/177: rename d3/d6/d8/d1d/d23/f24 to d3/d6/d8/d1d/d23/f3b 0 2024-09-16T00:50:07.911 INFO:tasks.workunit.client.1.smithi152.stdout:0/178: read - d3/d6/d8/d1d/f26 zero size 2024-09-16T00:50:07.911 INFO:tasks.workunit.client.1.smithi152.stdout:0/179: write d3/d6/d8/d1d/d23/f3b [1901032,30699] 0 2024-09-16T00:50:07.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/225: chown d9/d3e/d41/d31/c45 1541584 1 2024-09-16T00:50:07.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/226: write d9/d3e/d41/f2f [827667,119841] 0 2024-09-16T00:50:07.915 INFO:tasks.workunit.client.1.smithi152.stdout:2/205: creat d4/d44/f48 x:0 0 0 2024-09-16T00:50:07.915 INFO:tasks.workunit.client.1.smithi152.stdout:2/206: readlink d4/d17/d3e/l43 0 2024-09-16T00:50:07.916 INFO:tasks.workunit.client.1.smithi152.stdout:0/180: mknod d3/d6/d2e/c3c 0 2024-09-16T00:50:07.916 INFO:tasks.workunit.client.1.smithi152.stdout:0/181: write d3/d6/f17 [962817,79892] 0 2024-09-16T00:50:07.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/215: dread f2 [0,4194304] 0 2024-09-16T00:50:07.918 INFO:tasks.workunit.client.1.smithi152.stdout:9/238: dread d1/ff [0,4194304] 0 2024-09-16T00:50:07.920 INFO:tasks.workunit.client.1.smithi152.stdout:5/286: sync 2024-09-16T00:50:07.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/207: rename d4/d19/d20/d28/d2c/f46 to d4/d19/f49 0 2024-09-16T00:50:07.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/239: mknod d1/d14/d32/c53 0 2024-09-16T00:50:07.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/240: write d1/d14/d32/f49 [931608,61321] 0 2024-09-16T00:50:07.924 INFO:tasks.workunit.client.1.smithi152.stdout:6/212: dwrite db/d12/d1c/d22/d33/f38 [0,4194304] 0 2024-09-16T00:50:07.925 INFO:tasks.workunit.client.1.smithi152.stdout:5/287: creat d6/d57/d2b/d50/d64/f6f x:0 0 0 2024-09-16T00:50:07.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/241: write d1/fc [953732,42174] 0 2024-09-16T00:50:07.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/208: rename d4/d19/d20/d28/l3d to d4/l4a 0 2024-09-16T00:50:07.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/182: rename d3/d6/d8/d1d/d23/d25/d2a/f2b to d3/d6/d8/f3d 0 2024-09-16T00:50:07.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/183: fsync d3/d6/f2f 0 2024-09-16T00:50:07.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/184: stat d3/d6/f2f 0 2024-09-16T00:50:07.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/213: dread f2 [0,4194304] 0 2024-09-16T00:50:07.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/214: readlink l4 0 2024-09-16T00:50:07.937 INFO:tasks.workunit.client.1.smithi152.stdout:2/209: creat d4/d17/d3e/f4b x:0 0 0 2024-09-16T00:50:07.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/185: mknod d3/d6/d8/d1d/d23/d25/c3e 0 2024-09-16T00:50:07.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/186: creat d3/d6/d8/d1d/d23/d25/f3f x:0 0 0 2024-09-16T00:50:07.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/187: stat d3/d6/d8/d1d/d23 0 2024-09-16T00:50:07.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/169: dwrite f5 [0,4194304] 0 2024-09-16T00:50:07.942 INFO:tasks.workunit.client.1.smithi152.stdout:3/170: readlink dc/l25 0 2024-09-16T00:50:07.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/215: creat db/d12/d1c/d22/d43/f47 x:0 0 0 2024-09-16T00:50:07.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/242: fsync d1/fb 0 2024-09-16T00:50:07.944 INFO:tasks.workunit.client.1.smithi152.stdout:7/216: dwrite d9/d10/f4d [0,4194304] 0 2024-09-16T00:50:07.944 INFO:tasks.workunit.client.1.smithi152.stdout:7/217: chown c5 86607680 1 2024-09-16T00:50:07.945 INFO:tasks.workunit.client.1.smithi152.stdout:4/339: dwrite d2/db/f66 [0,4194304] 0 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: Deploying cephadm binary to smithi053 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: pgmap v4: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: mgrmap e23: smithi152.nlmwrx(active, since 2s) 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: [16/Sep/2024:00:50:06] ENGINE Bus STARTING 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: [16/Sep/2024:00:50:06] ENGINE Serving on https://172.21.15.152:7150 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:07 smithi152 ceph-mon[33237]: [16/Sep/2024:00:50:07] ENGINE Error in HTTPServer.serve 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:50:07.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-16T00:50:07.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:50:07.949 INFO:tasks.workunit.client.1.smithi152.stdout:0/188: link d3/d6/d8/d1d/f36 d3/d6/d8/f40 0 2024-09-16T00:50:07.958 INFO:tasks.workunit.client.1.smithi152.stdout:3/171: dread f8 [8388608,4194304] 0 2024-09-16T00:50:07.958 INFO:tasks.workunit.client.1.smithi152.stdout:5/288: dwrite d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:07.962 INFO:tasks.workunit.client.1.smithi152.stdout:7/218: symlink d9/d10/d30/d41/d46/l53 0 2024-09-16T00:50:07.970 INFO:tasks.workunit.client.1.smithi152.stdout:0/189: dwrite d3/d6/d8/d1d/d23/d25/f3f [0,4194304] 0 2024-09-16T00:50:07.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/172: dread dc/f1a [0,4194304] 0 2024-09-16T00:50:07.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/173: truncate f5 4599348 0 2024-09-16T00:50:07.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/289: creat d6/d57/d54/f70 x:0 0 0 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/219: symlink d9/d10/d27/d2a/d3c/l54 0 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/220: fdatasync f3 0 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/221: fdatasync d9/f1b 0 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/222: stat d9/d10/d27/d4b 0 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:0/190: rmdir d3/d6/d2e 39 2024-09-16T00:50:07.981 INFO:tasks.workunit.client.1.smithi152.stdout:6/216: dwrite db/d12/d1c/d22/f2a [0,4194304] 0 2024-09-16T00:50:07.982 INFO:tasks.workunit.client.1.smithi152.stdout:3/174: rmdir dc/d10/d17/d27 0 2024-09-16T00:50:07.984 INFO:tasks.workunit.client.1.smithi152.stdout:5/290: write d6/f1a [3186155,80122] 0 2024-09-16T00:50:07.984 INFO:tasks.workunit.client.1.smithi152.stdout:5/291: read - d6/f44 zero size 2024-09-16T00:50:07.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/340: dwrite d2/d1e/f5e [8388608,4194304] 0 2024-09-16T00:50:07.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/243: dwrite d1/d7/d13/d1c/f2f [0,4194304] 0 2024-09-16T00:50:07.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/244: fsync d1/f31 0 2024-09-16T00:50:08.005 INFO:tasks.workunit.client.1.smithi152.stdout:9/245: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:08.006 INFO:tasks.workunit.client.1.smithi152.stdout:0/191: dwrite d3/d6/d8/f2c [0,4194304] 0 2024-09-16T00:50:08.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/223: creat d9/d10/d30/f55 x:0 0 0 2024-09-16T00:50:08.024 INFO:tasks.workunit.client.1.smithi152.stdout:6/217: mkdir db/d12/d1c/d22/d43/d48 0 2024-09-16T00:50:08.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/175: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d2f 0 2024-09-16T00:50:08.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/176: getdents dc/d10/d17/d1c/d1f/d22/d2c/d2f 0 2024-09-16T00:50:08.031 INFO:tasks.workunit.client.1.smithi152.stdout:5/292: unlink d6/d57/d2b/d50/l6a 0 2024-09-16T00:50:08.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/120: sync 2024-09-16T00:50:08.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/121: dread - dd/f1f zero size 2024-09-16T00:50:08.039 INFO:tasks.workunit.client.1.smithi152.stdout:9/246: symlink d1/d14/d32/l54 0 2024-09-16T00:50:08.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/192: symlink d3/d6/d2e/l41 0 2024-09-16T00:50:08.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/193: fsync d3/d6/d8/f40 0 2024-09-16T00:50:08.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/194: truncate d3/d6/d8/f40 1527240 0 2024-09-16T00:50:08.056 INFO:tasks.workunit.client.1.smithi152.stdout:7/224: creat d9/d31/f56 x:0 0 0 2024-09-16T00:50:08.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/218: mkdir db/d28/d49 0 2024-09-16T00:50:08.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/177: mknod dc/d10/d17/d1c/c30 0 2024-09-16T00:50:08.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/178: write dc/d10/d17/d1c/f23 [678845,37899] 0 2024-09-16T00:50:08.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/179: dread - dc/d10/d17/d1c/d1f/f2a zero size 2024-09-16T00:50:08.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/180: fdatasync dc/d10/d17/f26 0 2024-09-16T00:50:08.063 INFO:tasks.workunit.client.1.smithi152.stdout:0/195: read d3/d6/d8/f2c [2830273,51161] 0 2024-09-16T00:50:08.063 INFO:tasks.workunit.client.1.smithi152.stdout:0/196: creat d3/d6/f42 x:0 0 0 2024-09-16T00:50:08.064 INFO:tasks.workunit.client.1.smithi152.stdout:5/293: creat d6/d16/f71 x:0 0 0 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: Deploying cephadm binary to smithi053 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: pgmap v4: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: mgrmap e23: smithi152.nlmwrx(active, since 2s) 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: [16/Sep/2024:00:50:06] ENGINE Bus STARTING 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: [16/Sep/2024:00:50:06] ENGINE Serving on https://172.21.15.152:7150 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:07 smithi053 ceph-mon[27950]: [16/Sep/2024:00:50:07] ENGINE Error in HTTPServer.serve 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Traceback (most recent call last): 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._run(expiration_interval) 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:50:08.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s = self.context.wrap_socket( 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: return self.sslsocket_class._create( 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self.do_handshake() 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._sslobj.do_handshake() 2024-09-16T00:50:08.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:50:08.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/122: mknod dd/d26/c2a 0 2024-09-16T00:50:08.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/123: fsync dd/d15/f20 0 2024-09-16T00:50:08.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/124: stat dd/d26/d29 0 2024-09-16T00:50:08.072 INFO:tasks.workunit.client.1.smithi152.stdout:9/247: creat d1/d4e/d48/d26/d30/d4f/f55 x:0 0 0 2024-09-16T00:50:08.072 INFO:tasks.workunit.client.1.smithi152.stdout:9/248: chown d1/d14/d32/l4c 61237 1 2024-09-16T00:50:08.072 INFO:tasks.workunit.client.1.smithi152.stdout:9/249: chown d1/d7 1 1 2024-09-16T00:50:08.074 INFO:tasks.workunit.client.1.smithi152.stdout:7/225: mknod d9/d10/d30/d41/d46/c57 0 2024-09-16T00:50:08.074 INFO:tasks.workunit.client.1.smithi152.stdout:7/226: chown d9/l1c 1 1 2024-09-16T00:50:08.078 INFO:tasks.workunit.client.1.smithi152.stdout:6/219: unlink db/d28/f39 0 2024-09-16T00:50:08.083 INFO:tasks.workunit.client.1.smithi152.stdout:0/197: symlink d3/d6/l43 0 2024-09-16T00:50:08.085 INFO:tasks.workunit.client.1.smithi152.stdout:5/294: symlink d6/d16/l72 0 2024-09-16T00:50:08.088 INFO:tasks.workunit.client.1.smithi152.stdout:4/341: rename d2/d1e/d28/d29/d32/d46 to d2/d1e/d28/d69 0 2024-09-16T00:50:08.088 INFO:tasks.workunit.client.1.smithi152.stdout:4/342: fdatasync d2/d1e/d28/f57 0 2024-09-16T00:50:08.090 INFO:tasks.workunit.client.1.smithi152.stdout:9/250: mknod d1/d4e/d48/c56 0 2024-09-16T00:50:08.094 INFO:tasks.workunit.client.1.smithi152.stdout:3/181: rename dc/d10/d17/d1c/d1f/d22/f28 to dc/d10/f31 0 2024-09-16T00:50:08.094 INFO:tasks.workunit.client.1.smithi152.stdout:5/295: dread d6/fc [0,4194304] 0 2024-09-16T00:50:08.099 INFO:tasks.workunit.client.1.smithi152.stdout:4/343: link d2/db/f47 d2/d1e/d28/d29/f6a 0 2024-09-16T00:50:08.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/251: creat d1/f57 x:0 0 0 2024-09-16T00:50:08.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/252: chown d1/d14/d32/c53 246816367 1 2024-09-16T00:50:08.104 INFO:tasks.workunit.client.1.smithi152.stdout:8/125: dwrite f3 [0,4194304] 0 2024-09-16T00:50:08.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/220: rename db/d12/d1c/d22 to db/d12/d23/d4a 0 2024-09-16T00:50:08.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/221: write db/d28/f32 [1244464,12354] 0 2024-09-16T00:50:08.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/344: dread d2/d1e/f5e [0,4194304] 0 2024-09-16T00:50:08.112 INFO:tasks.workunit.client.1.smithi152.stdout:4/345: stat d2/d1e/d28/d29 0 2024-09-16T00:50:08.113 INFO:tasks.workunit.client.1.smithi152.stdout:7/227: dwrite f2 [0,4194304] 0 2024-09-16T00:50:08.115 INFO:tasks.workunit.client.1.smithi152.stdout:4/346: mknod d2/d1e/c6b 0 2024-09-16T00:50:08.115 INFO:tasks.workunit.client.1.smithi152.stdout:4/347: fdatasync d2/db/d39/f59 0 2024-09-16T00:50:08.115 INFO:tasks.workunit.client.1.smithi152.stdout:4/348: write d2/db/f4f [362432,77431] 0 2024-09-16T00:50:08.115 INFO:tasks.workunit.client.1.smithi152.stdout:4/349: creat d2/db/d39/f6c x:0 0 0 2024-09-16T00:50:08.115 INFO:tasks.workunit.client.1.smithi152.stdout:7/228: creat d9/d10/d30/d41/f58 x:0 0 0 2024-09-16T00:50:08.117 INFO:tasks.workunit.client.1.smithi152.stdout:9/253: dread d1/fb [0,4194304] 0 2024-09-16T00:50:08.117 INFO:tasks.workunit.client.1.smithi152.stdout:9/254: chown d1/d7/d13/d1c/f2f 1 1 2024-09-16T00:50:08.117 INFO:tasks.workunit.client.1.smithi152.stdout:9/255: fsync d1/fc 0 2024-09-16T00:50:08.118 INFO:tasks.workunit.client.1.smithi152.stdout:4/350: creat d2/d1e/d28/d69/f6d x:0 0 0 2024-09-16T00:50:08.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/256: mkdir d1/d4e/d48/d26/d58 0 2024-09-16T00:50:08.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/257: rename d1/d7/d13/d1c to d1/d59 0 2024-09-16T00:50:08.124 INFO:tasks.workunit.client.1.smithi152.stdout:3/182: dwrite dc/d10/d17/d1c/d1f/d22/d2c/f2e [0,4194304] 0 2024-09-16T00:50:08.125 INFO:tasks.workunit.client.1.smithi152.stdout:3/183: mknod dc/c32 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:3/184: truncate dc/f15 414883 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:7/229: write d9/fd [4233227,5257] 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/296: dwrite d6/d57/d2b/f2f [0,4194304] 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/297: read - d6/d16/f71 zero size 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/298: stat d6/d16/c18 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/299: chown d6/d16/d1f/f2e 10 1 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/258: dread d1/fc [0,4194304] 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/259: stat d1/d4e/d48/d2b 0 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/260: dread - d1/d4e/d48/d26/d30/d4f/f55 zero size 2024-09-16T00:50:08.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/261: chown d1/d7/c1d 2094323 1 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/126: dwrite dd/de/f13 [0,4194304] 0 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/127: write dd/de/f21 [1140829,117375] 0 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/128: creat dd/de/f2b x:0 0 0 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/129: truncate dd/f1f 946768 0 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/130: dread - dd/d26/f28 zero size 2024-09-16T00:50:08.129 INFO:tasks.workunit.client.1.smithi152.stdout:5/300: creat d6/d16/d1f/d6c/f73 x:0 0 0 2024-09-16T00:50:08.130 INFO:tasks.workunit.client.1.smithi152.stdout:5/301: chown d6/f5f 28390 1 2024-09-16T00:50:08.130 INFO:tasks.workunit.client.1.smithi152.stdout:5/302: readlink d6/d57/d2b/l3f 0 2024-09-16T00:50:08.132 INFO:tasks.workunit.client.1.smithi152.stdout:9/262: mknod d1/c5a 0 2024-09-16T00:50:08.137 INFO:tasks.workunit.client.1.smithi152.stdout:3/185: dread f2 [0,4194304] 0 2024-09-16T00:50:08.137 INFO:tasks.workunit.client.1.smithi152.stdout:3/186: chown dc/d10/d17/d1c/d1f/c20 6 1 2024-09-16T00:50:08.142 INFO:tasks.workunit.client.1.smithi152.stdout:8/131: symlink dd/d23/l2c 0 2024-09-16T00:50:08.142 INFO:tasks.workunit.client.1.smithi152.stdout:8/132: write dd/de/f22 [27435,21219] 0 2024-09-16T00:50:08.143 INFO:tasks.workunit.client.1.smithi152.stdout:5/303: mknod d6/d57/d54/c74 0 2024-09-16T00:50:08.146 INFO:tasks.workunit.client.1.smithi152.stdout:9/263: symlink d1/d7/l5b 0 2024-09-16T00:50:08.148 INFO:tasks.workunit.client.1.smithi152.stdout:3/187: mkdir dc/d10/d17/d1c/d1f/d33 0 2024-09-16T00:50:08.149 INFO:tasks.workunit.client.1.smithi152.stdout:7/230: dwrite d9/fd [4194304,4194304] 0 2024-09-16T00:50:08.150 INFO:tasks.workunit.client.1.smithi152.stdout:8/133: mknod dd/d15/c2d 0 2024-09-16T00:50:08.151 INFO:tasks.workunit.client.1.smithi152.stdout:8/134: write dd/de/f2b [364603,52572] 0 2024-09-16T00:50:08.154 INFO:tasks.workunit.client.1.smithi152.stdout:5/304: dread d6/f32 [0,4194304] 0 2024-09-16T00:50:08.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/264: creat d1/d59/f5c x:0 0 0 2024-09-16T00:50:08.154 INFO:tasks.workunit.client.1.smithi152.stdout:3/188: dread f2 [0,4194304] 0 2024-09-16T00:50:08.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/222: dwrite db/d28/f32 [0,4194304] 0 2024-09-16T00:50:08.154 INFO:tasks.workunit.client.1.smithi152.stdout:7/231: chown d9/d10/f36 970809 1 2024-09-16T00:50:08.156 INFO:tasks.workunit.client.1.smithi152.stdout:5/305: dread d6/d57/d54/f60 [0,4194304] 0 2024-09-16T00:50:08.158 INFO:tasks.workunit.client.1.smithi152.stdout:3/189: creat dc/d10/d17/d1c/d1f/d33/f34 x:0 0 0 2024-09-16T00:50:08.158 INFO:tasks.workunit.client.1.smithi152.stdout:3/190: creat dc/f35 x:0 0 0 2024-09-16T00:50:08.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/223: mkdir db/d12/d20/d4b 0 2024-09-16T00:50:08.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/351: getdents d2/d1e/d28 0 2024-09-16T00:50:08.163 INFO:tasks.workunit.client.1.smithi152.stdout:4/352: fsync d2/db/d44/f50 0 2024-09-16T00:50:08.167 INFO:tasks.workunit.client.1.smithi152.stdout:5/306: stat d6/d16/l43 0 2024-09-16T00:50:08.167 INFO:tasks.workunit.client.1.smithi152.stdout:5/307: truncate d6/f8 4642506 0 2024-09-16T00:50:08.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/210: sync 2024-09-16T00:50:08.169 INFO:tasks.workunit.client.1.smithi152.stdout:1/227: sync 2024-09-16T00:50:08.174 INFO:tasks.workunit.client.1.smithi152.stdout:3/191: rename dc/c11 to dc/c36 0 2024-09-16T00:50:08.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/224: truncate db/fe 3769785 0 2024-09-16T00:50:08.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/225: getdents db/d12/d23/d4a/d43/d48 0 2024-09-16T00:50:08.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/226: dread - db/d12/f44 zero size 2024-09-16T00:50:08.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/227: readlink db/ld 0 2024-09-16T00:50:08.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/135: dwrite dd/d15/d1a/f1e [0,4194304] 0 2024-09-16T00:50:08.179 INFO:tasks.workunit.client.1.smithi152.stdout:9/265: dwrite d1/f57 [0,4194304] 0 2024-09-16T00:50:08.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/353: dwrite d2/d1e/d28/d69/f6d [0,4194304] 0 2024-09-16T00:50:08.187 INFO:tasks.workunit.client.1.smithi152.stdout:5/308: unlink d6/d16/f39 0 2024-09-16T00:50:08.187 INFO:tasks.workunit.client.1.smithi152.stdout:7/232: rmdir d9 39 2024-09-16T00:50:08.189 INFO:tasks.workunit.client.1.smithi152.stdout:2/211: unlink d4/c22 0 2024-09-16T00:50:08.190 INFO:tasks.workunit.client.1.smithi152.stdout:1/228: mknod d9/d3e/d41/d31/d48/c4f 0 2024-09-16T00:50:08.193 INFO:tasks.workunit.client.1.smithi152.stdout:3/192: rename dc/d10/d17/d1c/d1f/d33/f34 to dc/d10/d17/f37 0 2024-09-16T00:50:08.194 INFO:tasks.workunit.client.1.smithi152.stdout:6/228: unlink db/d28/f42 0 2024-09-16T00:50:08.196 INFO:tasks.workunit.client.1.smithi152.stdout:8/136: mknod dd/d23/c2e 0 2024-09-16T00:50:08.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/266: mkdir d1/d7/d13/d5d 0 2024-09-16T00:50:08.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/267: readlink d1/le 0 2024-09-16T00:50:08.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/268: write d1/d7/d13/f27 [4441396,118968] 0 2024-09-16T00:50:08.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/269: chown d1/d4e/d34/f39 5666 1 2024-09-16T00:50:08.218 INFO:tasks.workunit.client.1.smithi152.stdout:9/270: dwrite d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:08.232 INFO:tasks.workunit.client.1.smithi152.stdout:7/233: creat d9/d10/d27/f59 x:0 0 0 2024-09-16T00:50:08.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/212: stat d4/c1f 0 2024-09-16T00:50:08.236 INFO:tasks.workunit.client.1.smithi152.stdout:9/271: dwrite d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:08.236 INFO:tasks.workunit.client.1.smithi152.stdout:9/272: write d1/f31 [1916892,117163] 0 2024-09-16T00:50:08.236 INFO:tasks.workunit.client.1.smithi152.stdout:1/229: mkdir d9/d3e/d4b/d50 0 2024-09-16T00:50:08.237 INFO:tasks.workunit.client.1.smithi152.stdout:3/193: rmdir dc/d10/d17/d1c/d1f/d22/d2c 39 2024-09-16T00:50:08.237 INFO:tasks.workunit.client.1.smithi152.stdout:3/194: chown dc/d10/d17/d1c/d1f/f2b 0 1 2024-09-16T00:50:08.240 INFO:tasks.workunit.client.1.smithi152.stdout:6/229: unlink db/d12/d23/d4a/d43/f47 0 2024-09-16T00:50:08.240 INFO:tasks.workunit.client.1.smithi152.stdout:9/273: dread d1/d14/d32/f49 [0,4194304] 0 2024-09-16T00:50:08.242 INFO:tasks.workunit.client.1.smithi152.stdout:8/137: mkdir dd/d26/d29/d2f 0 2024-09-16T00:50:08.247 INFO:tasks.workunit.client.1.smithi152.stdout:7/234: unlink d9/d10/l52 0 2024-09-16T00:50:08.250 INFO:tasks.workunit.client.1.smithi152.stdout:2/213: mknod d4/d19/d20/d34/c4c 0 2024-09-16T00:50:08.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/230: creat d9/d3e/d4b/f51 x:0 0 0 2024-09-16T00:50:08.256 INFO:tasks.workunit.client.1.smithi152.stdout:2/214: dread d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:08.259 INFO:tasks.workunit.client.1.smithi152.stdout:6/230: truncate db/d12/d23/d4a/d33/f38 2617609 0 2024-09-16T00:50:08.259 INFO:tasks.workunit.client.1.smithi152.stdout:3/195: dwrite dc/d10/d17/d1c/d1f/f2a [0,4194304] 0 2024-09-16T00:50:08.260 INFO:tasks.workunit.client.1.smithi152.stdout:8/138: dwrite dd/de/f13 [0,4194304] 0 2024-09-16T00:50:08.262 INFO:tasks.workunit.client.1.smithi152.stdout:9/274: creat d1/d4e/d34/f5e x:0 0 0 2024-09-16T00:50:08.262 INFO:tasks.workunit.client.1.smithi152.stdout:2/215: dread d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:08.265 INFO:tasks.workunit.client.1.smithi152.stdout:7/235: link d9/d10/d27/d2a/d3c/f42 d9/d10/d27/d2a/d3c/f5a 0 2024-09-16T00:50:08.265 INFO:tasks.workunit.client.1.smithi152.stdout:7/236: write f4 [1888194,124620] 0 2024-09-16T00:50:08.269 INFO:tasks.workunit.client.1.smithi152.stdout:1/231: getdents d9/d3e/d41/d31 0 2024-09-16T00:50:08.277 INFO:tasks.workunit.client.1.smithi152.stdout:3/196: mknod dc/d10/d17/d1c/d1f/d22/c38 0 2024-09-16T00:50:08.280 INFO:tasks.workunit.client.1.smithi152.stdout:8/139: creat dd/d25/f30 x:0 0 0 2024-09-16T00:50:08.280 INFO:tasks.workunit.client.1.smithi152.stdout:8/140: fdatasync dd/d25/f30 0 2024-09-16T00:50:08.283 INFO:tasks.workunit.client.1.smithi152.stdout:9/275: mknod d1/d7/d13/d5d/c5f 0 2024-09-16T00:50:08.283 INFO:tasks.workunit.client.1.smithi152.stdout:9/276: chown d1/d7/d13 55 1 2024-09-16T00:50:08.284 INFO:tasks.workunit.client.1.smithi152.stdout:6/231: dwrite db/d28/f32 [0,4194304] 0 2024-09-16T00:50:08.284 INFO:tasks.workunit.client.1.smithi152.stdout:2/216: dwrite d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:08.287 INFO:tasks.workunit.client.1.smithi152.stdout:7/237: mkdir d9/d10/d27/d2a/d3c/d5b 0 2024-09-16T00:50:08.292 INFO:tasks.workunit.client.1.smithi152.stdout:1/232: truncate d9/f19 2918020 0 2024-09-16T00:50:08.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/141: rename dd/de/f12 to dd/d26/d29/d2f/f31 0 2024-09-16T00:50:08.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/142: readlink dd/de/l10 0 2024-09-16T00:50:08.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/277: symlink d1/d4e/d48/d2b/l60 0 2024-09-16T00:50:08.301 INFO:tasks.workunit.client.1.smithi152.stdout:1/233: write d9/d3e/d41/f2a [255132,310] 0 2024-09-16T00:50:08.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/198: sync 2024-09-16T00:50:08.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/217: mkdir d4/d19/d20/d28/d2c/d4d 0 2024-09-16T00:50:08.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/218: creat d4/d44/f4e x:0 0 0 2024-09-16T00:50:08.310 INFO:tasks.workunit.client.1.smithi152.stdout:7/238: creat d9/f5c x:0 0 0 2024-09-16T00:50:08.313 INFO:tasks.workunit.client.1.smithi152.stdout:3/197: getdents dc/d10/d17/d1c 0 2024-09-16T00:50:08.313 INFO:tasks.workunit.client.1.smithi152.stdout:3/198: readlink l9 0 2024-09-16T00:50:08.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/234: dwrite d9/da/df/f47 [0,4194304] 0 2024-09-16T00:50:08.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/143: symlink dd/d26/d29/d2f/l32 0 2024-09-16T00:50:08.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/144: fsync dd/d15/f20 0 2024-09-16T00:50:08.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/145: truncate dd/de/f13 5088095 0 2024-09-16T00:50:08.320 INFO:tasks.workunit.client.1.smithi152.stdout:9/278: creat d1/d4e/f61 x:0 0 0 2024-09-16T00:50:08.325 INFO:tasks.workunit.client.1.smithi152.stdout:6/232: getdents db/d12/d20 0 2024-09-16T00:50:08.325 INFO:tasks.workunit.client.1.smithi152.stdout:6/233: truncate db/d12/f44 4228 0 2024-09-16T00:50:08.328 INFO:tasks.workunit.client.1.smithi152.stdout:0/199: symlink d3/d6/d8/d1d/d23/l44 0 2024-09-16T00:50:08.333 INFO:tasks.workunit.client.1.smithi152.stdout:2/219: unlink d4/d19/f2b 0 2024-09-16T00:50:08.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/239: mknod d9/d31/c5d 0 2024-09-16T00:50:08.340 INFO:tasks.workunit.client.1.smithi152.stdout:3/199: creat dc/d10/d17/d1c/d1f/d24/f39 x:0 0 0 2024-09-16T00:50:08.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/220: write d4/f9 [11550,113054] 0 2024-09-16T00:50:08.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/221: chown d4/d19/d20/d28/f2a 172 1 2024-09-16T00:50:08.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/222: chown d4/d17/c30 13558 1 2024-09-16T00:50:08.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/223: write d4/d19/f27 [3890165,73250] 0 2024-09-16T00:50:08.349 INFO:tasks.workunit.client.1.smithi152.stdout:1/235: link d9/da/df/f30 d9/d3e/f52 0 2024-09-16T00:50:08.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/279: creat d1/d4e/d34/f62 x:0 0 0 2024-09-16T00:50:08.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/280: chown d1/d7/f18 4793879 1 2024-09-16T00:50:08.357 INFO:tasks.workunit.client.1.smithi152.stdout:6/234: unlink db/d12/d23/d4a/f2a 0 2024-09-16T00:50:08.359 INFO:tasks.workunit.client.1.smithi152.stdout:7/240: dwrite d9/f1f [0,4194304] 0 2024-09-16T00:50:08.359 INFO:tasks.workunit.client.1.smithi152.stdout:7/241: fdatasync d9/f37 0 2024-09-16T00:50:08.361 INFO:tasks.workunit.client.1.smithi152.stdout:3/200: dwrite dc/fe [0,4194304] 0 2024-09-16T00:50:08.362 INFO:tasks.workunit.client.1.smithi152.stdout:3/201: dread - dc/d10/d17/d1c/d1f/f2b zero size 2024-09-16T00:50:08.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/236: rename d9/d3e/d41/c4d to d9/d3e/d4b/c53 0 2024-09-16T00:50:08.373 INFO:tasks.workunit.client.1.smithi152.stdout:8/146: getdents dd/de 0 2024-09-16T00:50:08.376 INFO:tasks.workunit.client.1.smithi152.stdout:6/235: symlink db/d28/d2c/l4c 0 2024-09-16T00:50:08.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/202: dwrite f7 [0,4194304] 0 2024-09-16T00:50:08.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/203: fdatasync dc/f35 0 2024-09-16T00:50:08.380 INFO:tasks.workunit.client.1.smithi152.stdout:2/224: truncate d4/d19/d20/d28/d2c/f31 2983083 0 2024-09-16T00:50:08.381 INFO:tasks.workunit.client.1.smithi152.stdout:4/354: sync 2024-09-16T00:50:08.384 INFO:tasks.workunit.client.1.smithi152.stdout:7/242: rename d9/c1d to d9/d10/d30/d41/c5e 0 2024-09-16T00:50:08.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/237: creat d9/d3e/d41/d31/d48/d4a/f54 x:0 0 0 2024-09-16T00:50:08.386 INFO:tasks.workunit.client.1.smithi152.stdout:9/281: rmdir d1/d7 39 2024-09-16T00:50:08.405 INFO:tasks.workunit.client.1.smithi152.stdout:1/238: read d9/da/df/f47 [1116854,87267] 0 2024-09-16T00:50:08.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/200: getdents d3/d6/d8/d1d/d23 0 2024-09-16T00:50:08.405 INFO:tasks.workunit.client.1.smithi152.stdout:4/355: dwrite d2/db/d39/f59 [0,4194304] 0 2024-09-16T00:50:08.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/225: rmdir d4/d19/d3f 0 2024-09-16T00:50:08.410 INFO:tasks.workunit.client.1.smithi152.stdout:9/282: dwrite d1/d7/f18 [0,4194304] 0 2024-09-16T00:50:08.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/204: rename dc/l25 to dc/d10/d17/d1c/l3a 0 2024-09-16T00:50:08.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/205: readlink dc/l13 0 2024-09-16T00:50:08.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/206: chown dc/d10/d17/d1c 2486098 1 2024-09-16T00:50:08.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/283: dread d1/d4e/d48/f3d [0,4194304] 0 2024-09-16T00:50:08.416 INFO:tasks.workunit.client.1.smithi152.stdout:6/236: getdents db 0 2024-09-16T00:50:08.416 INFO:tasks.workunit.client.1.smithi152.stdout:6/237: chown db/d12/d1c/f37 151 1 2024-09-16T00:50:08.420 INFO:tasks.workunit.client.1.smithi152.stdout:5/309: sync 2024-09-16T00:50:08.421 INFO:tasks.workunit.client.1.smithi152.stdout:7/243: dwrite d9/d10/d30/d41/f50 [0,4194304] 0 2024-09-16T00:50:08.423 INFO:tasks.workunit.client.1.smithi152.stdout:0/201: dwrite d3/d6/d8/d1d/d23/f3b [0,4194304] 0 2024-09-16T00:50:08.425 INFO:tasks.workunit.client.1.smithi152.stdout:1/239: dwrite d9/da/f1d [0,4194304] 0 2024-09-16T00:50:08.426 INFO:tasks.workunit.client.1.smithi152.stdout:1/240: read d9/da/df/f30 [408170,129646] 0 2024-09-16T00:50:08.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/202: dread d3/d6/d8/f27 [0,4194304] 0 2024-09-16T00:50:08.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/203: truncate d3/f21 4297933 0 2024-09-16T00:50:08.431 INFO:tasks.workunit.client.1.smithi152.stdout:3/207: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d3b 0 2024-09-16T00:50:08.431 INFO:tasks.workunit.client.1.smithi152.stdout:3/208: write dc/d10/d17/d1c/d1f/d24/f39 [156293,91117] 0 2024-09-16T00:50:08.431 INFO:tasks.workunit.client.1.smithi152.stdout:3/209: chown f5 16035 1 2024-09-16T00:50:08.431 INFO:tasks.workunit.client.1.smithi152.stdout:5/310: write d6/fe [9541309,120064] 0 2024-09-16T00:50:08.431 INFO:tasks.workunit.client.1.smithi152.stdout:5/311: stat d6/d16/d1f/f3e 0 2024-09-16T00:50:08.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/284: symlink d1/l63 0 2024-09-16T00:50:08.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/238: creat db/d12/d23/d4a/d43/d48/f4d x:0 0 0 2024-09-16T00:50:08.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/239: readlink l7 0 2024-09-16T00:50:08.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/240: chown db/fc 257 1 2024-09-16T00:50:08.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/312: write d6/d16/d1f/f22 [37378,58985] 0 2024-09-16T00:50:08.444 INFO:tasks.workunit.client.1.smithi152.stdout:7/244: rmdir d9/d10/d30 39 2024-09-16T00:50:08.444 INFO:tasks.workunit.client.1.smithi152.stdout:7/245: stat d9/d10/d27/d2a/d3c/f5a 0 2024-09-16T00:50:08.446 INFO:tasks.workunit.client.1.smithi152.stdout:3/210: dwrite f3 [0,4194304] 0 2024-09-16T00:50:08.447 INFO:tasks.workunit.client.1.smithi152.stdout:4/356: symlink d2/l6e 0 2024-09-16T00:50:08.450 INFO:tasks.workunit.client.1.smithi152.stdout:3/211: dread dc/d10/d17/d1c/d1f/d24/f39 [0,4194304] 0 2024-09-16T00:50:08.457 INFO:tasks.workunit.client.1.smithi152.stdout:1/241: creat d9/d3e/d41/d31/d48/f55 x:0 0 0 2024-09-16T00:50:08.460 INFO:tasks.workunit.client.1.smithi152.stdout:2/226: getdents d4/d19/d20/d28/d2c 0 2024-09-16T00:50:08.460 INFO:tasks.workunit.client.1.smithi152.stdout:1/242: dread d9/d3e/f49 [0,4194304] 0 2024-09-16T00:50:08.463 INFO:tasks.workunit.client.1.smithi152.stdout:0/204: mkdir d3/d6/d8/d1d/d23/d25/d45 0 2024-09-16T00:50:08.465 INFO:tasks.workunit.client.1.smithi152.stdout:9/285: truncate d1/f31 1095663 0 2024-09-16T00:50:08.467 INFO:tasks.workunit.client.1.smithi152.stdout:9/286: write d1/fc [156264,55301] 0 2024-09-16T00:50:08.467 INFO:tasks.workunit.client.1.smithi152.stdout:9/287: write d1/d4e/d48/d2b/f4d [332523,123713] 0 2024-09-16T00:50:08.467 INFO:tasks.workunit.client.1.smithi152.stdout:9/288: write d1/d14/f33 [5840955,117532] 0 2024-09-16T00:50:08.467 INFO:tasks.workunit.client.1.smithi152.stdout:9/289: write d1/d14/d32/f35 [1277657,107574] 0 2024-09-16T00:50:08.468 INFO:tasks.workunit.client.1.smithi152.stdout:1/243: dread d9/da/df/f47 [0,4194304] 0 2024-09-16T00:50:08.468 INFO:tasks.workunit.client.1.smithi152.stdout:1/244: read - d9/d3e/d41/d31/f44 zero size 2024-09-16T00:50:08.468 INFO:tasks.workunit.client.1.smithi152.stdout:6/241: creat db/d12/d20/d4b/f4e x:0 0 0 2024-09-16T00:50:08.468 INFO:tasks.workunit.client.1.smithi152.stdout:6/242: dread - db/d12/f3d zero size 2024-09-16T00:50:08.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/313: dwrite d6/d57/d2b/f31 [0,4194304] 0 2024-09-16T00:50:08.473 INFO:tasks.workunit.client.1.smithi152.stdout:9/290: dread d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:08.473 INFO:tasks.workunit.client.1.smithi152.stdout:9/291: read - d1/d4e/f61 zero size 2024-09-16T00:50:08.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/246: dwrite d9/d10/d27/d2a/d3c/f5a [0,4194304] 0 2024-09-16T00:50:08.488 INFO:tasks.workunit.client.1.smithi152.stdout:6/243: dwrite db/fe [0,4194304] 0 2024-09-16T00:50:08.489 INFO:tasks.workunit.client.1.smithi152.stdout:6/244: stat db/d28/f3c 0 2024-09-16T00:50:08.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/357: symlink d2/db/d39/l6f 0 2024-09-16T00:50:08.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/358: fsync d2/db/d39/d3c/f58 0 2024-09-16T00:50:08.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/359: chown d2/d1e/d28/d29/l3a 183445567 1 2024-09-16T00:50:08.493 INFO:tasks.workunit.client.1.smithi152.stdout:2/227: creat d4/d19/f4f x:0 0 0 2024-09-16T00:50:08.493 INFO:tasks.workunit.client.1.smithi152.stdout:2/228: chown d4/d17/f1d 37823542 1 2024-09-16T00:50:08.496 INFO:tasks.workunit.client.1.smithi152.stdout:0/205: symlink d3/l46 0 2024-09-16T00:50:08.500 INFO:tasks.workunit.client.1.smithi152.stdout:1/245: creat d9/d3e/f56 x:0 0 0 2024-09-16T00:50:08.503 INFO:tasks.workunit.client.1.smithi152.stdout:5/314: rmdir d6/d16/d1f/d65 39 2024-09-16T00:50:08.507 INFO:tasks.workunit.client.1.smithi152.stdout:0/206: read d3/f21 [2920261,38447] 0 2024-09-16T00:50:08.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/292: link d1/d4e/d34/f39 d1/d4e/d48/d26/d58/f64 0 2024-09-16T00:50:08.520 INFO:tasks.workunit.client.1.smithi152.stdout:4/360: dwrite d2/d1e/d28/d29/f1c [0,4194304] 0 2024-09-16T00:50:08.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/246: dwrite d9/f36 [0,4194304] 0 2024-09-16T00:50:08.525 INFO:tasks.workunit.client.1.smithi152.stdout:7/247: creat d9/d31/f5f x:0 0 0 2024-09-16T00:50:08.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/229: unlink d4/d19/d20/f32 0 2024-09-16T00:50:08.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/315: symlink d6/d57/d2b/d50/d66/l75 0 2024-09-16T00:50:08.531 INFO:tasks.workunit.client.1.smithi152.stdout:0/207: unlink d3/d6/l43 0 2024-09-16T00:50:08.535 INFO:tasks.workunit.client.1.smithi152.stdout:9/293: dwrite d1/d14/f33 [4194304,4194304] 0 2024-09-16T00:50:08.535 INFO:tasks.workunit.client.1.smithi152.stdout:9/294: chown d1/f31 1973 1 2024-09-16T00:50:08.535 INFO:tasks.workunit.client.1.smithi152.stdout:9/295: stat d1/d4e/d48/d26/d30 0 2024-09-16T00:50:08.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/247: mkdir d9/d3e/d41/d31/d38/d57 0 2024-09-16T00:50:08.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/248: creat d9/da/f58 x:0 0 0 2024-09-16T00:50:08.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/249: write d9/da/df/f47 [3594510,10052] 0 2024-09-16T00:50:08.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/147: sync 2024-09-16T00:50:08.542 INFO:tasks.workunit.client.1.smithi152.stdout:0/208: write d3/d6/d8/d1d/f20 [1344784,76172] 0 2024-09-16T00:50:08.543 INFO:tasks.workunit.client.1.smithi152.stdout:7/248: creat d9/d10/d27/d2a/d3c/d5b/f60 x:0 0 0 2024-09-16T00:50:08.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/230: creat d4/d19/d20/d28/f50 x:0 0 0 2024-09-16T00:50:08.546 INFO:tasks.workunit.client.1.smithi152.stdout:5/316: mknod d6/d16/d1f/c76 0 2024-09-16T00:50:08.548 INFO:tasks.workunit.client.1.smithi152.stdout:4/361: symlink d2/l70 0 2024-09-16T00:50:08.551 INFO:tasks.workunit.client.1.smithi152.stdout:9/296: link d1/d14/d32/l40 d1/d4e/d48/d26/l65 0 2024-09-16T00:50:08.551 INFO:tasks.workunit.client.1.smithi152.stdout:9/297: write d1/d7/d13/f37 [4483969,26392] 0 2024-09-16T00:50:08.557 INFO:tasks.workunit.client.1.smithi152.stdout:8/148: symlink dd/de/l33 0 2024-09-16T00:50:08.559 INFO:tasks.workunit.client.1.smithi152.stdout:0/209: truncate d3/f16 659560 0 2024-09-16T00:50:08.559 INFO:tasks.workunit.client.1.smithi152.stdout:0/210: readlink d3/d6/d8/d1d/d23/d25/l3a 0 2024-09-16T00:50:08.561 INFO:tasks.workunit.client.1.smithi152.stdout:7/249: link d9/d10/d27/f59 d9/d10/d27/d2a/f61 0 2024-09-16T00:50:08.566 INFO:tasks.workunit.client.1.smithi152.stdout:2/231: mknod d4/d19/d20/d28/c51 0 2024-09-16T00:50:08.566 INFO:tasks.workunit.client.1.smithi152.stdout:2/232: creat d4/d19/d20/d28/f52 x:0 0 0 2024-09-16T00:50:08.566 INFO:tasks.workunit.client.1.smithi152.stdout:2/233: write d4/f15 [8974013,24500] 0 2024-09-16T00:50:08.566 INFO:tasks.workunit.client.1.smithi152.stdout:8/149: dread f3 [0,4194304] 0 2024-09-16T00:50:08.569 INFO:tasks.workunit.client.1.smithi152.stdout:5/317: mkdir d6/d16/d1f/d65/d77 0 2024-09-16T00:50:08.569 INFO:tasks.workunit.client.1.smithi152.stdout:0/211: dread d3/d6/d8/d1d/d23/f3b [0,4194304] 0 2024-09-16T00:50:08.572 INFO:tasks.workunit.client.1.smithi152.stdout:4/362: rmdir d2/db/d39/d3c 39 2024-09-16T00:50:08.572 INFO:tasks.workunit.client.1.smithi152.stdout:4/363: chown d2/d1e/c43 0 1 2024-09-16T00:50:08.579 INFO:tasks.workunit.client.1.smithi152.stdout:9/298: mkdir d1/d4e/d48/d66 0 2024-09-16T00:50:08.579 INFO:tasks.workunit.client.1.smithi152.stdout:9/299: creat d1/d4e/f67 x:0 0 0 2024-09-16T00:50:08.582 INFO:tasks.workunit.client.1.smithi152.stdout:8/150: dwrite dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:08.582 INFO:tasks.workunit.client.1.smithi152.stdout:8/151: chown dd/d26/d29/d2f/f31 65728267 1 2024-09-16T00:50:08.582 INFO:tasks.workunit.client.1.smithi152.stdout:8/152: dread - dd/d25/f30 zero size 2024-09-16T00:50:08.585 INFO:tasks.workunit.client.1.smithi152.stdout:1/250: symlink d9/da/df/l59 0 2024-09-16T00:50:08.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/234: unlink d4/c1c 0 2024-09-16T00:50:08.591 INFO:tasks.workunit.client.1.smithi152.stdout:5/318: mknod d6/d16/d1f/c78 0 2024-09-16T00:50:08.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/153: write dd/ff [315749,75826] 0 2024-09-16T00:50:08.593 INFO:tasks.workunit.client.1.smithi152.stdout:0/212: mkdir d3/d6/d8/d1d/d23/d25/d45/d47 0 2024-09-16T00:50:08.593 INFO:tasks.workunit.client.1.smithi152.stdout:0/213: chown d3/d6/d8/d1d/d23/d25/d2a 15 1 2024-09-16T00:50:08.593 INFO:tasks.workunit.client.1.smithi152.stdout:0/214: fdatasync d3/d6/d8/d1d/f20 0 2024-09-16T00:50:08.593 INFO:tasks.workunit.client.1.smithi152.stdout:0/215: creat d3/d6/d8/d1d/f48 x:0 0 0 2024-09-16T00:50:08.593 INFO:tasks.workunit.client.1.smithi152.stdout:0/216: creat d3/d6/d8/d1d/f49 x:0 0 0 2024-09-16T00:50:08.607 INFO:tasks.workunit.client.1.smithi152.stdout:2/235: rename d4/c35 to d4/d19/d20/d28/d2c/c53 0 2024-09-16T00:50:08.608 INFO:tasks.workunit.client.1.smithi152.stdout:5/319: rmdir d6/d16/d1f 39 2024-09-16T00:50:08.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/236: dread f2 [0,4194304] 0 2024-09-16T00:50:08.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/237: read - d4/d19/f4f zero size 2024-09-16T00:50:08.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/238: truncate d4/f16 1133184 0 2024-09-16T00:50:08.610 INFO:tasks.workunit.client.1.smithi152.stdout:8/154: rename dd/d23/c2e to dd/d23/c34 0 2024-09-16T00:50:08.619 INFO:tasks.workunit.client.1.smithi152.stdout:0/217: link d3/d6/d2e/l34 d3/d6/d8/d1d/d23/l4a 0 2024-09-16T00:50:08.619 INFO:tasks.workunit.client.1.smithi152.stdout:0/218: fsync d3/d6/f42 0 2024-09-16T00:50:08.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/364: symlink d2/l71 0 2024-09-16T00:50:08.631 INFO:tasks.workunit.client.1.smithi152.stdout:1/251: rmdir d9/d3e/d41/d31/d48 39 2024-09-16T00:50:08.634 INFO:tasks.workunit.client.1.smithi152.stdout:0/219: dwrite d3/d6/d8/d1d/d23/d25/d2a/f2d [0,4194304] 0 2024-09-16T00:50:08.634 INFO:tasks.workunit.client.1.smithi152.stdout:0/220: fsync d3/d6/d8/d1d/f36 0 2024-09-16T00:50:08.634 INFO:tasks.workunit.client.1.smithi152.stdout:5/320: truncate d6/d16/f36 2784801 0 2024-09-16T00:50:08.634 INFO:tasks.workunit.client.1.smithi152.stdout:5/321: write d6/d16/f4d [1304973,74595] 0 2024-09-16T00:50:08.639 INFO:tasks.workunit.client.1.smithi152.stdout:3/212: sync 2024-09-16T00:50:08.639 INFO:tasks.workunit.client.1.smithi152.stdout:3/213: read - dc/d10/d17/f37 zero size 2024-09-16T00:50:08.639 INFO:tasks.workunit.client.1.smithi152.stdout:3/214: readlink l9 0 2024-09-16T00:50:08.639 INFO:tasks.workunit.client.1.smithi152.stdout:8/155: creat dd/d26/d29/d2f/f35 x:0 0 0 2024-09-16T00:50:08.642 INFO:tasks.workunit.client.1.smithi152.stdout:4/365: creat d2/d41/f72 x:0 0 0 2024-09-16T00:50:08.642 INFO:tasks.workunit.client.1.smithi152.stdout:4/366: write d2/db/d44/f68 [787140,67454] 0 2024-09-16T00:50:08.645 INFO:tasks.workunit.client.1.smithi152.stdout:1/252: symlink d9/da/l5a 0 2024-09-16T00:50:08.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/221: mkdir d3/d6/d8/d1d/d23/d4b 0 2024-09-16T00:50:08.657 INFO:tasks.workunit.client.1.smithi152.stdout:5/322: link d6/d16/f23 d6/d57/d2b/f79 0 2024-09-16T00:50:08.661 INFO:tasks.workunit.client.1.smithi152.stdout:2/239: getdents d4/d19/d20 0 2024-09-16T00:50:08.665 INFO:tasks.workunit.client.1.smithi152.stdout:3/215: rename dc/d10/d17/d1c/c29 to dc/d10/d17/d1c/d1f/d22/d2c/d3b/c3c 0 2024-09-16T00:50:08.665 INFO:tasks.workunit.client.1.smithi152.stdout:3/216: creat dc/f3d x:0 0 0 2024-09-16T00:50:08.665 INFO:tasks.workunit.client.1.smithi152.stdout:3/217: write dc/f35 [51228,56049] 0 2024-09-16T00:50:08.666 INFO:tasks.workunit.client.1.smithi152.stdout:5/323: dread d6/d57/d2b/f31 [0,4194304] 0 2024-09-16T00:50:08.667 INFO:tasks.workunit.client.1.smithi152.stdout:4/367: dread - d2/db/f38 zero size 2024-09-16T00:50:08.669 INFO:tasks.workunit.client.1.smithi152.stdout:1/253: rmdir d9/d3e/d41/d31/d38/d57 0 2024-09-16T00:50:08.669 INFO:tasks.workunit.client.1.smithi152.stdout:1/254: dread - d9/d3e/d41/d31/f3a zero size 2024-09-16T00:50:08.669 INFO:tasks.workunit.client.1.smithi152.stdout:1/255: write d9/da/df/f30 [1338154,24110] 0 2024-09-16T00:50:08.671 INFO:tasks.workunit.client.1.smithi152.stdout:0/222: creat d3/d6/d8/d1d/d23/d25/d45/d47/f4c x:0 0 0 2024-09-16T00:50:08.673 INFO:tasks.workunit.client.1.smithi152.stdout:2/240: creat d4/d19/d20/d28/d2c/f54 x:0 0 0 2024-09-16T00:50:08.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/245: sync 2024-09-16T00:50:08.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/246: read - db/d12/d23/d4a/d43/d48/f4d zero size 2024-09-16T00:50:08.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/156: rename cc to dd/d26/c36 0 2024-09-16T00:50:08.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/157: chown c9 34375 1 2024-09-16T00:50:08.688 INFO:tasks.workunit.client.1.smithi152.stdout:5/324: creat d6/d57/f7a x:0 0 0 2024-09-16T00:50:08.691 INFO:tasks.workunit.client.1.smithi152.stdout:4/368: link d2/db/d39/c27 d2/d41/c73 0 2024-09-16T00:50:08.697 INFO:tasks.workunit.client.1.smithi152.stdout:2/241: symlink d4/d17/l55 0 2024-09-16T00:50:08.697 INFO:tasks.workunit.client.1.smithi152.stdout:2/242: chown d4/l4a 79794 1 2024-09-16T00:50:08.699 INFO:tasks.workunit.client.1.smithi152.stdout:1/256: rename d9/d3e/d41/f2a to d9/d3e/d41/d31/d48/d4a/f5b 0 2024-09-16T00:50:08.702 INFO:tasks.workunit.client.1.smithi152.stdout:7/250: sync 2024-09-16T00:50:08.704 INFO:tasks.workunit.client.1.smithi152.stdout:4/369: dwrite d2/d1e/d28/d29/f24 [0,4194304] 0 2024-09-16T00:50:08.710 INFO:tasks.workunit.client.1.smithi152.stdout:7/251: dread d9/f25 [0,4194304] 0 2024-09-16T00:50:08.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/218: rmdir dc/d10/d17/d1c/d1f 39 2024-09-16T00:50:08.724 INFO:tasks.workunit.client.1.smithi152.stdout:5/325: symlink d6/l7b 0 2024-09-16T00:50:08.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/223: rmdir d3/d6 39 2024-09-16T00:50:08.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/224: chown d3/d6/d8/d1d/d23/d25/d2a/f2d 35425773 1 2024-09-16T00:50:08.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/225: readlink d3/d6/d8/d1d/d23/d25/d2a/l30 0 2024-09-16T00:50:08.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/226: readlink d3/d6/d8/d1d/d23/l44 0 2024-09-16T00:50:08.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/227: chown d3/d6/d8/d1d 3 1 2024-09-16T00:50:08.737 INFO:tasks.workunit.client.1.smithi152.stdout:2/243: mkdir d4/d19/d20/d28/d2c/d56 0 2024-09-16T00:50:08.739 INFO:tasks.workunit.client.1.smithi152.stdout:1/257: link d9/d3e/d41/l2e d9/d3e/d41/d31/l5c 0 2024-09-16T00:50:08.743 INFO:tasks.workunit.client.1.smithi152.stdout:9/300: sync 2024-09-16T00:50:08.744 INFO:tasks.workunit.client.1.smithi152.stdout:4/370: truncate d2/d1e/f5e 11096804 0 2024-09-16T00:50:08.749 INFO:tasks.workunit.client.1.smithi152.stdout:3/219: mkdir dc/d3e 0 2024-09-16T00:50:08.750 INFO:tasks.workunit.client.1.smithi152.stdout:9/301: dread d1/d4e/d34/f39 [4194304,4194304] 0 2024-09-16T00:50:08.751 INFO:tasks.workunit.client.1.smithi152.stdout:5/326: rename d6/d57/d2b/d50/f5c to d6/f7c 0 2024-09-16T00:50:08.755 INFO:tasks.workunit.client.1.smithi152.stdout:2/244: mkdir d4/d17/d57 0 2024-09-16T00:50:08.759 INFO:tasks.workunit.client.1.smithi152.stdout:1/258: link d9/da/df/f46 d9/d3e/d41/d31/d38/f5d 0 2024-09-16T00:50:08.761 INFO:tasks.workunit.client.1.smithi152.stdout:4/371: creat d2/d1e/d28/d29/d32/f74 x:0 0 0 2024-09-16T00:50:08.761 INFO:tasks.workunit.client.1.smithi152.stdout:4/372: write d2/d1e/d28/d29/f5c [723951,89462] 0 2024-09-16T00:50:08.761 INFO:tasks.workunit.client.1.smithi152.stdout:4/373: write d2/d1e/d28/d69/f5b [875649,93644] 0 2024-09-16T00:50:08.765 INFO:tasks.workunit.client.1.smithi152.stdout:5/327: unlink d6/d57/d2b/d50/f5a 0 2024-09-16T00:50:08.765 INFO:tasks.workunit.client.1.smithi152.stdout:5/328: readlink d6/d16/l43 0 2024-09-16T00:50:08.768 INFO:tasks.workunit.client.1.smithi152.stdout:1/259: creat d9/d3e/d41/d31/d48/f5e x:0 0 0 2024-09-16T00:50:08.768 INFO:tasks.workunit.client.1.smithi152.stdout:1/260: readlink d9/da/le 0 2024-09-16T00:50:08.768 INFO:tasks.workunit.client.1.smithi152.stdout:1/261: creat d9/d3e/d4b/f5f x:0 0 0 2024-09-16T00:50:08.773 INFO:tasks.workunit.client.1.smithi152.stdout:4/374: creat d2/db/d39/d3c/f75 x:0 0 0 2024-09-16T00:50:08.776 INFO:tasks.workunit.client.1.smithi152.stdout:5/329: rename d6/d16/d1f/f21 to d6/d16/d1f/d65/f7d 0 2024-09-16T00:50:08.776 INFO:tasks.workunit.client.1.smithi152.stdout:5/330: write d6/d57/f7a [498194,3975] 0 2024-09-16T00:50:08.776 INFO:tasks.workunit.client.1.smithi152.stdout:5/331: chown d6/d57/d2b/f2f 13032 1 2024-09-16T00:50:08.779 INFO:tasks.workunit.client.1.smithi152.stdout:7/252: dwrite d9/d10/f12 [0,4194304] 0 2024-09-16T00:50:08.779 INFO:tasks.workunit.client.1.smithi152.stdout:3/220: dwrite dc/f15 [4194304,4194304] 0 2024-09-16T00:50:08.781 INFO:tasks.workunit.client.1.smithi152.stdout:9/302: dwrite d1/d4e/d48/d26/d30/d4f/f55 [0,4194304] 0 2024-09-16T00:50:08.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/221: dread f6 [0,4194304] 0 2024-09-16T00:50:08.783 INFO:tasks.workunit.client.1.smithi152.stdout:7/253: creat d9/d10/d30/d41/f62 x:0 0 0 2024-09-16T00:50:08.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/262: write d9/f37 [1960949,88755] 0 2024-09-16T00:50:08.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/263: creat d9/d3e/d41/f60 x:0 0 0 2024-09-16T00:50:08.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/264: chown d9/da/df/f1e 182762 1 2024-09-16T00:50:08.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/265: read d9/d3e/f52 [986323,110079] 0 2024-09-16T00:50:08.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/266: chown d9/d3e/d41/d31/f3a 1718 1 2024-09-16T00:50:08.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/332: dread d6/f2d [0,4194304] 0 2024-09-16T00:50:08.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/333: read d6/d16/d1f/f22 [3582291,46648] 0 2024-09-16T00:50:08.790 INFO:tasks.workunit.client.1.smithi152.stdout:5/334: dread d6/f20 [0,4194304] 0 2024-09-16T00:50:08.790 INFO:tasks.workunit.client.1.smithi152.stdout:5/335: chown d6/d16/c46 147631 1 2024-09-16T00:50:08.792 INFO:tasks.workunit.client.1.smithi152.stdout:4/375: dwrite d2/db/f38 [0,4194304] 0 2024-09-16T00:50:08.793 INFO:tasks.workunit.client.1.smithi152.stdout:7/254: rmdir d9/d10/d30 39 2024-09-16T00:50:08.793 INFO:tasks.workunit.client.1.smithi152.stdout:3/222: dread f2 [0,4194304] 0 2024-09-16T00:50:08.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/267: mknod d9/d3e/d41/c61 0 2024-09-16T00:50:08.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/268: stat d9/da/df/f1e 0 2024-09-16T00:50:08.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/269: write d9/d3e/d41/f40 [496778,112272] 0 2024-09-16T00:50:08.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/270: chown d9/f19 1 1 2024-09-16T00:50:08.796 INFO:tasks.workunit.client.1.smithi152.stdout:5/336: symlink d6/d57/d2b/d50/d66/l7e 0 2024-09-16T00:50:08.799 INFO:tasks.workunit.client.1.smithi152.stdout:9/303: dwrite d1/f57 [0,4194304] 0 2024-09-16T00:50:08.800 INFO:tasks.workunit.client.1.smithi152.stdout:4/376: mkdir d2/db/d39/d3c/d76 0 2024-09-16T00:50:08.800 INFO:tasks.workunit.client.1.smithi152.stdout:4/377: fsync d2/db/d44/f68 0 2024-09-16T00:50:08.802 INFO:tasks.workunit.client.1.smithi152.stdout:9/304: write d1/fb [3505130,91992] 0 2024-09-16T00:50:08.802 INFO:tasks.workunit.client.1.smithi152.stdout:9/305: write d1/d4e/d48/f3d [681590,14465] 0 2024-09-16T00:50:08.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/255: unlink d9/d31/f56 0 2024-09-16T00:50:08.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/256: chown d9/d10/d27/d2a/d3c 57937 1 2024-09-16T00:50:08.805 INFO:tasks.workunit.client.1.smithi152.stdout:3/223: rename dc/c18 to dc/d10/d17/c3f 0 2024-09-16T00:50:08.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/271: unlink d9/f21 0 2024-09-16T00:50:08.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/272: write d9/f16 [1085210,127653] 0 2024-09-16T00:50:08.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/273: chown d9/l22 24 1 2024-09-16T00:50:08.810 INFO:tasks.workunit.client.1.smithi152.stdout:5/337: symlink d6/d57/d54/l7f 0 2024-09-16T00:50:08.810 INFO:tasks.workunit.client.1.smithi152.stdout:5/338: fsync d6/d16/f36 0 2024-09-16T00:50:08.812 INFO:tasks.workunit.client.1.smithi152.stdout:3/224: dread f7 [0,4194304] 0 2024-09-16T00:50:08.815 INFO:tasks.workunit.client.1.smithi152.stdout:4/378: unlink d2/db/l22 0 2024-09-16T00:50:08.816 INFO:tasks.workunit.client.1.smithi152.stdout:1/274: dread d9/d3e/d41/d31/d38/f43 [0,4194304] 0 2024-09-16T00:50:08.817 INFO:tasks.workunit.client.1.smithi152.stdout:9/306: mkdir d1/d14/d68 0 2024-09-16T00:50:08.819 INFO:tasks.workunit.client.1.smithi152.stdout:7/257: rmdir d9/d10/d27/d2a 39 2024-09-16T00:50:08.830 INFO:tasks.workunit.client.1.smithi152.stdout:3/225: dwrite f7 [0,4194304] 0 2024-09-16T00:50:08.837 INFO:tasks.workunit.client.1.smithi152.stdout:7/258: dwrite d9/d10/d27/f59 [0,4194304] 0 2024-09-16T00:50:08.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/379: truncate d2/fe 1759408 0 2024-09-16T00:50:08.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/380: creat d2/db/d39/d3c/f77 x:0 0 0 2024-09-16T00:50:08.842 INFO:tasks.workunit.client.1.smithi152.stdout:4/381: read d2/db/f2c [333637,73806] 0 2024-09-16T00:50:08.843 INFO:tasks.workunit.client.1.smithi152.stdout:1/275: mknod d9/da/c62 0 2024-09-16T00:50:08.844 INFO:tasks.workunit.client.1.smithi152.stdout:1/276: fsync d9/d3e/f56 0 2024-09-16T00:50:08.844 INFO:tasks.workunit.client.1.smithi152.stdout:1/277: dread - d9/d3e/d4b/f51 zero size 2024-09-16T00:50:08.844 INFO:tasks.workunit.client.1.smithi152.stdout:1/278: write d9/d3e/d41/d31/d38/f39 [827777,25437] 0 2024-09-16T00:50:08.844 INFO:tasks.workunit.client.1.smithi152.stdout:1/279: read d9/d3e/d41/f40 [3025114,1189] 0 2024-09-16T00:50:08.845 INFO:tasks.workunit.client.1.smithi152.stdout:9/307: mkdir d1/d7/d13/d5d/d69 0 2024-09-16T00:50:08.848 INFO:tasks.workunit.client.1.smithi152.stdout:7/259: write d9/d10/f12 [192949,114086] 0 2024-09-16T00:50:08.848 INFO:tasks.workunit.client.1.smithi152.stdout:7/260: chown d9/d10/d27/d2a/d3c/f5a 17741733 1 2024-09-16T00:50:08.859 INFO:tasks.workunit.client.1.smithi152.stdout:5/339: getdents d6/d57/d2b/d50/d64 0 2024-09-16T00:50:08.864 INFO:tasks.workunit.client.1.smithi152.stdout:9/308: dwrite d1/d4e/d34/f62 [0,4194304] 0 2024-09-16T00:50:08.864 INFO:tasks.workunit.client.1.smithi152.stdout:1/280: dwrite d9/d3e/d41/d31/d48/f55 [0,4194304] 0 2024-09-16T00:50:08.864 INFO:tasks.workunit.client.1.smithi152.stdout:1/281: creat d9/d3e/d41/d31/d48/f63 x:0 0 0 2024-09-16T00:50:08.865 INFO:tasks.workunit.client.1.smithi152.stdout:4/382: creat d2/d1e/d28/d69/f78 x:0 0 0 2024-09-16T00:50:08.867 INFO:tasks.workunit.client.1.smithi152.stdout:3/226: rename dc/d10/d17/c3f to dc/d10/d17/d1c/d1f/d22/d2c/d2f/c40 0 2024-09-16T00:50:08.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/261: mknod d9/d10/d27/d2a/d3c/c63 0 2024-09-16T00:50:08.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/262: write d9/d10/d27/d2a/f4f [3795856,128667] 0 2024-09-16T00:50:08.874 INFO:tasks.workunit.client.1.smithi152.stdout:5/340: creat d6/d16/d1f/d65/d77/f80 x:0 0 0 2024-09-16T00:50:08.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/309: dwrite d1/d14/d32/f35 [0,4194304] 0 2024-09-16T00:50:08.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/282: symlink d9/d3e/l64 0 2024-09-16T00:50:08.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/283: write d9/d3e/d41/d31/d48/f63 [347039,109491] 0 2024-09-16T00:50:08.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/284: stat d9/l22 0 2024-09-16T00:50:08.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/285: chown d9/f37 0 1 2024-09-16T00:50:08.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/286: creat d9/d3e/d41/d31/d48/f65 x:0 0 0 2024-09-16T00:50:08.889 INFO:tasks.workunit.client.1.smithi152.stdout:5/341: symlink d6/d57/d2b/d50/l81 0 2024-09-16T00:50:08.895 INFO:tasks.workunit.client.1.smithi152.stdout:9/310: symlink d1/d7/d13/d5d/d69/l6a 0 2024-09-16T00:50:08.895 INFO:tasks.workunit.client.1.smithi152.stdout:9/311: write d1/d59/f5c [114417,66526] 0 2024-09-16T00:50:08.895 INFO:tasks.workunit.client.1.smithi152.stdout:9/312: fsync d1/d4e/f67 0 2024-09-16T00:50:08.899 INFO:tasks.workunit.client.1.smithi152.stdout:4/383: getdents d2/db/d44 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/384: readlink d2/db/l2b 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/228: sync 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/247: sync 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/158: sync 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/248: fsync db/f31 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/249: fdatasync db/d12/f44 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/229: write d3/f16 [1558960,57184] 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/159: write dd/d23/f24 [1517226,99387] 0 2024-09-16T00:50:08.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/160: fsync dd/de/f13 0 2024-09-16T00:50:08.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/342: rmdir d6/d16/d1f/d65 39 2024-09-16T00:50:08.910 INFO:tasks.workunit.client.1.smithi152.stdout:2/245: sync 2024-09-16T00:50:08.910 INFO:tasks.workunit.client.1.smithi152.stdout:2/246: stat d4/d19/d20/d28/c39 0 2024-09-16T00:50:08.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/287: mknod d9/da/df/c66 0 2024-09-16T00:50:08.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/288: fsync d9/d3e/d4b/f51 0 2024-09-16T00:50:08.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/289: readlink d9/l22 0 2024-09-16T00:50:08.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/263: rename d9/d10/d27/d2a to d9/d31/d64 0 2024-09-16T00:50:08.917 INFO:tasks.workunit.client.1.smithi152.stdout:2/247: write d4/d17/f38 [2794883,47187] 0 2024-09-16T00:50:08.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/161: mknod dd/d26/c37 0 2024-09-16T00:50:08.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/162: truncate dd/d26/d29/d2f/f31 4466593 0 2024-09-16T00:50:08.928 INFO:tasks.workunit.client.1.smithi152.stdout:8/163: dread dd/ff [0,4194304] 0 2024-09-16T00:50:08.928 INFO:tasks.workunit.client.1.smithi152.stdout:8/164: creat dd/f38 x:0 0 0 2024-09-16T00:50:08.928 INFO:tasks.workunit.client.1.smithi152.stdout:3/227: rmdir dc/d10/d17/d1c/d1f/d33 0 2024-09-16T00:50:08.931 INFO:tasks.workunit.client.1.smithi152.stdout:3/228: write dc/f1a [195393,122582] 0 2024-09-16T00:50:08.931 INFO:tasks.workunit.client.1.smithi152.stdout:3/229: write dc/d10/d17/d1c/f23 [1370998,81984] 0 2024-09-16T00:50:08.942 INFO:tasks.workunit.client.1.smithi152.stdout:5/343: getdents d6/d57/d54 0 2024-09-16T00:50:08.944 INFO:tasks.workunit.client.1.smithi152.stdout:1/290: symlink d9/d3e/d41/l67 0 2024-09-16T00:50:08.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/291: readlink d9/da/l5a 0 2024-09-16T00:50:08.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/292: fsync d9/d3e/d41/d31/d48/f5e 0 2024-09-16T00:50:08.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/293: write d9/d3e/d41/d31/d48/d4a/f54 [1027586,90981] 0 2024-09-16T00:50:08.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/294: chown d9/d3e/f49 0 1 2024-09-16T00:50:08.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:08 smithi152 ceph-mon[33237]: [16/Sep/2024:00:50:07] ENGINE Serving on http://172.21.15.152:8765 2024-09-16T00:50:08.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:08 smithi152 ceph-mon[33237]: [16/Sep/2024:00:50:07] ENGINE Bus STARTED 2024-09-16T00:50:08.947 INFO:tasks.workunit.client.1.smithi152.stdout:9/313: rename d1/d4e/d48/d26/d58/f64 to d1/d7/d13/d5d/f6b 0 2024-09-16T00:50:08.949 INFO:tasks.workunit.client.1.smithi152.stdout:4/385: getdents d2/d1e/d28/d69 0 2024-09-16T00:50:08.949 INFO:tasks.workunit.client.1.smithi152.stdout:4/386: creat d2/d1e/d28/d29/f79 x:0 0 0 2024-09-16T00:50:08.952 INFO:tasks.workunit.client.1.smithi152.stdout:3/230: dwrite dc/f35 [0,4194304] 0 2024-09-16T00:50:08.953 INFO:tasks.workunit.client.1.smithi152.stdout:2/248: mknod d4/d19/c58 0 2024-09-16T00:50:08.954 INFO:tasks.workunit.client.1.smithi152.stdout:6/250: rmdir db/d12/d1c 39 2024-09-16T00:50:08.957 INFO:tasks.workunit.client.1.smithi152.stdout:4/387: write d2/db/d39/f59 [1640816,59702] 0 2024-09-16T00:50:08.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/251: write db/f40 [102031,7165] 0 2024-09-16T00:50:08.963 INFO:tasks.workunit.client.1.smithi152.stdout:5/344: truncate d6/fb 234806 0 2024-09-16T00:50:08.965 INFO:tasks.workunit.client.1.smithi152.stdout:9/314: mknod d1/d4e/c6c 0 2024-09-16T00:50:08.965 INFO:tasks.workunit.client.1.smithi152.stdout:3/231: dread dc/fe [4194304,4194304] 0 2024-09-16T00:50:08.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/295: dwrite d9/da/f58 [0,4194304] 0 2024-09-16T00:50:08.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/296: getdents d9/d3e/d4b/d50 0 2024-09-16T00:50:08.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/297: chown d9/da/df/f27 82 1 2024-09-16T00:50:08.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/298: creat d9/da/f68 x:0 0 0 2024-09-16T00:50:08.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/249: rmdir d4/d19/d20/d28/d2c/d56 0 2024-09-16T00:50:08.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/250: creat d4/d19/f59 x:0 0 0 2024-09-16T00:50:08.979 INFO:tasks.workunit.client.1.smithi152.stdout:4/388: mknod d2/d41/c7a 0 2024-09-16T00:50:08.981 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:08 smithi053 ceph-mon[27950]: [16/Sep/2024:00:50:07] ENGINE Serving on http://172.21.15.152:8765 2024-09-16T00:50:08.981 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:08 smithi053 ceph-mon[27950]: [16/Sep/2024:00:50:07] ENGINE Bus STARTED 2024-09-16T00:50:08.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/252: unlink db/c10 0 2024-09-16T00:50:08.986 INFO:tasks.workunit.client.1.smithi152.stdout:8/165: rmdir dd/d26 39 2024-09-16T00:50:08.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/166: creat dd/f39 x:0 0 0 2024-09-16T00:50:08.992 INFO:tasks.workunit.client.1.smithi152.stdout:5/345: link d6/d57/d2b/d50/d66/l75 d6/d57/d2b/d50/d6e/l82 0 2024-09-16T00:50:08.992 INFO:tasks.workunit.client.1.smithi152.stdout:5/346: write d6/d57/d2b/f79 [1826800,16454] 0 2024-09-16T00:50:08.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/347: dread d6/f2d [0,4194304] 0 2024-09-16T00:50:08.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/348: dread - d6/d16/d1f/d6c/f73 zero size 2024-09-16T00:50:09.007 INFO:tasks.workunit.client.1.smithi152.stdout:9/315: truncate d1/d4e/d34/f62 2080408 0 2024-09-16T00:50:09.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/232: link dc/d10/d17/d1c/d1f/c20 dc/d10/c41 0 2024-09-16T00:50:09.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/233: write dc/d10/d17/f37 [818357,16213] 0 2024-09-16T00:50:09.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/167: dwrite dd/f1f [0,4194304] 0 2024-09-16T00:50:09.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/168: chown dd/d15 81 1 2024-09-16T00:50:09.019 INFO:tasks.workunit.client.1.smithi152.stdout:3/234: write f8 [5800414,55991] 0 2024-09-16T00:50:09.019 INFO:tasks.workunit.client.1.smithi152.stdout:3/235: chown dc/d10/c41 12 1 2024-09-16T00:50:09.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/169: dread dd/de/f13 [0,4194304] 0 2024-09-16T00:50:09.026 INFO:tasks.workunit.client.1.smithi152.stdout:4/389: mkdir d2/d1e/d28/d7b 0 2024-09-16T00:50:09.026 INFO:tasks.workunit.client.1.smithi152.stdout:4/390: chown d2/d1e/d28/d29/d32/f74 0 1 2024-09-16T00:50:09.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/253: symlink db/d12/d23/d4a/l4f 0 2024-09-16T00:50:09.029 INFO:tasks.workunit.client.1.smithi152.stdout:6/254: chown db/d12/d1c/f3f 30 1 2024-09-16T00:50:09.029 INFO:tasks.workunit.client.1.smithi152.stdout:6/255: write db/f31 [3565620,89506] 0 2024-09-16T00:50:09.031 INFO:tasks.workunit.client.1.smithi152.stdout:6/256: dread db/d28/f3c [0,4194304] 0 2024-09-16T00:50:09.036 INFO:tasks.workunit.client.1.smithi152.stdout:5/349: symlink d6/d57/d54/l83 0 2024-09-16T00:50:09.036 INFO:tasks.workunit.client.1.smithi152.stdout:5/350: read - d6/d57/d2b/d50/d64/f6f zero size 2024-09-16T00:50:09.049 INFO:tasks.workunit.client.1.smithi152.stdout:1/299: link d9/d3e/d41/f3b d9/da/df/f69 0 2024-09-16T00:50:09.053 INFO:tasks.workunit.client.1.smithi152.stdout:3/236: symlink dc/d10/l42 0 2024-09-16T00:50:09.055 INFO:tasks.workunit.client.1.smithi152.stdout:1/300: dread d9/da/df/f1e [4194304,4194304] 0 2024-09-16T00:50:09.057 INFO:tasks.workunit.client.1.smithi152.stdout:2/251: rmdir d4/d19/d20/d28/d2c 39 2024-09-16T00:50:09.057 INFO:tasks.workunit.client.1.smithi152.stdout:2/252: stat d4/f16 0 2024-09-16T00:50:09.060 INFO:tasks.workunit.client.1.smithi152.stdout:8/170: creat dd/d15/d1a/f3a x:0 0 0 2024-09-16T00:50:09.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/171: dread dd/de/f22 [0,4194304] 0 2024-09-16T00:50:09.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/172: chown dd/d15/f20 192321 1 2024-09-16T00:50:09.062 INFO:tasks.workunit.client.1.smithi152.stdout:4/391: unlink d2/d1e/d28/d29/d32/l61 0 2024-09-16T00:50:09.062 INFO:tasks.workunit.client.1.smithi152.stdout:4/392: creat d2/db/d39/d3c/f7c x:0 0 0 2024-09-16T00:50:09.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/393: write d2/d1e/d28/d69/f6d [4973159,24155] 0 2024-09-16T00:50:09.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/394: read d2/db/f4f [204330,6315] 0 2024-09-16T00:50:09.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/395: chown d2/db/c54 2797821 1 2024-09-16T00:50:09.064 INFO:tasks.workunit.client.1.smithi152.stdout:6/257: mknod db/d12/c50 0 2024-09-16T00:50:09.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/258: dread f9 [0,4194304] 0 2024-09-16T00:50:09.068 INFO:tasks.workunit.client.1.smithi152.stdout:5/351: creat d6/d57/d54/f84 x:0 0 0 2024-09-16T00:50:09.073 INFO:tasks.workunit.client.1.smithi152.stdout:5/352: read d6/f2d [1293341,47694] 0 2024-09-16T00:50:09.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/237: getdents dc/d10/d17/d1c 0 2024-09-16T00:50:09.084 INFO:tasks.workunit.client.1.smithi152.stdout:4/396: dwrite d2/d1e/d28/d29/f1c [4194304,4194304] 0 2024-09-16T00:50:09.085 INFO:tasks.workunit.client.1.smithi152.stdout:8/173: dwrite dd/d15/d1a/f3a [0,4194304] 0 2024-09-16T00:50:09.089 INFO:tasks.workunit.client.1.smithi152.stdout:6/259: creat db/d12/d20/f51 x:0 0 0 2024-09-16T00:50:09.089 INFO:tasks.workunit.client.1.smithi152.stdout:5/353: truncate d6/f2d 404540 0 2024-09-16T00:50:09.089 INFO:tasks.workunit.client.1.smithi152.stdout:8/174: dread dd/de/f21 [0,4194304] 0 2024-09-16T00:50:09.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/175: dread dd/de/f2b [0,4194304] 0 2024-09-16T00:50:09.092 INFO:tasks.workunit.client.1.smithi152.stdout:8/176: dread - dd/f39 zero size 2024-09-16T00:50:09.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/238: rename dc/l13 to dc/d10/d17/d1c/l43 0 2024-09-16T00:50:09.095 INFO:tasks.workunit.client.1.smithi152.stdout:1/301: mknod d9/da/df/c6a 0 2024-09-16T00:50:09.097 INFO:tasks.workunit.client.1.smithi152.stdout:2/253: getdents d4/d44 0 2024-09-16T00:50:09.107 INFO:tasks.workunit.client.1.smithi152.stdout:5/354: mknod d6/d57/d2b/d50/d6e/c85 0 2024-09-16T00:50:09.107 INFO:tasks.workunit.client.1.smithi152.stdout:5/355: write d6/d16/d1f/d65/f7d [4271572,6352] 0 2024-09-16T00:50:09.108 INFO:tasks.workunit.client.1.smithi152.stdout:6/260: write db/d12/d20/f3e [2637191,71030] 0 2024-09-16T00:50:09.110 INFO:tasks.workunit.client.1.smithi152.stdout:3/239: mknod dc/d10/d17/d1c/c44 0 2024-09-16T00:50:09.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/397: dwrite d2/d1e/d28/d69/f49 [0,4194304] 0 2024-09-16T00:50:09.118 INFO:tasks.workunit.client.1.smithi152.stdout:5/356: rename d6/l7b to d6/d16/d1f/d65/l86 0 2024-09-16T00:50:09.121 INFO:tasks.workunit.client.1.smithi152.stdout:5/357: dread d6/d16/d1f/f2e [0,4194304] 0 2024-09-16T00:50:09.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/261: stat db/d12/c1d 0 2024-09-16T00:50:09.125 INFO:tasks.workunit.client.1.smithi152.stdout:0/230: sync 2024-09-16T00:50:09.125 INFO:tasks.workunit.client.1.smithi152.stdout:7/264: sync 2024-09-16T00:50:09.125 INFO:tasks.workunit.client.1.smithi152.stdout:8/177: dwrite dd/de/f22 [0,4194304] 0 2024-09-16T00:50:09.128 INFO:tasks.workunit.client.1.smithi152.stdout:3/240: truncate dc/f35 4076972 0 2024-09-16T00:50:09.129 INFO:tasks.workunit.client.1.smithi152.stdout:1/302: dwrite d9/f29 [0,4194304] 0 2024-09-16T00:50:09.129 INFO:tasks.workunit.client.1.smithi152.stdout:2/254: dwrite d4/f16 [0,4194304] 0 2024-09-16T00:50:09.129 INFO:tasks.workunit.client.1.smithi152.stdout:2/255: write d4/f7 [2754788,27104] 0 2024-09-16T00:50:09.129 INFO:tasks.workunit.client.1.smithi152.stdout:2/256: fdatasync d4/d19/f4f 0 2024-09-16T00:50:09.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/358: creat d6/d57/d2b/d50/d66/f87 x:0 0 0 2024-09-16T00:50:09.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/359: truncate d6/f44 66853 0 2024-09-16T00:50:09.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/360: creat d6/d16/d1f/d6c/f88 x:0 0 0 2024-09-16T00:50:09.140 INFO:tasks.workunit.client.1.smithi152.stdout:8/178: dread dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:09.141 INFO:tasks.workunit.client.1.smithi152.stdout:6/262: getdents db/d12/d1c 0 2024-09-16T00:50:09.144 INFO:tasks.workunit.client.1.smithi152.stdout:0/231: stat d3/d6/la 0 2024-09-16T00:50:09.157 INFO:tasks.workunit.client.1.smithi152.stdout:3/241: symlink dc/d10/d17/d1c/d1f/l45 0 2024-09-16T00:50:09.160 INFO:tasks.workunit.client.1.smithi152.stdout:8/179: dwrite dd/d15/f20 [0,4194304] 0 2024-09-16T00:50:09.171 INFO:tasks.workunit.client.1.smithi152.stdout:1/303: unlink d9/d3e/d41/d31/l32 0 2024-09-16T00:50:09.171 INFO:tasks.workunit.client.1.smithi152.stdout:1/304: write d9/d3e/d41/d31/d48/f65 [437323,117735] 0 2024-09-16T00:50:09.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/257: rmdir d4/d19/d20 39 2024-09-16T00:50:09.179 INFO:tasks.workunit.client.1.smithi152.stdout:4/398: getdents d2/d1e 0 2024-09-16T00:50:09.179 INFO:tasks.workunit.client.1.smithi152.stdout:4/399: fsync d2/db/f4f 0 2024-09-16T00:50:09.179 INFO:tasks.workunit.client.1.smithi152.stdout:4/400: fsync d2/fe 0 2024-09-16T00:50:09.187 INFO:tasks.workunit.client.1.smithi152.stdout:5/361: creat d6/d16/d1f/d65/f89 x:0 0 0 2024-09-16T00:50:09.191 INFO:tasks.workunit.client.1.smithi152.stdout:0/232: rmdir d3/d6/d8/d1d/d23/d25 39 2024-09-16T00:50:09.191 INFO:tasks.workunit.client.1.smithi152.stdout:4/401: dread d2/db/d39/f3b [0,4194304] 0 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/233: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/234: write d3/d6/f42 [13028,127776] 0 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/235: chown d3/d6/d8/f40 27064285 1 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/242: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d2f/d46 0 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/243: chown dc/d10/d17/d1c/d1f/d22/c38 835307 1 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/244: readlink l9 0 2024-09-16T00:50:09.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/245: dread - dc/d10/d17/d1c/d1f/f2b zero size 2024-09-16T00:50:09.198 INFO:tasks.workunit.client.1.smithi152.stdout:4/402: dread d2/fe [0,4194304] 0 2024-09-16T00:50:09.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/180: unlink f8 0 2024-09-16T00:50:09.205 INFO:tasks.workunit.client.1.smithi152.stdout:1/305: truncate d9/da/f1d 952404 0 2024-09-16T00:50:09.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/362: dwrite d6/f40 [0,4194304] 0 2024-09-16T00:50:09.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/363: fdatasync d6/d57/d2b/f6b 0 2024-09-16T00:50:09.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/364: read - d6/d16/d1f/d65/d77/f80 zero size 2024-09-16T00:50:09.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/365: write d6/f32 [4560134,109570] 0 2024-09-16T00:50:09.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/258: dwrite d4/d17/f33 [0,4194304] 0 2024-09-16T00:50:09.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/259: write d4/d19/f49 [982943,46573] 0 2024-09-16T00:50:09.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/265: rename d9/d10/d27 to d9/d31/d65 0 2024-09-16T00:50:09.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/236: creat d3/d6/d8/d1d/d23/d25/f4d x:0 0 0 2024-09-16T00:50:09.215 INFO:tasks.workunit.client.1.smithi152.stdout:8/181: write dd/ff [3238570,20033] 0 2024-09-16T00:50:09.215 INFO:tasks.workunit.client.1.smithi152.stdout:8/182: fdatasync dd/d15/d1a/f3a 0 2024-09-16T00:50:09.215 INFO:tasks.workunit.client.1.smithi152.stdout:8/183: read - dd/f38 zero size 2024-09-16T00:50:09.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/366: dread f0 [0,4194304] 0 2024-09-16T00:50:09.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/306: mkdir d9/d3e/d4b/d6b 0 2024-09-16T00:50:09.229 INFO:tasks.workunit.client.1.smithi152.stdout:2/260: rename d4/d17/d57 to d4/d19/d20/d28/d2c/d5a 0 2024-09-16T00:50:09.229 INFO:tasks.workunit.client.1.smithi152.stdout:2/261: creat d4/d19/f5b x:0 0 0 2024-09-16T00:50:09.229 INFO:tasks.workunit.client.1.smithi152.stdout:3/246: dwrite f6 [0,4194304] 0 2024-09-16T00:50:09.230 INFO:tasks.workunit.client.1.smithi152.stdout:4/403: dwrite d2/d1e/f37 [0,4194304] 0 2024-09-16T00:50:09.230 INFO:tasks.workunit.client.1.smithi152.stdout:7/266: dwrite d9/f1f [0,4194304] 0 2024-09-16T00:50:09.231 INFO:tasks.workunit.client.1.smithi152.stdout:0/237: mkdir d3/d6/d4e 0 2024-09-16T00:50:09.235 INFO:tasks.workunit.client.1.smithi152.stdout:8/184: symlink dd/d25/l3b 0 2024-09-16T00:50:09.238 INFO:tasks.workunit.client.1.smithi152.stdout:5/367: mknod d6/d57/c8a 0 2024-09-16T00:50:09.239 INFO:tasks.workunit.client.1.smithi152.stdout:0/238: write d3/f19 [1123721,36110] 0 2024-09-16T00:50:09.239 INFO:tasks.workunit.client.1.smithi152.stdout:0/239: readlink d3/d6/d8/d1d/d23/d25/d2a/l30 0 2024-09-16T00:50:09.239 INFO:tasks.workunit.client.1.smithi152.stdout:0/240: chown d3/d6/d8/d1d/f49 1333 1 2024-09-16T00:50:09.239 INFO:tasks.workunit.client.1.smithi152.stdout:5/368: read d6/fb [121865,89135] 0 2024-09-16T00:50:09.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/307: symlink d9/d3e/d4b/d6b/l6c 0 2024-09-16T00:50:09.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/308: dread - d9/d3e/d41/f4e zero size 2024-09-16T00:50:09.244 INFO:tasks.workunit.client.1.smithi152.stdout:1/309: dread d9/d3e/d41/d31/d48/d4a/f54 [0,4194304] 0 2024-09-16T00:50:09.249 INFO:tasks.workunit.client.1.smithi152.stdout:2/262: creat d4/d19/d20/d28/d2c/d4d/f5c x:0 0 0 2024-09-16T00:50:09.256 INFO:tasks.workunit.client.1.smithi152.stdout:3/247: mkdir dc/d10/d47 0 2024-09-16T00:50:09.257 INFO:tasks.workunit.client.1.smithi152.stdout:3/248: chown dc/d3e 5222104 1 2024-09-16T00:50:09.257 INFO:tasks.workunit.client.1.smithi152.stdout:3/249: chown dc/d10/d17/d1c/d1f/d22/d2c/d2f/c40 9 1 2024-09-16T00:50:09.260 INFO:tasks.workunit.client.1.smithi152.stdout:0/241: dwrite d3/d6/d8/d1d/d23/d25/d2a/f2d [0,4194304] 0 2024-09-16T00:50:09.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/369: dwrite d6/d16/f27 [0,4194304] 0 2024-09-16T00:50:09.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/370: dread - d6/d57/d54/f70 zero size 2024-09-16T00:50:09.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/404: symlink d2/d1e/d28/d69/l7d 0 2024-09-16T00:50:09.276 INFO:tasks.workunit.client.1.smithi152.stdout:4/405: write d2/d1e/d28/d69/f6d [2858529,101930] 0 2024-09-16T00:50:09.277 INFO:tasks.workunit.client.1.smithi152.stdout:7/267: creat d9/d31/d65/d4b/f66 x:0 0 0 2024-09-16T00:50:09.277 INFO:tasks.workunit.client.1.smithi152.stdout:7/268: fsync d9/d10/d30/f3b 0 2024-09-16T00:50:09.281 INFO:tasks.workunit.client.1.smithi152.stdout:8/185: rename dd/d15/d1a/f1e to dd/de/f3c 0 2024-09-16T00:50:09.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/269: dread d9/d31/d64/f4f [0,4194304] 0 2024-09-16T00:50:09.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/270: creat d9/d31/f67 x:0 0 0 2024-09-16T00:50:09.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/271: write d9/d10/d30/f3b [719883,78736] 0 2024-09-16T00:50:09.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/272: chown d9/f23 6228 1 2024-09-16T00:50:09.286 INFO:tasks.workunit.client.1.smithi152.stdout:1/310: mkdir d9/d3e/d4b/d6b/d6d 0 2024-09-16T00:50:09.286 INFO:tasks.workunit.client.1.smithi152.stdout:1/311: creat d9/d3e/d41/d31/d48/f6e x:0 0 0 2024-09-16T00:50:09.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/250: link dc/d10/d17/d1c/d1f/f2b dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 0 2024-09-16T00:50:09.294 INFO:tasks.workunit.client.1.smithi152.stdout:9/316: sync 2024-09-16T00:50:09.294 INFO:tasks.workunit.client.1.smithi152.stdout:9/317: readlink d1/d7/l5b 0 2024-09-16T00:50:09.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/251: write dc/d10/d17/f26 [2700178,105307] 0 2024-09-16T00:50:09.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/252: chown dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 23109 1 2024-09-16T00:50:09.296 INFO:tasks.workunit.client.1.smithi152.stdout:0/242: getdents d3/d6/d8/d1d/d23/d25/d45/d47 0 2024-09-16T00:50:09.299 INFO:tasks.workunit.client.1.smithi152.stdout:5/371: mkdir d6/d16/d8b 0 2024-09-16T00:50:09.299 INFO:tasks.workunit.client.1.smithi152.stdout:5/372: chown d6/c5b 8513 1 2024-09-16T00:50:09.305 INFO:tasks.workunit.client.1.smithi152.stdout:1/312: dwrite d9/d3e/d41/d31/d48/f6e [0,4194304] 0 2024-09-16T00:50:09.305 INFO:tasks.workunit.client.1.smithi152.stdout:1/313: truncate d9/da/df/f27 1575973 0 2024-09-16T00:50:09.305 INFO:tasks.workunit.client.1.smithi152.stdout:1/314: stat d9/d3e/d4b/d6b 0 2024-09-16T00:50:09.305 INFO:tasks.workunit.client.1.smithi152.stdout:4/406: unlink d2/db/f4f 0 2024-09-16T00:50:09.309 INFO:tasks.workunit.client.1.smithi152.stdout:8/186: creat dd/d26/d29/d2f/f3d x:0 0 0 2024-09-16T00:50:09.313 INFO:tasks.workunit.client.1.smithi152.stdout:7/273: mknod d9/d10/d30/d41/d46/c68 0 2024-09-16T00:50:09.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/274: write d9/f23 [991433,2850] 0 2024-09-16T00:50:09.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/253: dwrite f5 [0,4194304] 0 2024-09-16T00:50:09.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/254: chown dc/d10/d17/d1c/c44 222323803 1 2024-09-16T00:50:09.317 INFO:tasks.workunit.client.1.smithi152.stdout:9/318: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:09.319 INFO:tasks.workunit.client.1.smithi152.stdout:2/263: getdents d4/d19/d20/d28 0 2024-09-16T00:50:09.321 INFO:tasks.workunit.client.1.smithi152.stdout:0/243: rename d3/d6/d8/d1d/d23/d25/c3e to d3/d6/d8/d1d/d23/d25/c4f 0 2024-09-16T00:50:09.327 INFO:tasks.workunit.client.1.smithi152.stdout:1/315: mknod d9/d3e/d41/d31/d48/d4a/c6f 0 2024-09-16T00:50:09.327 INFO:tasks.workunit.client.1.smithi152.stdout:1/316: creat d9/d3e/d41/d31/d48/f70 x:0 0 0 2024-09-16T00:50:09.330 INFO:tasks.workunit.client.1.smithi152.stdout:4/407: unlink d2/l8 0 2024-09-16T00:50:09.330 INFO:tasks.workunit.client.1.smithi152.stdout:4/408: getdents d2/db/d39/d3c/d76 0 2024-09-16T00:50:09.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/275: creat d9/d31/d65/f69 x:0 0 0 2024-09-16T00:50:09.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/276: readlink d9/l21 0 2024-09-16T00:50:09.337 INFO:tasks.workunit.client.1.smithi152.stdout:0/244: dwrite d3/d6/d8/d1d/f36 [0,4194304] 0 2024-09-16T00:50:09.351 INFO:tasks.workunit.client.1.smithi152.stdout:3/255: creat dc/d10/d17/d1c/d1f/f49 x:0 0 0 2024-09-16T00:50:09.353 INFO:tasks.workunit.client.1.smithi152.stdout:9/319: getdents d1/d4e/d48/d2b 0 2024-09-16T00:50:09.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/373: getdents d6/d16/d1f/d65/d77 0 2024-09-16T00:50:09.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/374: stat d6/f8 0 2024-09-16T00:50:09.364 INFO:tasks.workunit.client.1.smithi152.stdout:3/256: dwrite dc/d10/d17/d1c/d1f/f2b [0,4194304] 0 2024-09-16T00:50:09.369 INFO:tasks.workunit.client.1.smithi152.stdout:1/317: symlink d9/d3e/d41/d31/d38/l71 0 2024-09-16T00:50:09.369 INFO:tasks.workunit.client.1.smithi152.stdout:1/318: creat d9/da/f72 x:0 0 0 2024-09-16T00:50:09.375 INFO:tasks.workunit.client.1.smithi152.stdout:0/245: creat d3/d6/d8/d1d/d23/d25/d2a/f50 x:0 0 0 2024-09-16T00:50:09.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/320: unlink d1/d4e/d48/d26/d30/d4f/f55 0 2024-09-16T00:50:09.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/264: mknod d4/c5d 0 2024-09-16T00:50:09.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/265: stat d4/cf 0 2024-09-16T00:50:09.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/266: chown d4/d19/d20/d28/d2c 1 1 2024-09-16T00:50:09.381 INFO:tasks.workunit.client.1.smithi152.stdout:5/375: mkdir d6/d16/d1f/d8c 0 2024-09-16T00:50:09.385 INFO:tasks.workunit.client.1.smithi152.stdout:3/257: mknod dc/d10/d17/d1c/d1f/d22/d2c/c4a 0 2024-09-16T00:50:09.387 INFO:tasks.workunit.client.1.smithi152.stdout:5/376: read d6/ff [1116226,1015] 0 2024-09-16T00:50:09.388 INFO:tasks.workunit.client.1.smithi152.stdout:1/319: mknod d9/d3e/d41/d31/d38/c73 0 2024-09-16T00:50:09.390 INFO:tasks.workunit.client.1.smithi152.stdout:0/246: mkdir d3/d6/d51 0 2024-09-16T00:50:09.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/321: symlink d1/d4e/d48/d66/l6d 0 2024-09-16T00:50:09.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/322: read d1/fc [612198,47403] 0 2024-09-16T00:50:09.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/267: rmdir d4/d19/d20/d34 39 2024-09-16T00:50:09.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/268: fdatasync d4/f16 0 2024-09-16T00:50:09.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/269: dread d4/d19/f25 [0,4194304] 0 2024-09-16T00:50:09.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/270: dread - d4/d19/f5b zero size 2024-09-16T00:50:09.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/258: mknod dc/d10/d17/c4b 0 2024-09-16T00:50:09.399 INFO:tasks.workunit.client.1.smithi152.stdout:0/247: read d3/d6/d8/f40 [1065105,101967] 0 2024-09-16T00:50:09.399 INFO:tasks.workunit.client.1.smithi152.stdout:5/377: symlink d6/d16/d1f/d65/l8d 0 2024-09-16T00:50:09.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/323: dwrite d1/fc [0,4194304] 0 2024-09-16T00:50:09.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/324: chown d1/d4e/c6c 37097797 1 2024-09-16T00:50:09.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/271: creat d4/f5e x:0 0 0 2024-09-16T00:50:09.408 INFO:tasks.workunit.client.1.smithi152.stdout:9/325: dread d1/d14/f43 [0,4194304] 0 2024-09-16T00:50:09.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/259: symlink dc/d10/d17/d1c/d1f/d22/l4c 0 2024-09-16T00:50:09.412 INFO:tasks.workunit.client.1.smithi152.stdout:0/248: symlink d3/d6/d4e/l52 0 2024-09-16T00:50:09.413 INFO:tasks.workunit.client.1.smithi152.stdout:8/187: rmdir dd/d26 39 2024-09-16T00:50:09.416 INFO:tasks.workunit.client.1.smithi152.stdout:2/272: write d4/f16 [1257521,84543] 0 2024-09-16T00:50:09.416 INFO:tasks.workunit.client.1.smithi152.stdout:2/273: write d4/d19/f5b [532681,109293] 0 2024-09-16T00:50:09.416 INFO:tasks.workunit.client.1.smithi152.stdout:2/274: dread - d4/d19/d20/d28/d2c/d4d/f5c zero size 2024-09-16T00:50:09.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/378: mknod d6/d57/d2b/d50/c8e 0 2024-09-16T00:50:09.422 INFO:tasks.workunit.client.1.smithi152.stdout:1/320: mknod d9/da/df/c74 0 2024-09-16T00:50:09.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/275: dread d4/f15 [4194304,4194304] 0 2024-09-16T00:50:09.426 INFO:tasks.workunit.client.1.smithi152.stdout:5/379: dread d6/f1a [0,4194304] 0 2024-09-16T00:50:09.428 INFO:tasks.workunit.client.1.smithi152.stdout:3/260: dwrite dc/d10/d17/f37 [0,4194304] 0 2024-09-16T00:50:09.430 INFO:tasks.workunit.client.1.smithi152.stdout:6/263: sync 2024-09-16T00:50:09.432 INFO:tasks.workunit.client.1.smithi152.stdout:9/326: truncate d1/d7/d13/d5d/f6b 3645981 0 2024-09-16T00:50:09.435 INFO:tasks.workunit.client.1.smithi152.stdout:0/249: symlink d3/d6/d8/d1d/d23/d25/d45/d47/l53 0 2024-09-16T00:50:09.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/188: fsync dd/de/f2b 0 2024-09-16T00:50:09.442 INFO:tasks.workunit.client.1.smithi152.stdout:0/250: dread d3/f21 [0,4194304] 0 2024-09-16T00:50:09.442 INFO:tasks.workunit.client.1.smithi152.stdout:9/327: write d1/d14/d32/f35 [1067609,37725] 0 2024-09-16T00:50:09.442 INFO:tasks.workunit.client.1.smithi152.stdout:9/328: chown d1/fb 27972679 1 2024-09-16T00:50:09.445 INFO:tasks.workunit.client.1.smithi152.stdout:0/251: dread d3/d6/d8/d1d/f36 [0,4194304] 0 2024-09-16T00:50:09.445 INFO:tasks.workunit.client.1.smithi152.stdout:0/252: chown d3/d6/d8/f27 304 1 2024-09-16T00:50:09.446 INFO:tasks.workunit.client.1.smithi152.stdout:5/380: dwrite d6/d57/d2b/f47 [0,4194304] 0 2024-09-16T00:50:09.448 INFO:tasks.workunit.client.1.smithi152.stdout:3/261: mknod dc/d10/d17/d1c/d1f/d22/d2c/d2f/c4d 0 2024-09-16T00:50:09.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/264: mknod db/d12/d23/d4a/d33/c52 0 2024-09-16T00:50:09.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/265: creat db/d12/d23/d4a/d43/d48/f53 x:0 0 0 2024-09-16T00:50:09.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/266: write f2 [2930910,42780] 0 2024-09-16T00:50:09.457 INFO:tasks.workunit.client.1.smithi152.stdout:5/381: dread d6/d16/f27 [0,4194304] 0 2024-09-16T00:50:09.457 INFO:tasks.workunit.client.1.smithi152.stdout:9/329: write d1/fc [958962,13338] 0 2024-09-16T00:50:09.459 INFO:tasks.workunit.client.1.smithi152.stdout:9/330: dread d1/d14/d32/f49 [0,4194304] 0 2024-09-16T00:50:09.467 INFO:tasks.workunit.client.1.smithi152.stdout:5/382: dread d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:09.467 INFO:tasks.workunit.client.1.smithi152.stdout:5/383: readlink d6/d57/d2b/d50/l6d 0 2024-09-16T00:50:09.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/267: dwrite db/d12/d23/d4a/d33/f38 [0,4194304] 0 2024-09-16T00:50:09.470 INFO:tasks.workunit.client.1.smithi152.stdout:2/276: rmdir d4 39 2024-09-16T00:50:09.472 INFO:tasks.workunit.client.1.smithi152.stdout:0/253: mkdir d3/d6/d8/d1d/d23/d4b/d54 0 2024-09-16T00:50:09.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/262: creat dc/d10/d47/f4e x:0 0 0 2024-09-16T00:50:09.485 INFO:tasks.workunit.client.1.smithi152.stdout:9/331: getdents d1/d7/d13/d5d/d69 0 2024-09-16T00:50:09.487 INFO:tasks.workunit.client.1.smithi152.stdout:5/384: truncate d6/d16/f33 429472 0 2024-09-16T00:50:09.487 INFO:tasks.workunit.client.1.smithi152.stdout:5/385: chown l5 1 1 2024-09-16T00:50:09.487 INFO:tasks.workunit.client.1.smithi152.stdout:5/386: getdents d6/d16/d8b 0 2024-09-16T00:50:09.491 INFO:tasks.workunit.client.1.smithi152.stdout:6/268: mkdir db/d28/d2c/d54 0 2024-09-16T00:50:09.491 INFO:tasks.workunit.client.1.smithi152.stdout:6/269: write db/d12/d20/f3e [672094,90901] 0 2024-09-16T00:50:09.494 INFO:tasks.workunit.client.1.smithi152.stdout:2/277: rename d4/d19/f59 to d4/d19/f5f 0 2024-09-16T00:50:09.495 INFO:tasks.workunit.client.1.smithi152.stdout:2/278: readlink d4/d17/l55 0 2024-09-16T00:50:09.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/279: dread f2 [0,4194304] 0 2024-09-16T00:50:09.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/280: write d4/f9 [1815339,42431] 0 2024-09-16T00:50:09.497 INFO:tasks.workunit.client.1.smithi152.stdout:0/254: link d3/d6/f17 d3/d6/d4e/f55 0 2024-09-16T00:50:09.499 INFO:tasks.workunit.client.1.smithi152.stdout:3/263: mkdir dc/d10/d17/d4f 0 2024-09-16T00:50:09.499 INFO:tasks.workunit.client.1.smithi152.stdout:3/264: chown dc/d10/d17/d1c/d1f/d22/d2c/d2f/c4d 388173 1 2024-09-16T00:50:09.501 INFO:tasks.workunit.client.1.smithi152.stdout:8/189: getdents dd/d15 0 2024-09-16T00:50:09.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/387: dwrite d6/d16/d1f/d65/f69 [0,4194304] 0 2024-09-16T00:50:09.503 INFO:tasks.workunit.client.1.smithi152.stdout:9/332: symlink d1/d4e/l6e 0 2024-09-16T00:50:09.509 INFO:tasks.workunit.client.1.smithi152.stdout:6/270: rename db/ld to db/l55 0 2024-09-16T00:50:09.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/281: symlink d4/d19/d20/d28/d2c/l60 0 2024-09-16T00:50:09.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/255: symlink d3/d6/d8/d1d/d23/d25/d45/l56 0 2024-09-16T00:50:09.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/256: write d3/d6/d8/d1d/d23/d25/f3f [4610119,13955] 0 2024-09-16T00:50:09.522 INFO:tasks.workunit.client.1.smithi152.stdout:3/265: rename dc/d3e to dc/d10/d17/d1c/d50 0 2024-09-16T00:50:09.529 INFO:tasks.workunit.client.1.smithi152.stdout:9/333: dwrite d1/d14/d32/f35 [0,4194304] 0 2024-09-16T00:50:09.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/388: dwrite d6/d16/d1f/d6c/f88 [0,4194304] 0 2024-09-16T00:50:09.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/257: creat d3/d6/d51/f57 x:0 0 0 2024-09-16T00:50:09.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/258: write d3/d6/d8/f2c [1788389,101648] 0 2024-09-16T00:50:09.536 INFO:tasks.workunit.client.1.smithi152.stdout:3/266: symlink dc/d10/l51 0 2024-09-16T00:50:09.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/334: read d1/d4e/d34/f62 [1389575,106105] 0 2024-09-16T00:50:09.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/335: write d1/d4e/d34/f5e [901561,30340] 0 2024-09-16T00:50:09.539 INFO:tasks.workunit.client.1.smithi152.stdout:8/190: creat dd/d23/f3e x:0 0 0 2024-09-16T00:50:09.539 INFO:tasks.workunit.client.1.smithi152.stdout:8/191: creat dd/d15/d1a/f3f x:0 0 0 2024-09-16T00:50:09.541 INFO:tasks.workunit.client.1.smithi152.stdout:2/282: mknod d4/c61 0 2024-09-16T00:50:09.541 INFO:tasks.workunit.client.1.smithi152.stdout:2/283: readlink d4/d17/d3e/l43 0 2024-09-16T00:50:09.541 INFO:tasks.workunit.client.1.smithi152.stdout:2/284: stat d4/d19/d20/d28/f52 0 2024-09-16T00:50:09.547 INFO:tasks.workunit.client.1.smithi152.stdout:0/259: dwrite d3/d6/d8/d1d/d23/d25/f4d [0,4194304] 0 2024-09-16T00:50:09.555 INFO:tasks.workunit.client.1.smithi152.stdout:5/389: symlink d6/d57/d2b/d50/d6e/l8f 0 2024-09-16T00:50:09.556 INFO:tasks.workunit.client.1.smithi152.stdout:5/390: creat d6/d57/d54/f90 x:0 0 0 2024-09-16T00:50:09.560 INFO:tasks.workunit.client.1.smithi152.stdout:3/267: creat dc/d10/d17/f52 x:0 0 0 2024-09-16T00:50:09.561 INFO:tasks.workunit.client.1.smithi152.stdout:9/336: mknod d1/d7/c6f 0 2024-09-16T00:50:09.561 INFO:tasks.workunit.client.1.smithi152.stdout:2/285: dwrite d4/d19/f25 [0,4194304] 0 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:5/391: dread d6/f1a [0,4194304] 0 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:5/392: chown d6/cd 262425636 1 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:2/286: chown d4/d44/f48 1 1 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:2/287: truncate d4/d19/d20/d28/f2a 401198 0 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:5/393: write d6/d57/d54/f90 [931421,90470] 0 2024-09-16T00:50:09.562 INFO:tasks.workunit.client.1.smithi152.stdout:5/394: readlink d6/d57/d2b/d50/d66/l75 0 2024-09-16T00:50:09.565 INFO:tasks.workunit.client.1.smithi152.stdout:8/192: dread - dd/d26/d29/d2f/f35 zero size 2024-09-16T00:50:09.565 INFO:tasks.workunit.client.1.smithi152.stdout:8/193: chown dd/d26/d29/d2f/l32 47303 1 2024-09-16T00:50:09.571 INFO:tasks.workunit.client.1.smithi152.stdout:0/260: mkdir d3/d6/d2e/d58 0 2024-09-16T00:50:09.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/261: stat d3/d6/d8 0 2024-09-16T00:50:09.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/262: readlink d3/d6/d4e/l52 0 2024-09-16T00:50:09.577 INFO:tasks.workunit.client.1.smithi152.stdout:3/268: creat dc/d10/d17/d1c/d1f/d22/f53 x:0 0 0 2024-09-16T00:50:09.581 INFO:tasks.workunit.client.1.smithi152.stdout:4/409: sync 2024-09-16T00:50:09.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/321: sync 2024-09-16T00:50:09.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/277: sync 2024-09-16T00:50:09.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/322: chown d9/d3e/f49 42 1 2024-09-16T00:50:09.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/323: dread - d9/d3e/d41/f4e zero size 2024-09-16T00:50:09.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/278: write d9/d10/d30/d41/f62 [161365,124335] 0 2024-09-16T00:50:09.584 INFO:tasks.workunit.client.1.smithi152.stdout:8/194: symlink dd/d26/d29/d2f/l40 0 2024-09-16T00:50:09.585 INFO:tasks.workunit.client.1.smithi152.stdout:0/263: read d3/d6/f2f [3567480,25032] 0 2024-09-16T00:50:09.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/269: write f5 [2689891,107847] 0 2024-09-16T00:50:09.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/410: truncate d2/d1e/d28/d29/f1c 1726301 0 2024-09-16T00:50:09.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/411: dread - d2/f56 zero size 2024-09-16T00:50:09.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/288: dwrite f2 [0,4194304] 0 2024-09-16T00:50:09.590 INFO:tasks.workunit.client.1.smithi152.stdout:9/337: dwrite d1/d4e/d48/d26/d30/f3f [4194304,4194304] 0 2024-09-16T00:50:09.591 INFO:tasks.workunit.client.1.smithi152.stdout:1/324: unlink d9/d3e/d4b/f51 0 2024-09-16T00:50:09.593 INFO:tasks.workunit.client.1.smithi152.stdout:7/279: symlink d9/d10/d30/l6a 0 2024-09-16T00:50:09.593 INFO:tasks.workunit.client.1.smithi152.stdout:7/280: fsync d9/d10/d30/f3b 0 2024-09-16T00:50:09.594 INFO:tasks.workunit.client.1.smithi152.stdout:5/395: dwrite d6/f32 [0,4194304] 0 2024-09-16T00:50:09.595 INFO:tasks.workunit.client.1.smithi152.stdout:5/396: chown d6/d16/d1f/l51 20 1 2024-09-16T00:50:09.595 INFO:tasks.workunit.client.1.smithi152.stdout:5/397: dread - d6/d16/d1f/d65/f89 zero size 2024-09-16T00:50:09.595 INFO:tasks.workunit.client.1.smithi152.stdout:8/195: unlink dd/d15/c17 0 2024-09-16T00:50:09.595 INFO:tasks.workunit.client.1.smithi152.stdout:8/196: chown dd/de 454399224 1 2024-09-16T00:50:09.595 INFO:tasks.workunit.client.1.smithi152.stdout:5/398: dread d6/f2d [0,4194304] 0 2024-09-16T00:50:09.597 INFO:tasks.workunit.client.1.smithi152.stdout:3/270: truncate f8 12227348 0 2024-09-16T00:50:09.602 INFO:tasks.workunit.client.1.smithi152.stdout:2/289: creat d4/d17/f62 x:0 0 0 2024-09-16T00:50:09.606 INFO:tasks.workunit.client.1.smithi152.stdout:7/281: mkdir d9/d31/d65/d6b 0 2024-09-16T00:50:09.612 INFO:tasks.workunit.client.1.smithi152.stdout:8/197: mknod dd/de/c41 0 2024-09-16T00:50:09.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/325: dwrite d9/d3e/d41/f2f [0,4194304] 0 2024-09-16T00:50:09.614 INFO:tasks.workunit.client.1.smithi152.stdout:0/264: dwrite d3/d6/d8/d1d/f20 [0,4194304] 0 2024-09-16T00:50:09.614 INFO:tasks.workunit.client.1.smithi152.stdout:5/399: link d6/d16/d1f/f56 d6/d57/d54/f91 0 2024-09-16T00:50:09.616 INFO:tasks.workunit.client.1.smithi152.stdout:4/412: mknod d2/db/d39/d3c/c7e 0 2024-09-16T00:50:09.618 INFO:tasks.workunit.client.1.smithi152.stdout:3/271: dwrite dc/d10/d17/d1c/d1f/f49 [0,4194304] 0 2024-09-16T00:50:09.619 INFO:tasks.workunit.client.1.smithi152.stdout:2/290: symlink d4/d44/l63 0 2024-09-16T00:50:09.619 INFO:tasks.workunit.client.1.smithi152.stdout:2/291: readlink d4/d17/d3e/l43 0 2024-09-16T00:50:09.619 INFO:tasks.workunit.client.1.smithi152.stdout:2/292: fsync d4/d19/f4f 0 2024-09-16T00:50:09.622 INFO:tasks.workunit.client.1.smithi152.stdout:7/282: symlink d9/d31/d64/d3c/d5b/l6c 0 2024-09-16T00:50:09.622 INFO:tasks.workunit.client.1.smithi152.stdout:7/283: read - d9/d31/f5f zero size 2024-09-16T00:50:09.627 INFO:tasks.workunit.client.1.smithi152.stdout:8/198: dread dd/d26/d29/d2f/f31 [0,4194304] 0 2024-09-16T00:50:09.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/284: write d9/d31/d65/f59 [4120437,15943] 0 2024-09-16T00:50:09.634 INFO:tasks.workunit.client.1.smithi152.stdout:7/285: chown d9/d31/d64/d3c/c63 111167847 1 2024-09-16T00:50:09.634 INFO:tasks.workunit.client.1.smithi152.stdout:9/338: dwrite d1/d4e/d48/f3d [0,4194304] 0 2024-09-16T00:50:09.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/326: creat d9/da/df/f75 x:0 0 0 2024-09-16T00:50:09.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/327: fsync d9/d3e/d41/d31/d48/d4a/f5b 0 2024-09-16T00:50:09.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/328: write d9/d3e/d41/d31/d48/f6e [5068292,129123] 0 2024-09-16T00:50:09.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/329: chown d9/da/df/f46 0 1 2024-09-16T00:50:09.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/330: fdatasync d9/da/df/f47 0 2024-09-16T00:50:09.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/331: chown d9/d3e/d41/d31/f44 3192 1 2024-09-16T00:50:09.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/265: mknod d3/d6/d8/c59 0 2024-09-16T00:50:09.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/266: readlink d3/d6/ld 0 2024-09-16T00:50:09.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/267: write d3/d6/d8/d1d/f49 [918836,33964] 0 2024-09-16T00:50:09.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/268: write d3/d6/d8/ff [2801373,24104] 0 2024-09-16T00:50:09.644 INFO:tasks.workunit.client.1.smithi152.stdout:9/339: read d1/d7/f18 [350127,90160] 0 2024-09-16T00:50:09.646 INFO:tasks.workunit.client.1.smithi152.stdout:9/340: dread d1/d4e/d34/f62 [0,4194304] 0 2024-09-16T00:50:09.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/293: symlink d4/d44/l64 0 2024-09-16T00:50:09.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/272: dwrite dc/d10/f31 [0,4194304] 0 2024-09-16T00:50:09.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/273: chown dc/d10/d17/c4b 22798152 1 2024-09-16T00:50:09.655 INFO:tasks.workunit.client.1.smithi152.stdout:4/413: dwrite d2/db/d39/d3c/f75 [0,4194304] 0 2024-09-16T00:50:09.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/341: dread d1/ff [0,4194304] 0 2024-09-16T00:50:09.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/342: chown d1/d4e 27492656 1 2024-09-16T00:50:09.655 INFO:tasks.workunit.client.1.smithi152.stdout:4/414: stat d2/d1e/d28/d29/d32/c65 0 2024-09-16T00:50:09.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/199: creat dd/f42 x:0 0 0 2024-09-16T00:50:09.669 INFO:tasks.workunit.client.1.smithi152.stdout:2/294: dwrite d4/d19/f5b [0,4194304] 0 2024-09-16T00:50:09.669 INFO:tasks.workunit.client.1.smithi152.stdout:2/295: write d4/d19/f27 [2649247,35088] 0 2024-09-16T00:50:09.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/286: truncate d9/d10/f12 1603198 0 2024-09-16T00:50:09.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/287: truncate d9/d31/f67 50482 0 2024-09-16T00:50:09.670 INFO:tasks.workunit.client.1.smithi152.stdout:9/343: dwrite d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:09.679 INFO:tasks.workunit.client.1.smithi152.stdout:1/332: rename d9/da/df/f11 to d9/d3e/d4b/d50/f76 0 2024-09-16T00:50:09.680 INFO:tasks.workunit.client.1.smithi152.stdout:1/333: write d9/d3e/d4b/f5f [162363,58614] 0 2024-09-16T00:50:09.684 INFO:tasks.workunit.client.1.smithi152.stdout:3/274: mkdir dc/d10/d17/d4f/d54 0 2024-09-16T00:50:09.689 INFO:tasks.workunit.client.1.smithi152.stdout:3/275: write dc/d10/d17/d1c/d1f/d22/d2c/f2e [1362783,72140] 0 2024-09-16T00:50:09.697 INFO:tasks.workunit.client.1.smithi152.stdout:4/415: dread d2/db/f2c [0,4194304] 0 2024-09-16T00:50:09.697 INFO:tasks.workunit.client.1.smithi152.stdout:8/200: link dd/de/f13 dd/d15/d1a/f43 0 2024-09-16T00:50:09.699 INFO:tasks.workunit.client.1.smithi152.stdout:3/276: dread dc/f35 [0,4194304] 0 2024-09-16T00:50:09.701 INFO:tasks.workunit.client.1.smithi152.stdout:4/416: dread d2/d1e/f64 [0,4194304] 0 2024-09-16T00:50:09.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/296: symlink d4/d17/l65 0 2024-09-16T00:50:09.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/288: mknod d9/d10/d30/d41/d46/c6d 0 2024-09-16T00:50:09.709 INFO:tasks.workunit.client.1.smithi152.stdout:9/344: link d1/d14/f43 d1/d4e/d48/d2b/f70 0 2024-09-16T00:50:09.710 INFO:tasks.workunit.client.1.smithi152.stdout:6/271: sync 2024-09-16T00:50:09.716 INFO:tasks.workunit.client.1.smithi152.stdout:8/201: dwrite dd/f42 [0,4194304] 0 2024-09-16T00:50:09.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/269: rename d3/d6/c13 to d3/d6/d8/d1d/d23/d4b/d54/c5a 0 2024-09-16T00:50:09.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/270: creat d3/d6/d8/d1d/d23/d25/d2a/f5b x:0 0 0 2024-09-16T00:50:09.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/271: write d3/d6/d8/f40 [4651060,76848] 0 2024-09-16T00:50:09.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/277: mkdir dc/d10/d17/d1c/d50/d55 0 2024-09-16T00:50:09.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/417: mkdir d2/db/d39/d3c/d7f 0 2024-09-16T00:50:09.727 INFO:tasks.workunit.client.1.smithi152.stdout:2/297: mkdir d4/d19/d20/d28/d2c/d5a/d66 0 2024-09-16T00:50:09.727 INFO:tasks.workunit.client.1.smithi152.stdout:2/298: write d4/d19/d20/f47 [267903,96729] 0 2024-09-16T00:50:09.729 INFO:tasks.workunit.client.1.smithi152.stdout:0/272: dwrite d3/d6/d4e/f55 [0,4194304] 0 2024-09-16T00:50:09.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/289: creat d9/d10/d30/d41/d46/f6e x:0 0 0 2024-09-16T00:50:09.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/290: dread - d9/d31/d64/d3c/f44 zero size 2024-09-16T00:50:09.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/291: dread - d9/d31/d65/f69 zero size 2024-09-16T00:50:09.732 INFO:tasks.workunit.client.1.smithi152.stdout:9/345: rmdir d1/d4e/d48/d26/d30 39 2024-09-16T00:50:09.732 INFO:tasks.workunit.client.1.smithi152.stdout:9/346: fsync d1/fb 0 2024-09-16T00:50:09.735 INFO:tasks.workunit.client.1.smithi152.stdout:6/272: mknod db/d12/d20/d4b/c56 0 2024-09-16T00:50:09.741 INFO:tasks.workunit.client.1.smithi152.stdout:7/292: dread d9/d31/d64/d3c/f5a [0,4194304] 0 2024-09-16T00:50:09.742 INFO:tasks.workunit.client.1.smithi152.stdout:2/299: dwrite d4/f15 [8388608,4194304] 0 2024-09-16T00:50:09.743 INFO:tasks.workunit.client.1.smithi152.stdout:2/300: truncate d4/d44/f48 741383 0 2024-09-16T00:50:09.762 INFO:tasks.workunit.client.1.smithi152.stdout:2/301: write d4/d17/f3b [3984856,9417] 0 2024-09-16T00:50:09.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/347: dwrite d1/f44 [0,4194304] 0 2024-09-16T00:50:09.762 INFO:tasks.workunit.client.1.smithi152.stdout:2/302: chown d4/d19/f5b 1429756 1 2024-09-16T00:50:09.762 INFO:tasks.workunit.client.1.smithi152.stdout:2/303: dread - d4/d19/f5f zero size 2024-09-16T00:50:09.764 INFO:tasks.workunit.client.1.smithi152.stdout:0/273: mkdir d3/d6/d8/d1d/d23/d25/d2a/d5c 0 2024-09-16T00:50:09.767 INFO:tasks.workunit.client.1.smithi152.stdout:6/273: link db/f18 db/d12/d23/d4a/d43/f57 0 2024-09-16T00:50:09.767 INFO:tasks.workunit.client.1.smithi152.stdout:6/274: chown db/d12/f3d 4 1 2024-09-16T00:50:09.767 INFO:tasks.workunit.client.1.smithi152.stdout:8/202: dwrite dd/ff [0,4194304] 0 2024-09-16T00:50:09.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/278: rename dc to dc/d10/d17/d1c/d1f/d22/d2c/d3b/d56 22 2024-09-16T00:50:09.770 INFO:tasks.workunit.client.1.smithi152.stdout:1/334: rename d9/f37 to d9/da/df/f77 0 2024-09-16T00:50:09.770 INFO:tasks.workunit.client.1.smithi152.stdout:8/203: dread dd/de/f21 [0,4194304] 0 2024-09-16T00:50:09.772 INFO:tasks.workunit.client.1.smithi152.stdout:7/293: unlink d9/d31/d64/d3c/f5a 0 2024-09-16T00:50:09.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/418: dwrite d2/db/d44/f50 [0,4194304] 0 2024-09-16T00:50:09.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/419: read - d2/db/d39/d3c/f77 zero size 2024-09-16T00:50:09.789 INFO:tasks.workunit.client.1.smithi152.stdout:9/348: symlink d1/d59/l71 0 2024-09-16T00:50:09.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/304: rename d4/d17/l55 to d4/d17/l67 0 2024-09-16T00:50:09.793 INFO:tasks.workunit.client.1.smithi152.stdout:0/274: symlink d3/d6/d2e/d58/l5d 0 2024-09-16T00:50:09.795 INFO:tasks.workunit.client.1.smithi152.stdout:0/275: write d3/d6/d8/f3d [1380909,41422] 0 2024-09-16T00:50:09.796 INFO:tasks.workunit.client.1.smithi152.stdout:6/275: mknod db/d28/d2c/c58 0 2024-09-16T00:50:09.796 INFO:tasks.workunit.client.1.smithi152.stdout:6/276: write db/fc [2149379,29637] 0 2024-09-16T00:50:09.799 INFO:tasks.workunit.client.1.smithi152.stdout:3/279: stat dc/c36 0 2024-09-16T00:50:09.799 INFO:tasks.workunit.client.1.smithi152.stdout:3/280: stat dc/d10/l51 0 2024-09-16T00:50:09.799 INFO:tasks.workunit.client.1.smithi152.stdout:3/281: chown dc/d10/d17/d1c/d1f/c20 74490754 1 2024-09-16T00:50:09.799 INFO:tasks.workunit.client.1.smithi152.stdout:3/282: fsync dc/d10/d17/f52 0 2024-09-16T00:50:09.799 INFO:tasks.workunit.client.1.smithi152.stdout:3/283: write dc/f3d [185027,9748] 0 2024-09-16T00:50:09.802 INFO:tasks.workunit.client.1.smithi152.stdout:1/335: rename d9/d3e/d41/l67 to d9/d3e/d41/l78 0 2024-09-16T00:50:09.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/204: mknod dd/d26/d29/c44 0 2024-09-16T00:50:09.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/205: creat dd/d15/d1a/f45 x:0 0 0 2024-09-16T00:50:09.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/206: stat dd/de/l33 0 2024-09-16T00:50:09.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/207: write dd/d26/d29/d2f/f35 [863218,102794] 0 2024-09-16T00:50:09.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/208: fsync dd/d26/d29/d2f/f3d 0 2024-09-16T00:50:09.805 INFO:tasks.workunit.client.1.smithi152.stdout:6/277: write db/d12/f14 [3758908,13793] 0 2024-09-16T00:50:09.805 INFO:tasks.workunit.client.1.smithi152.stdout:7/294: symlink d9/d31/d64/l6f 0 2024-09-16T00:50:09.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/278: dread db/d12/d23/d4a/d43/f57 [4194304,4194304] 0 2024-09-16T00:50:09.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/279: chown db/d12/l17 78512087 1 2024-09-16T00:50:09.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/420: mknod d2/d1e/d28/d29/d32/c80 0 2024-09-16T00:50:09.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/349: mknod d1/d59/c72 0 2024-09-16T00:50:09.822 INFO:tasks.workunit.client.1.smithi152.stdout:2/305: rename d4/f7 to d4/d19/d20/d28/f68 0 2024-09-16T00:50:09.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/276: getdents d3/d6/d8/d1d/d23/d25/d45/d47 0 2024-09-16T00:50:09.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/277: creat d3/d6/d51/f5e x:0 0 0 2024-09-16T00:50:09.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/278: write d3/d6/d8/d1d/f26 [173635,35351] 0 2024-09-16T00:50:09.827 INFO:tasks.workunit.client.1.smithi152.stdout:3/284: creat dc/d10/d17/d1c/d1f/d22/d2c/d3b/f57 x:0 0 0 2024-09-16T00:50:09.829 INFO:tasks.workunit.client.1.smithi152.stdout:1/336: creat d9/d3e/d4b/d6b/f79 x:0 0 0 2024-09-16T00:50:09.833 INFO:tasks.workunit.client.1.smithi152.stdout:8/209: creat dd/d26/d29/f46 x:0 0 0 2024-09-16T00:50:09.834 INFO:tasks.workunit.client.1.smithi152.stdout:6/280: stat db/d12/d1c/l25 0 2024-09-16T00:50:09.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/421: symlink d2/db/d39/d3c/d7f/l81 0 2024-09-16T00:50:09.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/422: chown d2/d1e/d28/d29/d32/c80 0 1 2024-09-16T00:50:09.842 INFO:tasks.workunit.client.1.smithi152.stdout:9/350: rename d1/d59/f5c to d1/d7/d13/f73 0 2024-09-16T00:50:09.847 INFO:tasks.workunit.client.1.smithi152.stdout:3/285: rmdir dc/d10/d17/d1c 39 2024-09-16T00:50:09.847 INFO:tasks.workunit.client.1.smithi152.stdout:3/286: write f3 [4391860,68279] 0 2024-09-16T00:50:09.847 INFO:tasks.workunit.client.1.smithi152.stdout:3/287: chown dc/d10/d17/d1c/d50/d55 606 1 2024-09-16T00:50:09.850 INFO:tasks.workunit.client.1.smithi152.stdout:4/423: dread d2/db/d39/d3c/f75 [0,4194304] 0 2024-09-16T00:50:09.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/337: link d9/da/df/c28 d9/c7a 0 2024-09-16T00:50:09.858 INFO:tasks.workunit.client.1.smithi152.stdout:0/279: rename d3/d6/d8/d1d/f36 to d3/d6/d8/d1d/d23/d25/d45/f5f 0 2024-09-16T00:50:09.860 INFO:tasks.workunit.client.1.smithi152.stdout:1/338: write d9/d3e/d41/d31/d48/f55 [1440507,123007] 0 2024-09-16T00:50:09.860 INFO:tasks.workunit.client.1.smithi152.stdout:9/351: unlink d1/d4e/l6e 0 2024-09-16T00:50:09.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/424: creat d2/db/d39/d3c/d76/f82 x:0 0 0 2024-09-16T00:50:09.867 INFO:tasks.workunit.client.1.smithi152.stdout:9/352: dread d1/d14/f33 [0,4194304] 0 2024-09-16T00:50:09.867 INFO:tasks.workunit.client.1.smithi152.stdout:9/353: fdatasync d1/ff 0 2024-09-16T00:50:09.868 INFO:tasks.workunit.client.1.smithi152.stdout:0/280: mknod d3/c60 0 2024-09-16T00:50:09.871 INFO:tasks.workunit.client.1.smithi152.stdout:4/425: mknod d2/d1e/d28/c83 0 2024-09-16T00:50:09.872 INFO:tasks.workunit.client.1.smithi152.stdout:4/426: write d2/d1e/d28/d69/f5b [1017421,107912] 0 2024-09-16T00:50:09.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/281: mkdir d3/d6/d8/d1d/d23/d25/d45/d47/d61 0 2024-09-16T00:50:09.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/282: chown d3/d6/d8/d1d/f49 10205 1 2024-09-16T00:50:09.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/283: creat d3/d6/d8/d1d/d23/f62 x:0 0 0 2024-09-16T00:50:09.901 INFO:tasks.workunit.client.1.smithi152.stdout:5/400: sync 2024-09-16T00:50:09.907 INFO:tasks.workunit.client.1.smithi152.stdout:1/339: write d9/d3e/d41/d31/d48/d4a/f54 [281007,4147] 0 2024-09-16T00:50:09.912 INFO:tasks.workunit.client.1.smithi152.stdout:6/281: dread fa [0,4194304] 0 2024-09-16T00:50:09.912 INFO:tasks.workunit.client.1.smithi152.stdout:5/401: write d6/f30 [3383513,11652] 0 2024-09-16T00:50:09.922 INFO:tasks.workunit.client.1.smithi152.stdout:4/427: dread d2/d1e/f37 [0,4194304] 0 2024-09-16T00:50:09.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/340: write d9/f19 [2516469,38215] 0 2024-09-16T00:50:09.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/428: creat d2/d1e/f84 x:0 0 0 2024-09-16T00:50:09.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/429: dread - d2/db/d39/f31 zero size 2024-09-16T00:50:09.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/430: creat d2/db/d39/d3c/f85 x:0 0 0 2024-09-16T00:50:09.926 INFO:tasks.workunit.client.1.smithi152.stdout:5/402: rmdir d6/d16/d1f/d6c 39 2024-09-16T00:50:09.926 INFO:tasks.workunit.client.1.smithi152.stdout:2/306: dwrite d4/d19/f27 [0,4194304] 0 2024-09-16T00:50:09.926 INFO:tasks.workunit.client.1.smithi152.stdout:2/307: readlink d4/d44/l63 0 2024-09-16T00:50:09.927 INFO:tasks.workunit.client.1.smithi152.stdout:3/288: dwrite dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 [4194304,4194304] 0 2024-09-16T00:50:09.927 INFO:tasks.workunit.client.1.smithi152.stdout:6/282: write db/d12/d23/d4a/d33/f38 [2497338,78108] 0 2024-09-16T00:50:09.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/354: dwrite d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:09.927 INFO:tasks.workunit.client.1.smithi152.stdout:6/283: read db/f31 [3280490,55114] 0 2024-09-16T00:50:09.929 INFO:tasks.workunit.client.1.smithi152.stdout:1/341: mkdir d9/d3e/d7b 0 2024-09-16T00:50:09.933 INFO:tasks.workunit.client.1.smithi152.stdout:4/431: mknod d2/d1e/d28/d29/d32/c86 0 2024-09-16T00:50:09.934 INFO:tasks.workunit.client.1.smithi152.stdout:5/403: mkdir d6/d57/d2b/d50/d64/d92 0 2024-09-16T00:50:09.935 INFO:tasks.workunit.client.1.smithi152.stdout:2/308: write d4/d19/f5b [520294,123436] 0 2024-09-16T00:50:09.937 INFO:tasks.workunit.client.1.smithi152.stdout:1/342: dread d9/da/df/f77 [0,4194304] 0 2024-09-16T00:50:09.937 INFO:tasks.workunit.client.1.smithi152.stdout:1/343: dread - d9/d3e/f56 zero size 2024-09-16T00:50:09.937 INFO:tasks.workunit.client.1.smithi152.stdout:1/344: write d9/da/f68 [411216,124544] 0 2024-09-16T00:50:09.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/289: mkdir dc/d10/d47/d58 0 2024-09-16T00:50:09.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/290: chown dc/d10/d17/d1c/d1f/d22/f53 14784654 1 2024-09-16T00:50:09.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:09 smithi152 ceph-mon[33237]: pgmap v5: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:09.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:09 smithi152 ceph-mon[33237]: mgrmap e24: smithi152.nlmwrx(active, since 4s) 2024-09-16T00:50:09.948 INFO:tasks.workunit.client.1.smithi152.stdout:8/210: rmdir dd/d15 39 2024-09-16T00:50:09.948 INFO:tasks.workunit.client.1.smithi152.stdout:2/309: dwrite d4/d19/d20/d28/d2c/f54 [0,4194304] 0 2024-09-16T00:50:09.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/355: mkdir d1/d74 0 2024-09-16T00:50:09.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/284: rename db/d28/d2c/d54 to db/d12/d23/d4a/d43/d59 0 2024-09-16T00:50:09.961 INFO:tasks.workunit.client.1.smithi152.stdout:4/432: symlink d2/d1e/d28/d69/l87 0 2024-09-16T00:50:09.962 INFO:tasks.workunit.client.1.smithi152.stdout:5/404: mknod d6/d57/d2b/d50/d6e/c93 0 2024-09-16T00:50:09.964 INFO:tasks.workunit.client.1.smithi152.stdout:5/405: write d6/d57/d54/f90 [162469,44645] 0 2024-09-16T00:50:09.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/345: mkdir d9/d3e/d7c 0 2024-09-16T00:50:09.971 INFO:tasks.workunit.client.1.smithi152.stdout:8/211: fdatasync dd/f16 0 2024-09-16T00:50:09.972 INFO:tasks.workunit.client.1.smithi152.stdout:5/406: dread d6/d57/f3c [0,4194304] 0 2024-09-16T00:50:09.975 INFO:tasks.workunit.client.1.smithi152.stdout:4/433: dwrite d2/d1e/d28/d29/f5c [0,4194304] 0 2024-09-16T00:50:09.975 INFO:tasks.workunit.client.1.smithi152.stdout:4/434: creat d2/d1e/d28/d29/d32/f88 x:0 0 0 2024-09-16T00:50:09.978 INFO:tasks.workunit.client.1.smithi152.stdout:2/310: truncate d4/d19/f49 1002983 0 2024-09-16T00:50:09.985 INFO:tasks.workunit.client.1.smithi152.stdout:6/285: truncate db/f1e 1026164 0 2024-09-16T00:50:09.987 INFO:tasks.workunit.client.1.smithi152.stdout:4/435: dwrite d2/db/d39/d3c/f7c [0,4194304] 0 2024-09-16T00:50:09.990 INFO:tasks.workunit.client.1.smithi152.stdout:1/346: mkdir d9/d3e/d41/d31/d48/d7d 0 2024-09-16T00:50:10.002 INFO:tasks.workunit.client.1.smithi152.stdout:5/407: truncate d6/d16/d1f/d65/f69 637742 0 2024-09-16T00:50:10.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/212: dread dd/d15/d1a/f3a [0,4194304] 0 2024-09-16T00:50:10.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/213: creat dd/d26/d29/f47 x:0 0 0 2024-09-16T00:50:10.011 INFO:tasks.workunit.client.1.smithi152.stdout:2/311: link d4/d17/f1d d4/d19/d20/d28/d2c/d4d/f69 0 2024-09-16T00:50:10.014 INFO:tasks.workunit.client.1.smithi152.stdout:6/286: creat db/d12/d23/d4a/f5a x:0 0 0 2024-09-16T00:50:10.014 INFO:tasks.workunit.client.1.smithi152.stdout:6/287: write db/d12/d1c/f3f [395143,33431] 0 2024-09-16T00:50:10.019 INFO:tasks.workunit.client.1.smithi152.stdout:4/436: creat d2/db/f89 x:0 0 0 2024-09-16T00:50:10.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/408: dwrite d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:10.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/409: fdatasync d6/d57/d54/f84 0 2024-09-16T00:50:10.026 INFO:tasks.workunit.client.1.smithi152.stdout:8/214: creat dd/d25/f48 x:0 0 0 2024-09-16T00:50:10.026 INFO:tasks.workunit.client.1.smithi152.stdout:8/215: stat dd/d26/d29/f46 0 2024-09-16T00:50:10.026 INFO:tasks.workunit.client.1.smithi152.stdout:2/312: mknod d4/d19/c6a 0 2024-09-16T00:50:10.029 INFO:tasks.workunit.client.1.smithi152.stdout:6/288: mknod db/d12/d23/d3a/c5b 0 2024-09-16T00:50:10.031 INFO:tasks.workunit.client.1.smithi152.stdout:4/437: truncate d2/d1e/f37 2151717 0 2024-09-16T00:50:10.038 INFO:tasks.workunit.client.1.smithi152.stdout:5/410: dwrite d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:10.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/347: rename d9/da/df/c6a to d9/da/df/c7e 0 2024-09-16T00:50:10.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:09 smithi053 ceph-mon[27950]: pgmap v5: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:10.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:09 smithi053 ceph-mon[27950]: mgrmap e24: smithi152.nlmwrx(active, since 4s) 2024-09-16T00:50:10.084 INFO:tasks.workunit.client.1.smithi152.stdout:3/291: rmdir dc 39 2024-09-16T00:50:10.084 INFO:tasks.workunit.client.1.smithi152.stdout:3/292: write f8 [13140959,38352] 0 2024-09-16T00:50:10.086 INFO:tasks.workunit.client.1.smithi152.stdout:1/348: dwrite d9/da/f1d [0,4194304] 0 2024-09-16T00:50:10.101 INFO:tasks.workunit.client.1.smithi152.stdout:1/349: dwrite d9/d3e/d41/f60 [0,4194304] 0 2024-09-16T00:50:10.101 INFO:tasks.workunit.client.1.smithi152.stdout:1/350: dread - d9/d3e/d41/d31/d48/f70 zero size 2024-09-16T00:50:10.120 INFO:tasks.workunit.client.1.smithi152.stdout:2/313: dwrite d4/d19/f49 [0,4194304] 0 2024-09-16T00:50:10.129 INFO:tasks.workunit.client.1.smithi152.stdout:5/411: write d6/d16/d1f/d65/f69 [276650,10346] 0 2024-09-16T00:50:10.130 INFO:tasks.workunit.client.1.smithi152.stdout:5/412: chown d6/d16/l1c 9292007 1 2024-09-16T00:50:10.130 INFO:tasks.workunit.client.1.smithi152.stdout:5/413: readlink d6/d57/d2b/d50/d66/l7e 0 2024-09-16T00:50:10.130 INFO:tasks.workunit.client.1.smithi152.stdout:5/414: readlink d6/l15 0 2024-09-16T00:50:10.148 INFO:tasks.workunit.client.1.smithi152.stdout:5/415: dwrite d6/d16/f4d [0,4194304] 0 2024-09-16T00:50:10.151 INFO:tasks.workunit.client.1.smithi152.stdout:6/289: getdents db/d12/d23/d3a 0 2024-09-16T00:50:10.169 INFO:tasks.workunit.client.1.smithi152.stdout:3/293: creat dc/d10/d17/f59 x:0 0 0 2024-09-16T00:50:10.169 INFO:tasks.workunit.client.1.smithi152.stdout:6/290: dwrite db/d28/f3c [0,4194304] 0 2024-09-16T00:50:10.178 INFO:tasks.workunit.client.1.smithi152.stdout:1/351: creat d9/d3e/d7b/f7f x:0 0 0 2024-09-16T00:50:10.186 INFO:tasks.workunit.client.1.smithi152.stdout:2/314: mknod d4/d19/d20/d28/d2c/d4d/c6b 0 2024-09-16T00:50:10.196 INFO:tasks.workunit.client.1.smithi152.stdout:5/416: creat d6/d16/d1f/d8c/f94 x:0 0 0 2024-09-16T00:50:10.196 INFO:tasks.workunit.client.1.smithi152.stdout:5/417: dread - d6/d16/d1f/f56 zero size 2024-09-16T00:50:10.201 INFO:tasks.workunit.client.1.smithi152.stdout:1/352: dwrite d9/da/df/f30 [0,4194304] 0 2024-09-16T00:50:10.202 INFO:tasks.workunit.client.1.smithi152.stdout:2/315: mknod d4/d19/d20/d28/d2c/d4d/c6c 0 2024-09-16T00:50:10.207 INFO:tasks.workunit.client.1.smithi152.stdout:5/418: creat d6/d57/d2b/d50/d64/d92/f95 x:0 0 0 2024-09-16T00:50:10.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/316: dwrite d4/d19/f5b [0,4194304] 0 2024-09-16T00:50:10.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/317: truncate d4/d17/f3a 530747 0 2024-09-16T00:50:10.226 INFO:tasks.workunit.client.1.smithi152.stdout:2/318: fdatasync d4/d44/f48 0 2024-09-16T00:50:10.228 INFO:tasks.workunit.client.1.smithi152.stdout:1/353: dwrite d9/da/df/f27 [0,4194304] 0 2024-09-16T00:50:10.230 INFO:tasks.workunit.client.1.smithi152.stdout:2/319: symlink d4/d19/d20/d28/d2c/d5a/l6d 0 2024-09-16T00:50:10.237 INFO:tasks.workunit.client.1.smithi152.stdout:2/320: link d4/c61 d4/d19/c6e 0 2024-09-16T00:50:10.237 INFO:tasks.workunit.client.1.smithi152.stdout:2/321: write d4/d19/d20/f47 [624962,5672] 0 2024-09-16T00:50:10.243 INFO:tasks.workunit.client.1.smithi152.stdout:2/322: dread d4/d17/f38 [0,4194304] 0 2024-09-16T00:50:10.243 INFO:tasks.workunit.client.1.smithi152.stdout:2/323: write d4/d19/d20/d28/d2c/f31 [3220323,16998] 0 2024-09-16T00:50:10.243 INFO:tasks.workunit.client.1.smithi152.stdout:2/324: write d4/d19/f4f [679168,70717] 0 2024-09-16T00:50:10.249 INFO:tasks.workunit.client.1.smithi152.stdout:2/325: link d4/d44/l63 d4/d17/d3e/l6f 0 2024-09-16T00:50:10.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/326: mknod d4/d19/d20/d28/d2c/d4d/c70 0 2024-09-16T00:50:10.337 INFO:tasks.workunit.client.1.smithi152.stdout:4/438: symlink d2/d1e/d28/d29/d32/l8a 0 2024-09-16T00:50:10.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/439: dwrite d2/db/d39/d3c/f48 [0,4194304] 0 2024-09-16T00:50:10.356 INFO:tasks.workunit.client.1.smithi152.stdout:4/440: dread d2/db/d39/d3c/f58 [0,4194304] 0 2024-09-16T00:50:10.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/441: mkdir d2/db/d39/d3c/d7f/d8b 0 2024-09-16T00:50:10.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/442: stat d2/d1e/c67 0 2024-09-16T00:50:10.362 INFO:tasks.workunit.client.1.smithi152.stdout:4/443: chown d2/l17 1170127 1 2024-09-16T00:50:10.362 INFO:tasks.workunit.client.1.smithi152.stdout:4/444: truncate d2/d1e/d28/d69/f78 957668 0 2024-09-16T00:50:10.429 INFO:tasks.workunit.client.1.smithi152.stdout:6/291: creat db/d12/d1c/f5c x:0 0 0 2024-09-16T00:50:10.432 INFO:tasks.workunit.client.1.smithi152.stdout:5/419: link d6/d57/d2b/d50/l81 d6/l96 0 2024-09-16T00:50:10.445 INFO:tasks.workunit.client.1.smithi152.stdout:6/292: dwrite db/f40 [0,4194304] 0 2024-09-16T00:50:10.445 INFO:tasks.workunit.client.1.smithi152.stdout:6/293: chown db/f31 108883944 1 2024-09-16T00:50:10.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/294: dread db/d12/f44 [0,4194304] 0 2024-09-16T00:50:10.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/295: getdents db/d12 0 2024-09-16T00:50:10.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/296: write db/d28/f3c [5034331,69623] 0 2024-09-16T00:50:10.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/297: creat db/d12/d23/d4a/d43/d48/f5d x:0 0 0 2024-09-16T00:50:10.452 INFO:tasks.workunit.client.1.smithi152.stdout:5/420: dwrite d6/d16/d1f/d65/f7d [0,4194304] 0 2024-09-16T00:50:10.459 INFO:tasks.workunit.client.1.smithi152.stdout:5/421: creat d6/d57/d2b/d50/d6e/f97 x:0 0 0 2024-09-16T00:50:10.460 INFO:tasks.workunit.client.1.smithi152.stdout:5/422: dread - d6/f1e zero size 2024-09-16T00:50:10.463 INFO:tasks.workunit.client.1.smithi152.stdout:5/423: symlink d6/d57/d2b/d50/l98 0 2024-09-16T00:50:10.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/298: dwrite db/d12/d20/f36 [0,4194304] 0 2024-09-16T00:50:10.474 INFO:tasks.workunit.client.1.smithi152.stdout:5/424: dwrite d6/f2d [0,4194304] 0 2024-09-16T00:50:10.475 INFO:tasks.workunit.client.1.smithi152.stdout:5/425: fsync d6/d16/d1f/d65/d77/f80 0 2024-09-16T00:50:10.492 INFO:tasks.workunit.client.1.smithi152.stdout:5/426: dwrite d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:10.492 INFO:tasks.workunit.client.1.smithi152.stdout:5/427: chown d6/d16/d1f/l25 989 1 2024-09-16T00:50:10.492 INFO:tasks.workunit.client.1.smithi152.stdout:5/428: chown d6/d57/d2b/d50/l98 113099 1 2024-09-16T00:50:10.498 INFO:tasks.workunit.client.1.smithi152.stdout:5/429: unlink d6/d16/d1f/c76 0 2024-09-16T00:50:10.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/430: mknod d6/d16/d1f/d65/d77/c99 0 2024-09-16T00:50:10.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/431: creat d6/d57/d2b/d50/d64/d92/f9a x:0 0 0 2024-09-16T00:50:10.531 INFO:tasks.workunit.client.1.smithi152.stdout:4/445: symlink d2/db/l8c 0 2024-09-16T00:50:10.534 INFO:tasks.workunit.client.1.smithi152.stdout:4/446: mknod d2/d1e/d28/c8d 0 2024-09-16T00:50:10.534 INFO:tasks.workunit.client.1.smithi152.stdout:4/447: dread - d2/db/f89 zero size 2024-09-16T00:50:10.537 INFO:tasks.workunit.client.1.smithi152.stdout:4/448: read d2/db/f1d [3737815,73429] 0 2024-09-16T00:50:10.544 INFO:tasks.workunit.client.1.smithi152.stdout:4/449: mkdir d2/d8e 0 2024-09-16T00:50:10.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/354: symlink d9/d3e/d41/l80 0 2024-09-16T00:50:10.547 INFO:tasks.workunit.client.1.smithi152.stdout:1/355: creat d9/d3e/d4b/d6b/d6d/f81 x:0 0 0 2024-09-16T00:50:10.549 INFO:tasks.workunit.client.1.smithi152.stdout:8/216: rename dd/de to dd/d15/d49 0 2024-09-16T00:50:10.549 INFO:tasks.workunit.client.1.smithi152.stdout:1/356: mkdir d9/d3e/d4b/d6b/d6d/d82 0 2024-09-16T00:50:10.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/294: rename dc/d10/d17/d4f/d54 to dc/d10/d17/d5a 0 2024-09-16T00:50:10.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/299: rename db/d12/d23 to db/d12/d23/d4a/d43/d5e 22 2024-09-16T00:50:10.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/432: rename d6/d16/c3b to d6/d57/d54/c9b 0 2024-09-16T00:50:10.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/433: truncate d6/d57/d54/f70 410831 0 2024-09-16T00:50:10.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/295: mknod dc/d10/d17/d5a/c5b 0 2024-09-16T00:50:10.560 INFO:tasks.workunit.client.1.smithi152.stdout:6/300: rmdir db/d12/d23/d4a/d33 39 2024-09-16T00:50:10.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/301: dread - db/d12/d23/d4a/f5a zero size 2024-09-16T00:50:10.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/302: creat db/d12/d23/d4a/f5f x:0 0 0 2024-09-16T00:50:10.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/303: chown db/d12/d23/d4a/c2b 108961 1 2024-09-16T00:50:10.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/304: chown db/d28/l29 0 1 2024-09-16T00:50:10.561 INFO:tasks.workunit.client.1.smithi152.stdout:4/450: dwrite d2/d1e/d28/d29/f1c [0,4194304] 0 2024-09-16T00:50:10.564 INFO:tasks.workunit.client.1.smithi152.stdout:6/305: rename c5 to db/d12/d23/d4a/d33/c60 0 2024-09-16T00:50:10.567 INFO:tasks.workunit.client.1.smithi152.stdout:4/451: creat d2/d1e/d28/d69/f8f x:0 0 0 2024-09-16T00:50:10.567 INFO:tasks.workunit.client.1.smithi152.stdout:4/452: fdatasync d2/d1e/d28/d29/f4a 0 2024-09-16T00:50:10.567 INFO:tasks.workunit.client.1.smithi152.stdout:4/453: write d2/d1e/d28/d69/f5b [1932057,52965] 0 2024-09-16T00:50:10.567 INFO:tasks.workunit.client.1.smithi152.stdout:4/454: chown d2/d1e/d28/f57 879560 1 2024-09-16T00:50:10.567 INFO:tasks.workunit.client.1.smithi152.stdout:5/434: dread d6/d16/d1f/d65/f7d [0,4194304] 0 2024-09-16T00:50:10.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/296: dread f7 [0,4194304] 0 2024-09-16T00:50:10.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/297: write dc/d10/d17/f59 [564045,55785] 0 2024-09-16T00:50:10.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/298: read f5 [3235808,96291] 0 2024-09-16T00:50:10.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/306: rmdir db/d28/d49 0 2024-09-16T00:50:10.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/307: write db/d12/d23/d4a/f5f [507680,70399] 0 2024-09-16T00:50:10.570 INFO:tasks.workunit.client.1.smithi152.stdout:4/455: readlink d2/l14 0 2024-09-16T00:50:10.572 INFO:tasks.workunit.client.1.smithi152.stdout:5/435: mknod d6/d16/c9c 0 2024-09-16T00:50:10.572 INFO:tasks.workunit.client.1.smithi152.stdout:1/357: dwrite d9/da/f1d [0,4194304] 0 2024-09-16T00:50:10.573 INFO:tasks.workunit.client.1.smithi152.stdout:6/308: mknod db/d12/d1c/c61 0 2024-09-16T00:50:10.573 INFO:tasks.workunit.client.1.smithi152.stdout:4/456: chown d2/db/c21 11321406 1 2024-09-16T00:50:10.577 INFO:tasks.workunit.client.1.smithi152.stdout:1/358: creat d9/d3e/d41/f83 x:0 0 0 2024-09-16T00:50:10.580 INFO:tasks.workunit.client.1.smithi152.stdout:6/309: symlink db/d12/d23/d3a/l62 0 2024-09-16T00:50:10.581 INFO:tasks.workunit.client.1.smithi152.stdout:4/457: rmdir d2 39 2024-09-16T00:50:10.582 INFO:tasks.workunit.client.1.smithi152.stdout:5/436: getdents d6/d57/d2b 0 2024-09-16T00:50:10.584 INFO:tasks.workunit.client.1.smithi152.stdout:6/310: link db/d12/d23/d4a/d33/c52 db/d12/d23/c63 0 2024-09-16T00:50:10.584 INFO:tasks.workunit.client.1.smithi152.stdout:5/437: mknod d6/c9d 0 2024-09-16T00:50:10.584 INFO:tasks.workunit.client.1.smithi152.stdout:5/438: fdatasync d6/f32 0 2024-09-16T00:50:10.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/359: write d9/d3e/d4b/d50/f76 [3784559,76062] 0 2024-09-16T00:50:10.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/360: write d9/da/df/f2c [784547,78839] 0 2024-09-16T00:50:10.586 INFO:tasks.workunit.client.1.smithi152.stdout:5/439: creat d6/d16/d1f/f9e x:0 0 0 2024-09-16T00:50:10.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/361: creat d9/f84 x:0 0 0 2024-09-16T00:50:10.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/362: dread - d9/d3e/d41/d31/d48/f70 zero size 2024-09-16T00:50:10.588 INFO:tasks.workunit.client.1.smithi152.stdout:5/440: mknod d6/d57/c9f 0 2024-09-16T00:50:10.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/363: creat d9/d3e/d41/d31/f85 x:0 0 0 2024-09-16T00:50:10.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/364: chown d9/da/df/f27 2881 1 2024-09-16T00:50:10.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/365: chown d9/d3e/d41/d31/d38 948306 1 2024-09-16T00:50:10.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/458: read d2/d1e/d28/d69/f49 [3849809,53107] 0 2024-09-16T00:50:10.589 INFO:tasks.workunit.client.1.smithi152.stdout:4/459: stat d2/d1e/d28/d29/f24 0 2024-09-16T00:50:10.590 INFO:tasks.workunit.client.1.smithi152.stdout:1/366: creat d9/da/df/f86 x:0 0 0 2024-09-16T00:50:10.592 INFO:tasks.workunit.client.1.smithi152.stdout:4/460: link d2/d1e/c55 d2/d1e/d28/d29/d32/c90 0 2024-09-16T00:50:10.593 INFO:tasks.workunit.client.1.smithi152.stdout:6/311: dread db/fe [0,4194304] 0 2024-09-16T00:50:10.593 INFO:tasks.workunit.client.1.smithi152.stdout:6/312: write db/f1e [1988084,67139] 0 2024-09-16T00:50:10.593 INFO:tasks.workunit.client.1.smithi152.stdout:6/313: chown db/f31 8301890 1 2024-09-16T00:50:10.593 INFO:tasks.workunit.client.1.smithi152.stdout:6/314: read db/d12/d1c/f3f [246704,92715] 0 2024-09-16T00:50:10.593 INFO:tasks.workunit.client.1.smithi152.stdout:6/315: fdatasync db/d12/d23/d4a/d43/d48/f53 0 2024-09-16T00:50:10.594 INFO:tasks.workunit.client.1.smithi152.stdout:4/461: rename d2/d1e/d28/d29/d32/c90 to d2/d1e/c91 0 2024-09-16T00:50:10.594 INFO:tasks.workunit.client.1.smithi152.stdout:4/462: read - d2/db/d39/f31 zero size 2024-09-16T00:50:10.596 INFO:tasks.workunit.client.1.smithi152.stdout:6/316: mkdir db/d12/d23/d4a/d43/d48/d64 0 2024-09-16T00:50:10.598 INFO:tasks.workunit.client.1.smithi152.stdout:4/463: creat d2/f92 x:0 0 0 2024-09-16T00:50:10.599 INFO:tasks.workunit.client.1.smithi152.stdout:6/317: mknod db/d12/d23/d4a/d33/c65 0 2024-09-16T00:50:10.609 INFO:tasks.workunit.client.1.smithi152.stdout:5/441: dwrite d6/d57/d2b/f6b [0,4194304] 0 2024-09-16T00:50:10.609 INFO:tasks.workunit.client.1.smithi152.stdout:5/442: creat d6/d16/d1f/d65/fa0 x:0 0 0 2024-09-16T00:50:10.609 INFO:tasks.workunit.client.1.smithi152.stdout:1/367: dwrite d9/da/f68 [0,4194304] 0 2024-09-16T00:50:10.610 INFO:tasks.workunit.client.1.smithi152.stdout:1/368: creat d9/d3e/d41/f87 x:0 0 0 2024-09-16T00:50:10.627 INFO:tasks.workunit.client.1.smithi152.stdout:1/369: dwrite d9/d3e/f56 [0,4194304] 0 2024-09-16T00:50:10.630 INFO:tasks.workunit.client.1.smithi152.stdout:5/443: dwrite d6/d57/d2b/d50/d64/d92/f9a [0,4194304] 0 2024-09-16T00:50:10.630 INFO:tasks.workunit.client.1.smithi152.stdout:1/370: symlink d9/d3e/d41/d31/l88 0 2024-09-16T00:50:10.634 INFO:tasks.workunit.client.1.smithi152.stdout:5/444: rename d6/l7 to d6/d16/d1f/d65/la1 0 2024-09-16T00:50:10.636 INFO:tasks.workunit.client.1.smithi152.stdout:1/371: rename d9/d3e/d41/d31/l88 to d9/d3e/d4b/d50/l89 0 2024-09-16T00:50:10.637 INFO:tasks.workunit.client.1.smithi152.stdout:5/445: creat d6/fa2 x:0 0 0 2024-09-16T00:50:10.641 INFO:tasks.workunit.client.1.smithi152.stdout:5/446: rename d6/d57/d54/c55 to d6/d16/ca3 0 2024-09-16T00:50:10.642 INFO:tasks.workunit.client.1.smithi152.stdout:5/447: dread - d6/d57/d54/f84 zero size 2024-09-16T00:50:10.642 INFO:tasks.workunit.client.1.smithi152.stdout:5/448: chown d6/d57/d54/f84 4936668 1 2024-09-16T00:50:10.642 INFO:tasks.workunit.client.1.smithi152.stdout:5/449: creat d6/d57/d2b/d50/d64/fa4 x:0 0 0 2024-09-16T00:50:10.642 INFO:tasks.workunit.client.1.smithi152.stdout:1/372: dread d9/d3e/d41/d31/d48/f55 [0,4194304] 0 2024-09-16T00:50:10.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/373: creat d9/d3e/d41/d31/d38/f8a x:0 0 0 2024-09-16T00:50:10.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/374: readlink d9/da/l5a 0 2024-09-16T00:50:10.645 INFO:tasks.workunit.client.1.smithi152.stdout:1/375: mknod d9/d3e/d7c/c8b 0 2024-09-16T00:50:10.645 INFO:tasks.workunit.client.1.smithi152.stdout:1/376: creat d9/da/df/f8c x:0 0 0 2024-09-16T00:50:10.645 INFO:tasks.workunit.client.1.smithi152.stdout:1/377: creat d9/d3e/d41/f8d x:0 0 0 2024-09-16T00:50:10.660 INFO:tasks.workunit.client.1.smithi152.stdout:5/450: dwrite d6/f44 [0,4194304] 0 2024-09-16T00:50:10.660 INFO:tasks.workunit.client.1.smithi152.stdout:5/451: stat d6/d57/d2b/d50/c8e 0 2024-09-16T00:50:10.661 INFO:tasks.workunit.client.0.smithi053.stdout:5/19: sync 2024-09-16T00:50:10.661 INFO:tasks.workunit.client.0.smithi053.stdout:6/15: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:0/6: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:0/7: dread - no filename 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:6/16: creat d1/f4 x:0 0 0 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/77: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/78: truncate d8/fb 774636 0 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:7/68: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/25: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/26: fdatasync d0/f8 0 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:1/43: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:1/44: write d5/d9/ff [604788,59249] 0 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:2/3: sync 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:2/4: dwrite - no filename 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:2/5: readlink - no filename 2024-09-16T00:50:10.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/86: sync 2024-09-16T00:50:10.663 INFO:tasks.workunit.client.0.smithi053.stdout:3/44: sync 2024-09-16T00:50:10.671 INFO:tasks.workunit.client.0.smithi053.stdout:5/20: truncate f0 154432 0 2024-09-16T00:50:10.671 INFO:tasks.workunit.client.0.smithi053.stdout:1/45: write d5/d7/fa [482844,115307] 0 2024-09-16T00:50:10.673 INFO:tasks.workunit.client.1.smithi152.stdout:5/452: rename d6/d16/d1f/d65/fa0 to d6/fa5 0 2024-09-16T00:50:10.673 INFO:tasks.workunit.client.1.smithi152.stdout:5/453: write d6/d57/d54/f70 [1012604,30788] 0 2024-09-16T00:50:10.673 INFO:tasks.workunit.client.1.smithi152.stdout:5/454: readlink d6/d57/d2b/d50/d6e/l82 0 2024-09-16T00:50:10.676 INFO:tasks.workunit.client.0.smithi053.stdout:0/8: mknod c0 0 2024-09-16T00:50:10.676 INFO:tasks.workunit.client.0.smithi053.stdout:0/9: chown c0 173 1 2024-09-16T00:50:10.680 INFO:tasks.workunit.client.0.smithi053.stdout:2/6: creat f0 x:0 0 0 2024-09-16T00:50:10.680 INFO:tasks.workunit.client.0.smithi053.stdout:2/7: creat f1 x:0 0 0 2024-09-16T00:50:10.680 INFO:tasks.workunit.client.0.smithi053.stdout:8/87: chown d10/l13 11165585 1 2024-09-16T00:50:10.685 INFO:tasks.workunit.client.0.smithi053.stdout:5/21: creat d3/f4 x:0 0 0 2024-09-16T00:50:10.686 INFO:tasks.workunit.client.0.smithi053.stdout:5/22: chown d3 1 1 2024-09-16T00:50:10.686 INFO:tasks.workunit.client.0.smithi053.stdout:5/23: stat f0 0 2024-09-16T00:50:10.687 INFO:tasks.workunit.client.0.smithi053.stdout:4/27: write d0/f5 [569396,118688] 0 2024-09-16T00:50:10.687 INFO:tasks.workunit.client.0.smithi053.stdout:4/28: stat d0/d2/f7 0 2024-09-16T00:50:10.688 INFO:tasks.workunit.client.0.smithi053.stdout:0/10: mknod c1 0 2024-09-16T00:50:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:8/88: creat d10/d1c/f23 x:0 0 0 2024-09-16T00:50:10.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/89: write d10/f14 [4238577,83502] 0 2024-09-16T00:50:10.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/90: truncate f8 5368678 0 2024-09-16T00:50:10.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/91: read d10/f20 [831707,31065] 0 2024-09-16T00:50:10.696 INFO:tasks.workunit.client.0.smithi053.stdout:0/11: rename c1 to c2 0 2024-09-16T00:50:10.698 INFO:tasks.workunit.client.0.smithi053.stdout:9/79: rename d8/d13/d1a to d8/d1c 0 2024-09-16T00:50:10.698 INFO:tasks.workunit.client.0.smithi053.stdout:9/80: dread - d8/f12 zero size 2024-09-16T00:50:10.699 INFO:tasks.workunit.client.0.smithi053.stdout:8/92: rmdir d10/d21 39 2024-09-16T00:50:10.700 INFO:tasks.workunit.client.0.smithi053.stdout:0/12: creat f3 x:0 0 0 2024-09-16T00:50:10.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/81: stat d8/c9 0 2024-09-16T00:50:10.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/82: dread - d8/f16 zero size 2024-09-16T00:50:10.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/83: creat d8/f1d x:0 0 0 2024-09-16T00:50:10.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/84: dread - d8/f1d zero size 2024-09-16T00:50:10.703 INFO:tasks.workunit.client.0.smithi053.stdout:0/13: mkdir d4 0 2024-09-16T00:50:10.709 INFO:tasks.workunit.client.0.smithi053.stdout:0/14: unlink c0 0 2024-09-16T00:50:10.709 INFO:tasks.workunit.client.0.smithi053.stdout:0/15: write f3 [1037689,7599] 0 2024-09-16T00:50:10.711 INFO:tasks.workunit.client.1.smithi152.stdout:2/327: sync 2024-09-16T00:50:10.711 INFO:tasks.workunit.client.1.smithi152.stdout:9/356: sync 2024-09-16T00:50:10.711 INFO:tasks.workunit.client.1.smithi152.stdout:0/284: sync 2024-09-16T00:50:10.711 INFO:tasks.workunit.client.1.smithi152.stdout:7/295: sync 2024-09-16T00:50:10.712 INFO:tasks.workunit.client.1.smithi152.stdout:9/357: fdatasync d1/d7/d13/f2c 0 2024-09-16T00:50:10.714 INFO:tasks.workunit.client.1.smithi152.stdout:2/328: mknod d4/d19/d20/d28/c71 0 2024-09-16T00:50:10.716 INFO:tasks.workunit.client.1.smithi152.stdout:9/358: symlink d1/d7/d13/d5d/l75 0 2024-09-16T00:50:10.717 INFO:tasks.workunit.client.1.smithi152.stdout:7/296: dread d9/d31/d65/f59 [0,4194304] 0 2024-09-16T00:50:10.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/285: rmdir d3/d6/d51 39 2024-09-16T00:50:10.717 INFO:tasks.workunit.client.0.smithi053.stdout:9/85: dread f2 [0,4194304] 0 2024-09-16T00:50:10.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/455: dwrite d6/fa5 [0,4194304] 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/17: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/18: write d1/f4 [17339,26735] 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/19: creat d1/f5 x:0 0 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/20: write d1/f4 [807972,37249] 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/21: creat d1/f6 x:0 0 0 2024-09-16T00:50:10.719 INFO:tasks.workunit.client.0.smithi053.stdout:1/46: dwrite d5/d9/ff [0,4194304] 0 2024-09-16T00:50:10.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/329: rename d4/d19/d20/d28/d2c/f37 to d4/d19/f72 0 2024-09-16T00:50:10.720 INFO:tasks.workunit.client.0.smithi053.stdout:3/45: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:10.720 INFO:tasks.workunit.client.0.smithi053.stdout:7/69: dwrite d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:10.723 INFO:tasks.workunit.client.1.smithi152.stdout:9/359: mkdir d1/d4e/d48/d66/d76 0 2024-09-16T00:50:10.723 INFO:tasks.workunit.client.0.smithi053.stdout:0/16: dread f3 [0,4194304] 0 2024-09-16T00:50:10.726 INFO:tasks.workunit.client.0.smithi053.stdout:4/29: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:10.726 INFO:tasks.workunit.client.0.smithi053.stdout:3/46: dread d1/d5/f8 [0,4194304] 0 2024-09-16T00:50:10.726 INFO:tasks.workunit.client.0.smithi053.stdout:3/47: write d1/d5/f6 [343358,99466] 0 2024-09-16T00:50:10.727 INFO:tasks.workunit.client.0.smithi053.stdout:9/86: unlink d8/f16 0 2024-09-16T00:50:10.729 INFO:tasks.workunit.client.0.smithi053.stdout:6/22: dread d1/f2 [0,4194304] 0 2024-09-16T00:50:10.730 INFO:tasks.workunit.client.0.smithi053.stdout:6/23: truncate d1/f6 58455 0 2024-09-16T00:50:10.730 INFO:tasks.workunit.client.1.smithi152.stdout:0/286: link d3/d6/d8/c59 d3/d6/d8/d1d/d23/d4b/d54/c63 0 2024-09-16T00:50:10.740 INFO:tasks.workunit.client.1.smithi152.stdout:5/456: mkdir d6/d16/da6 0 2024-09-16T00:50:10.742 INFO:tasks.workunit.client.1.smithi152.stdout:7/297: dwrite d9/f1b [4194304,4194304] 0 2024-09-16T00:50:10.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/330: mknod d4/d17/d3e/c73 0 2024-09-16T00:50:10.747 INFO:tasks.workunit.client.0.smithi053.stdout:7/70: creat d1/d3/d10/d14/f16 x:0 0 0 2024-09-16T00:50:10.748 INFO:tasks.workunit.client.1.smithi152.stdout:0/287: dwrite d3/d6/d8/d1d/d23/d25/d2a/f5b [0,4194304] 0 2024-09-16T00:50:10.751 INFO:tasks.workunit.client.1.smithi152.stdout:5/457: creat d6/d16/da6/fa7 x:0 0 0 2024-09-16T00:50:10.753 INFO:tasks.workunit.client.0.smithi053.stdout:0/17: link f3 d4/f5 0 2024-09-16T00:50:10.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/288: dread d3/d6/d4e/f55 [0,4194304] 0 2024-09-16T00:50:10.757 INFO:tasks.workunit.client.0.smithi053.stdout:4/30: symlink d0/d2/lb 0 2024-09-16T00:50:10.757 INFO:tasks.workunit.client.0.smithi053.stdout:4/31: write d0/f8 [590736,54807] 0 2024-09-16T00:50:10.757 INFO:tasks.workunit.client.0.smithi053.stdout:4/32: dread - d0/d2/f7 zero size 2024-09-16T00:50:10.759 INFO:tasks.workunit.client.1.smithi152.stdout:2/331: creat d4/f74 x:0 0 0 2024-09-16T00:50:10.761 INFO:tasks.workunit.client.0.smithi053.stdout:3/48: rename d1/c4 to d1/cb 0 2024-09-16T00:50:10.761 INFO:tasks.workunit.client.0.smithi053.stdout:3/49: write d1/d5/f6 [367048,83475] 0 2024-09-16T00:50:10.762 INFO:tasks.workunit.client.1.smithi152.stdout:4/464: fsync d2/f92 0 2024-09-16T00:50:10.762 INFO:tasks.workunit.client.1.smithi152.stdout:4/465: write d2/d1e/d28/d29/f79 [248316,128060] 0 2024-09-16T00:50:10.765 INFO:tasks.workunit.client.0.smithi053.stdout:9/87: mknod d8/d13/c1e 0 2024-09-16T00:50:10.765 INFO:tasks.workunit.client.0.smithi053.stdout:9/88: readlink d8/l10 0 2024-09-16T00:50:10.765 INFO:tasks.workunit.client.0.smithi053.stdout:9/89: chown d8/d13 7495049 1 2024-09-16T00:50:10.765 INFO:tasks.workunit.client.0.smithi053.stdout:9/90: creat d8/f1f x:0 0 0 2024-09-16T00:50:10.767 INFO:tasks.workunit.client.1.smithi152.stdout:0/289: dread d3/fc [0,4194304] 0 2024-09-16T00:50:10.769 INFO:tasks.workunit.client.1.smithi152.stdout:4/466: dread d2/d1e/d28/d29/f6a [0,4194304] 0 2024-09-16T00:50:10.769 INFO:tasks.workunit.client.1.smithi152.stdout:4/467: write d2/db/d44/f68 [1132118,26178] 0 2024-09-16T00:50:10.772 INFO:tasks.workunit.client.0.smithi053.stdout:7/71: link d1/cc d1/d3/d10/d14/d15/c17 0 2024-09-16T00:50:10.772 INFO:tasks.workunit.client.0.smithi053.stdout:7/72: fdatasync d1/d3/f5 0 2024-09-16T00:50:10.774 INFO:tasks.workunit.client.1.smithi152.stdout:5/458: symlink d6/la8 0 2024-09-16T00:50:10.775 INFO:tasks.workunit.client.0.smithi053.stdout:0/18: symlink d4/l6 0 2024-09-16T00:50:10.775 INFO:tasks.workunit.client.0.smithi053.stdout:0/19: truncate d4/f5 1909283 0 2024-09-16T00:50:10.776 INFO:tasks.workunit.client.1.smithi152.stdout:0/290: mkdir d3/d6/d64 0 2024-09-16T00:50:10.779 INFO:tasks.workunit.client.0.smithi053.stdout:4/33: unlink d0/f8 0 2024-09-16T00:50:10.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/468: unlink d2/db/d39/l3e 0 2024-09-16T00:50:10.782 INFO:tasks.workunit.client.1.smithi152.stdout:2/332: dwrite d4/d19/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:10.782 INFO:tasks.workunit.client.0.smithi053.stdout:9/91: dwrite d8/f17 [0,4194304] 0 2024-09-16T00:50:10.783 INFO:tasks.workunit.client.0.smithi053.stdout:9/92: chown d8/ce 6 1 2024-09-16T00:50:10.783 INFO:tasks.workunit.client.0.smithi053.stdout:9/93: write d8/d1c/f1b [1048485,48886] 0 2024-09-16T00:50:10.784 INFO:tasks.workunit.client.0.smithi053.stdout:9/94: write f4 [880395,67188] 0 2024-09-16T00:50:10.785 INFO:tasks.workunit.client.1.smithi152.stdout:9/360: rename d1/d14 to d1/d7/d77 0 2024-09-16T00:50:10.786 INFO:tasks.workunit.client.0.smithi053.stdout:3/50: symlink d1/lc 0 2024-09-16T00:50:10.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/459: mknod d6/d16/d8b/ca9 0 2024-09-16T00:50:10.793 INFO:tasks.workunit.client.1.smithi152.stdout:0/291: mkdir d3/d6/d8/d1d/d65 0 2024-09-16T00:50:10.793 INFO:tasks.workunit.client.1.smithi152.stdout:0/292: readlink d3/d6/d2e/l39 0 2024-09-16T00:50:10.793 INFO:tasks.workunit.client.1.smithi152.stdout:1/378: getdents d9/d3e/d7c 0 2024-09-16T00:50:10.793 INFO:tasks.workunit.client.1.smithi152.stdout:1/379: write d9/d3e/d41/f8d [934755,48232] 0 2024-09-16T00:50:10.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/469: creat d2/db/d39/f93 x:0 0 0 2024-09-16T00:50:10.798 INFO:tasks.workunit.client.0.smithi053.stdout:7/73: rmdir d1/d3/d10 39 2024-09-16T00:50:10.798 INFO:tasks.workunit.client.0.smithi053.stdout:7/74: write d1/d3/d10/d14/f16 [953738,30753] 0 2024-09-16T00:50:10.801 INFO:tasks.workunit.client.0.smithi053.stdout:0/20: creat d4/f7 x:0 0 0 2024-09-16T00:50:10.801 INFO:tasks.workunit.client.0.smithi053.stdout:0/21: creat d4/f8 x:0 0 0 2024-09-16T00:50:10.801 INFO:tasks.workunit.client.0.smithi053.stdout:0/22: creat d4/f9 x:0 0 0 2024-09-16T00:50:10.801 INFO:tasks.workunit.client.0.smithi053.stdout:0/23: dread - d4/f8 zero size 2024-09-16T00:50:10.805 INFO:tasks.workunit.client.1.smithi152.stdout:7/298: rename d9/d10/d30/d41/d46/l53 to d9/l70 0 2024-09-16T00:50:10.807 INFO:tasks.workunit.client.0.smithi053.stdout:5/24: write f0 [152695,120605] 0 2024-09-16T00:50:10.809 INFO:tasks.workunit.client.1.smithi152.stdout:1/380: creat d9/d3e/d4b/d6b/d6d/d82/f8e x:0 0 0 2024-09-16T00:50:10.809 INFO:tasks.workunit.client.1.smithi152.stdout:1/381: dread - d9/d3e/d41/f87 zero size 2024-09-16T00:50:10.813 INFO:tasks.workunit.client.0.smithi053.stdout:9/95: creat d8/d13/f20 x:0 0 0 2024-09-16T00:50:10.815 INFO:tasks.workunit.client.1.smithi152.stdout:9/361: dwrite d1/d4e/d48/d2b/f70 [0,4194304] 0 2024-09-16T00:50:10.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/460: dwrite d6/d57/d2b/f79 [0,4194304] 0 2024-09-16T00:50:10.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/470: link d2/d1e/d28/d69/f8f d2/db/d44/f94 0 2024-09-16T00:50:10.816 INFO:tasks.workunit.client.1.smithi152.stdout:2/333: rename d4/d17/f23 to d4/d19/d20/d28/d2c/d5a/f75 0 2024-09-16T00:50:10.816 INFO:tasks.workunit.client.0.smithi053.stdout:3/51: link d1/lc d1/d5/ld 0 2024-09-16T00:50:10.818 INFO:tasks.workunit.client.0.smithi053.stdout:7/75: chown d1/l8 19 1 2024-09-16T00:50:10.824 INFO:tasks.workunit.client.1.smithi152.stdout:2/334: dread d4/d19/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:10.826 INFO:tasks.workunit.client.0.smithi053.stdout:8/93: getdents d10/d1c 0 2024-09-16T00:50:10.827 INFO:tasks.workunit.client.0.smithi053.stdout:3/52: write d1/f2 [1090275,125433] 0 2024-09-16T00:50:10.835 INFO:tasks.workunit.client.0.smithi053.stdout:5/25: symlink d3/l5 0 2024-09-16T00:50:10.835 INFO:tasks.workunit.client.0.smithi053.stdout:5/26: write d3/f4 [979605,125774] 0 2024-09-16T00:50:10.837 INFO:tasks.workunit.client.1.smithi152.stdout:5/461: link d6/d16/d1f/d65/l86 d6/d16/da6/laa 0 2024-09-16T00:50:10.837 INFO:tasks.workunit.client.1.smithi152.stdout:5/462: creat d6/d16/d1f/fab x:0 0 0 2024-09-16T00:50:10.844 INFO:tasks.workunit.client.1.smithi152.stdout:4/471: truncate d2/d1e/f37 170737 0 2024-09-16T00:50:10.844 INFO:tasks.workunit.client.1.smithi152.stdout:4/472: getdents d2/d8e 0 2024-09-16T00:50:10.844 INFO:tasks.workunit.client.1.smithi152.stdout:4/473: fdatasync d2/d1e/f84 0 2024-09-16T00:50:10.845 INFO:tasks.workunit.client.0.smithi053.stdout:7/76: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:10.846 INFO:tasks.workunit.client.0.smithi053.stdout:3/53: unlink d1/d5/f8 0 2024-09-16T00:50:10.847 INFO:tasks.workunit.client.1.smithi152.stdout:9/362: dwrite d1/d4e/d48/d2b/f70 [0,4194304] 0 2024-09-16T00:50:10.850 INFO:tasks.workunit.client.1.smithi152.stdout:0/293: rename d3/d6/d8/f2c to d3/d6/d8/d1d/d23/d25/d2a/f66 0 2024-09-16T00:50:10.852 INFO:tasks.workunit.client.1.smithi152.stdout:1/382: getdents d9/d3e 0 2024-09-16T00:50:10.852 INFO:tasks.workunit.client.1.smithi152.stdout:9/363: dread d1/d4e/d34/f39 [0,4194304] 0 2024-09-16T00:50:10.855 INFO:tasks.workunit.client.0.smithi053.stdout:5/27: stat c2 0 2024-09-16T00:50:10.857 INFO:tasks.workunit.client.1.smithi152.stdout:2/335: symlink d4/d17/d3e/l76 0 2024-09-16T00:50:10.860 INFO:tasks.workunit.client.1.smithi152.stdout:2/336: write d4/d19/d20/d28/f52 [3037346,124678] 0 2024-09-16T00:50:10.863 INFO:tasks.workunit.client.1.smithi152.stdout:1/383: dread d9/d3e/d41/d31/d38/f43 [0,4194304] 0 2024-09-16T00:50:10.863 INFO:tasks.workunit.client.1.smithi152.stdout:1/384: chown d9/d3e/d41/d31/d38/f5d 0 1 2024-09-16T00:50:10.863 INFO:tasks.workunit.client.1.smithi152.stdout:1/385: write d9/d3e/d41/f60 [5218048,11973] 0 2024-09-16T00:50:10.863 INFO:tasks.workunit.client.1.smithi152.stdout:1/386: creat d9/d3e/d41/d31/f8f x:0 0 0 2024-09-16T00:50:10.864 INFO:tasks.workunit.client.0.smithi053.stdout:3/54: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:10.864 INFO:tasks.workunit.client.0.smithi053.stdout:5/28: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:10.865 INFO:tasks.workunit.client.0.smithi053.stdout:5/29: creat d3/f6 x:0 0 0 2024-09-16T00:50:10.865 INFO:tasks.workunit.client.0.smithi053.stdout:5/30: chown c2 13 1 2024-09-16T00:50:10.865 INFO:tasks.workunit.client.1.smithi152.stdout:5/463: creat d6/d57/d2b/fac x:0 0 0 2024-09-16T00:50:10.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/464: truncate d6/d57/d2b/fac 685295 0 2024-09-16T00:50:10.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/465: write d6/d57/d2b/d50/d64/fa4 [461277,3940] 0 2024-09-16T00:50:10.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/466: truncate d6/d16/d1f/f3e 57774 0 2024-09-16T00:50:10.869 INFO:tasks.workunit.client.1.smithi152.stdout:4/474: mkdir d2/db/d39/d95 0 2024-09-16T00:50:10.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/294: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/f67 x:0 0 0 2024-09-16T00:50:10.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/295: write d3/d6/d8/ff [2757010,112867] 0 2024-09-16T00:50:10.876 INFO:tasks.workunit.client.0.smithi053.stdout:3/55: symlink d1/le 0 2024-09-16T00:50:10.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/296: dread d3/d6/d8/d1d/f26 [0,4194304] 0 2024-09-16T00:50:10.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/297: read d3/f21 [2947160,39593] 0 2024-09-16T00:50:10.879 INFO:tasks.workunit.client.1.smithi152.stdout:9/364: link d1/d7/d13/d5d/l75 d1/d4e/d48/d66/l78 0 2024-09-16T00:50:10.886 INFO:tasks.workunit.client.0.smithi053.stdout:7/77: mkdir d1/d18 0 2024-09-16T00:50:10.886 INFO:tasks.workunit.client.1.smithi152.stdout:9/365: dread d1/fc [0,4194304] 0 2024-09-16T00:50:10.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/337: rmdir d4/d19/d20/d28/d2c 39 2024-09-16T00:50:10.890 INFO:tasks.workunit.client.0.smithi053.stdout:5/31: dwrite d3/f6 [0,4194304] 0 2024-09-16T00:50:10.893 INFO:tasks.workunit.client.1.smithi152.stdout:1/387: mkdir d9/d3e/d7b/d90 0 2024-09-16T00:50:10.893 INFO:tasks.workunit.client.1.smithi152.stdout:1/388: chown d9/d3e/d41/d31/f85 7061 1 2024-09-16T00:50:10.895 INFO:tasks.workunit.client.1.smithi152.stdout:4/475: creat d2/db/d39/d95/f96 x:0 0 0 2024-09-16T00:50:10.898 INFO:tasks.workunit.client.0.smithi053.stdout:7/78: dread d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:10.898 INFO:tasks.workunit.client.1.smithi152.stdout:9/366: write d1/d7/d77/d32/f35 [3667825,94744] 0 2024-09-16T00:50:10.899 INFO:tasks.workunit.client.0.smithi053.stdout:5/32: mkdir d3/d7 0 2024-09-16T00:50:10.902 INFO:tasks.workunit.client.1.smithi152.stdout:9/367: dread d1/d7/d77/f33 [0,4194304] 0 2024-09-16T00:50:10.902 INFO:tasks.workunit.client.1.smithi152.stdout:0/298: dwrite d3/d6/d8/d1d/d23/d25/f4d [0,4194304] 0 2024-09-16T00:50:10.902 INFO:tasks.workunit.client.1.smithi152.stdout:9/368: write d1/d7/d13/f2c [2187528,90600] 0 2024-09-16T00:50:10.902 INFO:tasks.workunit.client.1.smithi152.stdout:9/369: getdents d1/d74 0 2024-09-16T00:50:10.902 INFO:tasks.workunit.client.1.smithi152.stdout:5/467: dwrite d6/d16/f23 [0,4194304] 0 2024-09-16T00:50:10.903 INFO:tasks.workunit.client.0.smithi053.stdout:3/56: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:10.903 INFO:tasks.workunit.client.1.smithi152.stdout:4/476: mknod d2/db/d39/d3c/c97 0 2024-09-16T00:50:10.903 INFO:tasks.workunit.client.1.smithi152.stdout:4/477: write d2/d1e/d28/f57 [67434,78038] 0 2024-09-16T00:50:10.906 INFO:tasks.workunit.client.0.smithi053.stdout:7/79: write d1/d3/f5 [5860585,28622] 0 2024-09-16T00:50:10.906 INFO:tasks.workunit.client.0.smithi053.stdout:5/33: dread f0 [0,4194304] 0 2024-09-16T00:50:10.908 INFO:tasks.workunit.client.0.smithi053.stdout:5/34: dread f0 [0,4194304] 0 2024-09-16T00:50:10.908 INFO:tasks.workunit.client.0.smithi053.stdout:3/57: rename d1/cb to d1/d5/cf 0 2024-09-16T00:50:10.912 INFO:tasks.workunit.client.0.smithi053.stdout:7/80: mknod d1/d3/d10/c19 0 2024-09-16T00:50:10.912 INFO:tasks.workunit.client.0.smithi053.stdout:7/81: chown d1/l13 1066003 1 2024-09-16T00:50:10.912 INFO:tasks.workunit.client.0.smithi053.stdout:4/34: getdents d0 0 2024-09-16T00:50:10.918 INFO:tasks.workunit.client.1.smithi152.stdout:6/318: sync 2024-09-16T00:50:10.918 INFO:tasks.workunit.client.1.smithi152.stdout:8/217: sync 2024-09-16T00:50:10.918 INFO:tasks.workunit.client.1.smithi152.stdout:3/299: sync 2024-09-16T00:50:10.919 INFO:tasks.workunit.client.0.smithi053.stdout:3/58: creat d1/d5/f10 x:0 0 0 2024-09-16T00:50:10.921 INFO:tasks.workunit.client.0.smithi053.stdout:4/35: unlink d0/d2/f7 0 2024-09-16T00:50:10.921 INFO:tasks.workunit.client.0.smithi053.stdout:4/36: read d0/f5 [170029,97420] 0 2024-09-16T00:50:10.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/478: rename d2/d1e/d28/d29/d32 to d2/db/d39/d3c/d7f/d98 0 2024-09-16T00:50:10.926 INFO:tasks.workunit.client.0.smithi053.stdout:7/82: write d1/d3/f5 [390647,103902] 0 2024-09-16T00:50:10.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/299: dwrite d3/d6/d8/d1d/f26 [0,4194304] 0 2024-09-16T00:50:10.928 INFO:tasks.workunit.client.1.smithi152.stdout:9/370: dwrite d1/d7/d77/d32/f35 [0,4194304] 0 2024-09-16T00:50:10.929 INFO:tasks.workunit.client.0.smithi053.stdout:3/59: write d1/f2 [3452217,9507] 0 2024-09-16T00:50:10.929 INFO:tasks.workunit.client.0.smithi053.stdout:3/60: chown d1/d5/f6 1215 1 2024-09-16T00:50:10.929 INFO:tasks.workunit.client.0.smithi053.stdout:3/61: chown d1/d5/f6 768471 1 2024-09-16T00:50:10.929 INFO:tasks.workunit.client.0.smithi053.stdout:3/62: chown d1/d5 0 1 2024-09-16T00:50:10.932 INFO:tasks.workunit.client.0.smithi053.stdout:7/83: creat d1/d3/d10/d14/d15/f1a x:0 0 0 2024-09-16T00:50:10.932 INFO:tasks.workunit.client.0.smithi053.stdout:7/84: readlink d1/l13 0 2024-09-16T00:50:10.933 INFO:tasks.workunit.client.0.smithi053.stdout:7/85: write d1/d3/f5 [1196820,47114] 0 2024-09-16T00:50:10.933 INFO:tasks.workunit.client.0.smithi053.stdout:7/86: stat d1/d18 0 2024-09-16T00:50:10.934 INFO:tasks.workunit.client.1.smithi152.stdout:6/319: unlink db/l26 0 2024-09-16T00:50:10.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/218: truncate dd/d15/f18 2356546 0 2024-09-16T00:50:10.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/219: truncate dd/d26/d29/f46 760512 0 2024-09-16T00:50:10.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/220: readlink dd/d23/l2c 0 2024-09-16T00:50:10.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/221: readlink dd/d15/d49/l10 0 2024-09-16T00:50:10.939 INFO:tasks.workunit.client.0.smithi053.stdout:3/63: mkdir d1/d5/d11 0 2024-09-16T00:50:10.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/300: rename dc/d10/d47/d58 to dc/d5c 0 2024-09-16T00:50:10.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/320: dread db/f31 [0,4194304] 0 2024-09-16T00:50:10.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/321: write db/d12/d20/f3e [493857,108892] 0 2024-09-16T00:50:10.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/322: readlink db/l55 0 2024-09-16T00:50:10.944 INFO:tasks.workunit.client.1.smithi152.stdout:4/479: creat d2/d1e/d28/d7b/f99 x:0 0 0 2024-09-16T00:50:10.950 INFO:tasks.workunit.client.0.smithi053.stdout:0/24: getdents d4 0 2024-09-16T00:50:10.950 INFO:tasks.workunit.client.0.smithi053.stdout:0/25: read - d4/f9 zero size 2024-09-16T00:50:10.951 INFO:tasks.workunit.client.1.smithi152.stdout:0/300: rmdir d3/d6/d4e 39 2024-09-16T00:50:10.955 INFO:tasks.workunit.client.0.smithi053.stdout:3/64: rename d1/f2 to d1/d5/d11/f12 0 2024-09-16T00:50:10.955 INFO:tasks.workunit.client.0.smithi053.stdout:3/65: fdatasync d1/d5/f10 0 2024-09-16T00:50:10.955 INFO:tasks.workunit.client.0.smithi053.stdout:3/66: write d1/d5/f10 [441354,57584] 0 2024-09-16T00:50:10.955 INFO:tasks.workunit.client.0.smithi053.stdout:3/67: readlink d1/le 0 2024-09-16T00:50:10.955 INFO:tasks.workunit.client.0.smithi053.stdout:7/87: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:10.958 INFO:tasks.workunit.client.0.smithi053.stdout:0/26: unlink d4/f7 0 2024-09-16T00:50:10.960 INFO:tasks.workunit.client.0.smithi053.stdout:3/68: dread d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:10.960 INFO:tasks.workunit.client.1.smithi152.stdout:9/371: unlink d1/fc 0 2024-09-16T00:50:10.965 INFO:tasks.workunit.client.0.smithi053.stdout:0/27: creat d4/fa x:0 0 0 2024-09-16T00:50:10.968 INFO:tasks.workunit.client.0.smithi053.stdout:3/69: mknod d1/c13 0 2024-09-16T00:50:10.969 INFO:tasks.workunit.client.0.smithi053.stdout:9/96: truncate f4 398751 0 2024-09-16T00:50:10.969 INFO:tasks.workunit.client.0.smithi053.stdout:9/97: dread - d8/f12 zero size 2024-09-16T00:50:10.971 INFO:tasks.workunit.client.0.smithi053.stdout:8/94: truncate d10/f1d 4714125 0 2024-09-16T00:50:10.975 INFO:tasks.workunit.client.0.smithi053.stdout:3/70: mkdir d1/d5/d14 0 2024-09-16T00:50:10.976 INFO:tasks.workunit.client.1.smithi152.stdout:8/222: read - dd/f38 zero size 2024-09-16T00:50:10.978 INFO:tasks.workunit.client.0.smithi053.stdout:8/95: getdents d10 0 2024-09-16T00:50:10.982 INFO:tasks.workunit.client.1.smithi152.stdout:3/301: mknod dc/d10/d17/d5a/c5d 0 2024-09-16T00:50:10.984 INFO:tasks.workunit.client.0.smithi053.stdout:8/96: creat d10/f24 x:0 0 0 2024-09-16T00:50:10.988 INFO:tasks.workunit.client.1.smithi152.stdout:6/323: unlink db/d12/d1c/c34 0 2024-09-16T00:50:10.988 INFO:tasks.workunit.client.0.smithi053.stdout:9/98: dwrite d8/f1f [0,4194304] 0 2024-09-16T00:50:10.988 INFO:tasks.workunit.client.0.smithi053.stdout:0/28: dwrite d4/f5 [0,4194304] 0 2024-09-16T00:50:10.989 INFO:tasks.workunit.client.1.smithi152.stdout:6/324: write db/d12/d23/d4a/f5f [118942,114684] 0 2024-09-16T00:50:10.989 INFO:tasks.workunit.client.1.smithi152.stdout:1/389: rmdir d9/d3e/d41 39 2024-09-16T00:50:10.989 INFO:tasks.workunit.client.1.smithi152.stdout:1/390: chown d9/d3e/d41/l78 3 1 2024-09-16T00:50:10.993 INFO:tasks.workunit.client.1.smithi152.stdout:0/301: creat d3/d6/d8/d1d/f68 x:0 0 0 2024-09-16T00:50:11.000 INFO:tasks.workunit.client.1.smithi152.stdout:9/372: truncate d1/d4e/d48/d26/d30/f3f 7567571 0 2024-09-16T00:50:11.003 INFO:tasks.workunit.client.1.smithi152.stdout:8/223: getdents dd/d26 0 2024-09-16T00:50:11.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/302: creat dc/d10/d17/d1c/d1f/d22/d2c/d3b/f5e x:0 0 0 2024-09-16T00:50:11.009 INFO:tasks.workunit.client.1.smithi152.stdout:1/391: dwrite d9/da/df/f75 [0,4194304] 0 2024-09-16T00:50:11.009 INFO:tasks.workunit.client.1.smithi152.stdout:1/392: dread - d9/d3e/d4b/d6b/d6d/d82/f8e zero size 2024-09-16T00:50:11.011 INFO:tasks.workunit.client.0.smithi053.stdout:0/29: unlink d4/f8 0 2024-09-16T00:50:11.011 INFO:tasks.workunit.client.0.smithi053.stdout:5/35: truncate d3/f4 911723 0 2024-09-16T00:50:11.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/325: mknod db/c66 0 2024-09-16T00:50:11.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/480: unlink d2/db/c54 0 2024-09-16T00:50:11.016 INFO:tasks.workunit.client.1.smithi152.stdout:9/373: dwrite d1/ff [0,4194304] 0 2024-09-16T00:50:11.017 INFO:tasks.workunit.client.0.smithi053.stdout:5/36: link f0 d3/f8 0 2024-09-16T00:50:11.019 INFO:tasks.workunit.client.1.smithi152.stdout:0/302: link d3/d6/d8/d1d/d23/d25/d2a/l30 d3/d6/d8/d1d/d23/d4b/d54/l69 0 2024-09-16T00:50:11.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/374: dread d1/d4e/d48/d2b/f4d [0,4194304] 0 2024-09-16T00:50:11.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/224: creat dd/d15/f4a x:0 0 0 2024-09-16T00:50:11.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/225: creat dd/d26/d29/d2f/f4b x:0 0 0 2024-09-16T00:50:11.030 INFO:tasks.workunit.client.1.smithi152.stdout:1/393: creat d9/d3e/d41/d31/d48/d4a/f91 x:0 0 0 2024-09-16T00:50:11.032 INFO:tasks.workunit.client.1.smithi152.stdout:6/326: mkdir db/d12/d23/d4a/d43/d59/d67 0 2024-09-16T00:50:11.032 INFO:tasks.workunit.client.1.smithi152.stdout:6/327: creat db/d12/d20/f68 x:0 0 0 2024-09-16T00:50:11.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/394: dread d9/f19 [0,4194304] 0 2024-09-16T00:50:11.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/395: getdents d9/d3e/d41/d31/d48/d7d 0 2024-09-16T00:50:11.034 INFO:tasks.workunit.client.1.smithi152.stdout:4/481: link d2/d1e/d28/d69/l4e d2/d1e/l9a 0 2024-09-16T00:50:11.035 INFO:tasks.workunit.client.1.smithi152.stdout:4/482: write d2/d1e/d28/d29/f6a [4878098,38012] 0 2024-09-16T00:50:11.038 INFO:tasks.workunit.client.1.smithi152.stdout:0/303: rename d3/d6/d8/d1d/d23/d25/d45/d47 to d3/d6/d64/d6a 0 2024-09-16T00:50:11.038 INFO:tasks.workunit.client.1.smithi152.stdout:0/304: stat d3/f16 0 2024-09-16T00:50:11.042 INFO:tasks.workunit.client.0.smithi053.stdout:3/71: truncate d1/d5/f10 393551 0 2024-09-16T00:50:11.043 INFO:tasks.workunit.client.1.smithi152.stdout:6/328: mknod db/d12/d23/d4a/d43/d48/d64/c69 0 2024-09-16T00:50:11.046 INFO:tasks.workunit.client.1.smithi152.stdout:1/396: mknod d9/d3e/d4b/d50/c92 0 2024-09-16T00:50:11.046 INFO:tasks.workunit.client.1.smithi152.stdout:1/397: creat d9/d3e/d41/d31/d48/d4a/f93 x:0 0 0 2024-09-16T00:50:11.052 INFO:tasks.workunit.client.1.smithi152.stdout:9/375: rename d1/d74 to d1/d4e/d48/d26/d30/d4f/d50/d79 0 2024-09-16T00:50:11.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/226: link dd/d15/d49/f3c dd/f4c 0 2024-09-16T00:50:11.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/227: creat dd/d15/f4d x:0 0 0 2024-09-16T00:50:11.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/228: chown dd/d26/c37 1777 1 2024-09-16T00:50:11.059 INFO:tasks.workunit.client.1.smithi152.stdout:6/329: dwrite db/d12/d1c/f5c [0,4194304] 0 2024-09-16T00:50:11.059 INFO:tasks.workunit.client.1.smithi152.stdout:4/483: mknod d2/db/c9b 0 2024-09-16T00:50:11.064 INFO:tasks.workunit.client.1.smithi152.stdout:0/305: rename d3/d6/d8/d1d/d23/d4b/d54/c63 to d3/d6/d8/d1d/d23/d25/c6b 0 2024-09-16T00:50:11.065 INFO:tasks.workunit.client.1.smithi152.stdout:9/376: mknod d1/d4e/d48/d26/d30/d4f/c7a 0 2024-09-16T00:50:11.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/398: rmdir d9/d3e/d4b/d6b/d6d/d82 39 2024-09-16T00:50:11.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/399: dread - d9/d3e/d41/d31/f3a zero size 2024-09-16T00:50:11.070 INFO:tasks.workunit.client.1.smithi152.stdout:6/330: mkdir db/d12/d23/d4a/d43/d48/d6a 0 2024-09-16T00:50:11.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/484: rename d2/db/d39/f31 to d2/d1e/d28/d69/f9c 0 2024-09-16T00:50:11.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/485: creat d2/db/d39/f9d x:0 0 0 2024-09-16T00:50:11.074 INFO:tasks.workunit.client.1.smithi152.stdout:9/377: dread d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:11.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/306: creat d3/d6/d64/f6c x:0 0 0 2024-09-16T00:50:11.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/307: chown d3/d6/d8/f27 48229 1 2024-09-16T00:50:11.074 INFO:tasks.workunit.client.1.smithi152.stdout:7/299: sync 2024-09-16T00:50:11.075 INFO:tasks.workunit.client.0.smithi053.stdout:0/30: truncate d4/f5 3827831 0 2024-09-16T00:50:11.078 INFO:tasks.workunit.client.0.smithi053.stdout:0/31: creat d4/fb x:0 0 0 2024-09-16T00:50:11.078 INFO:tasks.workunit.client.1.smithi152.stdout:3/303: rmdir dc/d10/d17/d1c/d1f/d22/d2c/d3b 39 2024-09-16T00:50:11.083 INFO:tasks.workunit.client.1.smithi152.stdout:8/229: dwrite dd/d26/d29/d2f/f3d [0,4194304] 0 2024-09-16T00:50:11.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/308: mkdir d3/d6/d6d 0 2024-09-16T00:50:11.085 INFO:tasks.workunit.client.0.smithi053.stdout:0/32: mkdir d4/dc 0 2024-09-16T00:50:11.086 INFO:tasks.workunit.client.0.smithi053.stdout:5/37: getdents d3 0 2024-09-16T00:50:11.089 INFO:tasks.workunit.client.1.smithi152.stdout:7/300: write d9/f1b [4959482,37068] 0 2024-09-16T00:50:11.092 INFO:tasks.workunit.client.1.smithi152.stdout:3/304: dread f6 [0,4194304] 0 2024-09-16T00:50:11.095 INFO:tasks.workunit.client.1.smithi152.stdout:8/230: symlink dd/d15/d49/l4e 0 2024-09-16T00:50:11.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/301: creat d9/d31/d64/d3c/f71 x:0 0 0 2024-09-16T00:50:11.103 INFO:tasks.workunit.client.1.smithi152.stdout:3/305: mknod dc/d10/d17/d1c/d1f/d22/d2c/d2f/c5f 0 2024-09-16T00:50:11.103 INFO:tasks.workunit.client.1.smithi152.stdout:3/306: stat dc/d10/d17/d1c/d1f/f49 0 2024-09-16T00:50:11.106 INFO:tasks.workunit.client.0.smithi053.stdout:0/33: rename d4/l6 to d4/ld 0 2024-09-16T00:50:11.108 INFO:tasks.workunit.client.1.smithi152.stdout:3/307: creat dc/d10/d17/d4f/f60 x:0 0 0 2024-09-16T00:50:11.108 INFO:tasks.workunit.client.1.smithi152.stdout:3/308: chown dc/d10/d17/f59 311519 1 2024-09-16T00:50:11.108 INFO:tasks.workunit.client.1.smithi152.stdout:3/309: chown dc/d10/d17/d1c/d50/d55 787112 1 2024-09-16T00:50:11.109 INFO:tasks.workunit.client.0.smithi053.stdout:0/34: symlink d4/dc/le 0 2024-09-16T00:50:11.109 INFO:tasks.workunit.client.0.smithi053.stdout:0/35: stat d4/fb 0 2024-09-16T00:50:11.118 INFO:tasks.workunit.client.1.smithi152.stdout:2/338: sync 2024-09-16T00:50:11.118 INFO:tasks.workunit.client.1.smithi152.stdout:6/331: dwrite db/d12/d1c/f37 [0,4194304] 0 2024-09-16T00:50:11.119 INFO:tasks.workunit.client.1.smithi152.stdout:2/339: truncate d4/d19/d20/d28/f52 400761 0 2024-09-16T00:50:11.120 INFO:tasks.workunit.client.1.smithi152.stdout:4/486: dwrite d2/d1e/d28/d69/f9c [0,4194304] 0 2024-09-16T00:50:11.120 INFO:tasks.workunit.client.1.smithi152.stdout:9/378: dwrite d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:11.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/332: symlink db/d12/d1c/l6b 0 2024-09-16T00:50:11.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/333: chown db/d12/d23/d4a/d43/d48 1124 1 2024-09-16T00:50:11.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/334: write db/d12/d1c/f3f [450324,39690] 0 2024-09-16T00:50:11.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/335: chown db/f40 1516452 1 2024-09-16T00:50:11.125 INFO:tasks.workunit.client.1.smithi152.stdout:2/340: mkdir d4/d19/d20/d28/d2c/d77 0 2024-09-16T00:50:11.126 INFO:tasks.workunit.client.1.smithi152.stdout:2/341: chown d4/d19/d20/d28/d2c/f54 107 1 2024-09-16T00:50:11.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/468: sync 2024-09-16T00:50:11.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/469: creat d6/d57/d2b/d50/d64/fad x:0 0 0 2024-09-16T00:50:11.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/470: write d6/d57/d54/f84 [58467,13982] 0 2024-09-16T00:50:11.128 INFO:tasks.workunit.client.1.smithi152.stdout:7/302: dwrite d9/d10/d30/d41/d46/f6e [0,4194304] 0 2024-09-16T00:50:11.129 INFO:tasks.workunit.client.1.smithi152.stdout:7/303: truncate d9/d31/d65/d4b/f66 885622 0 2024-09-16T00:50:11.129 INFO:tasks.workunit.client.1.smithi152.stdout:0/309: dwrite d3/d6/d8/f27 [0,4194304] 0 2024-09-16T00:50:11.129 INFO:tasks.workunit.client.1.smithi152.stdout:0/310: readlink d3/d6/d64/d6a/l53 0 2024-09-16T00:50:11.129 INFO:tasks.workunit.client.1.smithi152.stdout:1/400: dwrite d9/d3e/d41/d31/d48/d4a/f93 [0,4194304] 0 2024-09-16T00:50:11.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/310: dwrite dc/d10/d17/d1c/d1f/d22/f53 [0,4194304] 0 2024-09-16T00:50:11.130 INFO:tasks.workunit.client.1.smithi152.stdout:4/487: symlink d2/d1e/d28/d69/l9e 0 2024-09-16T00:50:11.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/72: write d1/d5/f10 [213828,52183] 0 2024-09-16T00:50:11.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/73: write d1/d5/f10 [1086355,7029] 0 2024-09-16T00:50:11.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/74: write d1/d5/f10 [355918,130884] 0 2024-09-16T00:50:11.132 INFO:tasks.workunit.client.1.smithi152.stdout:9/379: mkdir d1/d4e/d48/d26/d58/d7b 0 2024-09-16T00:50:11.132 INFO:tasks.workunit.client.1.smithi152.stdout:9/380: fsync d1/d7/d13/d5d/f6b 0 2024-09-16T00:50:11.133 INFO:tasks.workunit.client.0.smithi053.stdout:3/75: dread d1/d5/f6 [0,4194304] 0 2024-09-16T00:50:11.133 INFO:tasks.workunit.client.0.smithi053.stdout:3/76: stat d1/le 0 2024-09-16T00:50:11.134 INFO:tasks.workunit.client.0.smithi053.stdout:3/77: fdatasync d1/d5/d11/f12 0 2024-09-16T00:50:11.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/342: creat d4/d19/f78 x:0 0 0 2024-09-16T00:50:11.138 INFO:tasks.workunit.client.0.smithi053.stdout:3/78: rename d1/d5/ld to d1/d5/l15 0 2024-09-16T00:50:11.141 INFO:tasks.workunit.client.1.smithi152.stdout:5/471: mknod d6/d16/d1f/cae 0 2024-09-16T00:50:11.141 INFO:tasks.workunit.client.1.smithi152.stdout:5/472: chown d6/d57/d2b/d50/d66/l75 0 1 2024-09-16T00:50:11.141 INFO:tasks.workunit.client.1.smithi152.stdout:5/473: fsync d6/d57/d2b/f79 0 2024-09-16T00:50:11.142 INFO:tasks.workunit.client.0.smithi053.stdout:3/79: mkdir d1/d5/d16 0 2024-09-16T00:50:11.142 INFO:tasks.workunit.client.0.smithi053.stdout:3/80: chown d1/d5/la 194026 1 2024-09-16T00:50:11.144 INFO:tasks.workunit.client.1.smithi152.stdout:7/304: dwrite d9/d31/d64/d3c/d5b/f60 [0,4194304] 0 2024-09-16T00:50:11.144 INFO:tasks.workunit.client.1.smithi152.stdout:7/305: truncate d9/d31/d64/f35 209443 0 2024-09-16T00:50:11.144 INFO:tasks.workunit.client.1.smithi152.stdout:7/306: fdatasync d9/f1f 0 2024-09-16T00:50:11.145 INFO:tasks.workunit.client.0.smithi053.stdout:3/81: symlink d1/l17 0 2024-09-16T00:50:11.146 INFO:tasks.workunit.client.0.smithi053.stdout:3/82: getdents d1/d5/d16 0 2024-09-16T00:50:11.146 INFO:tasks.workunit.client.0.smithi053.stdout:3/83: write d1/d5/d11/f12 [3706015,23318] 0 2024-09-16T00:50:11.146 INFO:tasks.workunit.client.0.smithi053.stdout:3/84: chown d1/d5/cf 23128 1 2024-09-16T00:50:11.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/311: mkdir d3/d6/d8/d1d/d65/d6e 0 2024-09-16T00:50:11.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/312: chown d3/d6/d8/d1d/d23/d25/d2a/f50 1560 1 2024-09-16T00:50:11.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/313: truncate d3/d6/d8/f40 4882984 0 2024-09-16T00:50:11.152 INFO:tasks.workunit.client.0.smithi053.stdout:3/85: dread d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:11.152 INFO:tasks.workunit.client.0.smithi053.stdout:8/97: truncate d10/f1d 3353604 0 2024-09-16T00:50:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:3/86: write d1/d5/f10 [853338,74501] 0 2024-09-16T00:50:11.155 INFO:tasks.workunit.client.1.smithi152.stdout:1/401: mknod d9/d3e/d41/d31/c94 0 2024-09-16T00:50:11.156 INFO:tasks.workunit.client.0.smithi053.stdout:3/87: dread d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:11.156 INFO:tasks.workunit.client.1.smithi152.stdout:0/314: dread d3/d6/d8/f40 [0,4194304] 0 2024-09-16T00:50:11.157 INFO:tasks.workunit.client.1.smithi152.stdout:0/315: stat d3/d6/d8/d1d/d23/d25/d2a/f66 0 2024-09-16T00:50:11.157 INFO:tasks.workunit.client.1.smithi152.stdout:0/316: chown d3/d6/d8/d1d/d23 38274490 1 2024-09-16T00:50:11.157 INFO:tasks.workunit.client.1.smithi152.stdout:0/317: stat d3/d6/d64 0 2024-09-16T00:50:11.159 INFO:tasks.workunit.client.1.smithi152.stdout:3/311: truncate dc/d10/d17/d1c/d1f/f2b 5895749 0 2024-09-16T00:50:11.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/488: rename d2/d1e/f5e to d2/db/d39/d3c/d7f/f9f 0 2024-09-16T00:50:11.164 INFO:tasks.workunit.client.1.smithi152.stdout:9/381: mkdir d1/d4e/d48/d2b/d7c 0 2024-09-16T00:50:11.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/343: creat d4/d19/d20/d28/d2c/f79 x:0 0 0 2024-09-16T00:50:11.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/344: write d4/d19/d20/d28/f2a [1057402,22916] 0 2024-09-16T00:50:11.166 INFO:tasks.workunit.client.1.smithi152.stdout:0/318: dread d3/d6/d8/d1d/d23/d25/f4d [0,4194304] 0 2024-09-16T00:50:11.166 INFO:tasks.workunit.client.1.smithi152.stdout:5/474: mknod d6/d16/caf 0 2024-09-16T00:50:11.170 INFO:tasks.workunit.client.1.smithi152.stdout:7/307: symlink d9/d31/d64/d3c/l72 0 2024-09-16T00:50:11.170 INFO:tasks.workunit.client.1.smithi152.stdout:7/308: read - d9/d31/d65/f69 zero size 2024-09-16T00:50:11.170 INFO:tasks.workunit.client.1.smithi152.stdout:7/309: readlink d9/d31/d64/d3c/d5b/l6c 0 2024-09-16T00:50:11.171 INFO:tasks.workunit.client.1.smithi152.stdout:1/402: symlink d9/d3e/d41/d31/d48/l95 0 2024-09-16T00:50:11.173 INFO:tasks.workunit.client.1.smithi152.stdout:3/312: mknod dc/c61 0 2024-09-16T00:50:11.173 INFO:tasks.workunit.client.1.smithi152.stdout:3/313: fsync f2 0 2024-09-16T00:50:11.173 INFO:tasks.workunit.client.1.smithi152.stdout:3/314: readlink dc/d10/l51 0 2024-09-16T00:50:11.173 INFO:tasks.workunit.client.1.smithi152.stdout:9/382: write d1/f57 [1114892,49096] 0 2024-09-16T00:50:11.176 INFO:tasks.workunit.client.1.smithi152.stdout:4/489: rename d2/fc to d2/d41/fa0 0 2024-09-16T00:50:11.176 INFO:tasks.workunit.client.1.smithi152.stdout:0/319: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f 0 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:4/490: dread - d2/db/d39/d95/f96 zero size 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:2/345: read d4/d17/f33 [636081,46815] 0 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:2/346: stat d4/c5d 0 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:2/347: readlink d4/d19/d20/d28/d2c/l60 0 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:2/348: fdatasync d4/f16 0 2024-09-16T00:50:11.177 INFO:tasks.workunit.client.1.smithi152.stdout:5/475: creat d6/d16/d1f/d65/d77/fb0 x:0 0 0 2024-09-16T00:50:11.178 INFO:tasks.workunit.client.1.smithi152.stdout:7/310: symlink d9/d31/d64/l73 0 2024-09-16T00:50:11.180 INFO:tasks.workunit.client.1.smithi152.stdout:1/403: creat d9/d3e/f96 x:0 0 0 2024-09-16T00:50:11.181 INFO:tasks.workunit.client.1.smithi152.stdout:9/383: write d1/d7/d77/d32/f35 [3507039,103712] 0 2024-09-16T00:50:11.182 INFO:tasks.workunit.client.1.smithi152.stdout:4/491: unlink d2/l3d 0 2024-09-16T00:50:11.183 INFO:tasks.workunit.client.1.smithi152.stdout:0/320: mknod d3/d6/d8/d1d/d65/c70 0 2024-09-16T00:50:11.185 INFO:tasks.workunit.client.1.smithi152.stdout:2/349: mkdir d4/d44/d7a 0 2024-09-16T00:50:11.186 INFO:tasks.workunit.client.1.smithi152.stdout:5/476: mknod d6/d57/d2b/d50/d66/cb1 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:7/311: link d9/l29 d9/d31/d65/d4b/l74 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:7/312: chown d9/d10/d30/d41/d46/f6e 2 1 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:7/313: write d9/fd [9059113,65001] 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/492: dread d2/db/d44/f53 [0,4194304] 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/493: creat d2/d1e/d28/d7b/fa1 x:0 0 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/494: dread - d2/d1e/d28/d7b/fa1 zero size 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:3/315: dwrite dc/f3d [0,4194304] 0 2024-09-16T00:50:11.188 INFO:tasks.workunit.client.1.smithi152.stdout:1/404: mkdir d9/d3e/d4b/d6b/d6d/d97 0 2024-09-16T00:50:11.190 INFO:tasks.workunit.client.1.smithi152.stdout:9/384: rename d1/l16 to d1/d4e/d48/d26/d30/d4f/l7d 0 2024-09-16T00:50:11.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/321: mknod d3/d6/d64/d6a/c71 0 2024-09-16T00:50:11.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/322: truncate d3/d6/d64/d6a/f4c 920582 0 2024-09-16T00:50:11.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/323: creat d3/d6/d8/d1d/d23/d25/f72 x:0 0 0 2024-09-16T00:50:11.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/350: truncate d4/d19/d20/d28/d2c/d5a/f75 3684608 0 2024-09-16T00:50:11.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/477: read d6/f44 [1233429,67486] 0 2024-09-16T00:50:11.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/478: creat d6/d16/d1f/d65/d77/fb2 x:0 0 0 2024-09-16T00:50:11.197 INFO:tasks.workunit.client.1.smithi152.stdout:7/314: rmdir d9 39 2024-09-16T00:50:11.197 INFO:tasks.workunit.client.1.smithi152.stdout:7/315: dread - d9/f5c zero size 2024-09-16T00:50:11.197 INFO:tasks.workunit.client.1.smithi152.stdout:7/316: truncate d9/d10/d30/f4a 1005445 0 2024-09-16T00:50:11.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/324: write d3/d6/f17 [3895643,52631] 0 2024-09-16T00:50:11.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/325: fdatasync d3/d6/d8/d1d/d23/f62 0 2024-09-16T00:50:11.199 INFO:tasks.workunit.client.1.smithi152.stdout:9/385: write d1/d7/d13/f27 [3219752,95457] 0 2024-09-16T00:50:11.200 INFO:tasks.workunit.client.1.smithi152.stdout:9/386: chown d1/d7/d13/f73 0 1 2024-09-16T00:50:11.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/316: mknod dc/d10/d17/d1c/d50/c62 0 2024-09-16T00:50:11.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/317: fsync dc/d10/d17/f52 0 2024-09-16T00:50:11.205 INFO:tasks.workunit.client.1.smithi152.stdout:1/405: truncate d9/da/df/f2b 117944 0 2024-09-16T00:50:11.205 INFO:tasks.workunit.client.1.smithi152.stdout:1/406: write d9/d3e/d41/d31/d48/d4a/f93 [4358818,2926] 0 2024-09-16T00:50:11.205 INFO:tasks.workunit.client.0.smithi053.stdout:8/98: dread d10/f1d [0,4194304] 0 2024-09-16T00:50:11.208 INFO:tasks.workunit.client.1.smithi152.stdout:4/495: rename d2/d1e/d28/d29/l19 to d2/db/d44/la2 0 2024-09-16T00:50:11.208 INFO:tasks.workunit.client.1.smithi152.stdout:4/496: creat d2/db/d39/d3c/fa3 x:0 0 0 2024-09-16T00:50:11.208 INFO:tasks.workunit.client.1.smithi152.stdout:4/497: dread - d2/db/d39/d95/f96 zero size 2024-09-16T00:50:11.216 INFO:tasks.workunit.client.1.smithi152.stdout:2/351: truncate d4/d19/f49 3880716 0 2024-09-16T00:50:11.216 INFO:tasks.workunit.client.1.smithi152.stdout:2/352: write d4/d19/d20/d28/d2c/f79 [964612,98313] 0 2024-09-16T00:50:11.216 INFO:tasks.workunit.client.1.smithi152.stdout:2/353: write d4/d19/d20/d28/f52 [290395,43308] 0 2024-09-16T00:50:11.224 INFO:tasks.workunit.client.1.smithi152.stdout:5/479: symlink d6/d16/d1f/d6c/lb3 0 2024-09-16T00:50:11.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/317: rmdir d9/d10/d30 39 2024-09-16T00:50:11.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/318: chown d9/d31/f5f 265852 1 2024-09-16T00:50:11.226 INFO:tasks.workunit.client.1.smithi152.stdout:0/326: creat d3/f73 x:0 0 0 2024-09-16T00:50:11.226 INFO:tasks.workunit.client.1.smithi152.stdout:9/387: getdents d1/d4e/d48/d2b 0 2024-09-16T00:50:11.228 INFO:tasks.workunit.client.1.smithi152.stdout:3/318: mkdir dc/d10/d17/d1c/d50/d63 0 2024-09-16T00:50:11.228 INFO:tasks.workunit.client.1.smithi152.stdout:3/319: write dc/d10/d17/d1c/d1f/d22/d2c/f2e [5126667,96286] 0 2024-09-16T00:50:11.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/319: dread d9/d10/d30/d41/f62 [0,4194304] 0 2024-09-16T00:50:11.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/320: chown f7 66834894 1 2024-09-16T00:50:11.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/321: truncate f3 9022691 0 2024-09-16T00:50:11.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/322: creat d9/d31/d64/d3c/f75 x:0 0 0 2024-09-16T00:50:11.231 INFO:tasks.workunit.client.1.smithi152.stdout:4/498: symlink d2/d1e/d28/d69/la4 0 2024-09-16T00:50:11.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/354: rmdir d4/d19/d20/d28 39 2024-09-16T00:50:11.237 INFO:tasks.workunit.client.1.smithi152.stdout:5/480: mknod d6/d16/cb4 0 2024-09-16T00:50:11.237 INFO:tasks.workunit.client.0.smithi053.stdout:8/99: dwrite d10/f24 [0,4194304] 0 2024-09-16T00:50:11.239 INFO:tasks.workunit.client.1.smithi152.stdout:3/320: rename dc/f3d to dc/d10/d17/d1c/d50/d63/f64 0 2024-09-16T00:50:11.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/407: dwrite d9/d3e/d41/d31/d38/f8a [0,4194304] 0 2024-09-16T00:50:11.245 INFO:tasks.workunit.client.1.smithi152.stdout:7/323: mknod d9/d31/d65/d6b/c76 0 2024-09-16T00:50:11.247 INFO:tasks.workunit.client.1.smithi152.stdout:9/388: dwrite d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:11.247 INFO:tasks.workunit.client.1.smithi152.stdout:0/327: dwrite d3/d6/d8/d1d/f49 [0,4194304] 0 2024-09-16T00:50:11.253 INFO:tasks.workunit.client.1.smithi152.stdout:4/499: link d2/f56 d2/d1e/d28/d7b/fa5 0 2024-09-16T00:50:11.254 INFO:tasks.workunit.client.0.smithi053.stdout:8/100: write d10/f20 [1654148,122438] 0 2024-09-16T00:50:11.263 INFO:tasks.workunit.client.1.smithi152.stdout:3/321: dwrite dc/f15 [4194304,4194304] 0 2024-09-16T00:50:11.263 INFO:tasks.workunit.client.1.smithi152.stdout:3/322: fdatasync dc/d10/d17/d1c/d1f/d22/d2c/f2e 0 2024-09-16T00:50:11.263 INFO:tasks.workunit.client.0.smithi053.stdout:8/101: link d10/d21/l22 d10/d1c/l25 0 2024-09-16T00:50:11.263 INFO:tasks.workunit.client.0.smithi053.stdout:8/102: stat cf 0 2024-09-16T00:50:11.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/389: truncate d1/d7/d77/d32/f49 65352 0 2024-09-16T00:50:11.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/390: creat d1/d4e/f7e x:0 0 0 2024-09-16T00:50:11.270 INFO:tasks.workunit.client.1.smithi152.stdout:7/324: dwrite f2 [0,4194304] 0 2024-09-16T00:50:11.272 INFO:tasks.workunit.client.1.smithi152.stdout:0/328: mknod d3/d6/d8/d1d/d23/d25/d2a/d5c/c74 0 2024-09-16T00:50:11.272 INFO:tasks.workunit.client.1.smithi152.stdout:0/329: write d3/d6/d64/f6c [371364,118819] 0 2024-09-16T00:50:11.273 INFO:tasks.workunit.client.1.smithi152.stdout:4/500: mknod d2/d41/ca6 0 2024-09-16T00:50:11.273 INFO:tasks.workunit.client.1.smithi152.stdout:4/501: write d2/d1e/d28/d29/f79 [1299520,79278] 0 2024-09-16T00:50:11.275 INFO:tasks.workunit.client.1.smithi152.stdout:4/502: write d2/db/d44/f68 [931222,80878] 0 2024-09-16T00:50:11.281 INFO:tasks.workunit.client.1.smithi152.stdout:2/355: write d4/d19/f49 [3692356,48517] 0 2024-09-16T00:50:11.281 INFO:tasks.workunit.client.1.smithi152.stdout:3/323: link f3 dc/d10/d17/d1c/d1f/d24/f65 0 2024-09-16T00:50:11.285 INFO:tasks.workunit.client.1.smithi152.stdout:7/325: creat d9/d31/d65/d6b/f77 x:0 0 0 2024-09-16T00:50:11.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/330: mknod d3/d6/d2e/c75 0 2024-09-16T00:50:11.289 INFO:tasks.workunit.client.1.smithi152.stdout:4/503: link d2/d1e/d28/d29/f23 d2/d1e/d28/d7b/fa7 0 2024-09-16T00:50:11.289 INFO:tasks.workunit.client.1.smithi152.stdout:4/504: fsync d2/d41/f72 0 2024-09-16T00:50:11.289 INFO:tasks.workunit.client.1.smithi152.stdout:7/326: dread d9/d31/d65/f59 [0,4194304] 0 2024-09-16T00:50:11.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/324: creat dc/d10/d17/d1c/d1f/d24/f66 x:0 0 0 2024-09-16T00:50:11.296 INFO:tasks.workunit.client.0.smithi053.stdout:8/103: dwrite d10/f19 [0,4194304] 0 2024-09-16T00:50:11.298 INFO:tasks.workunit.client.0.smithi053.stdout:8/104: truncate d10/f1d 2750242 0 2024-09-16T00:50:11.300 INFO:tasks.workunit.client.1.smithi152.stdout:3/325: rmdir dc/d10/d17/d4f 39 2024-09-16T00:50:11.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/356: dwrite d4/f5e [0,4194304] 0 2024-09-16T00:50:11.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/357: stat d4/d17/l2f 0 2024-09-16T00:50:11.305 INFO:tasks.workunit.client.1.smithi152.stdout:2/358: unlink d4/f74 0 2024-09-16T00:50:11.305 INFO:tasks.workunit.client.1.smithi152.stdout:5/481: write d6/d16/d1f/f3e [649729,116883] 0 2024-09-16T00:50:11.306 INFO:tasks.workunit.client.1.smithi152.stdout:4/505: dwrite d2/db/f2c [0,4194304] 0 2024-09-16T00:50:11.306 INFO:tasks.workunit.client.1.smithi152.stdout:4/506: chown d2/d1e/d28/d29/l3a 5989 1 2024-09-16T00:50:11.333 INFO:tasks.workunit.client.1.smithi152.stdout:0/331: dread d3/d6/d8/d1d/d23/d25/d2a/f2d [0,4194304] 0 2024-09-16T00:50:11.334 INFO:tasks.workunit.client.1.smithi152.stdout:9/391: dwrite d1/d59/f2f [0,4194304] 0 2024-09-16T00:50:11.334 INFO:tasks.workunit.client.1.smithi152.stdout:9/392: read d1/d7/d13/f73 [115437,75671] 0 2024-09-16T00:50:11.339 INFO:tasks.workunit.client.1.smithi152.stdout:2/359: stat d4/c11 0 2024-09-16T00:50:11.341 INFO:tasks.workunit.client.1.smithi152.stdout:2/360: dread d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:11.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/482: unlink d6/d16/c46 0 2024-09-16T00:50:11.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/483: chown d6/f30 1460 1 2024-09-16T00:50:11.344 INFO:tasks.workunit.client.0.smithi053.stdout:8/105: rmdir d10 39 2024-09-16T00:50:11.344 INFO:tasks.workunit.client.0.smithi053.stdout:8/106: chown f8 114671 1 2024-09-16T00:50:11.345 INFO:tasks.workunit.client.0.smithi053.stdout:8/107: fsync fb 0 2024-09-16T00:50:11.349 INFO:tasks.workunit.client.0.smithi053.stdout:8/108: creat d10/d1c/f26 x:0 0 0 2024-09-16T00:50:11.349 INFO:tasks.workunit.client.0.smithi053.stdout:8/109: write d10/f20 [4221351,63092] 0 2024-09-16T00:50:11.349 INFO:tasks.workunit.client.0.smithi053.stdout:8/110: chown l2 29 1 2024-09-16T00:50:11.349 INFO:tasks.workunit.client.0.smithi053.stdout:8/111: fdatasync f8 0 2024-09-16T00:50:11.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/332: unlink d3/f73 0 2024-09-16T00:50:11.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/333: readlink d3/l46 0 2024-09-16T00:50:11.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/334: chown d3/d6/d2e/d58 6 1 2024-09-16T00:50:11.354 INFO:tasks.workunit.client.1.smithi152.stdout:2/361: rename d4/d19/d20/d28/d2c/f54 to d4/d19/d20/d28/d2c/f7b 0 2024-09-16T00:50:11.354 INFO:tasks.workunit.client.0.smithi053.stdout:8/112: write d10/f15 [2177098,64850] 0 2024-09-16T00:50:11.355 INFO:tasks.workunit.client.1.smithi152.stdout:5/484: mkdir d6/d16/d1f/db5 0 2024-09-16T00:50:11.356 INFO:tasks.workunit.client.1.smithi152.stdout:4/507: rmdir d2/d1e/d28/d69 39 2024-09-16T00:50:11.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/485: dread d6/fb [0,4194304] 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:3/326: dwrite dc/d10/d17/d1c/d50/d63/f64 [0,4194304] 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:3/327: write dc/d10/d17/d1c/d1f/d22/d2c/d3b/f57 [1045553,114142] 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/327: dwrite d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/328: fdatasync d9/d31/d65/d4b/f66 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/329: creat d9/d31/d64/d3c/f78 x:0 0 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/330: write d9/d31/d64/d3c/f71 [564640,170] 0 2024-09-16T00:50:11.358 INFO:tasks.workunit.client.1.smithi152.stdout:9/393: dwrite d1/f31 [0,4194304] 0 2024-09-16T00:50:11.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/362: rename d4/d19/f5f to d4/d44/d7a/f7c 0 2024-09-16T00:50:11.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/363: truncate d4/d17/d3e/f4b 1024700 0 2024-09-16T00:50:11.361 INFO:tasks.workunit.client.1.smithi152.stdout:4/508: write d2/fe [86947,104708] 0 2024-09-16T00:50:11.362 INFO:tasks.workunit.client.0.smithi053.stdout:8/113: link d10/c17 d10/d21/c27 0 2024-09-16T00:50:11.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/335: dread d3/d6/d8/d1d/d23/d25/f3f [0,4194304] 0 2024-09-16T00:50:11.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/486: rmdir d6/d57 39 2024-09-16T00:50:11.366 INFO:tasks.workunit.client.1.smithi152.stdout:3/328: creat dc/d10/d17/d1c/d1f/d22/d2c/f67 x:0 0 0 2024-09-16T00:50:11.383 INFO:tasks.workunit.client.1.smithi152.stdout:7/331: mknod d9/d31/d65/d6b/c79 0 2024-09-16T00:50:11.389 INFO:tasks.workunit.client.1.smithi152.stdout:2/364: mknod d4/d44/c7d 0 2024-09-16T00:50:11.391 INFO:tasks.workunit.client.1.smithi152.stdout:4/509: mknod d2/db/d39/d3c/ca8 0 2024-09-16T00:50:11.395 INFO:tasks.workunit.client.1.smithi152.stdout:0/336: symlink d3/d6/d8/d1d/d23/d25/d45/d6f/l76 0 2024-09-16T00:50:11.395 INFO:tasks.workunit.client.1.smithi152.stdout:0/337: chown d3/d6/ld 1 1 2024-09-16T00:50:11.396 INFO:tasks.workunit.client.1.smithi152.stdout:5/487: link d6/d16/d1f/c78 d6/d57/d2b/d50/d66/cb6 0 2024-09-16T00:50:11.396 INFO:tasks.workunit.client.1.smithi152.stdout:0/338: dread d3/d6/f42 [0,4194304] 0 2024-09-16T00:50:11.396 INFO:tasks.workunit.client.0.smithi053.stdout:8/114: truncate d10/f19 2125619 0 2024-09-16T00:50:11.399 INFO:tasks.workunit.client.1.smithi152.stdout:3/329: mkdir dc/d10/d17/d5a/d68 0 2024-09-16T00:50:11.402 INFO:tasks.workunit.client.1.smithi152.stdout:7/332: unlink d9/d31/d64/d3c/l54 0 2024-09-16T00:50:11.404 INFO:tasks.workunit.client.1.smithi152.stdout:2/365: link d4/d19/f78 d4/d44/d7a/f7e 0 2024-09-16T00:50:11.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/339: mknod d3/d6/d2e/c77 0 2024-09-16T00:50:11.408 INFO:tasks.workunit.client.1.smithi152.stdout:4/510: dread d2/db/f66 [0,4194304] 0 2024-09-16T00:50:11.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/333: creat d9/d31/d64/d3c/d5b/f7a x:0 0 0 2024-09-16T00:50:11.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/334: dread - d9/d31/d64/d3c/d5b/f7a zero size 2024-09-16T00:50:11.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/335: stat d9/d31/d64/l2d 0 2024-09-16T00:50:11.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/336: creat d9/d31/d65/f7b x:0 0 0 2024-09-16T00:50:11.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/337: creat d9/d31/d65/f7c x:0 0 0 2024-09-16T00:50:11.410 INFO:tasks.workunit.client.1.smithi152.stdout:0/340: dread d3/d6/d8/d1d/d23/d25/f4d [0,4194304] 0 2024-09-16T00:50:11.410 INFO:tasks.workunit.client.1.smithi152.stdout:0/341: stat d3/d6/d8/d1d/d23/d25/f72 0 2024-09-16T00:50:11.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/338: mkdir d9/d10/d30/d41/d46/d7d 0 2024-09-16T00:50:11.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/339: truncate d9/d31/f5f 985634 0 2024-09-16T00:50:11.412 INFO:tasks.workunit.client.1.smithi152.stdout:8/231: sync 2024-09-16T00:50:11.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/342: link d3/f21 d3/d6/d2e/d58/f78 0 2024-09-16T00:50:11.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/343: truncate d3/f21 5326738 0 2024-09-16T00:50:11.414 INFO:tasks.workunit.client.1.smithi152.stdout:0/344: chown d3/d6/d4e/f55 74715661 1 2024-09-16T00:50:11.414 INFO:tasks.workunit.client.0.smithi053.stdout:8/115: dwrite fb [0,4194304] 0 2024-09-16T00:50:11.414 INFO:tasks.workunit.client.1.smithi152.stdout:7/340: mknod d9/d10/d30/d41/c7e 0 2024-09-16T00:50:11.415 INFO:tasks.workunit.client.1.smithi152.stdout:0/345: mknod d3/d6/d2e/c79 0 2024-09-16T00:50:11.416 INFO:tasks.workunit.client.0.smithi053.stdout:8/116: mkdir d10/d21/d28 0 2024-09-16T00:50:11.416 INFO:tasks.workunit.client.0.smithi053.stdout:8/117: write d10/d1c/f23 [261587,38920] 0 2024-09-16T00:50:11.418 INFO:tasks.workunit.client.1.smithi152.stdout:0/346: symlink d3/d6/d8/d1d/l7a 0 2024-09-16T00:50:11.418 INFO:tasks.workunit.client.1.smithi152.stdout:6/336: sync 2024-09-16T00:50:11.420 INFO:tasks.workunit.client.0.smithi053.stdout:8/118: link l1 d10/d21/d28/l29 0 2024-09-16T00:50:11.422 INFO:tasks.workunit.client.1.smithi152.stdout:0/347: link d3/c15 d3/d6/d2e/d58/c7b 0 2024-09-16T00:50:11.424 INFO:tasks.workunit.client.1.smithi152.stdout:6/337: rmdir db/d12/d23/d4a/d43/d48/d64 39 2024-09-16T00:50:11.424 INFO:tasks.workunit.client.1.smithi152.stdout:6/338: write db/d12/f3d [49491,35126] 0 2024-09-16T00:50:11.424 INFO:tasks.workunit.client.1.smithi152.stdout:6/339: getdents db/d12/d23/d4a/d43/d59/d67 0 2024-09-16T00:50:11.435 INFO:tasks.workunit.client.1.smithi152.stdout:7/341: dwrite d9/d31/d65/f69 [0,4194304] 0 2024-09-16T00:50:11.440 INFO:tasks.workunit.client.1.smithi152.stdout:7/342: rename d9/c24 to d9/d31/d65/d6b/c7f 0 2024-09-16T00:50:11.441 INFO:tasks.workunit.client.1.smithi152.stdout:7/343: write d9/d10/d30/d41/f62 [73957,46053] 0 2024-09-16T00:50:11.445 INFO:tasks.workunit.client.1.smithi152.stdout:7/344: rmdir d9/d10 39 2024-09-16T00:50:11.447 INFO:tasks.workunit.client.1.smithi152.stdout:7/345: mkdir d9/d80 0 2024-09-16T00:50:11.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/340: dwrite db/d12/d20/f36 [0,4194304] 0 2024-09-16T00:50:11.448 INFO:tasks.workunit.client.0.smithi053.stdout:8/119: dwrite d10/d1c/f26 [0,4194304] 0 2024-09-16T00:50:11.448 INFO:tasks.workunit.client.1.smithi152.stdout:0/348: dwrite d3/d6/d4e/f55 [0,4194304] 0 2024-09-16T00:50:11.449 INFO:tasks.workunit.client.1.smithi152.stdout:7/346: creat d9/d31/d65/d4b/f81 x:0 0 0 2024-09-16T00:50:11.456 INFO:tasks.workunit.client.0.smithi053.stdout:8/120: mknod d10/d1c/c2a 0 2024-09-16T00:50:11.459 INFO:tasks.workunit.client.1.smithi152.stdout:0/349: rename d3/d6/d8/d1d/d23/d25/d45/l56 to d3/d6/d8/d1d/d23/d4b/l7c 0 2024-09-16T00:50:11.459 INFO:tasks.workunit.client.1.smithi152.stdout:0/350: chown d3/d6/d8/d1d/d23/d25/d2a/f50 69486 1 2024-09-16T00:50:11.460 INFO:tasks.workunit.client.0.smithi053.stdout:8/121: mkdir d10/d1c/d2b 0 2024-09-16T00:50:11.460 INFO:tasks.workunit.client.0.smithi053.stdout:8/122: truncate d10/f1d 3356387 0 2024-09-16T00:50:11.460 INFO:tasks.workunit.client.0.smithi053.stdout:8/123: write d10/f24 [4841017,104040] 0 2024-09-16T00:50:11.461 INFO:tasks.workunit.client.0.smithi053.stdout:8/124: chown d10 3684935 1 2024-09-16T00:50:11.461 INFO:tasks.workunit.client.1.smithi152.stdout:7/347: mkdir d9/d80/d82 0 2024-09-16T00:50:11.461 INFO:tasks.workunit.client.1.smithi152.stdout:6/341: rmdir db/d12/d20/d4b 39 2024-09-16T00:50:11.462 INFO:tasks.workunit.client.0.smithi053.stdout:8/125: rmdir d10 39 2024-09-16T00:50:11.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/351: mknod d3/d6/c7d 0 2024-09-16T00:50:11.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/352: chown d3/d6/d8/d1d/d23/d25/f72 17915552 1 2024-09-16T00:50:11.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/353: fsync d3/d6/d8/d1d/f49 0 2024-09-16T00:50:11.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/354: write d3/d6/d8/d1d/d23/f62 [776769,52987] 0 2024-09-16T00:50:11.466 INFO:tasks.workunit.client.1.smithi152.stdout:7/348: link d9/d10/d30/d41/d46/c57 d9/d31/d64/d3c/c83 0 2024-09-16T00:50:11.467 INFO:tasks.workunit.client.1.smithi152.stdout:0/355: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e 0 2024-09-16T00:50:11.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/342: dread fa [0,4194304] 0 2024-09-16T00:50:11.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/343: dread - db/d12/d23/d4a/f5a zero size 2024-09-16T00:50:11.470 INFO:tasks.workunit.client.1.smithi152.stdout:0/356: creat d3/d6/f7f x:0 0 0 2024-09-16T00:50:11.472 INFO:tasks.workunit.client.1.smithi152.stdout:6/344: mknod db/d12/d20/d4b/c6c 0 2024-09-16T00:50:11.472 INFO:tasks.workunit.client.1.smithi152.stdout:6/345: chown db/d12/c1d 1194543615 1 2024-09-16T00:50:11.472 INFO:tasks.workunit.client.1.smithi152.stdout:6/346: readlink db/d12/d1c/l25 0 2024-09-16T00:50:11.474 INFO:tasks.workunit.client.1.smithi152.stdout:7/349: dread d9/f25 [0,4194304] 0 2024-09-16T00:50:11.475 INFO:tasks.workunit.client.1.smithi152.stdout:0/357: dread d3/d6/d8/d1d/d23/d25/d45/f5f [0,4194304] 0 2024-09-16T00:50:11.478 INFO:tasks.workunit.client.1.smithi152.stdout:6/347: rename db/d12/d1c/f37 to db/d12/d23/d4a/d43/d48/d64/f6d 0 2024-09-16T00:50:11.479 INFO:tasks.workunit.client.1.smithi152.stdout:7/350: symlink d9/d31/d64/l84 0 2024-09-16T00:50:11.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/358: rename d3/d6/d8/d1d/f48 to d3/d6/d64/f80 0 2024-09-16T00:50:11.482 INFO:tasks.workunit.client.1.smithi152.stdout:0/359: chown d3/d6/d8/d1d/d23/d25/d2a/l30 4014718 1 2024-09-16T00:50:11.482 INFO:tasks.workunit.client.1.smithi152.stdout:6/348: link db/d12/d23/d4a/d33/c65 db/d12/d20/c6e 0 2024-09-16T00:50:11.483 INFO:tasks.workunit.client.0.smithi053.stdout:8/126: dwrite d10/f1e [0,4194304] 0 2024-09-16T00:50:11.485 INFO:tasks.workunit.client.1.smithi152.stdout:1/408: sync 2024-09-16T00:50:11.485 INFO:tasks.workunit.client.1.smithi152.stdout:0/360: symlink d3/d6/d51/l81 0 2024-09-16T00:50:11.485 INFO:tasks.workunit.client.1.smithi152.stdout:1/409: write d9/d3e/d41/f87 [80645,20438] 0 2024-09-16T00:50:11.486 INFO:tasks.workunit.client.1.smithi152.stdout:6/349: mknod db/d12/d23/d4a/d43/d48/d6a/c6f 0 2024-09-16T00:50:11.491 INFO:tasks.workunit.client.1.smithi152.stdout:6/350: unlink db/d12/d23/d4a/f24 0 2024-09-16T00:50:11.491 INFO:tasks.workunit.client.0.smithi053.stdout:8/127: write d10/f1d [2272019,19894] 0 2024-09-16T00:50:11.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/351: write d9/d31/d64/d3c/f42 [189746,1243] 0 2024-09-16T00:50:11.492 INFO:tasks.workunit.client.1.smithi152.stdout:1/410: rmdir d9/d3e/d4b/d6b/d6d 39 2024-09-16T00:50:11.495 INFO:tasks.workunit.client.1.smithi152.stdout:6/351: mkdir db/d12/d23/d4a/d70 0 2024-09-16T00:50:11.495 INFO:tasks.workunit.client.1.smithi152.stdout:6/352: write db/d12/d23/d4a/f5f [1580604,18684] 0 2024-09-16T00:50:11.495 INFO:tasks.workunit.client.1.smithi152.stdout:6/353: chown f9 4974713 1 2024-09-16T00:50:11.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/411: dread d9/d3e/d41/d31/d48/d4a/f54 [0,4194304] 0 2024-09-16T00:50:11.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/412: rename d9 to d9/d3e/d41/d31/d38/d98 22 2024-09-16T00:50:11.498 INFO:tasks.workunit.client.0.smithi053.stdout:8/128: getdents d10/d1c 0 2024-09-16T00:50:11.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/361: dwrite d3/d6/d8/d1d/d23/f62 [0,4194304] 0 2024-09-16T00:50:11.500 INFO:tasks.workunit.client.1.smithi152.stdout:7/352: symlink d9/d31/d65/d6b/l85 0 2024-09-16T00:50:11.500 INFO:tasks.workunit.client.0.smithi053.stdout:8/129: fsync d10/d1c/f23 0 2024-09-16T00:50:11.504 INFO:tasks.workunit.client.0.smithi053.stdout:8/130: dread d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:11.504 INFO:tasks.workunit.client.1.smithi152.stdout:6/354: rmdir db/d28/d2c 39 2024-09-16T00:50:11.505 INFO:tasks.workunit.client.1.smithi152.stdout:1/413: mkdir d9/d3e/d4b/d6b/d6d/d99 0 2024-09-16T00:50:11.505 INFO:tasks.workunit.client.1.smithi152.stdout:1/414: fsync d9/d3e/d4b/f5f 0 2024-09-16T00:50:11.507 INFO:tasks.workunit.client.1.smithi152.stdout:7/353: mkdir d9/d10/d30/d41/d46/d7d/d86 0 2024-09-16T00:50:11.507 INFO:tasks.workunit.client.1.smithi152.stdout:7/354: write d9/d10/d30/f55 [836545,100586] 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/415: mkdir d9/d3e/d41/d9a 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/416: truncate d9/d3e/d7b/f7f 438766 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/417: write d9/d3e/d41/d31/d48/f63 [1384463,4092] 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/418: write d9/d3e/d41/d31/d48/f5e [997655,54891] 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/419: fdatasync d9/f19 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/420: fdatasync d9/f29 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/421: creat d9/f9b x:0 0 0 2024-09-16T00:50:11.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/362: dread d3/d6/d8/f27 [0,4194304] 0 2024-09-16T00:50:11.511 INFO:tasks.workunit.client.1.smithi152.stdout:7/355: unlink d9/d31/d64/l73 0 2024-09-16T00:50:11.512 INFO:tasks.workunit.client.1.smithi152.stdout:7/356: fsync d9/d10/f36 0 2024-09-16T00:50:11.512 INFO:tasks.workunit.client.1.smithi152.stdout:7/357: write d9/fd [635193,41036] 0 2024-09-16T00:50:11.516 INFO:tasks.workunit.client.1.smithi152.stdout:1/422: mknod d9/d3e/d41/d31/d48/c9c 0 2024-09-16T00:50:11.516 INFO:tasks.workunit.client.1.smithi152.stdout:0/363: rmdir d3/d6/d2e/d58 39 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/358: unlink d9/d10/f4d 0 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/359: stat d9/c15 0 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/360: dread - d9/d31/d65/d6b/f77 zero size 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/361: dread - d9/d31/d65/f28 zero size 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/362: write f8 [1757106,92046] 0 2024-09-16T00:50:11.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/363: write f8 [298858,27379] 0 2024-09-16T00:50:11.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/423: symlink d9/da/l9d 0 2024-09-16T00:50:11.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/424: chown d9 0 1 2024-09-16T00:50:11.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/364: mkdir d3/d6/d8/d1d/d65/d6e/d82 0 2024-09-16T00:50:11.520 INFO:tasks.workunit.client.1.smithi152.stdout:6/355: dwrite db/f45 [0,4194304] 0 2024-09-16T00:50:11.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/425: truncate d9/da/f1d 3692061 0 2024-09-16T00:50:11.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/426: chown d9/d3e/d41/c26 21548341 1 2024-09-16T00:50:11.522 INFO:tasks.workunit.client.1.smithi152.stdout:0/365: mknod d3/d6/d8/d1d/d65/d6e/d82/c83 0 2024-09-16T00:50:11.523 INFO:tasks.workunit.client.1.smithi152.stdout:6/356: mknod db/d28/c71 0 2024-09-16T00:50:11.524 INFO:tasks.workunit.client.1.smithi152.stdout:6/357: chown db/d12/d1c/l6b 2799 1 2024-09-16T00:50:11.524 INFO:tasks.workunit.client.1.smithi152.stdout:6/358: fdatasync db/d12/d1c/f3f 0 2024-09-16T00:50:11.525 INFO:tasks.workunit.client.1.smithi152.stdout:1/427: symlink d9/l9e 0 2024-09-16T00:50:11.525 INFO:tasks.workunit.client.1.smithi152.stdout:1/428: fdatasync d9/da/df/f47 0 2024-09-16T00:50:11.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/429: symlink d9/d3e/d4b/d6b/d6d/l9f 0 2024-09-16T00:50:11.530 INFO:tasks.workunit.client.1.smithi152.stdout:1/430: creat d9/d3e/d41/d31/fa0 x:0 0 0 2024-09-16T00:50:11.530 INFO:tasks.workunit.client.1.smithi152.stdout:1/431: dread - d9/d3e/d4b/d6b/d6d/f81 zero size 2024-09-16T00:50:11.535 INFO:tasks.workunit.client.1.smithi152.stdout:6/359: dread db/d28/f32 [0,4194304] 0 2024-09-16T00:50:11.535 INFO:tasks.workunit.client.1.smithi152.stdout:6/360: stat db/d28/d2c/l4c 0 2024-09-16T00:50:11.536 INFO:tasks.workunit.client.1.smithi152.stdout:9/394: sync 2024-09-16T00:50:11.537 INFO:tasks.workunit.client.1.smithi152.stdout:3/330: sync 2024-09-16T00:50:11.537 INFO:tasks.workunit.client.1.smithi152.stdout:5/488: sync 2024-09-16T00:50:11.541 INFO:tasks.workunit.client.1.smithi152.stdout:8/232: sync 2024-09-16T00:50:11.541 INFO:tasks.workunit.client.1.smithi152.stdout:4/511: sync 2024-09-16T00:50:11.541 INFO:tasks.workunit.client.1.smithi152.stdout:2/366: sync 2024-09-16T00:50:11.544 INFO:tasks.workunit.client.1.smithi152.stdout:5/489: getdents d6/d16/d1f 0 2024-09-16T00:50:11.544 INFO:tasks.workunit.client.1.smithi152.stdout:5/490: fdatasync d6/d57/d54/f90 0 2024-09-16T00:50:11.545 INFO:tasks.workunit.client.1.smithi152.stdout:4/512: unlink d2/db/c21 0 2024-09-16T00:50:11.545 INFO:tasks.workunit.client.1.smithi152.stdout:4/513: write d2/db/d39/d3c/d7f/f9f [3707934,77706] 0 2024-09-16T00:50:11.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/366: dwrite d3/d6/d8/d1d/d23/f62 [0,4194304] 0 2024-09-16T00:50:11.547 INFO:tasks.workunit.client.1.smithi152.stdout:8/233: rename dd/d26/d29/c44 to dd/d26/d29/d2f/c4f 0 2024-09-16T00:50:11.547 INFO:tasks.workunit.client.1.smithi152.stdout:8/234: fdatasync dd/d26/d29/d2f/f31 0 2024-09-16T00:50:11.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/361: dread db/d28/f3c [0,4194304] 0 2024-09-16T00:50:11.549 INFO:tasks.workunit.client.1.smithi152.stdout:6/362: write db/d12/f14 [5070142,77227] 0 2024-09-16T00:50:11.549 INFO:tasks.workunit.client.1.smithi152.stdout:6/363: creat db/d12/d20/f72 x:0 0 0 2024-09-16T00:50:11.549 INFO:tasks.workunit.client.1.smithi152.stdout:2/367: creat d4/d19/d20/d28/d2c/d5a/f7f x:0 0 0 2024-09-16T00:50:11.552 INFO:tasks.workunit.client.1.smithi152.stdout:7/364: dwrite d9/d31/d64/d3c/f44 [0,4194304] 0 2024-09-16T00:50:11.553 INFO:tasks.workunit.client.1.smithi152.stdout:8/235: dread - dd/f39 zero size 2024-09-16T00:50:11.557 INFO:tasks.workunit.client.1.smithi152.stdout:6/364: mknod db/d12/d1c/c73 0 2024-09-16T00:50:11.558 INFO:tasks.workunit.client.1.smithi152.stdout:1/432: dwrite d9/d3e/d41/d31/d48/f70 [0,4194304] 0 2024-09-16T00:50:11.558 INFO:tasks.workunit.client.1.smithi152.stdout:1/433: chown d9/d3e/f52 817759950 1 2024-09-16T00:50:11.558 INFO:tasks.workunit.client.1.smithi152.stdout:1/434: fdatasync d9/da/df/f69 0 2024-09-16T00:50:11.560 INFO:tasks.workunit.client.1.smithi152.stdout:2/368: write d4/d17/f1d [110118,102929] 0 2024-09-16T00:50:11.560 INFO:tasks.workunit.client.1.smithi152.stdout:2/369: fdatasync d4/d19/d20/d28/d2c/f7b 0 2024-09-16T00:50:11.560 INFO:tasks.workunit.client.1.smithi152.stdout:6/365: symlink db/d12/d23/d4a/d43/l74 0 2024-09-16T00:50:11.567 INFO:tasks.workunit.client.1.smithi152.stdout:4/514: write d2/db/f38 [175214,113947] 0 2024-09-16T00:50:11.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/331: dwrite dc/d10/d17/d1c/d1f/f2b [0,4194304] 0 2024-09-16T00:50:11.568 INFO:tasks.workunit.client.1.smithi152.stdout:0/367: dwrite d3/d6/d64/f80 [0,4194304] 0 2024-09-16T00:50:11.569 INFO:tasks.workunit.client.1.smithi152.stdout:2/370: link d4/d19/d20/d28/c51 d4/d19/d20/d28/c80 0 2024-09-16T00:50:11.570 INFO:tasks.workunit.client.1.smithi152.stdout:1/435: dread d9/f29 [0,4194304] 0 2024-09-16T00:50:11.571 INFO:tasks.workunit.client.1.smithi152.stdout:8/236: rename dd/d26 to dd/d50 0 2024-09-16T00:50:11.571 INFO:tasks.workunit.client.1.smithi152.stdout:8/237: truncate dd/d25/f48 64236 0 2024-09-16T00:50:11.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/368: truncate d3/d6/d8/d1d/d23/d25/f4d 431648 0 2024-09-16T00:50:11.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/369: write d3/d6/d8/f3d [2055031,125986] 0 2024-09-16T00:50:11.577 INFO:tasks.workunit.client.1.smithi152.stdout:1/436: dread d9/d3e/d4b/d50/f76 [0,4194304] 0 2024-09-16T00:50:11.578 INFO:tasks.workunit.client.1.smithi152.stdout:2/371: getdents d4/d17/d3e 0 2024-09-16T00:50:11.580 INFO:tasks.workunit.client.1.smithi152.stdout:4/515: dread d2/d1e/d28/d69/f9c [0,4194304] 0 2024-09-16T00:50:11.581 INFO:tasks.workunit.client.1.smithi152.stdout:8/238: link dd/d50/f28 dd/d15/d49/f51 0 2024-09-16T00:50:11.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/370: getdents d3/d6/d2e 0 2024-09-16T00:50:11.581 INFO:tasks.workunit.client.1.smithi152.stdout:1/437: mknod d9/d3e/d41/d31/d38/ca1 0 2024-09-16T00:50:11.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/516: dread d2/f16 [0,4194304] 0 2024-09-16T00:50:11.582 INFO:tasks.workunit.client.1.smithi152.stdout:6/366: dwrite db/f18 [4194304,4194304] 0 2024-09-16T00:50:11.586 INFO:tasks.workunit.client.1.smithi152.stdout:0/371: dread d3/d6/d8/f27 [0,4194304] 0 2024-09-16T00:50:11.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/332: write dc/d10/d17/d1c/d50/d63/f64 [1065898,52002] 0 2024-09-16T00:50:11.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/333: read f2 [3337880,34014] 0 2024-09-16T00:50:11.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/239: write dd/d15/d49/f3c [2488139,59687] 0 2024-09-16T00:50:11.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/240: creat dd/d15/f52 x:0 0 0 2024-09-16T00:50:11.597 INFO:tasks.workunit.client.1.smithi152.stdout:0/372: read d3/d6/d8/d1d/f49 [2494113,24647] 0 2024-09-16T00:50:11.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/438: mkdir d9/da/da2 0 2024-09-16T00:50:11.637 INFO:tasks.workunit.client.1.smithi152.stdout:2/372: dwrite d4/d17/d3e/f4b [0,4194304] 0 2024-09-16T00:50:11.637 INFO:tasks.workunit.client.1.smithi152.stdout:2/373: dread - d4/d44/f4e zero size 2024-09-16T00:50:11.637 INFO:tasks.workunit.client.1.smithi152.stdout:4/517: mknod d2/d8e/ca9 0 2024-09-16T00:50:11.647 INFO:tasks.workunit.client.1.smithi152.stdout:3/334: dwrite dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 [0,4194304] 0 2024-09-16T00:50:11.648 INFO:tasks.workunit.client.1.smithi152.stdout:8/241: write dd/ff [1433967,41665] 0 2024-09-16T00:50:11.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/373: truncate d3/d6/d8/f1c 1868369 0 2024-09-16T00:50:11.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/439: link d9/d3e/d4b/d50/c92 d9/d3e/d4b/d6b/d6d/ca3 0 2024-09-16T00:50:11.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/440: stat d9/d3e/d4b/d50 0 2024-09-16T00:50:11.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/441: readlink d9/da/l18 0 2024-09-16T00:50:11.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/442: chown d9/da/l5a 100026031 1 2024-09-16T00:50:11.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/443: fsync d9/d3e/d41/d31/d38/f5d 0 2024-09-16T00:50:11.653 INFO:tasks.workunit.client.1.smithi152.stdout:2/374: dwrite d4/d19/d20/d28/d2c/f79 [0,4194304] 0 2024-09-16T00:50:11.653 INFO:tasks.workunit.client.1.smithi152.stdout:2/375: stat d4/d19/d20/d28/c71 0 2024-09-16T00:50:11.660 INFO:tasks.workunit.client.1.smithi152.stdout:3/335: write dc/fe [7650367,9601] 0 2024-09-16T00:50:11.661 INFO:tasks.workunit.client.1.smithi152.stdout:4/518: truncate d2/db/d39/d3c/d7f/f9f 2584159 0 2024-09-16T00:50:11.661 INFO:tasks.workunit.client.1.smithi152.stdout:6/367: getdents db/d12/d23/d4a/d43 0 2024-09-16T00:50:11.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/242: mkdir dd/d50/d29/d2f/d53 0 2024-09-16T00:50:11.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/243: readlink dd/d15/d1a/l1c 0 2024-09-16T00:50:11.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/374: creat d3/d6/d8/f84 x:0 0 0 2024-09-16T00:50:11.667 INFO:tasks.workunit.client.1.smithi152.stdout:0/375: fdatasync d3/d6/f1e 0 2024-09-16T00:50:11.668 INFO:tasks.workunit.client.1.smithi152.stdout:1/444: symlink d9/d3e/d41/d31/d48/d4a/la4 0 2024-09-16T00:50:11.678 INFO:tasks.workunit.client.1.smithi152.stdout:2/376: creat d4/d19/d20/d28/f81 x:0 0 0 2024-09-16T00:50:11.678 INFO:tasks.workunit.client.1.smithi152.stdout:6/368: dwrite db/d12/d20/f3e [4194304,4194304] 0 2024-09-16T00:50:11.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/336: symlink dc/d10/d17/d1c/d1f/l69 0 2024-09-16T00:50:11.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/519: truncate d2/d1e/d28/d29/f4a 4059481 0 2024-09-16T00:50:11.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/244: symlink dd/d15/d49/l54 0 2024-09-16T00:50:11.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/245: chown dd/d50/f28 204007 1 2024-09-16T00:50:11.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/246: write dd/f16 [1025554,30828] 0 2024-09-16T00:50:11.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/247: dread - dd/f39 zero size 2024-09-16T00:50:11.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/248: creat dd/d23/f55 x:0 0 0 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:9/395: sync 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:0/376: link d3/d6/d8/d1d/d23/d25/f72 d3/d6/d51/f85 0 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:5/491: sync 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:5/492: chown d6/fa2 60 1 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:0/377: stat d3/d6/d8/d1d/d23/d25/d2a/f2d 0 2024-09-16T00:50:11.688 INFO:tasks.workunit.client.1.smithi152.stdout:0/378: chown d3/d6/d2e/l39 0 1 2024-09-16T00:50:11.689 INFO:tasks.workunit.client.1.smithi152.stdout:0/379: fdatasync d3/d6/d8/d1d/f68 0 2024-09-16T00:50:11.689 INFO:tasks.workunit.client.1.smithi152.stdout:7/365: sync 2024-09-16T00:50:11.689 INFO:tasks.workunit.client.1.smithi152.stdout:2/377: truncate f2 1341816 0 2024-09-16T00:50:11.689 INFO:tasks.workunit.client.1.smithi152.stdout:8/249: dread dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:11.689 INFO:tasks.workunit.client.1.smithi152.stdout:9/396: dread d1/d4e/d48/d2b/f4d [0,4194304] 0 2024-09-16T00:50:11.693 INFO:tasks.workunit.client.1.smithi152.stdout:0/380: mknod d3/d6/d8/d1d/d23/c86 0 2024-09-16T00:50:11.693 INFO:tasks.workunit.client.1.smithi152.stdout:0/381: stat d3/d6/d8/f27 0 2024-09-16T00:50:11.696 INFO:tasks.workunit.client.1.smithi152.stdout:7/366: mknod d9/d10/d30/d41/d46/c87 0 2024-09-16T00:50:11.696 INFO:tasks.workunit.client.1.smithi152.stdout:8/250: symlink dd/d15/d1a/l56 0 2024-09-16T00:50:11.697 INFO:tasks.workunit.client.1.smithi152.stdout:5/493: read d6/d57/d2b/f47 [1341128,81997] 0 2024-09-16T00:50:11.698 INFO:tasks.workunit.client.1.smithi152.stdout:4/520: rename d2/d1e/d28/d29/l3a to d2/laa 0 2024-09-16T00:50:11.700 INFO:tasks.workunit.client.1.smithi152.stdout:3/337: dwrite dc/d10/d17/d1c/d1f/d22/d2c/f2e [0,4194304] 0 2024-09-16T00:50:11.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/382: link d3/d6/d8/d1d/d23/d4b/d54/l69 d3/d6/d51/l87 0 2024-09-16T00:50:11.701 INFO:tasks.workunit.client.1.smithi152.stdout:6/369: dwrite db/d12/d23/d4a/d43/d48/d64/f6d [0,4194304] 0 2024-09-16T00:50:11.702 INFO:tasks.workunit.client.1.smithi152.stdout:7/367: creat d9/d10/d30/f88 x:0 0 0 2024-09-16T00:50:11.703 INFO:tasks.workunit.client.1.smithi152.stdout:9/397: dread d1/fb [0,4194304] 0 2024-09-16T00:50:11.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/494: symlink d6/d16/d1f/lb7 0 2024-09-16T00:50:11.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/495: fsync d6/d57/f4f 0 2024-09-16T00:50:11.705 INFO:tasks.workunit.client.1.smithi152.stdout:4/521: symlink d2/d8e/lab 0 2024-09-16T00:50:11.706 INFO:tasks.workunit.client.1.smithi152.stdout:3/338: dread dc/d10/d17/d1c/d50/d63/f64 [0,4194304] 0 2024-09-16T00:50:11.706 INFO:tasks.workunit.client.1.smithi152.stdout:3/339: truncate dc/d10/d17/d1c/d1f/d24/f66 446034 0 2024-09-16T00:50:11.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/383: symlink d3/d6/d2e/l88 0 2024-09-16T00:50:11.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/384: fdatasync d3/fc 0 2024-09-16T00:50:11.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/385: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 x:0 0 0 2024-09-16T00:50:11.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/386: creat d3/d6/f8a x:0 0 0 2024-09-16T00:50:11.711 INFO:tasks.workunit.client.1.smithi152.stdout:7/368: symlink d9/d80/d82/l89 0 2024-09-16T00:50:11.713 INFO:tasks.workunit.client.1.smithi152.stdout:8/251: symlink dd/l57 0 2024-09-16T00:50:11.716 INFO:tasks.workunit.client.1.smithi152.stdout:4/522: rmdir d2/db/d39/d3c/d7f 39 2024-09-16T00:50:11.719 INFO:tasks.workunit.client.1.smithi152.stdout:3/340: creat dc/d10/d17/d1c/f6a x:0 0 0 2024-09-16T00:50:11.723 INFO:tasks.workunit.client.1.smithi152.stdout:9/398: dread d1/d7/d13/d5d/f6b [0,4194304] 0 2024-09-16T00:50:11.724 INFO:tasks.workunit.client.1.smithi152.stdout:8/252: dread dd/f16 [0,4194304] 0 2024-09-16T00:50:11.724 INFO:tasks.workunit.client.1.smithi152.stdout:3/341: getdents dc/d10/d17/d1c/d1f/d22/d2c/d2f 0 2024-09-16T00:50:11.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/399: stat d1/d4e/d48/d66/l78 0 2024-09-16T00:50:11.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/496: rename d6/d16/da6 to d6/d16/d1f/d8c/db8 0 2024-09-16T00:50:11.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/369: dwrite f3 [8388608,4194304] 0 2024-09-16T00:50:11.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/370: read - d9/d31/d64/d3c/f78 zero size 2024-09-16T00:50:11.730 INFO:tasks.workunit.client.1.smithi152.stdout:8/253: creat dd/d50/d29/f58 x:0 0 0 2024-09-16T00:50:11.732 INFO:tasks.workunit.client.1.smithi152.stdout:0/387: rename d3/l46 to d3/d6/d8/d1d/d23/d4b/l8b 0 2024-09-16T00:50:11.734 INFO:tasks.workunit.client.1.smithi152.stdout:5/497: symlink d6/d16/d1f/db5/lb9 0 2024-09-16T00:50:11.736 INFO:tasks.workunit.client.1.smithi152.stdout:7/371: unlink d9/d31/d65/d6b/c76 0 2024-09-16T00:50:11.737 INFO:tasks.workunit.client.1.smithi152.stdout:8/254: symlink dd/d15/l59 0 2024-09-16T00:50:11.740 INFO:tasks.workunit.client.1.smithi152.stdout:9/400: rename d1/d7/d77/d32/c53 to d1/d4e/d48/d26/d30/c7f 0 2024-09-16T00:50:11.741 INFO:tasks.workunit.client.1.smithi152.stdout:0/388: mknod d3/d6/d8/d1d/d65/d6e/d82/c8c 0 2024-09-16T00:50:11.742 INFO:tasks.workunit.client.1.smithi152.stdout:3/342: dwrite dc/d10/d17/f37 [0,4194304] 0 2024-09-16T00:50:11.745 INFO:tasks.workunit.client.1.smithi152.stdout:9/401: mkdir d1/d7/d13/d80 0 2024-09-16T00:50:11.746 INFO:tasks.workunit.client.1.smithi152.stdout:5/498: write d6/d57/f3c [3244503,126723] 0 2024-09-16T00:50:11.748 INFO:tasks.workunit.client.1.smithi152.stdout:3/343: unlink dc/d10/d17/d1c/d1f/d22/f53 0 2024-09-16T00:50:11.749 INFO:tasks.workunit.client.1.smithi152.stdout:3/344: truncate dc/d10/d17/f52 920345 0 2024-09-16T00:50:11.749 INFO:tasks.workunit.client.1.smithi152.stdout:9/402: dread d1/fb [0,4194304] 0 2024-09-16T00:50:11.749 INFO:tasks.workunit.client.1.smithi152.stdout:9/403: chown d1/d7/d77/d3c 25139062 1 2024-09-16T00:50:11.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/389: write d3/d6/d8/d1d/f20 [4156676,19047] 0 2024-09-16T00:50:11.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/390: chown d3/d6/d8/d1d/d23/d25/d2a/f2d 798342 1 2024-09-16T00:50:11.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/499: mknod d6/d57/d2b/cba 0 2024-09-16T00:50:11.760 INFO:tasks.workunit.client.1.smithi152.stdout:9/404: creat d1/d4e/d48/d66/d76/f81 x:0 0 0 2024-09-16T00:50:11.763 INFO:tasks.workunit.client.1.smithi152.stdout:7/372: rename d9/d10/d30 to d9/d31/d65/d8a 0 2024-09-16T00:50:11.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/500: symlink d6/d57/d2b/d50/d66/lbb 0 2024-09-16T00:50:11.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/501: chown d6/f44 320 1 2024-09-16T00:50:11.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/502: creat d6/d57/d2b/d50/d6e/fbc x:0 0 0 2024-09-16T00:50:11.769 INFO:tasks.workunit.client.1.smithi152.stdout:3/345: dwrite f7 [4194304,4194304] 0 2024-09-16T00:50:11.769 INFO:tasks.workunit.client.1.smithi152.stdout:3/346: chown dc/d10/d17/d4f/f60 0 1 2024-09-16T00:50:11.769 INFO:tasks.workunit.client.1.smithi152.stdout:3/347: truncate dc/d10/d17/d1c/d1f/d24/f66 852462 0 2024-09-16T00:50:11.770 INFO:tasks.workunit.client.1.smithi152.stdout:5/503: creat d6/d16/d1f/d6c/fbd x:0 0 0 2024-09-16T00:50:11.770 INFO:tasks.workunit.client.1.smithi152.stdout:5/504: creat d6/d16/d1f/d6c/fbe x:0 0 0 2024-09-16T00:50:11.779 INFO:tasks.workunit.client.1.smithi152.stdout:5/505: read d6/d16/f36 [1708771,92737] 0 2024-09-16T00:50:11.783 INFO:tasks.workunit.client.1.smithi152.stdout:0/391: dwrite d3/f21 [0,4194304] 0 2024-09-16T00:50:11.784 INFO:tasks.workunit.client.1.smithi152.stdout:0/392: rename d3/d6/d8/d1d/f49 to d3/d6/d8/d1d/d23/d25/d2a/f8d 0 2024-09-16T00:50:11.785 INFO:tasks.workunit.client.1.smithi152.stdout:0/393: link d3/d6/d8/d1d/d23/d25/d45/f5f d3/d6/d6d/f8e 0 2024-09-16T00:50:11.786 INFO:tasks.workunit.client.1.smithi152.stdout:0/394: truncate d3/d6/d8/d1d/d23/d25/f4d 169423 0 2024-09-16T00:50:11.787 INFO:tasks.workunit.client.1.smithi152.stdout:0/395: chown d3/d6/d8/d1d/d23/d25/l3a 968 1 2024-09-16T00:50:11.787 INFO:tasks.workunit.client.1.smithi152.stdout:0/396: write d3/d6/d8/f1c [2890674,54455] 0 2024-09-16T00:50:11.787 INFO:tasks.workunit.client.1.smithi152.stdout:0/397: write d3/d6/d8/f40 [1427488,25732] 0 2024-09-16T00:50:11.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/370: dwrite db/d12/f1a [0,4194304] 0 2024-09-16T00:50:11.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/371: chown db/d12/d20/f2d 79 1 2024-09-16T00:50:11.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/372: chown db/d28/c71 20126264 1 2024-09-16T00:50:11.814 INFO:tasks.workunit.client.1.smithi152.stdout:6/373: rmdir db/d12/d23/d4a/d70 0 2024-09-16T00:50:11.816 INFO:tasks.workunit.client.1.smithi152.stdout:6/374: link db/d12/d23/d4a/d43/d48/d64/f6d db/d12/d23/f75 0 2024-09-16T00:50:11.816 INFO:tasks.workunit.client.1.smithi152.stdout:6/375: dread - db/d12/d23/d4a/d43/d48/f4d zero size 2024-09-16T00:50:11.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/376: truncate db/d28/f32 2752638 0 2024-09-16T00:50:11.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:11 smithi053 ceph-mon[27950]: pgmap v6: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:11.819 INFO:tasks.workunit.client.1.smithi152.stdout:6/377: mknod db/d12/d23/d4a/d43/d48/d64/c76 0 2024-09-16T00:50:11.819 INFO:tasks.workunit.client.1.smithi152.stdout:9/405: dwrite d1/f31 [0,4194304] 0 2024-09-16T00:50:11.820 INFO:tasks.workunit.client.1.smithi152.stdout:6/378: mknod db/d12/d1c/c77 0 2024-09-16T00:50:11.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/406: creat d1/d7/d77/d68/f82 x:0 0 0 2024-09-16T00:50:11.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/407: truncate d1/d7/d77/f33 2166092 0 2024-09-16T00:50:11.833 INFO:tasks.workunit.client.1.smithi152.stdout:7/373: dwrite d9/d31/d65/d8a/f88 [0,4194304] 0 2024-09-16T00:50:11.833 INFO:tasks.workunit.client.1.smithi152.stdout:7/374: creat d9/d31/d64/d3c/f8b x:0 0 0 2024-09-16T00:50:11.833 INFO:tasks.workunit.client.1.smithi152.stdout:7/375: fdatasync d9/d31/d64/d3c/d5b/f7a 0 2024-09-16T00:50:11.833 INFO:tasks.workunit.client.1.smithi152.stdout:7/376: readlink d9/d31/d64/l84 0 2024-09-16T00:50:11.837 INFO:tasks.workunit.client.1.smithi152.stdout:7/377: symlink d9/d80/l8c 0 2024-09-16T00:50:11.838 INFO:tasks.workunit.client.1.smithi152.stdout:7/378: mknod d9/d10/c8d 0 2024-09-16T00:50:11.838 INFO:tasks.workunit.client.1.smithi152.stdout:7/379: write d9/d31/d65/d6b/f77 [30750,49660] 0 2024-09-16T00:50:11.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/380: creat d9/d31/d64/f8e x:0 0 0 2024-09-16T00:50:11.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/381: fsync d9/d31/d64/d3c/f42 0 2024-09-16T00:50:11.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/348: dwrite dc/d10/d17/d1c/d1f/f2b [0,4194304] 0 2024-09-16T00:50:11.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/349: stat dc/d10/d17/c1b 0 2024-09-16T00:50:11.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/350: chown dc/d10/d17/d5a/c5b 695217877 1 2024-09-16T00:50:11.843 INFO:tasks.workunit.client.1.smithi152.stdout:5/506: dwrite d6/fb [0,4194304] 0 2024-09-16T00:50:11.845 INFO:tasks.workunit.client.1.smithi152.stdout:0/398: dwrite d3/d6/d64/f80 [0,4194304] 0 2024-09-16T00:50:11.845 INFO:tasks.workunit.client.1.smithi152.stdout:0/399: chown d3/d6/d8/d1d/d23/d25/l3a 946166 1 2024-09-16T00:50:11.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/379: dwrite db/d12/d20/f51 [0,4194304] 0 2024-09-16T00:50:11.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/380: readlink db/d12/d1c/l41 0 2024-09-16T00:50:11.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/381: fsync db/d12/f14 0 2024-09-16T00:50:11.847 INFO:tasks.workunit.client.1.smithi152.stdout:3/351: symlink dc/d10/d17/d1c/d1f/d24/l6b 0 2024-09-16T00:50:11.856 INFO:tasks.workunit.client.1.smithi152.stdout:5/507: mkdir d6/d16/d1f/d8c/db8/dbf 0 2024-09-16T00:50:11.861 INFO:tasks.workunit.client.1.smithi152.stdout:7/382: dwrite d9/f1f [0,4194304] 0 2024-09-16T00:50:11.863 INFO:tasks.workunit.client.1.smithi152.stdout:5/508: rename d6/d16/d1f/d6c/fbe to d6/d16/d1f/db5/fc0 0 2024-09-16T00:50:11.863 INFO:tasks.workunit.client.1.smithi152.stdout:5/509: chown d6/d57/d2b/d50/d64/d92/f9a 2481972 1 2024-09-16T00:50:11.869 INFO:tasks.workunit.client.1.smithi152.stdout:0/400: dwrite d3/d6/f2f [4194304,4194304] 0 2024-09-16T00:50:11.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/383: mknod d9/d31/d64/d3c/c8f 0 2024-09-16T00:50:11.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/382: dwrite db/d12/d20/f51 [0,4194304] 0 2024-09-16T00:50:11.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/383: write db/d12/d23/d4a/f5f [2406429,91042] 0 2024-09-16T00:50:11.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/384: unlink d9/d31/d64/c43 0 2024-09-16T00:50:11.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/401: dread d3/d6/d8/d1d/f20 [0,4194304] 0 2024-09-16T00:50:11.873 INFO:tasks.workunit.client.1.smithi152.stdout:1/445: sync 2024-09-16T00:50:11.873 INFO:tasks.workunit.client.1.smithi152.stdout:1/446: chown d9/c20 40640 1 2024-09-16T00:50:11.875 INFO:tasks.workunit.client.1.smithi152.stdout:1/447: getdents d9/da 0 2024-09-16T00:50:11.875 INFO:tasks.workunit.client.1.smithi152.stdout:1/448: fdatasync d9/d3e/d4b/d6b/d6d/f81 0 2024-09-16T00:50:11.875 INFO:tasks.workunit.client.1.smithi152.stdout:1/449: write d9/d3e/d4b/f5f [298622,82476] 0 2024-09-16T00:50:11.875 INFO:tasks.workunit.client.1.smithi152.stdout:5/510: read d6/d16/f4d [3898555,81738] 0 2024-09-16T00:50:11.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/450: mkdir d9/d3e/d41/d31/da5 0 2024-09-16T00:50:11.882 INFO:tasks.workunit.client.1.smithi152.stdout:1/451: mknod d9/d3e/d41/ca6 0 2024-09-16T00:50:11.882 INFO:tasks.workunit.client.1.smithi152.stdout:1/452: write d9/d3e/d4b/d50/f76 [4398954,31479] 0 2024-09-16T00:50:11.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/453: symlink d9/d3e/d41/d9a/la7 0 2024-09-16T00:50:11.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/454: fsync d9/d3e/d41/d31/d48/f6e 0 2024-09-16T00:50:11.887 INFO:tasks.workunit.client.1.smithi152.stdout:3/352: dwrite dc/f2d [0,4194304] 0 2024-09-16T00:50:11.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/385: dread d9/d31/d64/d3c/f42 [0,4194304] 0 2024-09-16T00:50:11.887 INFO:tasks.workunit.client.1.smithi152.stdout:3/353: truncate dc/d10/d17/d1c/f6a 674897 0 2024-09-16T00:50:11.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/386: mkdir d9/d31/d65/d8a/d90 0 2024-09-16T00:50:11.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/354: creat dc/f6c x:0 0 0 2024-09-16T00:50:11.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/511: dread d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:11.894 INFO:tasks.workunit.client.1.smithi152.stdout:3/355: mkdir dc/d10/d17/d1c/d50/d55/d6d 0 2024-09-16T00:50:11.894 INFO:tasks.workunit.client.1.smithi152.stdout:3/356: fdatasync dc/d10/d17/d1c/d1f/d24/f65 0 2024-09-16T00:50:11.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/512: unlink d6/c12 0 2024-09-16T00:50:11.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/513: chown d6/l59 2991090 1 2024-09-16T00:50:11.896 INFO:tasks.workunit.client.1.smithi152.stdout:5/514: creat d6/d57/d2b/d50/d6e/fc1 x:0 0 0 2024-09-16T00:50:11.896 INFO:tasks.workunit.client.1.smithi152.stdout:5/515: write d6/d16/d1f/d6c/f88 [4378721,52120] 0 2024-09-16T00:50:11.896 INFO:tasks.workunit.client.1.smithi152.stdout:3/357: mknod dc/d10/d47/c6e 0 2024-09-16T00:50:11.896 INFO:tasks.workunit.client.1.smithi152.stdout:1/455: write d9/d3e/d41/d31/d38/f8a [1280296,104457] 0 2024-09-16T00:50:11.897 INFO:tasks.workunit.client.1.smithi152.stdout:6/384: dwrite db/d12/f14 [4194304,4194304] 0 2024-09-16T00:50:11.898 INFO:tasks.workunit.client.1.smithi152.stdout:5/516: mknod d6/d16/d1f/cc2 0 2024-09-16T00:50:11.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/385: rename l7 to db/d28/l78 0 2024-09-16T00:50:11.903 INFO:tasks.workunit.client.1.smithi152.stdout:6/386: write db/d12/d23/d4a/d43/d48/f4d [914101,72448] 0 2024-09-16T00:50:11.904 INFO:tasks.workunit.client.1.smithi152.stdout:5/517: mknod d6/d57/d2b/d50/d6e/cc3 0 2024-09-16T00:50:11.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/402: dwrite d3/f21 [0,4194304] 0 2024-09-16T00:50:11.905 INFO:tasks.workunit.client.1.smithi152.stdout:1/456: dread d9/f19 [0,4194304] 0 2024-09-16T00:50:11.906 INFO:tasks.workunit.client.1.smithi152.stdout:6/387: rename db/d12/d20/f68 to db/d12/d23/f79 0 2024-09-16T00:50:11.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/518: creat d6/d16/d1f/db5/fc4 x:0 0 0 2024-09-16T00:50:11.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/358: dread f6 [0,4194304] 0 2024-09-16T00:50:11.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/387: dwrite d9/f25 [4194304,4194304] 0 2024-09-16T00:50:11.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/457: symlink d9/d3e/d7b/la8 0 2024-09-16T00:50:11.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/458: creat d9/d3e/d7b/fa9 x:0 0 0 2024-09-16T00:50:11.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/403: rename d3/d6/d8/d1d/d23/d25/d2a/f2d to d3/d6/d6d/f8f 0 2024-09-16T00:50:11.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/404: truncate d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 47770 0 2024-09-16T00:50:11.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/405: chown d3/d6/d8/d1d/d23/d25/f3f 39837 1 2024-09-16T00:50:11.921 INFO:tasks.workunit.client.1.smithi152.stdout:6/388: creat db/d28/d2c/f7a x:0 0 0 2024-09-16T00:50:11.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/519: link d6/d57/d2b/d50/d66/cb6 d6/d16/cc5 0 2024-09-16T00:50:11.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/520: fdatasync d6/d57/d2b/fac 0 2024-09-16T00:50:11.925 INFO:tasks.workunit.client.1.smithi152.stdout:3/359: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f 0 2024-09-16T00:50:11.925 INFO:tasks.workunit.client.1.smithi152.stdout:3/360: write dc/d10/d17/d1c/d1f/d24/f39 [588212,68504] 0 2024-09-16T00:50:11.925 INFO:tasks.workunit.client.1.smithi152.stdout:3/361: chown f6 5 1 2024-09-16T00:50:11.925 INFO:tasks.workunit.client.1.smithi152.stdout:3/362: chown dc/c36 687030650 1 2024-09-16T00:50:11.926 INFO:tasks.workunit.client.1.smithi152.stdout:3/363: dread dc/d10/d17/d1c/d1f/d24/f66 [0,4194304] 0 2024-09-16T00:50:11.926 INFO:tasks.workunit.client.1.smithi152.stdout:3/364: write dc/d10/d17/d1c/d50/d63/f64 [4261410,42709] 0 2024-09-16T00:50:11.928 INFO:tasks.workunit.client.1.smithi152.stdout:7/388: mknod d9/d31/d64/d3c/c91 0 2024-09-16T00:50:11.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/459: creat d9/d3e/d4b/d6b/d6d/d97/faa x:0 0 0 2024-09-16T00:50:11.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/460: chown d9/da/l18 80958 1 2024-09-16T00:50:11.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/461: chown d9/d3e/d41/d31/d48/d4a/f54 534537903 1 2024-09-16T00:50:11.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/406: link d3/d6/d8/d1d/f26 d3/d6/d8/d1d/d23/d4b/d54/f90 0 2024-09-16T00:50:11.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/407: dread - d3/d6/d8/d1d/d23/d25/d2a/d5c/f67 zero size 2024-09-16T00:50:11.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/408: stat d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 0 2024-09-16T00:50:11.933 INFO:tasks.workunit.client.1.smithi152.stdout:6/389: unlink db/d12/d23/d4a/d33/c65 0 2024-09-16T00:50:11.933 INFO:tasks.workunit.client.1.smithi152.stdout:5/521: truncate d6/d57/d2b/f31 3795866 0 2024-09-16T00:50:11.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/365: mknod dc/d10/d17/d1c/c70 0 2024-09-16T00:50:11.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/389: mknod d9/d31/d64/d3c/d5b/c92 0 2024-09-16T00:50:11.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/366: dread dc/d10/d17/d1c/d1f/f2a [0,4194304] 0 2024-09-16T00:50:11.946 INFO:tasks.workunit.client.1.smithi152.stdout:2/378: sync 2024-09-16T00:50:11.946 INFO:tasks.workunit.client.1.smithi152.stdout:4/523: sync 2024-09-16T00:50:11.946 INFO:tasks.workunit.client.1.smithi152.stdout:2/379: chown d4/d19/d20/d28/c39 85 1 2024-09-16T00:50:11.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:11 smithi152 ceph-mon[33237]: pgmap v6: 65 pgs: 65 active+clean; 530 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:50:11.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/522: dread d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:11.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/523: creat d6/d57/d2b/d50/d64/d92/fc6 x:0 0 0 2024-09-16T00:50:11.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/524: creat d6/d16/d1f/d65/d77/fc7 x:0 0 0 2024-09-16T00:50:11.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/525: creat d6/d57/d2b/d50/d66/fc8 x:0 0 0 2024-09-16T00:50:11.947 INFO:tasks.workunit.client.1.smithi152.stdout:0/409: link d3/d6/f7f d3/d6/d8/d1d/d65/d6e/d82/f91 0 2024-09-16T00:50:11.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/367: mknod dc/d10/d47/c71 0 2024-09-16T00:50:11.950 INFO:tasks.workunit.client.1.smithi152.stdout:4/524: getdents d2/d1e 0 2024-09-16T00:50:11.950 INFO:tasks.workunit.client.1.smithi152.stdout:4/525: fsync d2/db/d39/f9d 0 2024-09-16T00:50:11.952 INFO:tasks.workunit.client.1.smithi152.stdout:2/380: link d4/d17/d3e/l43 d4/d17/l82 0 2024-09-16T00:50:11.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/390: dread d9/f37 [0,4194304] 0 2024-09-16T00:50:11.954 INFO:tasks.workunit.client.1.smithi152.stdout:1/462: dwrite d9/d3e/d41/f87 [0,4194304] 0 2024-09-16T00:50:11.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/391: dread - d9/d31/d64/f8e zero size 2024-09-16T00:50:11.955 INFO:tasks.workunit.client.1.smithi152.stdout:7/392: write d9/fd [8718451,62437] 0 2024-09-16T00:50:11.958 INFO:tasks.workunit.client.1.smithi152.stdout:5/526: symlink d6/d16/d1f/db5/lc9 0 2024-09-16T00:50:11.958 INFO:tasks.workunit.client.1.smithi152.stdout:6/390: dwrite db/d12/f14 [4194304,4194304] 0 2024-09-16T00:50:11.958 INFO:tasks.workunit.client.1.smithi152.stdout:6/391: chown db/d12/d1c/l25 3429586 1 2024-09-16T00:50:11.958 INFO:tasks.workunit.client.1.smithi152.stdout:3/368: dread dc/d10/d17/f37 [0,4194304] 0 2024-09-16T00:50:11.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/381: write d4/d19/d20/f47 [78089,127893] 0 2024-09-16T00:50:11.959 INFO:tasks.workunit.client.1.smithi152.stdout:0/410: symlink d3/d6/d8/d1d/d23/d25/l92 0 2024-09-16T00:50:11.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/463: rmdir d9/d3e/d7b/d90 0 2024-09-16T00:50:11.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/464: chown d9/d3e/d41/d31/d38/l71 28826604 1 2024-09-16T00:50:11.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/465: readlink d9/d3e/d41/d31/d48/l95 0 2024-09-16T00:50:11.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/466: truncate d9/d3e/d4b/d6b/d6d/d97/faa 425480 0 2024-09-16T00:50:11.966 INFO:tasks.workunit.client.1.smithi152.stdout:7/393: rename d9/d31/d65/d8a/f88 to d9/f93 0 2024-09-16T00:50:11.968 INFO:tasks.workunit.client.1.smithi152.stdout:5/527: link d6/d57/d2b/d50/d66/cb6 d6/d16/d1f/d8c/cca 0 2024-09-16T00:50:11.969 INFO:tasks.workunit.client.1.smithi152.stdout:6/392: symlink db/d12/d23/d3a/l7b 0 2024-09-16T00:50:11.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/526: dwrite d2/d1e/d28/d69/f9c [0,4194304] 0 2024-09-16T00:50:11.974 INFO:tasks.workunit.client.1.smithi152.stdout:2/382: symlink d4/d19/d20/d34/l83 0 2024-09-16T00:50:11.975 INFO:tasks.workunit.client.1.smithi152.stdout:0/411: symlink d3/d6/d8/d1d/d65/l93 0 2024-09-16T00:50:11.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/369: dwrite dc/f15 [0,4194304] 0 2024-09-16T00:50:11.980 INFO:tasks.workunit.client.1.smithi152.stdout:1/467: mknod d9/d3e/d41/d31/d38/cab 0 2024-09-16T00:50:11.983 INFO:tasks.workunit.client.1.smithi152.stdout:7/394: unlink d9/d31/c47 0 2024-09-16T00:50:11.983 INFO:tasks.workunit.client.1.smithi152.stdout:7/395: fsync d9/d31/d65/d6b/f77 0 2024-09-16T00:50:11.985 INFO:tasks.workunit.client.1.smithi152.stdout:5/528: mkdir d6/d16/d1f/db5/dcb 0 2024-09-16T00:50:11.988 INFO:tasks.workunit.client.1.smithi152.stdout:2/383: mknod d4/d19/d20/d28/c84 0 2024-09-16T00:50:11.992 INFO:tasks.workunit.client.1.smithi152.stdout:1/468: getdents d9/d3e/d4b/d6b/d6d/d82 0 2024-09-16T00:50:11.992 INFO:tasks.workunit.client.1.smithi152.stdout:1/469: truncate d9/d3e/d41/d31/d38/f39 1417775 0 2024-09-16T00:50:11.994 INFO:tasks.workunit.client.1.smithi152.stdout:7/396: rename d9/d31/d64/l6f to d9/d31/d65/d8a/d41/l94 0 2024-09-16T00:50:11.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/527: dwrite d2/d1e/d28/d69/f8f [0,4194304] 0 2024-09-16T00:50:11.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/528: fdatasync d2/d1e/d28/d7b/fa1 0 2024-09-16T00:50:11.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/529: readlink d2/d1e/l9a 0 2024-09-16T00:50:11.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/530: chown d2/d1e/d28/d69 10300 1 2024-09-16T00:50:11.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/531: truncate d2/d1e/d28/d69/f5b 2129337 0 2024-09-16T00:50:11.997 INFO:tasks.workunit.client.1.smithi152.stdout:5/529: mknod d6/d16/d1f/d8c/ccc 0 2024-09-16T00:50:11.997 INFO:tasks.workunit.client.1.smithi152.stdout:5/530: chown d6/d57/d54/l62 1083910 1 2024-09-16T00:50:11.998 INFO:tasks.workunit.client.1.smithi152.stdout:2/384: mknod d4/d19/d20/d28/d2c/d5a/c85 0 2024-09-16T00:50:11.999 INFO:tasks.workunit.client.1.smithi152.stdout:1/470: creat d9/d3e/d41/fac x:0 0 0 2024-09-16T00:50:11.999 INFO:tasks.workunit.client.1.smithi152.stdout:1/471: write d9/d3e/d41/d31/f3a [654950,57038] 0 2024-09-16T00:50:12.000 INFO:tasks.workunit.client.1.smithi152.stdout:7/397: rmdir d9/d31/d65/d8a 39 2024-09-16T00:50:12.001 INFO:tasks.workunit.client.1.smithi152.stdout:8/255: sync 2024-09-16T00:50:12.002 INFO:tasks.workunit.client.1.smithi152.stdout:9/408: sync 2024-09-16T00:50:12.002 INFO:tasks.workunit.client.1.smithi152.stdout:8/256: creat dd/d15/f5a x:0 0 0 2024-09-16T00:50:12.003 INFO:tasks.workunit.client.1.smithi152.stdout:0/412: dwrite d3/d6/d8/d1d/f20 [0,4194304] 0 2024-09-16T00:50:12.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/531: creat d6/d16/d1f/d8c/db8/fcd x:0 0 0 2024-09-16T00:50:12.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/370: dwrite dc/f2d [0,4194304] 0 2024-09-16T00:50:12.010 INFO:tasks.workunit.client.1.smithi152.stdout:1/472: mknod d9/d3e/d4b/d6b/d6d/d99/cad 0 2024-09-16T00:50:12.012 INFO:tasks.workunit.client.1.smithi152.stdout:7/398: symlink d9/d31/d64/d3c/d5b/l95 0 2024-09-16T00:50:12.012 INFO:tasks.workunit.client.1.smithi152.stdout:9/409: dread d1/d7/d77/f33 [0,4194304] 0 2024-09-16T00:50:12.014 INFO:tasks.workunit.client.1.smithi152.stdout:2/385: rmdir d4/d19/d20/d28/d2c/d5a 39 2024-09-16T00:50:12.015 INFO:tasks.workunit.client.1.smithi152.stdout:8/257: mknod dd/d50/c5b 0 2024-09-16T00:50:12.018 INFO:tasks.workunit.client.1.smithi152.stdout:0/413: unlink d3/d6/d8/d1d/d65/d6e/d82/c8c 0 2024-09-16T00:50:12.018 INFO:tasks.workunit.client.1.smithi152.stdout:0/414: chown d3/d6/d64 1 1 2024-09-16T00:50:12.020 INFO:tasks.workunit.client.1.smithi152.stdout:4/532: mknod d2/db/cac 0 2024-09-16T00:50:12.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/371: rename dc/d10/d17/d1c/f6a to dc/d10/d17/d1c/d1f/d22/f72 0 2024-09-16T00:50:12.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/372: fsync dc/d10/d17/d1c/d1f/d22/d2c/f2e 0 2024-09-16T00:50:12.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/373: write dc/d10/d17/d1c/d1f/d22/d2c/f67 [449097,25225] 0 2024-09-16T00:50:12.023 INFO:tasks.workunit.client.1.smithi152.stdout:5/532: dwrite d6/fa5 [0,4194304] 0 2024-09-16T00:50:12.027 INFO:tasks.workunit.client.1.smithi152.stdout:9/410: mkdir d1/d4e/d48/d26/d30/d4f/d50/d83 0 2024-09-16T00:50:12.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/258: mknod dd/d15/c5c 0 2024-09-16T00:50:12.030 INFO:tasks.workunit.client.1.smithi152.stdout:0/415: mkdir d3/d6/d8/d1d/d23/d94 0 2024-09-16T00:50:12.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/259: creat dd/d25/f5d x:0 0 0 2024-09-16T00:50:12.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/260: readlink dd/d50/d29/d2f/l32 0 2024-09-16T00:50:12.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/261: dread - dd/d50/d29/d2f/f4b zero size 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/473: rename d9/d3e/d4b/d6b/d6d/d97/faa to d9/d3e/d41/d31/d48/d7d/fae 0 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/474: creat d9/faf x:0 0 0 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/475: truncate d9/d3e/d41/f8d 1061616 0 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/476: chown d9/d3e/d41/f3b 1 1 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/477: read - d9/da/df/f69 zero size 2024-09-16T00:50:12.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/478: fdatasync d9/d3e/d41/d31/d48/f70 0 2024-09-16T00:50:12.035 INFO:tasks.workunit.client.1.smithi152.stdout:3/374: mknod dc/d10/d17/d5a/d68/c73 0 2024-09-16T00:50:12.036 INFO:tasks.workunit.client.1.smithi152.stdout:9/411: creat d1/d4e/d34/f84 x:0 0 0 2024-09-16T00:50:12.036 INFO:tasks.workunit.client.1.smithi152.stdout:9/412: dread - d1/d4e/d34/f84 zero size 2024-09-16T00:50:12.036 INFO:tasks.workunit.client.1.smithi152.stdout:9/413: fdatasync d1/d4e/d34/f39 0 2024-09-16T00:50:12.038 INFO:tasks.workunit.client.1.smithi152.stdout:1/479: creat d9/d3e/d41/d31/d38/fb0 x:0 0 0 2024-09-16T00:50:12.039 INFO:tasks.workunit.client.1.smithi152.stdout:1/480: chown d9/d3e/d41/f60 10921889 1 2024-09-16T00:50:12.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/481: rename d9/da/c62 to d9/d3e/d41/d9a/cb1 0 2024-09-16T00:50:12.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/482: chown d9/da/df/l35 7935577 1 2024-09-16T00:50:12.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/375: rmdir dc/d10/d17/d1c/d1f/d22/d2c 39 2024-09-16T00:50:12.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/376: chown dc/d10/d17/d1c/d1f/d22/d2c/d2f/c40 213744 1 2024-09-16T00:50:12.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/483: mkdir d9/d3e/d41/d31/d48/db2 0 2024-09-16T00:50:12.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/484: fsync d9/d3e/f49 0 2024-09-16T00:50:12.043 INFO:tasks.workunit.client.1.smithi152.stdout:2/386: dwrite d4/d19/d20/d28/d2c/f7b [0,4194304] 0 2024-09-16T00:50:12.043 INFO:tasks.workunit.client.1.smithi152.stdout:0/416: dread d3/d6/d4e/f55 [0,4194304] 0 2024-09-16T00:50:12.044 INFO:tasks.workunit.client.1.smithi152.stdout:2/387: chown d4/d19/d20/d28/d2c/d4d/f69 257949260 1 2024-09-16T00:50:12.044 INFO:tasks.workunit.client.1.smithi152.stdout:2/388: chown d4/d19/d20/d28/d2c/d4d/f5c 40101 1 2024-09-16T00:50:12.044 INFO:tasks.workunit.client.1.smithi152.stdout:2/389: write d4/d19/d20/d28/f52 [1144337,92682] 0 2024-09-16T00:50:12.044 INFO:tasks.workunit.client.1.smithi152.stdout:7/399: dwrite d9/f1b [0,4194304] 0 2024-09-16T00:50:12.044 INFO:tasks.workunit.client.1.smithi152.stdout:3/377: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/d74 0 2024-09-16T00:50:12.045 INFO:tasks.workunit.client.1.smithi152.stdout:3/378: getdents dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/d74 0 2024-09-16T00:50:12.045 INFO:tasks.workunit.client.1.smithi152.stdout:3/379: write f3 [5321325,78136] 0 2024-09-16T00:50:12.045 INFO:tasks.workunit.client.1.smithi152.stdout:3/380: truncate dc/f15 8528065 0 2024-09-16T00:50:12.046 INFO:tasks.workunit.client.1.smithi152.stdout:1/485: unlink d9/da/df/f47 0 2024-09-16T00:50:12.048 INFO:tasks.workunit.client.1.smithi152.stdout:0/417: unlink d3/d6/c38 0 2024-09-16T00:50:12.049 INFO:tasks.workunit.client.1.smithi152.stdout:0/418: creat d3/d6/d64/f95 x:0 0 0 2024-09-16T00:50:12.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/414: write d1/d59/f2f [1158946,101743] 0 2024-09-16T00:50:12.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/415: write d1/d7/d77/f33 [1612608,85586] 0 2024-09-16T00:50:12.049 INFO:tasks.workunit.client.1.smithi152.stdout:4/533: dwrite d2/d1e/d28/d29/f6a [0,4194304] 0 2024-09-16T00:50:12.049 INFO:tasks.workunit.client.1.smithi152.stdout:5/533: dwrite d6/d57/d2b/d50/d66/f87 [0,4194304] 0 2024-09-16T00:50:12.050 INFO:tasks.workunit.client.1.smithi152.stdout:5/534: fdatasync d6/d16/d1f/d6c/f73 0 2024-09-16T00:50:12.052 INFO:tasks.workunit.client.1.smithi152.stdout:5/535: dread d6/d16/d1f/f2e [0,4194304] 0 2024-09-16T00:50:12.052 INFO:tasks.workunit.client.1.smithi152.stdout:5/536: chown d6/d57/d2b/d50/c8e 32971 1 2024-09-16T00:50:12.052 INFO:tasks.workunit.client.1.smithi152.stdout:5/537: creat d6/d57/d2b/d50/d6e/fce x:0 0 0 2024-09-16T00:50:12.052 INFO:tasks.workunit.client.1.smithi152.stdout:2/390: rename d4/d19/d20/d28/d2c/d5a to d4/d44/d7a/d86 0 2024-09-16T00:50:12.052 INFO:tasks.workunit.client.1.smithi152.stdout:7/400: dread d9/d31/d64/d3c/f42 [0,4194304] 0 2024-09-16T00:50:12.053 INFO:tasks.workunit.client.1.smithi152.stdout:3/381: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d2f/d75 0 2024-09-16T00:50:12.057 INFO:tasks.workunit.client.1.smithi152.stdout:3/382: write dc/d10/d17/d1c/d1f/d24/f66 [535958,128290] 0 2024-09-16T00:50:12.057 INFO:tasks.workunit.client.1.smithi152.stdout:3/383: read dc/d10/d17/d1c/d50/d63/f64 [1040872,53164] 0 2024-09-16T00:50:12.058 INFO:tasks.workunit.client.1.smithi152.stdout:3/384: fsync f6 0 2024-09-16T00:50:12.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/419: mknod d3/d6/d8/d1d/d23/d25/d45/d6f/c96 0 2024-09-16T00:50:12.059 INFO:tasks.workunit.client.1.smithi152.stdout:9/416: mknod d1/d4e/d48/d2b/d7c/c85 0 2024-09-16T00:50:12.061 INFO:tasks.workunit.client.1.smithi152.stdout:4/534: symlink d2/d1e/d28/d7b/lad 0 2024-09-16T00:50:12.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/391: mkdir d4/d44/d7a/d86/d87 0 2024-09-16T00:50:12.067 INFO:tasks.workunit.client.1.smithi152.stdout:7/401: symlink d9/d31/d64/l96 0 2024-09-16T00:50:12.073 INFO:tasks.workunit.client.1.smithi152.stdout:5/538: dwrite d6/d16/d1f/d6c/f73 [0,4194304] 0 2024-09-16T00:50:12.074 INFO:tasks.workunit.client.1.smithi152.stdout:5/539: truncate d6/d57/d2b/d50/d6e/fce 424304 0 2024-09-16T00:50:12.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/420: write d3/d6/d8/d1d/d23/f3b [3754473,91529] 0 2024-09-16T00:50:12.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/392: write d4/d44/d7a/d86/f75 [1883387,75953] 0 2024-09-16T00:50:12.074 INFO:tasks.workunit.client.1.smithi152.stdout:4/535: read d2/db/d44/f94 [4167136,105355] 0 2024-09-16T00:50:12.076 INFO:tasks.workunit.client.1.smithi152.stdout:3/385: creat dc/d10/d17/d1c/d1f/d22/d2c/f76 x:0 0 0 2024-09-16T00:50:12.076 INFO:tasks.workunit.client.1.smithi152.stdout:3/386: chown dc/d10/d17/d1c/d1f/d22/d2c/c4a 381842 1 2024-09-16T00:50:12.077 INFO:tasks.workunit.client.1.smithi152.stdout:1/486: link d9/d3e/d41/d9a/cb1 d9/d3e/d4b/d6b/d6d/d82/cb3 0 2024-09-16T00:50:12.078 INFO:tasks.workunit.client.1.smithi152.stdout:1/487: write d9/da/df/f46 [410064,93057] 0 2024-09-16T00:50:12.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/417: creat d1/d7/d13/d80/f86 x:0 0 0 2024-09-16T00:50:12.082 INFO:tasks.workunit.client.1.smithi152.stdout:3/387: write dc/d10/d17/f37 [2922528,110908] 0 2024-09-16T00:50:12.087 INFO:tasks.workunit.client.1.smithi152.stdout:5/540: mknod d6/d57/d2b/d50/d6e/ccf 0 2024-09-16T00:50:12.090 INFO:tasks.workunit.client.1.smithi152.stdout:0/421: mknod d3/d6/d64/d6a/d61/c97 0 2024-09-16T00:50:12.090 INFO:tasks.workunit.client.1.smithi152.stdout:0/422: write d3/d6/f2f [8668084,43502] 0 2024-09-16T00:50:12.093 INFO:tasks.workunit.client.1.smithi152.stdout:2/393: symlink d4/d19/d20/d28/d2c/l88 0 2024-09-16T00:50:12.093 INFO:tasks.workunit.client.1.smithi152.stdout:2/394: chown d4/f9 23 1 2024-09-16T00:50:12.093 INFO:tasks.workunit.client.1.smithi152.stdout:2/395: fsync d4/d19/d20/d28/d2c/d4d/f69 0 2024-09-16T00:50:12.096 INFO:tasks.workunit.client.1.smithi152.stdout:3/388: mkdir dc/d10/d17/d1c/d1f/d22/d2c/d2f/d46/d77 0 2024-09-16T00:50:12.097 INFO:tasks.workunit.client.1.smithi152.stdout:5/541: mknod d6/d57/d54/cd0 0 2024-09-16T00:50:12.100 INFO:tasks.workunit.client.1.smithi152.stdout:3/389: symlink dc/d10/d17/d1c/d50/d63/l78 0 2024-09-16T00:50:12.103 INFO:tasks.workunit.client.1.smithi152.stdout:5/542: rename d6/d57/d2b/c58 to d6/d16/d1f/d65/cd1 0 2024-09-16T00:50:12.103 INFO:tasks.workunit.client.1.smithi152.stdout:5/543: readlink l5 0 2024-09-16T00:50:12.103 INFO:tasks.workunit.client.1.smithi152.stdout:5/544: write d6/f1a [4873052,51851] 0 2024-09-16T00:50:12.104 INFO:tasks.workunit.client.1.smithi152.stdout:5/545: fsync d6/d16/d1f/d65/d77/f80 0 2024-09-16T00:50:12.104 INFO:tasks.workunit.client.1.smithi152.stdout:5/546: truncate d6/d57/f4f 119561 0 2024-09-16T00:50:12.104 INFO:tasks.workunit.client.1.smithi152.stdout:0/423: dread d3/d6/d6d/f8e [0,4194304] 0 2024-09-16T00:50:12.104 INFO:tasks.workunit.client.1.smithi152.stdout:0/424: dread - d3/d6/d8/d1d/d23/d25/f72 zero size 2024-09-16T00:50:12.104 INFO:tasks.workunit.client.1.smithi152.stdout:2/396: getdents d4/d17 0 2024-09-16T00:50:12.105 INFO:tasks.workunit.client.1.smithi152.stdout:0/425: rmdir d3/d6/d8/d1d/d23/d25/d45/d6f 39 2024-09-16T00:50:12.106 INFO:tasks.workunit.client.1.smithi152.stdout:0/426: write d3/d6/f1f [389349,61341] 0 2024-09-16T00:50:12.106 INFO:tasks.workunit.client.1.smithi152.stdout:1/488: dwrite d9/f19 [0,4194304] 0 2024-09-16T00:50:12.106 INFO:tasks.workunit.client.1.smithi152.stdout:7/402: dwrite f7 [0,4194304] 0 2024-09-16T00:50:12.106 INFO:tasks.workunit.client.1.smithi152.stdout:1/489: fsync d9/d3e/d41/f40 0 2024-09-16T00:50:12.106 INFO:tasks.workunit.client.1.smithi152.stdout:1/490: chown d9/da/df/c7e 1866195 1 2024-09-16T00:50:12.108 INFO:tasks.workunit.client.1.smithi152.stdout:2/397: creat d4/d17/d3e/f89 x:0 0 0 2024-09-16T00:50:12.108 INFO:tasks.workunit.client.1.smithi152.stdout:2/398: chown d4/d19/d20/d28/f52 13567952 1 2024-09-16T00:50:12.110 INFO:tasks.workunit.client.1.smithi152.stdout:0/427: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98 0 2024-09-16T00:50:12.110 INFO:tasks.workunit.client.1.smithi152.stdout:4/536: dwrite d2/db/d39/d95/f96 [0,4194304] 0 2024-09-16T00:50:12.113 INFO:tasks.workunit.client.1.smithi152.stdout:7/403: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d97 0 2024-09-16T00:50:12.115 INFO:tasks.workunit.client.1.smithi152.stdout:7/404: dread d9/d31/f67 [0,4194304] 0 2024-09-16T00:50:12.115 INFO:tasks.workunit.client.1.smithi152.stdout:7/405: creat d9/d31/d65/f98 x:0 0 0 2024-09-16T00:50:12.116 INFO:tasks.workunit.client.1.smithi152.stdout:1/491: rename d9/d3e/d4b/d6b/d6d/d99/cad to d9/d3e/d4b/d6b/cb4 0 2024-09-16T00:50:12.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/418: getdents d1/d7/d13/d80 0 2024-09-16T00:50:12.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/419: fsync d1/d7/d77/d68/f82 0 2024-09-16T00:50:12.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/420: read d1/d7/d13/f27 [855860,14289] 0 2024-09-16T00:50:12.126 INFO:tasks.workunit.client.1.smithi152.stdout:7/406: dread f2 [0,4194304] 0 2024-09-16T00:50:12.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/537: stat d2/db/l2b 0 2024-09-16T00:50:12.134 INFO:tasks.workunit.client.1.smithi152.stdout:5/547: dwrite d6/d16/d1f/d8c/db8/fa7 [0,4194304] 0 2024-09-16T00:50:12.134 INFO:tasks.workunit.client.1.smithi152.stdout:0/428: dwrite d3/d6/d4e/f55 [0,4194304] 0 2024-09-16T00:50:12.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/429: write d3/d6/d8/d1d/d23/d25/f4d [75108,3356] 0 2024-09-16T00:50:12.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/430: write d3/d6/f7f [562041,42540] 0 2024-09-16T00:50:12.138 INFO:tasks.workunit.client.1.smithi152.stdout:3/390: dwrite dc/d10/d17/d1c/d1f/d22/d2c/f67 [0,4194304] 0 2024-09-16T00:50:12.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/399: getdents d4/d19/d20/d28 0 2024-09-16T00:50:12.148 INFO:tasks.workunit.client.1.smithi152.stdout:0/431: fdatasync d3/d6/d8/d1d/d23/f3b 0 2024-09-16T00:50:12.148 INFO:tasks.workunit.client.1.smithi152.stdout:5/548: mkdir d6/d16/d1f/d65/dd2 0 2024-09-16T00:50:12.153 INFO:tasks.workunit.client.1.smithi152.stdout:0/432: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:12.153 INFO:tasks.workunit.client.1.smithi152.stdout:0/433: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/f99 x:0 0 0 2024-09-16T00:50:12.153 INFO:tasks.workunit.client.1.smithi152.stdout:7/407: dwrite d9/d31/d65/f7b [0,4194304] 0 2024-09-16T00:50:12.153 INFO:tasks.workunit.client.1.smithi152.stdout:7/408: write d9/f23 [1615975,109768] 0 2024-09-16T00:50:12.155 INFO:tasks.workunit.client.1.smithi152.stdout:3/391: truncate dc/f35 173032 0 2024-09-16T00:50:12.156 INFO:tasks.workunit.client.1.smithi152.stdout:2/400: write d4/d19/f72 [2763003,14115] 0 2024-09-16T00:50:12.156 INFO:tasks.workunit.client.1.smithi152.stdout:1/492: getdents d9/d3e/d41/d31/d38 0 2024-09-16T00:50:12.158 INFO:tasks.workunit.client.1.smithi152.stdout:5/549: mkdir d6/d16/d1f/db5/dd3 0 2024-09-16T00:50:12.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/538: dwrite d2/db/d44/f50 [0,4194304] 0 2024-09-16T00:50:12.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/539: write d2/db/d39/d3c/f85 [828934,102386] 0 2024-09-16T00:50:12.161 INFO:tasks.workunit.client.1.smithi152.stdout:9/421: dwrite d1/d7/d77/f43 [0,4194304] 0 2024-09-16T00:50:12.161 INFO:tasks.workunit.client.1.smithi152.stdout:0/434: link d3/d6/d8/d1d/d23/d25/l3a d3/d6/d6d/l9a 0 2024-09-16T00:50:12.166 INFO:tasks.workunit.client.1.smithi152.stdout:7/409: mknod d9/d31/d64/d3c/c99 0 2024-09-16T00:50:12.166 INFO:tasks.workunit.client.1.smithi152.stdout:1/493: write d9/d3e/d41/f87 [1720902,22206] 0 2024-09-16T00:50:12.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/401: creat d4/d44/d7a/f8a x:0 0 0 2024-09-16T00:50:12.171 INFO:tasks.workunit.client.1.smithi152.stdout:9/422: dread d1/d7/d77/f43 [0,4194304] 0 2024-09-16T00:50:12.174 INFO:tasks.workunit.client.1.smithi152.stdout:3/392: dread f3 [0,4194304] 0 2024-09-16T00:50:12.174 INFO:tasks.workunit.client.1.smithi152.stdout:3/393: chown dc/d10/d17/d1c/l3a 0 1 2024-09-16T00:50:12.174 INFO:tasks.workunit.client.1.smithi152.stdout:3/394: truncate dc/d10/d17/d1c/d1f/d22/d2c/d3b/f5e 161922 0 2024-09-16T00:50:12.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/540: mknod d2/db/d39/d3c/d76/cae 0 2024-09-16T00:50:12.177 INFO:tasks.workunit.client.1.smithi152.stdout:0/435: mknod d3/d6/c9b 0 2024-09-16T00:50:12.178 INFO:tasks.workunit.client.1.smithi152.stdout:0/436: write d3/d6/f1e [584885,128807] 0 2024-09-16T00:50:12.180 INFO:tasks.workunit.client.1.smithi152.stdout:6/393: sync 2024-09-16T00:50:12.180 INFO:tasks.workunit.client.1.smithi152.stdout:8/262: sync 2024-09-16T00:50:12.180 INFO:tasks.workunit.client.1.smithi152.stdout:6/394: chown db/l55 248 1 2024-09-16T00:50:12.180 INFO:tasks.workunit.client.1.smithi152.stdout:8/263: chown dd/d15/c5c 14488767 1 2024-09-16T00:50:12.180 INFO:tasks.workunit.client.1.smithi152.stdout:8/264: stat dd/d15/d49/f13 0 2024-09-16T00:50:12.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/494: creat d9/d3e/d41/d31/d38/fb5 x:0 0 0 2024-09-16T00:50:12.183 INFO:tasks.workunit.client.1.smithi152.stdout:5/550: rmdir d6/d16/d1f/d65 39 2024-09-16T00:50:12.183 INFO:tasks.workunit.client.1.smithi152.stdout:5/551: chown d6/d16/d1f/d65/f7d 2270161 1 2024-09-16T00:50:12.183 INFO:tasks.workunit.client.1.smithi152.stdout:5/552: write d6/d57/d2b/d50/d6e/fce [759900,29063] 0 2024-09-16T00:50:12.187 INFO:tasks.workunit.client.1.smithi152.stdout:9/423: rmdir d1/d7 39 2024-09-16T00:50:12.187 INFO:tasks.workunit.client.1.smithi152.stdout:9/424: write d1/d4e/d48/d66/d76/f81 [756845,32677] 0 2024-09-16T00:50:12.191 INFO:tasks.workunit.client.1.smithi152.stdout:3/395: link dc/d10/d17/d1c/c30 dc/d10/d17/d1c/d1f/d22/d2c/d3b/c79 0 2024-09-16T00:50:12.192 INFO:tasks.workunit.client.1.smithi152.stdout:4/541: symlink d2/d8e/laf 0 2024-09-16T00:50:12.192 INFO:tasks.workunit.client.1.smithi152.stdout:4/542: dread - d2/db/d39/f93 zero size 2024-09-16T00:50:12.192 INFO:tasks.workunit.client.1.smithi152.stdout:4/543: truncate d2/db/d39/f93 252519 0 2024-09-16T00:50:12.193 INFO:tasks.workunit.client.1.smithi152.stdout:7/410: dwrite d9/f1f [0,4194304] 0 2024-09-16T00:50:12.193 INFO:tasks.workunit.client.1.smithi152.stdout:7/411: stat d9/d31/d65/l2b 0 2024-09-16T00:50:12.195 INFO:tasks.workunit.client.1.smithi152.stdout:6/395: symlink db/d12/d23/d4a/d43/d48/d6a/l7c 0 2024-09-16T00:50:12.196 INFO:tasks.workunit.client.1.smithi152.stdout:8/265: symlink dd/d15/d49/l5e 0 2024-09-16T00:50:12.198 INFO:tasks.workunit.client.1.smithi152.stdout:3/396: rename dc/d10/d17/d1c/d1f/d22/d2c/f67 to dc/d10/f7a 0 2024-09-16T00:50:12.199 INFO:tasks.workunit.client.1.smithi152.stdout:7/412: truncate d9/d31/d65/d8a/f4a 231430 0 2024-09-16T00:50:12.200 INFO:tasks.workunit.client.1.smithi152.stdout:6/396: fsync db/d12/d20/d4b/f4e 0 2024-09-16T00:50:12.201 INFO:tasks.workunit.client.1.smithi152.stdout:8/266: mkdir dd/d50/d29/d2f/d5f 0 2024-09-16T00:50:12.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/397: creat dc/d10/d17/d1c/d1f/d22/d2c/d2f/f7b x:0 0 0 2024-09-16T00:50:12.203 INFO:tasks.workunit.client.1.smithi152.stdout:0/437: dwrite d3/f21 [4194304,4194304] 0 2024-09-16T00:50:12.203 INFO:tasks.workunit.client.1.smithi152.stdout:5/553: dwrite f0 [4194304,4194304] 0 2024-09-16T00:50:12.204 INFO:tasks.workunit.client.1.smithi152.stdout:8/267: truncate dd/d23/f24 2054314 0 2024-09-16T00:50:12.209 INFO:tasks.workunit.client.1.smithi152.stdout:0/438: mknod d3/c9c 0 2024-09-16T00:50:12.210 INFO:tasks.workunit.client.1.smithi152.stdout:5/554: creat d6/d16/d1f/db5/dd3/fd4 x:0 0 0 2024-09-16T00:50:12.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/439: mkdir d3/d6/d8/d1d/d23/d25/d45/d9d 0 2024-09-16T00:50:12.212 INFO:tasks.workunit.client.1.smithi152.stdout:0/440: dread - d3/d6/d8/d1d/d23/d25/d2a/f50 zero size 2024-09-16T00:50:12.213 INFO:tasks.workunit.client.1.smithi152.stdout:5/555: unlink d6/d16/cb4 0 2024-09-16T00:50:12.214 INFO:tasks.workunit.client.1.smithi152.stdout:0/441: mkdir d3/d6/d8/d9e 0 2024-09-16T00:50:12.214 INFO:tasks.workunit.client.1.smithi152.stdout:0/442: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/f9f x:0 0 0 2024-09-16T00:50:12.214 INFO:tasks.workunit.client.1.smithi152.stdout:0/443: fsync d3/d6/d8/f40 0 2024-09-16T00:50:12.215 INFO:tasks.workunit.client.1.smithi152.stdout:5/556: rmdir d6/d57 39 2024-09-16T00:50:12.215 INFO:tasks.workunit.client.1.smithi152.stdout:3/398: dwrite f8 [8388608,4194304] 0 2024-09-16T00:50:12.216 INFO:tasks.workunit.client.1.smithi152.stdout:7/413: write d9/d31/d65/d8a/f4a [507683,108685] 0 2024-09-16T00:50:12.216 INFO:tasks.workunit.client.1.smithi152.stdout:0/444: rmdir d3/d6/d64/d6a 39 2024-09-16T00:50:12.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/557: creat d6/d57/fd5 x:0 0 0 2024-09-16T00:50:12.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/399: creat dc/d10/d17/d5a/d68/f7c x:0 0 0 2024-09-16T00:50:12.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/400: write dc/d10/d17/d5a/d68/f7c [877059,106387] 0 2024-09-16T00:50:12.220 INFO:tasks.workunit.client.1.smithi152.stdout:7/414: link d9/d10/f12 d9/d80/f9a 0 2024-09-16T00:50:12.221 INFO:tasks.workunit.client.1.smithi152.stdout:0/445: rmdir d3/d6/d4e 39 2024-09-16T00:50:12.223 INFO:tasks.workunit.client.1.smithi152.stdout:3/401: unlink dc/d10/d17/d1c/c70 0 2024-09-16T00:50:12.225 INFO:tasks.workunit.client.1.smithi152.stdout:3/402: write dc/ff [126202,121585] 0 2024-09-16T00:50:12.226 INFO:tasks.workunit.client.1.smithi152.stdout:7/415: truncate d9/d10/f36 1816219 0 2024-09-16T00:50:12.238 INFO:tasks.workunit.client.1.smithi152.stdout:7/416: dread d9/d31/d65/f59 [0,4194304] 0 2024-09-16T00:50:12.238 INFO:tasks.workunit.client.1.smithi152.stdout:7/417: chown d9/d31/d65/d4b/f81 1431924 1 2024-09-16T00:50:12.240 INFO:tasks.workunit.client.1.smithi152.stdout:5/558: dwrite d6/d16/d1f/db5/fc0 [0,4194304] 0 2024-09-16T00:50:12.240 INFO:tasks.workunit.client.1.smithi152.stdout:5/559: creat d6/d57/d2b/d50/d66/fd6 x:0 0 0 2024-09-16T00:50:12.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/418: dread d9/d31/d65/d6b/f77 [0,4194304] 0 2024-09-16T00:50:12.244 INFO:tasks.workunit.client.1.smithi152.stdout:5/560: symlink d6/d16/d1f/db5/ld7 0 2024-09-16T00:50:12.244 INFO:tasks.workunit.client.1.smithi152.stdout:0/446: dwrite d3/d6/d64/f95 [0,4194304] 0 2024-09-16T00:50:12.249 INFO:tasks.workunit.client.1.smithi152.stdout:3/403: dwrite f2 [0,4194304] 0 2024-09-16T00:50:12.249 INFO:tasks.workunit.client.1.smithi152.stdout:7/419: symlink d9/d31/d64/d3c/l9b 0 2024-09-16T00:50:12.249 INFO:tasks.workunit.client.1.smithi152.stdout:7/420: write d9/d31/d65/d4b/f81 [137724,17] 0 2024-09-16T00:50:12.253 INFO:tasks.workunit.client.1.smithi152.stdout:7/421: creat d9/d31/d65/d4b/f9c x:0 0 0 2024-09-16T00:50:12.255 INFO:tasks.workunit.client.1.smithi152.stdout:3/404: write dc/d10/d17/d1c/d1f/d22/d2c/d3b/f57 [455681,113961] 0 2024-09-16T00:50:12.255 INFO:tasks.workunit.client.1.smithi152.stdout:3/405: truncate dc/d10/d17/d1c/d1f/d22/d2c/f76 112580 0 2024-09-16T00:50:12.257 INFO:tasks.workunit.client.1.smithi152.stdout:3/406: truncate dc/d10/d17/d1c/f23 332652 0 2024-09-16T00:50:12.260 INFO:tasks.workunit.client.1.smithi152.stdout:3/407: creat dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/f7d x:0 0 0 2024-09-16T00:50:12.260 INFO:tasks.workunit.client.1.smithi152.stdout:3/408: creat dc/d10/d17/d1c/f7e x:0 0 0 2024-09-16T00:50:12.260 INFO:tasks.workunit.client.1.smithi152.stdout:0/447: dwrite d3/d6/f8a [0,4194304] 0 2024-09-16T00:50:12.260 INFO:tasks.workunit.client.1.smithi152.stdout:0/448: readlink d3/d6/d8/d1d/d23/d25/d45/d6f/l76 0 2024-09-16T00:50:12.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/449: fdatasync d3/d6/d51/f85 0 2024-09-16T00:50:12.267 INFO:tasks.workunit.client.1.smithi152.stdout:3/409: dread dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 [4194304,4194304] 0 2024-09-16T00:50:12.270 INFO:tasks.workunit.client.1.smithi152.stdout:7/422: dwrite d9/d31/f67 [0,4194304] 0 2024-09-16T00:50:12.270 INFO:tasks.workunit.client.1.smithi152.stdout:0/450: write d3/d6/d8/d1d/f26 [332598,71250] 0 2024-09-16T00:50:12.271 INFO:tasks.workunit.client.1.smithi152.stdout:0/451: fdatasync d3/d6/d8/d1d/d23/d25/d2a/d5c/f99 0 2024-09-16T00:50:12.271 INFO:tasks.workunit.client.1.smithi152.stdout:0/452: chown d3/d6/d8/d1d/d23/d25/d2a/d5c/f67 55 1 2024-09-16T00:50:12.277 INFO:tasks.workunit.client.1.smithi152.stdout:7/423: truncate d9/d31/d64/f61 3100629 0 2024-09-16T00:50:12.277 INFO:tasks.workunit.client.1.smithi152.stdout:3/410: dread dc/d10/f7a [0,4194304] 0 2024-09-16T00:50:12.277 INFO:tasks.workunit.client.1.smithi152.stdout:0/453: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fa0 x:0 0 0 2024-09-16T00:50:12.279 INFO:tasks.workunit.client.1.smithi152.stdout:3/411: rename dc/c61 to dc/d10/d47/c7f 0 2024-09-16T00:50:12.280 INFO:tasks.workunit.client.1.smithi152.stdout:0/454: dread d3/d6/d6d/f8e [0,4194304] 0 2024-09-16T00:50:12.280 INFO:tasks.workunit.client.1.smithi152.stdout:0/455: fsync d3/d6/d6d/f8f 0 2024-09-16T00:50:12.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/424: rmdir d9/d31/d64/d3c 39 2024-09-16T00:50:12.284 INFO:tasks.workunit.client.1.smithi152.stdout:3/412: rename dc/d10/d17/d1c/d1f/f2b to dc/d10/d17/f80 0 2024-09-16T00:50:12.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/456: symlink d3/d6/d8/d1d/d65/la1 0 2024-09-16T00:50:12.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/457: creat d3/d6/d64/fa2 x:0 0 0 2024-09-16T00:50:12.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/458: fsync d3/d6/d8/d1d/d23/d25/f4d 0 2024-09-16T00:50:12.290 INFO:tasks.workunit.client.1.smithi152.stdout:7/425: creat d9/d10/f9d x:0 0 0 2024-09-16T00:50:12.291 INFO:tasks.workunit.client.1.smithi152.stdout:0/459: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:12.298 INFO:tasks.workunit.client.1.smithi152.stdout:7/426: dread d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:12.300 INFO:tasks.workunit.client.1.smithi152.stdout:7/427: write d9/f23 [142169,76291] 0 2024-09-16T00:50:12.300 INFO:tasks.workunit.client.1.smithi152.stdout:0/460: write d3/d6/f8a [1276986,53327] 0 2024-09-16T00:50:12.300 INFO:tasks.workunit.client.1.smithi152.stdout:0/461: write d3/fc [5096217,59568] 0 2024-09-16T00:50:12.301 INFO:tasks.workunit.client.1.smithi152.stdout:0/462: truncate d3/d6/d8/d1d/d23/d25/d2a/d5c/f99 768923 0 2024-09-16T00:50:12.302 INFO:tasks.workunit.client.1.smithi152.stdout:3/413: dwrite f5 [0,4194304] 0 2024-09-16T00:50:12.304 INFO:tasks.workunit.client.1.smithi152.stdout:3/414: mknod dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/d74/c81 0 2024-09-16T00:50:12.311 INFO:tasks.workunit.client.1.smithi152.stdout:7/428: dread d9/d31/d64/d3c/d5b/f60 [0,4194304] 0 2024-09-16T00:50:12.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/429: mknod d9/d10/c9e 0 2024-09-16T00:50:12.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/430: dread - d9/d10/f9d zero size 2024-09-16T00:50:12.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/431: dread - d9/d31/d65/f28 zero size 2024-09-16T00:50:12.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/415: read dc/d10/d17/d1c/d1f/d22/d2c/f2e [1838219,126005] 0 2024-09-16T00:50:12.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/432: link d9/d31/d65/d8a/f4a d9/f9f 0 2024-09-16T00:50:12.319 INFO:tasks.workunit.client.1.smithi152.stdout:3/416: unlink dc/d10/d17/d1c/d1f/d22/d2c/d3b/c3c 0 2024-09-16T00:50:12.320 INFO:tasks.workunit.client.1.smithi152.stdout:7/433: creat d9/d31/d64/d3c/fa0 x:0 0 0 2024-09-16T00:50:12.321 INFO:tasks.workunit.client.1.smithi152.stdout:7/434: creat d9/d31/d65/fa1 x:0 0 0 2024-09-16T00:50:12.328 INFO:tasks.workunit.client.1.smithi152.stdout:3/417: read f5 [2959228,84936] 0 2024-09-16T00:50:12.330 INFO:tasks.workunit.client.1.smithi152.stdout:3/418: symlink dc/d10/l82 0 2024-09-16T00:50:12.333 INFO:tasks.workunit.client.1.smithi152.stdout:3/419: read dc/d10/d17/d1c/d1f/d24/f65 [3002830,114807] 0 2024-09-16T00:50:12.333 INFO:tasks.workunit.client.1.smithi152.stdout:3/420: creat dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/f83 x:0 0 0 2024-09-16T00:50:12.336 INFO:tasks.workunit.client.1.smithi152.stdout:3/421: truncate dc/d10/d17/d1c/d1f/d22/d2c/f2e 1762300 0 2024-09-16T00:50:12.336 INFO:tasks.workunit.client.1.smithi152.stdout:3/422: dread - dc/d10/d17/d4f/f60 zero size 2024-09-16T00:50:12.337 INFO:tasks.workunit.client.1.smithi152.stdout:3/423: rmdir dc/d10/d17/d1c/d1f/d22/d2c/d2f/d46 39 2024-09-16T00:50:12.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/435: dwrite d9/d31/d64/d3c/f75 [4194304,4194304] 0 2024-09-16T00:50:12.340 INFO:tasks.workunit.client.1.smithi152.stdout:7/436: creat d9/d31/d65/d8a/d41/d46/fa2 x:0 0 0 2024-09-16T00:50:12.344 INFO:tasks.workunit.client.1.smithi152.stdout:7/437: rmdir d9/d31/d65/d6b 39 2024-09-16T00:50:12.344 INFO:tasks.workunit.client.1.smithi152.stdout:7/438: chown d9/d31/d65/d8a/d41/d46/d7d 125 1 2024-09-16T00:50:12.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/439: dread d9/d31/d64/d3c/f71 [0,4194304] 0 2024-09-16T00:50:12.346 INFO:tasks.workunit.client.1.smithi152.stdout:7/440: getdents d9/d31/d65/d8a/d41/d46/d7d 0 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/495: sync 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:2/402: sync 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/496: dread - d9/d3e/d41/f83 zero size 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/497: fdatasync d9/da/df/f77 0 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:2/403: write d4/d44/f4e [54941,116969] 0 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:2/404: fdatasync d4/d17/f3b 0 2024-09-16T00:50:12.348 INFO:tasks.workunit.client.1.smithi152.stdout:2/405: write d4/f16 [5018932,37376] 0 2024-09-16T00:50:12.349 INFO:tasks.workunit.client.1.smithi152.stdout:1/498: creat d9/da/da2/fb6 x:0 0 0 2024-09-16T00:50:12.349 INFO:tasks.workunit.client.1.smithi152.stdout:1/499: chown d9/d3e/d41/d31/d48/db2 153 1 2024-09-16T00:50:12.352 INFO:tasks.workunit.client.1.smithi152.stdout:2/406: mkdir d4/d19/d20/d28/d8b 0 2024-09-16T00:50:12.354 INFO:tasks.workunit.client.1.smithi152.stdout:1/500: mkdir d9/d3e/d4b/db7 0 2024-09-16T00:50:12.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/501: chown d9/da/le 1514467 1 2024-09-16T00:50:12.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/502: write d9/d3e/d41/d31/d38/f5d [1016992,30641] 0 2024-09-16T00:50:12.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/503: write d9/d3e/d41/d31/d48/d4a/f54 [1418844,81853] 0 2024-09-16T00:50:12.356 INFO:tasks.workunit.client.1.smithi152.stdout:2/407: symlink d4/d17/l8c 0 2024-09-16T00:50:12.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/408: getdents d4/d17 0 2024-09-16T00:50:12.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/409: fsync d4/d19/d20/d28/f52 0 2024-09-16T00:50:12.362 INFO:tasks.workunit.client.1.smithi152.stdout:2/410: mkdir d4/d17/d3e/d8d 0 2024-09-16T00:50:12.365 INFO:tasks.workunit.client.1.smithi152.stdout:1/504: write d9/f29 [1643042,84557] 0 2024-09-16T00:50:12.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/505: symlink d9/d3e/d41/d31/d48/d7d/lb8 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:2/411: dread d4/d17/f38 [0,4194304] 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:2/412: fsync d4/d44/d7a/d86/f75 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:2/413: truncate d4/d19/f4f 1266116 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:2/414: stat d4/cf 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:1/506: getdents d9/d3e/d41/d9a 0 2024-09-16T00:50:12.368 INFO:tasks.workunit.client.1.smithi152.stdout:1/507: write d9/d3e/d41/d31/d38/f5d [705809,126289] 0 2024-09-16T00:50:12.370 INFO:tasks.workunit.client.1.smithi152.stdout:2/415: getdents d4/d19/d20/d28/d2c 0 2024-09-16T00:50:12.370 INFO:tasks.workunit.client.1.smithi152.stdout:2/416: readlink d4/d17/l67 0 2024-09-16T00:50:12.371 INFO:tasks.workunit.client.1.smithi152.stdout:1/508: symlink d9/d3e/d4b/d6b/d6d/d97/lb9 0 2024-09-16T00:50:12.372 INFO:tasks.workunit.client.1.smithi152.stdout:1/509: chown d9/d3e/d41/d31/d38/l71 103 1 2024-09-16T00:50:12.372 INFO:tasks.workunit.client.1.smithi152.stdout:1/510: creat d9/d3e/fba x:0 0 0 2024-09-16T00:50:12.374 INFO:tasks.workunit.client.1.smithi152.stdout:1/511: link d9/d3e/d41/f40 d9/d3e/d41/d31/d48/d7d/fbb 0 2024-09-16T00:50:12.376 INFO:tasks.workunit.client.1.smithi152.stdout:1/512: mknod d9/d3e/d4b/db7/cbc 0 2024-09-16T00:50:12.376 INFO:tasks.workunit.client.1.smithi152.stdout:1/513: stat d9/da/df/l59 0 2024-09-16T00:50:12.377 INFO:tasks.workunit.client.1.smithi152.stdout:2/417: write d4/d19/d20/d28/d2c/f7b [2162110,14579] 0 2024-09-16T00:50:12.377 INFO:tasks.workunit.client.1.smithi152.stdout:2/418: stat d4/d17/d3e/f4b 0 2024-09-16T00:50:12.378 INFO:tasks.workunit.client.1.smithi152.stdout:2/419: mknod d4/d19/d20/d28/d8b/c8e 0 2024-09-16T00:50:12.378 INFO:tasks.workunit.client.1.smithi152.stdout:2/420: dread - d4/d19/d20/d28/d2c/d4d/f5c zero size 2024-09-16T00:50:12.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/421: mkdir d4/d19/d20/d28/d2c/d4d/d8f 0 2024-09-16T00:50:12.380 INFO:tasks.workunit.client.1.smithi152.stdout:2/422: mknod d4/d19/d20/d28/d2c/d77/c90 0 2024-09-16T00:50:12.394 INFO:tasks.workunit.client.1.smithi152.stdout:7/441: dwrite d9/d31/d64/f61 [0,4194304] 0 2024-09-16T00:50:12.395 INFO:tasks.workunit.client.1.smithi152.stdout:1/514: dread d9/da/df/f77 [0,4194304] 0 2024-09-16T00:50:12.395 INFO:tasks.workunit.client.1.smithi152.stdout:1/515: creat d9/d3e/d41/fbd x:0 0 0 2024-09-16T00:50:12.399 INFO:tasks.workunit.client.1.smithi152.stdout:7/442: symlink d9/d31/la3 0 2024-09-16T00:50:12.399 INFO:tasks.workunit.client.1.smithi152.stdout:7/443: fsync d9/d31/d65/f98 0 2024-09-16T00:50:12.403 INFO:tasks.workunit.client.1.smithi152.stdout:7/444: creat d9/d31/d65/d8a/d90/fa4 x:0 0 0 2024-09-16T00:50:12.408 INFO:tasks.workunit.client.1.smithi152.stdout:1/516: dwrite d9/f9b [0,4194304] 0 2024-09-16T00:50:12.408 INFO:tasks.workunit.client.1.smithi152.stdout:1/517: chown d9/d3e/d4b/d50 3055 1 2024-09-16T00:50:12.408 INFO:tasks.workunit.client.1.smithi152.stdout:1/518: chown d9/d3e/d41/f3b 352199 1 2024-09-16T00:50:12.417 INFO:tasks.workunit.client.1.smithi152.stdout:7/445: getdents d9/d31 0 2024-09-16T00:50:12.427 INFO:tasks.workunit.client.1.smithi152.stdout:1/519: dwrite d9/d3e/f96 [0,4194304] 0 2024-09-16T00:50:12.430 INFO:tasks.workunit.client.1.smithi152.stdout:1/520: link d9/c1a d9/d3e/d41/d9a/cbe 0 2024-09-16T00:50:12.430 INFO:tasks.workunit.client.1.smithi152.stdout:7/446: dwrite d9/d31/d65/f98 [0,4194304] 0 2024-09-16T00:50:12.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/521: link d9/da/da2/fb6 d9/da/fbf 0 2024-09-16T00:50:12.434 INFO:tasks.workunit.client.1.smithi152.stdout:1/522: rename d9/d3e/d41/d31/f3a to d9/d3e/d4b/db7/fc0 0 2024-09-16T00:50:12.434 INFO:tasks.workunit.client.1.smithi152.stdout:1/523: chown d9/d3e/d41/d31/d38/c73 367370 1 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:4/544: sync 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:6/397: sync 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:9/425: sync 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:8/268: sync 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:5/561: sync 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:6/398: chown db/d28/f3c 64 1 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:5/562: chown d6/d16/c3d 46 1 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:8/269: write dd/d15/d1a/f45 [205091,46458] 0 2024-09-16T00:50:12.440 INFO:tasks.workunit.client.1.smithi152.stdout:8/270: write dd/d15/d1a/f45 [292481,19210] 0 2024-09-16T00:50:12.441 INFO:tasks.workunit.client.1.smithi152.stdout:6/399: write db/d12/d23/f79 [643216,124025] 0 2024-09-16T00:50:12.441 INFO:tasks.workunit.client.1.smithi152.stdout:8/271: creat dd/d23/f60 x:0 0 0 2024-09-16T00:50:12.441 INFO:tasks.workunit.client.1.smithi152.stdout:7/447: dread d9/d31/d65/d8a/d41/f50 [0,4194304] 0 2024-09-16T00:50:12.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/545: dread d2/d1e/d28/d69/f78 [0,4194304] 0 2024-09-16T00:50:12.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/546: chown d2/db/d39/d3c/d7f/d98 857812 1 2024-09-16T00:50:12.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/563: creat d6/d16/d1f/d65/d77/fd8 x:0 0 0 2024-09-16T00:50:12.444 INFO:tasks.workunit.client.1.smithi152.stdout:4/547: dread d2/fe [0,4194304] 0 2024-09-16T00:50:12.444 INFO:tasks.workunit.client.1.smithi152.stdout:4/548: write d2/d1e/d28/d69/f9c [5145176,51879] 0 2024-09-16T00:50:12.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/400: unlink fa 0 2024-09-16T00:50:12.449 INFO:tasks.workunit.client.1.smithi152.stdout:8/272: mkdir dd/d50/d29/d2f/d61 0 2024-09-16T00:50:12.449 INFO:tasks.workunit.client.1.smithi152.stdout:8/273: chown f3 265682471 1 2024-09-16T00:50:12.450 INFO:tasks.workunit.client.1.smithi152.stdout:8/274: write dd/d50/d29/f58 [272537,13443] 0 2024-09-16T00:50:12.450 INFO:tasks.workunit.client.1.smithi152.stdout:5/564: symlink d6/d57/d2b/ld9 0 2024-09-16T00:50:12.450 INFO:tasks.workunit.client.1.smithi152.stdout:5/565: chown d6/c4c 1541238436 1 2024-09-16T00:50:12.451 INFO:tasks.workunit.client.1.smithi152.stdout:9/426: dread d1/ff [0,4194304] 0 2024-09-16T00:50:12.454 INFO:tasks.workunit.client.1.smithi152.stdout:5/566: dread d6/d16/d1f/f3e [0,4194304] 0 2024-09-16T00:50:12.454 INFO:tasks.workunit.client.1.smithi152.stdout:5/567: creat d6/d57/d54/fda x:0 0 0 2024-09-16T00:50:12.456 INFO:tasks.workunit.client.1.smithi152.stdout:9/427: link d1/d4e/d48/d26/d30/c7f d1/d7/d77/d32/c87 0 2024-09-16T00:50:12.457 INFO:tasks.workunit.client.1.smithi152.stdout:8/275: dread dd/d15/d49/f13 [0,4194304] 0 2024-09-16T00:50:12.457 INFO:tasks.workunit.client.1.smithi152.stdout:8/276: dread - dd/d50/f28 zero size 2024-09-16T00:50:12.457 INFO:tasks.workunit.client.1.smithi152.stdout:8/277: stat dd/d50/d29/f58 0 2024-09-16T00:50:12.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/549: rmdir d2/db/d39/d3c/d76 39 2024-09-16T00:50:12.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/550: chown d2/d1e/d28/d69/f9c 2094 1 2024-09-16T00:50:12.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/551: write d2/db/d39/d3c/d76/f82 [551186,97120] 0 2024-09-16T00:50:12.460 INFO:tasks.workunit.client.1.smithi152.stdout:1/524: dwrite d9/da/df/f8c [0,4194304] 0 2024-09-16T00:50:12.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/401: write db/d12/d20/f36 [1292543,92022] 0 2024-09-16T00:50:12.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/402: dread - db/d28/d2c/f7a zero size 2024-09-16T00:50:12.462 INFO:tasks.workunit.client.1.smithi152.stdout:5/568: unlink d6/d16/l72 0 2024-09-16T00:50:12.465 INFO:tasks.workunit.client.1.smithi152.stdout:9/428: mknod d1/d7/d77/d32/c88 0 2024-09-16T00:50:12.466 INFO:tasks.workunit.client.1.smithi152.stdout:8/278: getdents dd/d15/d1a 0 2024-09-16T00:50:12.466 INFO:tasks.workunit.client.1.smithi152.stdout:8/279: creat dd/d15/f62 x:0 0 0 2024-09-16T00:50:12.467 INFO:tasks.workunit.client.1.smithi152.stdout:9/429: write d1/d4e/d48/d2b/f4d [11085,47213] 0 2024-09-16T00:50:12.470 INFO:tasks.workunit.client.1.smithi152.stdout:9/430: dread d1/d7/d13/f73 [0,4194304] 0 2024-09-16T00:50:12.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/569: creat d6/d16/d8b/fdb x:0 0 0 2024-09-16T00:50:12.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/570: write d6/d57/d54/f90 [384463,116031] 0 2024-09-16T00:50:12.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/571: write d6/d16/d1f/db5/dd3/fd4 [491554,20981] 0 2024-09-16T00:50:12.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/280: unlink dd/d50/d29/f47 0 2024-09-16T00:50:12.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/281: fsync dd/f16 0 2024-09-16T00:50:12.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/282: chown dd/d15/d1a 4968 1 2024-09-16T00:50:12.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/572: mkdir d6/d57/ddc 0 2024-09-16T00:50:12.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/573: dread - d6/f7c zero size 2024-09-16T00:50:12.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/574: truncate d6/d16/f71 992024 0 2024-09-16T00:50:12.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/525: dwrite d9/d3e/d41/d31/f85 [0,4194304] 0 2024-09-16T00:50:12.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/526: dread - d9/da/df/f42 zero size 2024-09-16T00:50:12.495 INFO:tasks.workunit.client.1.smithi152.stdout:1/527: mkdir d9/d3e/d41/d31/d48/d4a/dc1 0 2024-09-16T00:50:12.500 INFO:tasks.workunit.client.1.smithi152.stdout:6/403: dwrite db/d12/d23/d4a/d33/f38 [0,4194304] 0 2024-09-16T00:50:12.500 INFO:tasks.workunit.client.1.smithi152.stdout:6/404: fsync db/d12/f3d 0 2024-09-16T00:50:12.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/552: dwrite d2/db/f47 [4194304,4194304] 0 2024-09-16T00:50:12.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/553: chown d2/d1e/d28/l51 17 1 2024-09-16T00:50:12.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/554: stat d2/db/d39/d3c/d7f/d98/c86 0 2024-09-16T00:50:12.502 INFO:tasks.workunit.client.1.smithi152.stdout:9/431: dwrite d1/f57 [0,4194304] 0 2024-09-16T00:50:12.504 INFO:tasks.workunit.client.1.smithi152.stdout:4/555: chown d2/db/l2a 2040393 1 2024-09-16T00:50:12.506 INFO:tasks.workunit.client.1.smithi152.stdout:9/432: rmdir d1/d4e/d48/d2b/d7c 39 2024-09-16T00:50:12.506 INFO:tasks.workunit.client.1.smithi152.stdout:9/433: chown d1/l38 7 1 2024-09-16T00:50:12.507 INFO:tasks.workunit.client.1.smithi152.stdout:8/283: dwrite dd/f42 [0,4194304] 0 2024-09-16T00:50:12.507 INFO:tasks.workunit.client.1.smithi152.stdout:6/405: fsync db/d12/d20/f36 0 2024-09-16T00:50:12.508 INFO:tasks.workunit.client.1.smithi152.stdout:6/406: dread - db/d28/d2c/f7a zero size 2024-09-16T00:50:12.509 INFO:tasks.workunit.client.1.smithi152.stdout:5/575: dwrite d6/d16/d1f/d6c/fbd [0,4194304] 0 2024-09-16T00:50:12.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/434: dread d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:12.515 INFO:tasks.workunit.client.1.smithi152.stdout:8/284: rmdir dd/d50/d29/d2f/d61 0 2024-09-16T00:50:12.517 INFO:tasks.workunit.client.1.smithi152.stdout:6/407: creat db/d12/f7d x:0 0 0 2024-09-16T00:50:12.518 INFO:tasks.workunit.client.1.smithi152.stdout:6/408: write db/d12/d23/f79 [1349372,30684] 0 2024-09-16T00:50:12.518 INFO:tasks.workunit.client.1.smithi152.stdout:6/409: write f9 [1252650,48569] 0 2024-09-16T00:50:12.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/576: link d6/d57/d2b/f47 d6/d16/d1f/d8c/db8/fdd 0 2024-09-16T00:50:12.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/577: write d6/d16/d1f/f2e [1158522,76511] 0 2024-09-16T00:50:12.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/578: creat d6/d57/d54/fde x:0 0 0 2024-09-16T00:50:12.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/285: mknod dd/d50/d29/c63 0 2024-09-16T00:50:12.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/286: chown dd/d50/d29/d2f/c4f 700 1 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:5/579: symlink d6/d57/d2b/d50/d6e/ldf 0 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:6/410: read db/d12/d23/f79 [1340911,60145] 0 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:9/435: dread d1/ff [0,4194304] 0 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:9/436: dread - d1/d4e/f67 zero size 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:9/437: stat d1/d7/d13/d80 0 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:1/528: dwrite d9/da/df/f77 [0,4194304] 0 2024-09-16T00:50:12.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/287: symlink dd/d23/l64 0 2024-09-16T00:50:12.523 INFO:tasks.workunit.client.1.smithi152.stdout:5/580: rename d6/d57/d54/fda to d6/d16/d1f/d8c/db8/fe0 0 2024-09-16T00:50:12.525 INFO:tasks.workunit.client.1.smithi152.stdout:1/529: dread d9/d3e/d41/f8d [0,4194304] 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:6/411: dread db/d12/d23/d4a/f5f [0,4194304] 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/438: creat d1/f89 x:0 0 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:6/412: write f2 [477028,81594] 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:8/288: truncate dd/d50/d29/d2f/f3d 2110647 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:8/289: getdents dd/d50/d29/d2f/d5f 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:8/290: truncate dd/d23/f24 3010583 0 2024-09-16T00:50:12.526 INFO:tasks.workunit.client.1.smithi152.stdout:5/581: creat d6/d16/d1f/d65/fe1 x:0 0 0 2024-09-16T00:50:12.529 INFO:tasks.workunit.client.1.smithi152.stdout:9/439: rename d1/f57 to d1/d4e/d48/d26/d30/d4f/d50/f8a 0 2024-09-16T00:50:12.530 INFO:tasks.workunit.client.1.smithi152.stdout:6/413: creat db/d12/d20/f7e x:0 0 0 2024-09-16T00:50:12.531 INFO:tasks.workunit.client.1.smithi152.stdout:8/291: creat dd/d50/d29/d2f/d53/f65 x:0 0 0 2024-09-16T00:50:12.532 INFO:tasks.workunit.client.1.smithi152.stdout:5/582: mkdir d6/d16/d1f/d6c/de2 0 2024-09-16T00:50:12.532 INFO:tasks.workunit.client.1.smithi152.stdout:5/583: fdatasync d6/d16/f4d 0 2024-09-16T00:50:12.532 INFO:tasks.workunit.client.1.smithi152.stdout:5/584: creat d6/d16/d8b/fe3 x:0 0 0 2024-09-16T00:50:12.532 INFO:tasks.workunit.client.1.smithi152.stdout:9/440: dread d1/d4e/d48/d66/d76/f81 [0,4194304] 0 2024-09-16T00:50:12.532 INFO:tasks.workunit.client.1.smithi152.stdout:9/441: creat d1/f8b x:0 0 0 2024-09-16T00:50:12.536 INFO:tasks.workunit.client.1.smithi152.stdout:8/292: link dd/l27 dd/d50/d29/d2f/l66 0 2024-09-16T00:50:12.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/414: dread db/d12/d23/d4a/d43/d48/d64/f6d [0,4194304] 0 2024-09-16T00:50:12.540 INFO:tasks.workunit.client.1.smithi152.stdout:6/415: creat db/d12/d23/d4a/d43/d48/f7f x:0 0 0 2024-09-16T00:50:12.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/293: link dd/d50/d29/d2f/c4f dd/d50/d29/d2f/d5f/c67 0 2024-09-16T00:50:12.541 INFO:tasks.workunit.client.1.smithi152.stdout:9/442: dread d1/d7/d77/f43 [0,4194304] 0 2024-09-16T00:50:12.543 INFO:tasks.workunit.client.1.smithi152.stdout:1/530: dwrite d9/d3e/fba [0,4194304] 0 2024-09-16T00:50:12.543 INFO:tasks.workunit.client.1.smithi152.stdout:1/531: fsync d9/d3e/d41/d31/fa0 0 2024-09-16T00:50:12.543 INFO:tasks.workunit.client.1.smithi152.stdout:8/294: rmdir dd/d15/d1a 39 2024-09-16T00:50:12.544 INFO:tasks.workunit.client.1.smithi152.stdout:9/443: truncate d1/d4e/d48/d66/d76/f81 403447 0 2024-09-16T00:50:12.550 INFO:tasks.workunit.client.1.smithi152.stdout:1/532: link d9/f84 d9/d3e/d41/d31/d48/fc2 0 2024-09-16T00:50:12.550 INFO:tasks.workunit.client.1.smithi152.stdout:4/556: truncate d2/db/f47 2678050 0 2024-09-16T00:50:12.553 INFO:tasks.workunit.client.1.smithi152.stdout:8/295: link dd/d23/f55 dd/d15/f68 0 2024-09-16T00:50:12.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/416: rename db/d28/d2c to db/d12/d1c/d80 0 2024-09-16T00:50:12.561 INFO:tasks.workunit.client.1.smithi152.stdout:1/533: mkdir d9/d3e/d41/d31/d48/dc3 0 2024-09-16T00:50:12.563 INFO:tasks.workunit.client.1.smithi152.stdout:4/557: mkdir d2/d1e/d28/d7b/db0 0 2024-09-16T00:50:12.563 INFO:tasks.workunit.client.1.smithi152.stdout:4/558: write d2/db/d39/d3c/d76/f82 [819981,99628] 0 2024-09-16T00:50:12.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/534: mkdir d9/d3e/d4b/db7/dc4 0 2024-09-16T00:50:12.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/535: write d9/d3e/d41/f83 [25625,19150] 0 2024-09-16T00:50:12.567 INFO:tasks.workunit.client.1.smithi152.stdout:1/536: mknod d9/d3e/d41/d31/da5/cc5 0 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/417: dwrite db/f18 [4194304,4194304] 0 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/418: readlink db/d12/d1c/l41 0 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:8/296: dwrite dd/d23/f3e [0,4194304] 0 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:8/297: fsync f3 0 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:8/298: chown dd/d50/d29/d2f/l32 99134 1 2024-09-16T00:50:12.590 INFO:tasks.workunit.client.1.smithi152.stdout:1/537: dwrite d9/f9b [0,4194304] 0 2024-09-16T00:50:12.591 INFO:tasks.workunit.client.1.smithi152.stdout:4/559: dwrite d2/d1e/d28/d29/f1c [0,4194304] 0 2024-09-16T00:50:12.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/419: creat db/d12/d23/f81 x:0 0 0 2024-09-16T00:50:12.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/420: write db/d12/d23/d4a/d43/d48/f5d [46260,39347] 0 2024-09-16T00:50:12.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/421: fsync db/d28/f3c 0 2024-09-16T00:50:12.594 INFO:tasks.workunit.client.1.smithi152.stdout:4/560: dread d2/d1e/f64 [0,4194304] 0 2024-09-16T00:50:12.594 INFO:tasks.workunit.client.1.smithi152.stdout:4/561: readlink d2/db/d39/d3c/d7f/d98/l4b 0 2024-09-16T00:50:12.595 INFO:tasks.workunit.client.1.smithi152.stdout:8/299: dread dd/d50/d29/d2f/f3d [0,4194304] 0 2024-09-16T00:50:12.595 INFO:tasks.workunit.client.1.smithi152.stdout:1/538: link d9/d3e/d41/d31/d48/d4a/f54 d9/d3e/d4b/d6b/d6d/d97/fc6 0 2024-09-16T00:50:12.599 INFO:tasks.workunit.client.1.smithi152.stdout:4/562: mknod d2/d1e/d28/d7b/cb1 0 2024-09-16T00:50:12.599 INFO:tasks.workunit.client.1.smithi152.stdout:4/563: write d2/d41/f72 [563353,82547] 0 2024-09-16T00:50:12.600 INFO:tasks.workunit.client.1.smithi152.stdout:6/422: dread db/d28/f3c [0,4194304] 0 2024-09-16T00:50:12.600 INFO:tasks.workunit.client.1.smithi152.stdout:1/539: creat d9/d3e/d7c/fc7 x:0 0 0 2024-09-16T00:50:12.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/540: mknod d9/d3e/d41/d31/d48/db2/cc8 0 2024-09-16T00:50:12.608 INFO:tasks.workunit.client.1.smithi152.stdout:6/423: rmdir db/d12/d20 39 2024-09-16T00:50:12.615 INFO:tasks.workunit.client.1.smithi152.stdout:1/541: dread d9/d3e/d41/d31/d48/d7d/fbb [0,4194304] 0 2024-09-16T00:50:12.617 INFO:tasks.workunit.client.1.smithi152.stdout:6/424: dread db/f31 [0,4194304] 0 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/424: sync 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:0/463: sync 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:2/423: sync 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/448: sync 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:2/424: stat d4/d17/d3e/l76 0 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:0/464: stat d3/d6/d8/d1d/d23/d25/d45/d6f/c96 0 2024-09-16T00:50:12.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/449: truncate d9/d31/d64/d3c/f44 4341674 0 2024-09-16T00:50:12.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/425: unlink dc/d10/d17/d1c/d1f/d24/f66 0 2024-09-16T00:50:12.623 INFO:tasks.workunit.client.1.smithi152.stdout:2/425: rename d4/d19/d20/d28/d2c/d4d/f5c to d4/d19/d20/d28/d2c/d4d/d8f/f91 0 2024-09-16T00:50:12.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/450: mkdir d9/d10/da5 0 2024-09-16T00:50:12.625 INFO:tasks.workunit.client.1.smithi152.stdout:2/426: rmdir d4/d44 39 2024-09-16T00:50:12.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/564: dwrite d2/d1e/d28/d69/f6d [4194304,4194304] 0 2024-09-16T00:50:12.626 INFO:tasks.workunit.client.1.smithi152.stdout:8/300: dwrite dd/d50/d29/d2f/d53/f65 [0,4194304] 0 2024-09-16T00:50:12.626 INFO:tasks.workunit.client.1.smithi152.stdout:3/426: dread dc/d10/d17/d1c/d1f/d24/f65 [4194304,4194304] 0 2024-09-16T00:50:12.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/427: mknod d4/d19/d20/d28/d8b/c92 0 2024-09-16T00:50:12.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/428: stat d4/d17/l2f 0 2024-09-16T00:50:12.634 INFO:tasks.workunit.client.1.smithi152.stdout:4/565: creat d2/fb2 x:0 0 0 2024-09-16T00:50:12.634 INFO:tasks.workunit.client.1.smithi152.stdout:4/566: write d2/f16 [541377,102082] 0 2024-09-16T00:50:12.635 INFO:tasks.workunit.client.1.smithi152.stdout:4/567: creat d2/db/d39/d3c/fb3 x:0 0 0 2024-09-16T00:50:12.635 INFO:tasks.workunit.client.1.smithi152.stdout:4/568: write d2/d1e/d28/d29/f34 [3526086,42142] 0 2024-09-16T00:50:12.650 INFO:tasks.workunit.client.1.smithi152.stdout:4/569: mkdir d2/db/d39/d3c/d76/db4 0 2024-09-16T00:50:12.650 INFO:tasks.workunit.client.1.smithi152.stdout:4/570: fdatasync d2/d1e/d28/d69/f8f 0 2024-09-16T00:50:12.652 INFO:tasks.workunit.client.1.smithi152.stdout:0/465: dwrite d3/d6/d51/f57 [0,4194304] 0 2024-09-16T00:50:12.659 INFO:tasks.workunit.client.1.smithi152.stdout:8/301: getdents dd/d50/d29 0 2024-09-16T00:50:12.660 INFO:tasks.workunit.client.1.smithi152.stdout:4/571: rmdir d2/d1e 39 2024-09-16T00:50:12.662 INFO:tasks.workunit.client.1.smithi152.stdout:4/572: getdents d2/db/d39/d3c/d7f/d98 0 2024-09-16T00:50:12.665 INFO:tasks.workunit.client.1.smithi152.stdout:4/573: creat d2/d1e/d28/d69/fb5 x:0 0 0 2024-09-16T00:50:12.665 INFO:tasks.workunit.client.1.smithi152.stdout:4/574: chown d2/d8e/laf 1 1 2024-09-16T00:50:12.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/425: dwrite db/d12/d23/d4a/d43/d48/f5d [0,4194304] 0 2024-09-16T00:50:12.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/426: fdatasync db/d12/f1a 0 2024-09-16T00:50:12.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/427: truncate db/d12/d1c/d80/f7a 881359 0 2024-09-16T00:50:12.666 INFO:tasks.workunit.client.1.smithi152.stdout:6/428: chown db/d12/d23 255 1 2024-09-16T00:50:12.666 INFO:tasks.workunit.client.1.smithi152.stdout:7/451: dwrite d9/d31/d65/f59 [4194304,4194304] 0 2024-09-16T00:50:12.666 INFO:tasks.workunit.client.1.smithi152.stdout:3/427: dwrite dc/d10/d17/d1c/d1f/f2a [0,4194304] 0 2024-09-16T00:50:12.666 INFO:tasks.workunit.client.1.smithi152.stdout:2/429: dwrite d4/d19/f4f [0,4194304] 0 2024-09-16T00:50:12.669 INFO:tasks.workunit.client.1.smithi152.stdout:4/575: symlink d2/d1e/d28/d7b/db0/lb6 0 2024-09-16T00:50:12.669 INFO:tasks.workunit.client.1.smithi152.stdout:4/576: readlink d2/db/d39/d3c/d7f/l81 0 2024-09-16T00:50:12.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/452: dread d9/d31/d65/d8a/f55 [0,4194304] 0 2024-09-16T00:50:12.672 INFO:tasks.workunit.client.1.smithi152.stdout:0/466: dwrite d3/d6/d51/f85 [0,4194304] 0 2024-09-16T00:50:12.675 INFO:tasks.workunit.client.1.smithi152.stdout:6/429: creat db/d12/d23/d4a/d43/d48/d6a/f82 x:0 0 0 2024-09-16T00:50:12.676 INFO:tasks.workunit.client.1.smithi152.stdout:8/302: dwrite dd/d50/d29/d2f/f4b [0,4194304] 0 2024-09-16T00:50:12.676 INFO:tasks.workunit.client.1.smithi152.stdout:8/303: chown dd/d15/d49/c41 40 1 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/430: rmdir d4/d19/d20 39 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/431: readlink d4/d19/d20/d34/l83 0 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/432: chown d4/d17/d3e/l76 62949 1 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/433: readlink d4/d19/d20/l42 0 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/434: readlink d4/d17/l1b 0 2024-09-16T00:50:12.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/435: fdatasync d4/f16 0 2024-09-16T00:50:12.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/577: mkdir d2/d1e/d28/db7 0 2024-09-16T00:50:12.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/430: mknod db/d12/d23/d4a/c83 0 2024-09-16T00:50:12.685 INFO:tasks.workunit.client.0.smithi053.stdout:1/47: sync 2024-09-16T00:50:12.686 INFO:tasks.workunit.client.0.smithi053.stdout:2/8: sync 2024-09-16T00:50:12.686 INFO:tasks.workunit.client.1.smithi152.stdout:3/428: dwrite dc/d10/d17/d1c/d1f/d22/d2c/d2f/f48 [4194304,4194304] 0 2024-09-16T00:50:12.686 INFO:tasks.workunit.client.1.smithi152.stdout:3/429: creat dc/d10/d17/d1c/d1f/d22/d2c/f84 x:0 0 0 2024-09-16T00:50:12.686 INFO:tasks.workunit.client.1.smithi152.stdout:3/430: creat dc/d10/d17/d1c/d1f/d24/f85 x:0 0 0 2024-09-16T00:50:12.688 INFO:tasks.workunit.client.1.smithi152.stdout:8/304: getdents dd/d15/d49 0 2024-09-16T00:50:12.689 INFO:tasks.workunit.client.1.smithi152.stdout:7/453: dwrite d9/d31/d64/d3c/f78 [0,4194304] 0 2024-09-16T00:50:12.690 INFO:tasks.workunit.client.0.smithi053.stdout:1/48: rename d5/dd/de to d5/d7/d10 0 2024-09-16T00:50:12.690 INFO:tasks.workunit.client.0.smithi053.stdout:1/49: write f2 [4291179,94789] 0 2024-09-16T00:50:12.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/436: getdents d4/d44/d7a/d86 0 2024-09-16T00:50:12.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/437: truncate d4/d19/f72 4496463 0 2024-09-16T00:50:12.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/467: dwrite d3/fc [0,4194304] 0 2024-09-16T00:50:12.693 INFO:tasks.workunit.client.0.smithi053.stdout:2/9: mknod c2 0 2024-09-16T00:50:12.694 INFO:tasks.workunit.client.1.smithi152.stdout:4/578: rename d2/d1e/d28/d29 to d2/db/d39/d3c/d76/db8 0 2024-09-16T00:50:12.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/468: write d3/d6/d8/ff [863025,34497] 0 2024-09-16T00:50:12.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/469: creat d3/d6/fa3 x:0 0 0 2024-09-16T00:50:12.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/470: dread - d3/d6/d8/d1d/d23/d25/d2a/d5c/f9f zero size 2024-09-16T00:50:12.698 INFO:tasks.workunit.client.1.smithi152.stdout:6/431: mkdir db/d28/d84 0 2024-09-16T00:50:12.698 INFO:tasks.workunit.client.1.smithi152.stdout:6/432: dread - db/d12/f7d zero size 2024-09-16T00:50:12.699 INFO:tasks.workunit.client.0.smithi053.stdout:1/50: unlink d5/d7/fa 0 2024-09-16T00:50:12.702 INFO:tasks.workunit.client.1.smithi152.stdout:3/431: symlink dc/d10/d17/d1c/d1f/d22/d2c/d2f/d46/l86 0 2024-09-16T00:50:12.702 INFO:tasks.workunit.client.1.smithi152.stdout:3/432: fdatasync dc/d10/d17/f37 0 2024-09-16T00:50:12.703 INFO:tasks.workunit.client.1.smithi152.stdout:8/305: mkdir dd/d15/d69 0 2024-09-16T00:50:12.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/454: creat d9/fa6 x:0 0 0 2024-09-16T00:50:12.709 INFO:tasks.workunit.client.0.smithi053.stdout:1/51: write f2 [3284423,89892] 0 2024-09-16T00:50:12.709 INFO:tasks.workunit.client.0.smithi053.stdout:1/52: chown d5/c6 432535 1 2024-09-16T00:50:12.709 INFO:tasks.workunit.client.1.smithi152.stdout:2/438: mkdir d4/d19/d20/d28/d2c/d4d/d93 0 2024-09-16T00:50:12.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/579: symlink d2/d41/lb9 0 2024-09-16T00:50:12.711 INFO:tasks.workunit.client.0.smithi053.stdout:2/10: dwrite f1 [0,4194304] 0 2024-09-16T00:50:12.711 INFO:tasks.workunit.client.0.smithi053.stdout:2/11: rmdir - no directory 2024-09-16T00:50:12.711 INFO:tasks.workunit.client.0.smithi053.stdout:1/53: creat d5/dd/f11 x:0 0 0 2024-09-16T00:50:12.715 INFO:tasks.workunit.client.1.smithi152.stdout:3/433: dread f7 [0,4194304] 0 2024-09-16T00:50:12.719 INFO:tasks.workunit.client.1.smithi152.stdout:0/471: truncate d3/d6/f17 3866781 0 2024-09-16T00:50:12.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/439: write d4/f5e [3372869,109105] 0 2024-09-16T00:50:12.722 INFO:tasks.workunit.client.1.smithi152.stdout:6/433: mknod db/d12/d23/d4a/d43/d59/d67/c85 0 2024-09-16T00:50:12.724 INFO:tasks.workunit.client.0.smithi053.stdout:1/54: creat d5/d7/d10/f12 x:0 0 0 2024-09-16T00:50:12.725 INFO:tasks.workunit.client.1.smithi152.stdout:8/306: creat dd/d50/d29/d2f/d5f/f6a x:0 0 0 2024-09-16T00:50:12.726 INFO:tasks.workunit.client.1.smithi152.stdout:7/455: rename d9/d31/d65/d6b/c7f to d9/d10/da5/ca7 0 2024-09-16T00:50:12.726 INFO:tasks.workunit.client.1.smithi152.stdout:7/456: dread - d9/d31/d64/d3c/f8b zero size 2024-09-16T00:50:12.726 INFO:tasks.workunit.client.1.smithi152.stdout:7/457: chown d9/d31/d65/f7b 1317 1 2024-09-16T00:50:12.727 INFO:tasks.workunit.client.0.smithi053.stdout:1/55: getdents d5 0 2024-09-16T00:50:12.727 INFO:tasks.workunit.client.0.smithi053.stdout:1/56: fdatasync d5/d9/ff 0 2024-09-16T00:50:12.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/580: link d2/d1e/c6b d2/d41/cba 0 2024-09-16T00:50:12.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/581: write d2/db/d39/d3c/f85 [1551364,95615] 0 2024-09-16T00:50:12.729 INFO:tasks.workunit.client.0.smithi053.stdout:2/12: dwrite f0 [0,4194304] 0 2024-09-16T00:50:12.729 INFO:tasks.workunit.client.1.smithi152.stdout:3/434: link f2 dc/d10/f87 0 2024-09-16T00:50:12.732 INFO:tasks.workunit.client.1.smithi152.stdout:3/435: dread dc/d10/d17/d5a/d68/f7c [0,4194304] 0 2024-09-16T00:50:12.732 INFO:tasks.workunit.client.1.smithi152.stdout:3/436: write f2 [973915,111620] 0 2024-09-16T00:50:12.735 INFO:tasks.workunit.client.1.smithi152.stdout:8/307: mknod dd/d23/c6b 0 2024-09-16T00:50:12.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/472: rename d3/d6/d8/d1d/d23/d94 to d3/d6/d8/d1d/d65/d6e/d82/da4 0 2024-09-16T00:50:12.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/473: write d3/d6/d8/d1d/d23/d4b/d54/f90 [3370871,25229] 0 2024-09-16T00:50:12.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/437: mknod dc/d10/d17/d1c/d1f/d22/d2c/c88 0 2024-09-16T00:50:12.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/308: dread dd/d50/d29/d2f/f31 [0,4194304] 0 2024-09-16T00:50:12.748 INFO:tasks.workunit.client.0.smithi053.stdout:1/57: dwrite d5/dd/f11 [0,4194304] 0 2024-09-16T00:50:12.748 INFO:tasks.workunit.client.0.smithi053.stdout:1/58: rename d5 to d5/d13 22 2024-09-16T00:50:12.748 INFO:tasks.workunit.client.0.smithi053.stdout:1/59: write f2 [4732747,48978] 0 2024-09-16T00:50:12.749 INFO:tasks.workunit.client.1.smithi152.stdout:6/434: mkdir db/d12/d20/d86 0 2024-09-16T00:50:12.754 INFO:tasks.workunit.client.1.smithi152.stdout:2/440: rename d4/d19/d20/d28/d2c/d4d to d4/d19/d94 0 2024-09-16T00:50:12.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/60: creat d5/f14 x:0 0 0 2024-09-16T00:50:12.758 INFO:tasks.workunit.client.1.smithi152.stdout:0/474: creat d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 x:0 0 0 2024-09-16T00:50:12.760 INFO:tasks.workunit.client.1.smithi152.stdout:7/458: getdents d9/d31/d65/d8a/d90 0 2024-09-16T00:50:12.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/438: symlink dc/d10/d17/d1c/d50/l89 0 2024-09-16T00:50:12.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/439: write dc/d10/d17/d1c/d1f/d22/d2c/d3b/d6f/f7d [103994,21433] 0 2024-09-16T00:50:12.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/440: stat dc/d10/d17/d1c/d1f/d22/d2c/d2f/d75 0 2024-09-16T00:50:12.763 INFO:tasks.workunit.client.1.smithi152.stdout:8/309: truncate dd/f16 946311 0 2024-09-16T00:50:12.763 INFO:tasks.workunit.client.1.smithi152.stdout:8/310: stat dd/f16 0 2024-09-16T00:50:12.765 INFO:tasks.workunit.client.0.smithi053.stdout:1/61: write d5/d9/ff [417726,5432] 0 2024-09-16T00:50:12.766 INFO:tasks.workunit.client.1.smithi152.stdout:6/435: read db/d12/d20/f3e [3419156,114832] 0 2024-09-16T00:50:12.770 INFO:tasks.workunit.client.1.smithi152.stdout:4/582: rename d2/db/l2b to d2/db/d39/d3c/d7f/d8b/lbb 0 2024-09-16T00:50:12.772 INFO:tasks.workunit.client.0.smithi053.stdout:1/62: creat d5/d7/d10/f15 x:0 0 0 2024-09-16T00:50:12.773 INFO:tasks.workunit.client.0.smithi053.stdout:1/63: truncate d5/d7/d10/f15 711580 0 2024-09-16T00:50:12.773 INFO:tasks.workunit.client.1.smithi152.stdout:2/441: symlink d4/d19/d20/d28/d8b/l95 0 2024-09-16T00:50:12.773 INFO:tasks.workunit.client.0.smithi053.stdout:1/64: dread d5/d7/d10/f15 [0,4194304] 0 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/65: write d5/d9/ff [2265610,75843] 0 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/66: write f2 [2690763,38431] 0 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/67: dread - d5/d7/d10/f12 zero size 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/68: chown d5/d7/d10 565 1 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/69: dread - d5/f14 zero size 2024-09-16T00:50:12.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/70: readlink d5/d7/l8 0 2024-09-16T00:50:12.778 INFO:tasks.workunit.client.1.smithi152.stdout:7/459: mknod d9/d80/ca8 0 2024-09-16T00:50:12.781 INFO:tasks.workunit.client.0.smithi053.stdout:1/71: link f2 d5/dd/f16 0 2024-09-16T00:50:12.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/441: mkdir dc/d10/d17/d1c/d1f/d8a 0 2024-09-16T00:50:12.786 INFO:tasks.workunit.client.1.smithi152.stdout:5/585: sync 2024-09-16T00:50:12.786 INFO:tasks.workunit.client.1.smithi152.stdout:1/542: sync 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/444: sync 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/586: chown d6/d16/d1f/d8c/db8/fcd 61 1 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/445: chown d1/l9 5 1 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/543: read d9/d3e/f49 [421356,92480] 0 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/544: write d9/f29 [858011,77266] 0 2024-09-16T00:50:12.787 INFO:tasks.workunit.client.1.smithi152.stdout:1/545: readlink d9/d3e/d41/d31/d48/l95 0 2024-09-16T00:50:12.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/587: dread d6/f20 [0,4194304] 0 2024-09-16T00:50:12.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/588: creat d6/d16/d1f/d65/fe4 x:0 0 0 2024-09-16T00:50:12.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/589: creat d6/d16/d1f/d6c/fe5 x:0 0 0 2024-09-16T00:50:12.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/590: chown d6/d57/d2b/d50/l5e 29 1 2024-09-16T00:50:12.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/591: chown d6/d57/c48 13 1 2024-09-16T00:50:12.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/592: chown d6/d57/d2b/d50/d6e/ldf 10344 1 2024-09-16T00:50:12.789 INFO:tasks.workunit.client.1.smithi152.stdout:5/593: write d6/d16/d1f/d65/f89 [981869,72198] 0 2024-09-16T00:50:12.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/311: link dd/d50/d29/d2f/l66 dd/d50/d29/l6c 0 2024-09-16T00:50:12.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/312: truncate dd/d15/f4d 520543 0 2024-09-16T00:50:12.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/442: creat d4/d44/f96 x:0 0 0 2024-09-16T00:50:12.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/443: read - d4/d19/d94/d8f/f91 zero size 2024-09-16T00:50:12.794 INFO:tasks.workunit.client.1.smithi152.stdout:0/475: truncate d3/fc 447187 0 2024-09-16T00:50:12.798 INFO:tasks.workunit.client.1.smithi152.stdout:0/476: dread d3/d6/f7f [0,4194304] 0 2024-09-16T00:50:12.798 INFO:tasks.workunit.client.1.smithi152.stdout:5/594: dread d6/d16/d1f/d65/f7d [0,4194304] 0 2024-09-16T00:50:12.798 INFO:tasks.workunit.client.1.smithi152.stdout:8/313: rename dd/d50/d29/f46 to dd/d15/d49/f6d 0 2024-09-16T00:50:12.798 INFO:tasks.workunit.client.1.smithi152.stdout:8/314: chown dd/d15/d49/f6d 1 1 2024-09-16T00:50:12.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/444: creat d4/d44/d7a/d86/d66/f97 x:0 0 0 2024-09-16T00:50:12.802 INFO:tasks.workunit.client.1.smithi152.stdout:5/595: symlink d6/d57/d2b/d50/d6e/le6 0 2024-09-16T00:50:12.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/596: dread d6/d16/f71 [0,4194304] 0 2024-09-16T00:50:12.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/597: fsync d6/d16/d8b/fe3 0 2024-09-16T00:50:12.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/598: mkdir d6/d16/d1f/d6c/de7 0 2024-09-16T00:50:12.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/599: truncate d6/d16/d1f/db5/fc0 4482911 0 2024-09-16T00:50:12.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/315: write dd/d15/f20 [472486,65430] 0 2024-09-16T00:50:12.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/316: chown dd/d50/d29/d2f/d5f/f6a 17304116 1 2024-09-16T00:50:12.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/317: chown dd/d50/d29/c63 485540131 1 2024-09-16T00:50:12.867 INFO:tasks.workunit.client.1.smithi152.stdout:8/318: mknod dd/d15/c6e 0 2024-09-16T00:50:12.869 INFO:tasks.workunit.client.1.smithi152.stdout:8/319: link dd/d15/d49/f13 dd/d15/d49/f6f 0 2024-09-16T00:50:12.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/546: dread d9/d3e/d41/d31/d48/d4a/f5b [0,4194304] 0 2024-09-16T00:50:12.870 INFO:tasks.workunit.client.1.smithi152.stdout:5/600: dread d6/d16/d1f/f2e [0,4194304] 0 2024-09-16T00:50:12.871 INFO:tasks.workunit.client.1.smithi152.stdout:1/547: creat d9/d3e/d4b/d6b/d6d/d99/fc9 x:0 0 0 2024-09-16T00:50:12.874 INFO:tasks.workunit.client.1.smithi152.stdout:5/601: rename d6/d16/d1f/d65/f69 to d6/d57/d2b/fe8 0 2024-09-16T00:50:12.875 INFO:tasks.workunit.client.1.smithi152.stdout:5/602: chown d6/d16/d1f/db5/dcb 199 1 2024-09-16T00:50:12.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/603: getdents d6/d16/d1f 0 2024-09-16T00:50:12.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/604: chown d6/d57/d54/f70 46 1 2024-09-16T00:50:12.877 INFO:tasks.workunit.client.1.smithi152.stdout:5/605: creat d6/d16/d1f/fe9 x:0 0 0 2024-09-16T00:50:12.881 INFO:tasks.workunit.client.1.smithi152.stdout:5/606: creat d6/d57/ddc/fea x:0 0 0 2024-09-16T00:50:12.883 INFO:tasks.workunit.client.1.smithi152.stdout:5/607: creat d6/d16/d1f/d8c/db8/feb x:0 0 0 2024-09-16T00:50:12.884 INFO:tasks.workunit.client.1.smithi152.stdout:5/608: chown d6/d16/ca3 28359123 1 2024-09-16T00:50:12.889 INFO:tasks.workunit.client.1.smithi152.stdout:5/609: mknod d6/d57/d54/cec 0 2024-09-16T00:50:12.889 INFO:tasks.workunit.client.1.smithi152.stdout:5/610: stat d6/d16/d1f/d65/fe4 0 2024-09-16T00:50:12.890 INFO:tasks.workunit.client.1.smithi152.stdout:6/436: dwrite db/d28/f32 [0,4194304] 0 2024-09-16T00:50:12.890 INFO:tasks.workunit.client.1.smithi152.stdout:6/437: write db/d12/d23/f81 [117474,117820] 0 2024-09-16T00:50:12.890 INFO:tasks.workunit.client.1.smithi152.stdout:5/611: mkdir d6/d16/d1f/d8c/db8/dbf/ded 0 2024-09-16T00:50:12.891 INFO:tasks.workunit.client.1.smithi152.stdout:6/438: chown db/d12/d20/f51 59 1 2024-09-16T00:50:12.892 INFO:tasks.workunit.client.1.smithi152.stdout:2/445: dwrite d4/d19/d20/d28/f2a [0,4194304] 0 2024-09-16T00:50:12.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/439: link db/f1e db/d12/d23/d4a/d43/d48/d6a/f87 0 2024-09-16T00:50:12.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/440: write db/d12/d23/d4a/d43/d48/d6a/f82 [688878,64389] 0 2024-09-16T00:50:12.896 INFO:tasks.workunit.client.1.smithi152.stdout:5/612: unlink d6/d16/d1f/db5/fc4 0 2024-09-16T00:50:12.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/477: dwrite d3/d6/d8/d1d/d23/d25/d2a/f5b [0,4194304] 0 2024-09-16T00:50:12.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/72: dwrite d5/dd/f11 [0,4194304] 0 2024-09-16T00:50:12.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/73: readlink d5/lb 0 2024-09-16T00:50:12.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/74: readlink l3 0 2024-09-16T00:50:12.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/75: stat d5/lb 0 2024-09-16T00:50:12.902 INFO:tasks.workunit.client.1.smithi152.stdout:2/446: rmdir d4/d17/d3e/d8d 0 2024-09-16T00:50:12.902 INFO:tasks.workunit.client.1.smithi152.stdout:9/446: dwrite d1/d4e/d34/f62 [0,4194304] 0 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:9/447: chown d1/d4e/d48/d66 316 1 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:9/448: chown d1/d7/d77/d68 29390 1 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/442: dwrite f2 [0,4194304] 0 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:9/449: write d1/d7/d13/f27 [2710538,125776] 0 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:8/320: dwrite dd/f39 [0,4194304] 0 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.1.smithi152.stdout:8/321: write dd/d25/f48 [460340,28432] 0 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.0.smithi053.stdout:4/37: sync 2024-09-16T00:50:12.903 INFO:tasks.workunit.client.0.smithi053.stdout:7/88: sync 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:6/24: sync 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:4/38: write d0/f5 [2420147,63250] 0 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:6/25: write d1/f6 [313324,67799] 0 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:0/36: sync 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:9/99: sync 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:2/13: sync 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.0.smithi053.stdout:2/14: stat f0 0 2024-09-16T00:50:12.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/548: dwrite d9/d3e/d4b/d6b/d6d/f81 [0,4194304] 0 2024-09-16T00:50:12.906 INFO:tasks.workunit.client.1.smithi152.stdout:6/441: mknod db/d12/d23/d4a/d43/c88 0 2024-09-16T00:50:12.906 INFO:tasks.workunit.client.1.smithi152.stdout:6/442: creat db/d12/d1c/f89 x:0 0 0 2024-09-16T00:50:12.906 INFO:tasks.workunit.client.1.smithi152.stdout:6/443: fsync db/d12/d20/d4b/f4e 0 2024-09-16T00:50:12.909 INFO:tasks.workunit.client.1.smithi152.stdout:0/478: dread d3/d6/d8/f3d [0,4194304] 0 2024-09-16T00:50:12.913 INFO:tasks.workunit.client.0.smithi053.stdout:0/37: write f3 [691187,86867] 0 2024-09-16T00:50:12.913 INFO:tasks.workunit.client.0.smithi053.stdout:0/38: write d4/f5 [3571224,103234] 0 2024-09-16T00:50:12.914 INFO:tasks.workunit.client.0.smithi053.stdout:0/39: dread - d4/fa zero size 2024-09-16T00:50:12.914 INFO:tasks.workunit.client.0.smithi053.stdout:0/40: chown d4/f5 456919 1 2024-09-16T00:50:12.914 INFO:tasks.workunit.client.0.smithi053.stdout:0/41: write d4/f5 [2248051,3816] 0 2024-09-16T00:50:12.914 INFO:tasks.workunit.client.0.smithi053.stdout:0/42: fdatasync d4/fb 0 2024-09-16T00:50:12.915 INFO:tasks.workunit.client.1.smithi152.stdout:5/613: unlink d6/d57/fd5 0 2024-09-16T00:50:12.918 INFO:tasks.workunit.client.0.smithi053.stdout:6/26: rename d1/f4 to d1/f7 0 2024-09-16T00:50:12.920 INFO:tasks.workunit.client.0.smithi053.stdout:9/100: symlink d8/d13/l21 0 2024-09-16T00:50:12.925 INFO:tasks.workunit.client.0.smithi053.stdout:7/89: symlink d1/l1b 0 2024-09-16T00:50:12.925 INFO:tasks.workunit.client.0.smithi053.stdout:7/90: chown d1/d3/d10/c19 2 1 2024-09-16T00:50:12.933 INFO:tasks.workunit.client.0.smithi053.stdout:8/131: sync 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/38: sync 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:3/88: sync 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/39: write d3/f8 [382625,129373] 0 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/40: fsync d3/f4 0 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/41: stat c2 0 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/42: chown c1 6 1 2024-09-16T00:50:12.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/43: stat d3/f8 0 2024-09-16T00:50:12.941 INFO:tasks.workunit.client.0.smithi053.stdout:7/91: rmdir d1/d3/d10/d14 39 2024-09-16T00:50:12.941 INFO:tasks.workunit.client.0.smithi053.stdout:7/92: chown d1/d3 31084 1 2024-09-16T00:50:12.944 INFO:tasks.workunit.client.0.smithi053.stdout:8/132: creat d10/d21/f2c x:0 0 0 2024-09-16T00:50:12.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/549: creat d9/d3e/d41/d9a/fca x:0 0 0 2024-09-16T00:50:12.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/550: chown d9/d3e/d7c/fc7 3076590 1 2024-09-16T00:50:12.948 INFO:tasks.workunit.client.0.smithi053.stdout:7/93: symlink d1/d3/d10/l1c 0 2024-09-16T00:50:12.949 INFO:tasks.workunit.client.1.smithi152.stdout:0/479: symlink d3/d6/d8/d1d/d23/d25/d45/d9d/la6 0 2024-09-16T00:50:12.952 INFO:tasks.workunit.client.1.smithi152.stdout:5/614: readlink d6/d16/d1f/l35 0 2024-09-16T00:50:12.957 INFO:tasks.workunit.client.1.smithi152.stdout:0/480: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/da7 0 2024-09-16T00:50:12.958 INFO:tasks.workunit.client.1.smithi152.stdout:5/615: write d6/d16/d1f/f3e [727404,88978] 0 2024-09-16T00:50:12.961 INFO:tasks.workunit.client.1.smithi152.stdout:0/481: mknod d3/d6/d8/d1d/d23/d25/d2a/ca8 0 2024-09-16T00:50:12.961 INFO:tasks.workunit.client.1.smithi152.stdout:0/482: chown d3/d6/d8/d1d/d23/d25/d2a/f50 13 1 2024-09-16T00:50:12.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/616: unlink d6/d57/c5d 0 2024-09-16T00:50:12.968 INFO:tasks.workunit.client.0.smithi053.stdout:5/44: dwrite f0 [0,4194304] 0 2024-09-16T00:50:12.971 INFO:tasks.workunit.client.0.smithi053.stdout:7/94: write d1/d3/f5 [4861132,54182] 0 2024-09-16T00:50:12.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/483: truncate d3/d6/d8/ff 1550206 0 2024-09-16T00:50:12.973 INFO:tasks.workunit.client.0.smithi053.stdout:5/45: creat d3/f9 x:0 0 0 2024-09-16T00:50:12.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/46: dread - d3/f9 zero size 2024-09-16T00:50:12.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/47: write d3/f4 [1669095,119595] 0 2024-09-16T00:50:12.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/48: chown f0 943 1 2024-09-16T00:50:12.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/617: mkdir d6/d57/d2b/dee 0 2024-09-16T00:50:12.976 INFO:tasks.workunit.client.0.smithi053.stdout:9/101: dwrite d8/fb [0,4194304] 0 2024-09-16T00:50:12.976 INFO:tasks.workunit.client.0.smithi053.stdout:4/39: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:12.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/95: creat d1/d3/d10/d14/d15/f1d x:0 0 0 2024-09-16T00:50:12.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/96: truncate d1/d3/d10/d14/f16 1071174 0 2024-09-16T00:50:12.980 INFO:tasks.workunit.client.1.smithi152.stdout:1/551: rename d9/d3e/d7c to d9/da/df/dcb 0 2024-09-16T00:50:12.983 INFO:tasks.workunit.client.1.smithi152.stdout:5/618: truncate d6/f40 2026628 0 2024-09-16T00:50:12.984 INFO:tasks.workunit.client.0.smithi053.stdout:9/102: dread d8/f17 [0,4194304] 0 2024-09-16T00:50:12.984 INFO:tasks.workunit.client.0.smithi053.stdout:9/103: fdatasync f2 0 2024-09-16T00:50:12.984 INFO:tasks.workunit.client.0.smithi053.stdout:9/104: chown d8/f1d 183111 1 2024-09-16T00:50:12.988 INFO:tasks.workunit.client.1.smithi152.stdout:5/619: creat d6/d16/d1f/d65/dd2/fef x:0 0 0 2024-09-16T00:50:12.989 INFO:tasks.workunit.client.0.smithi053.stdout:4/40: rmdir d0 39 2024-09-16T00:50:12.989 INFO:tasks.workunit.client.0.smithi053.stdout:4/41: write d0/f5 [1356172,107223] 0 2024-09-16T00:50:12.990 INFO:tasks.workunit.client.1.smithi152.stdout:8/322: dwrite dd/d50/d29/d2f/f4b [0,4194304] 0 2024-09-16T00:50:12.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/97: creat d1/d3/d10/f1e x:0 0 0 2024-09-16T00:50:12.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/98: creat d1/d3/f1f x:0 0 0 2024-09-16T00:50:12.993 INFO:tasks.workunit.client.0.smithi053.stdout:9/105: mkdir d8/d22 0 2024-09-16T00:50:12.995 INFO:tasks.workunit.client.1.smithi152.stdout:5/620: link d6/d16/d1f/f2e d6/d57/d2b/dee/ff0 0 2024-09-16T00:50:12.995 INFO:tasks.workunit.client.1.smithi152.stdout:5/621: chown d6/fa5 3634 1 2024-09-16T00:50:12.996 INFO:tasks.workunit.client.0.smithi053.stdout:4/42: creat d0/fc x:0 0 0 2024-09-16T00:50:12.997 INFO:tasks.workunit.client.1.smithi152.stdout:5/622: dread d6/d57/d2b/d50/d6e/fce [0,4194304] 0 2024-09-16T00:50:12.998 INFO:tasks.workunit.client.0.smithi053.stdout:7/99: unlink d1/cc 0 2024-09-16T00:50:12.999 INFO:tasks.workunit.client.1.smithi152.stdout:5/623: mkdir d6/d57/d2b/d50/d66/df1 0 2024-09-16T00:50:13.000 INFO:tasks.workunit.client.0.smithi053.stdout:9/106: symlink d8/d13/l23 0 2024-09-16T00:50:13.003 INFO:tasks.workunit.client.1.smithi152.stdout:5/624: unlink d6/d16/d1f/d65/d77/fc7 0 2024-09-16T00:50:13.006 INFO:tasks.workunit.client.0.smithi053.stdout:7/100: rmdir d1/d3 39 2024-09-16T00:50:13.009 INFO:tasks.workunit.client.0.smithi053.stdout:1/76: dwrite d5/dd/f11 [0,4194304] 0 2024-09-16T00:50:13.010 INFO:tasks.workunit.client.0.smithi053.stdout:1/77: truncate d5/d7/d10/f12 892406 0 2024-09-16T00:50:13.010 INFO:tasks.workunit.client.1.smithi152.stdout:9/450: dwrite d1/d7/d77/f33 [0,4194304] 0 2024-09-16T00:50:13.010 INFO:tasks.workunit.client.1.smithi152.stdout:2/447: dwrite d4/d44/f4e [0,4194304] 0 2024-09-16T00:50:13.011 INFO:tasks.workunit.client.0.smithi053.stdout:8/133: dwrite d10/f24 [0,4194304] 0 2024-09-16T00:50:13.014 INFO:tasks.workunit.client.0.smithi053.stdout:0/43: dread f3 [0,4194304] 0 2024-09-16T00:50:13.015 INFO:tasks.workunit.client.0.smithi053.stdout:6/27: dwrite d1/f2 [0,4194304] 0 2024-09-16T00:50:13.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/444: dwrite db/d12/d20/f51 [0,4194304] 0 2024-09-16T00:50:13.016 INFO:tasks.workunit.client.0.smithi053.stdout:4/43: fsync d0/f5 0 2024-09-16T00:50:13.017 INFO:tasks.workunit.client.0.smithi053.stdout:3/89: dwrite d1/d5/f6 [0,4194304] 0 2024-09-16T00:50:13.017 INFO:tasks.workunit.client.0.smithi053.stdout:5/49: dwrite d3/f8 [4194304,4194304] 0 2024-09-16T00:50:13.020 INFO:tasks.workunit.client.1.smithi152.stdout:1/552: dwrite d9/faf [0,4194304] 0 2024-09-16T00:50:13.020 INFO:tasks.workunit.client.1.smithi152.stdout:1/553: chown d9/d3e/d4b/d6b/d6d/d82 89 1 2024-09-16T00:50:13.020 INFO:tasks.workunit.client.1.smithi152.stdout:1/554: stat d9/d3e/d41/f2f 0 2024-09-16T00:50:13.026 INFO:tasks.workunit.client.0.smithi053.stdout:4/44: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:13.034 INFO:tasks.workunit.client.0.smithi053.stdout:8/134: dwrite d10/d1c/f26 [0,4194304] 0 2024-09-16T00:50:13.034 INFO:tasks.workunit.client.0.smithi053.stdout:8/135: chown d10/d21/l22 1316071032 1 2024-09-16T00:50:13.036 INFO:tasks.workunit.client.0.smithi053.stdout:1/78: dwrite d5/dd/f16 [0,4194304] 0 2024-09-16T00:50:13.036 INFO:tasks.workunit.client.0.smithi053.stdout:1/79: write d5/d7/d10/f15 [766568,47241] 0 2024-09-16T00:50:13.038 INFO:tasks.workunit.client.1.smithi152.stdout:6/445: dwrite db/d12/f3d [0,4194304] 0 2024-09-16T00:50:13.073 INFO:tasks.workunit.client.0.smithi053.stdout:7/101: creat d1/d18/f20 x:0 0 0 2024-09-16T00:50:13.075 INFO:tasks.workunit.client.1.smithi152.stdout:9/451: unlink d1/d7/f18 0 2024-09-16T00:50:13.075 INFO:tasks.workunit.client.1.smithi152.stdout:9/452: write d1/d59/f2f [4837367,122699] 0 2024-09-16T00:50:13.080 INFO:tasks.workunit.client.1.smithi152.stdout:2/448: symlink d4/d19/d20/d28/d2c/l98 0 2024-09-16T00:50:13.081 INFO:tasks.workunit.client.1.smithi152.stdout:9/453: write d1/d4e/d48/d26/d30/d4f/d50/f8a [2597723,18253] 0 2024-09-16T00:50:13.093 INFO:tasks.workunit.client.0.smithi053.stdout:6/28: mknod d1/c8 0 2024-09-16T00:50:13.093 INFO:tasks.workunit.client.0.smithi053.stdout:6/29: fdatasync d1/f7 0 2024-09-16T00:50:13.097 INFO:tasks.workunit.client.1.smithi152.stdout:1/555: symlink d9/d3e/d41/d31/d48/d7d/lcc 0 2024-09-16T00:50:13.103 INFO:tasks.workunit.client.1.smithi152.stdout:6/446: creat db/d12/d1c/d80/f8a x:0 0 0 2024-09-16T00:50:13.104 INFO:tasks.workunit.client.0.smithi053.stdout:8/136: symlink d10/d21/d28/l2d 0 2024-09-16T00:50:13.104 INFO:tasks.workunit.client.0.smithi053.stdout:8/137: write d10/d1c/f23 [300870,87790] 0 2024-09-16T00:50:13.109 INFO:tasks.workunit.client.1.smithi152.stdout:2/449: creat d4/d19/d94/d93/f99 x:0 0 0 2024-09-16T00:50:13.116 INFO:tasks.workunit.client.0.smithi053.stdout:8/138: write d10/d1c/f26 [2150642,51491] 0 2024-09-16T00:50:13.116 INFO:tasks.workunit.client.0.smithi053.stdout:8/139: fsync f8 0 2024-09-16T00:50:13.116 INFO:tasks.workunit.client.1.smithi152.stdout:4/583: sync 2024-09-16T00:50:13.116 INFO:tasks.workunit.client.1.smithi152.stdout:7/460: sync 2024-09-16T00:50:13.116 INFO:tasks.workunit.client.1.smithi152.stdout:7/461: write d9/d31/d65/d8a/d41/f58 [423595,65585] 0 2024-09-16T00:50:13.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/454: symlink d1/d4e/d48/d26/d30/l8c 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:0/44: mknod d4/cf 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:0/45: write d4/fa [584059,7456] 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:6/30: truncate d1/f6 136424 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:6/31: fsync d1/f2 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:6/32: creat d1/f9 x:0 0 0 2024-09-16T00:50:13.120 INFO:tasks.workunit.client.0.smithi053.stdout:6/33: fsync d1/f2 0 2024-09-16T00:50:13.121 INFO:tasks.workunit.client.0.smithi053.stdout:3/90: truncate d1/d5/f6 2029037 0 2024-09-16T00:50:13.121 INFO:tasks.workunit.client.0.smithi053.stdout:3/91: chown d1/d5/f6 20495243 1 2024-09-16T00:50:13.122 INFO:tasks.workunit.client.1.smithi152.stdout:7/462: read f8 [1759427,35939] 0 2024-09-16T00:50:13.122 INFO:tasks.workunit.client.1.smithi152.stdout:1/556: mknod d9/d3e/d41/d31/d48/db2/ccd 0 2024-09-16T00:50:13.122 INFO:tasks.workunit.client.1.smithi152.stdout:1/557: chown d9/d3e/d41/d31/c34 772468612 1 2024-09-16T00:50:13.122 INFO:tasks.workunit.client.0.smithi053.stdout:5/50: getdents d3 0 2024-09-16T00:50:13.124 INFO:tasks.workunit.client.1.smithi152.stdout:2/450: rename d4/d17/f38 to d4/d44/d7a/d86/d66/f9a 0 2024-09-16T00:50:13.125 INFO:tasks.workunit.client.0.smithi053.stdout:4/45: getdents d0/d2 0 2024-09-16T00:50:13.125 INFO:tasks.workunit.client.0.smithi053.stdout:4/46: write d0/f5 [985387,120691] 0 2024-09-16T00:50:13.125 INFO:tasks.workunit.client.0.smithi053.stdout:4/47: dread - d0/fc zero size 2024-09-16T00:50:13.128 INFO:tasks.workunit.client.1.smithi152.stdout:4/584: mknod d2/d1e/d28/d69/cbc 0 2024-09-16T00:50:13.128 INFO:tasks.workunit.client.1.smithi152.stdout:4/585: write d2/d1e/d28/d69/f49 [3841859,24019] 0 2024-09-16T00:50:13.130 INFO:tasks.workunit.client.1.smithi152.stdout:9/455: link d1/d7/d77/d32/f35 d1/d7/f8d 0 2024-09-16T00:50:13.130 INFO:tasks.workunit.client.1.smithi152.stdout:6/447: dwrite db/d12/f44 [0,4194304] 0 2024-09-16T00:50:13.130 INFO:tasks.workunit.client.0.smithi053.stdout:7/102: dwrite d1/d3/d10/f1e [0,4194304] 0 2024-09-16T00:50:13.135 INFO:tasks.workunit.client.1.smithi152.stdout:7/463: symlink d9/d31/d64/d3c/d5b/la9 0 2024-09-16T00:50:13.135 INFO:tasks.workunit.client.0.smithi053.stdout:4/48: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:13.135 INFO:tasks.workunit.client.0.smithi053.stdout:4/49: chown d0/f5 437354536 1 2024-09-16T00:50:13.136 INFO:tasks.workunit.client.0.smithi053.stdout:3/92: fsync d1/d5/f6 0 2024-09-16T00:50:13.136 INFO:tasks.workunit.client.0.smithi053.stdout:8/140: symlink d10/d21/d28/l2e 0 2024-09-16T00:50:13.137 INFO:tasks.workunit.client.0.smithi053.stdout:8/141: chown fb 7 1 2024-09-16T00:50:13.137 INFO:tasks.workunit.client.0.smithi053.stdout:8/142: fdatasync d10/f19 0 2024-09-16T00:50:13.138 INFO:tasks.workunit.client.1.smithi152.stdout:1/558: mknod d9/d3e/d41/d31/d48/db2/cce 0 2024-09-16T00:50:13.139 INFO:tasks.workunit.client.0.smithi053.stdout:0/46: getdents d4/dc 0 2024-09-16T00:50:13.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/451: symlink d4/d19/d94/d93/l9b 0 2024-09-16T00:50:13.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/452: chown d4/c24 11287760 1 2024-09-16T00:50:13.148 INFO:tasks.workunit.client.0.smithi053.stdout:6/34: mkdir d1/da 0 2024-09-16T00:50:13.149 INFO:tasks.workunit.client.1.smithi152.stdout:4/586: mknod d2/d1e/d28/d7b/cbd 0 2024-09-16T00:50:13.151 INFO:tasks.workunit.client.1.smithi152.stdout:9/456: symlink d1/d59/l8e 0 2024-09-16T00:50:13.152 INFO:tasks.workunit.client.0.smithi053.stdout:5/51: symlink d3/la 0 2024-09-16T00:50:13.154 INFO:tasks.workunit.client.0.smithi053.stdout:8/143: dwrite d10/f1e [0,4194304] 0 2024-09-16T00:50:13.155 INFO:tasks.workunit.client.0.smithi053.stdout:0/47: dwrite f3 [0,4194304] 0 2024-09-16T00:50:13.156 INFO:tasks.workunit.client.1.smithi152.stdout:6/448: creat db/d12/d20/d86/f8b x:0 0 0 2024-09-16T00:50:13.156 INFO:tasks.workunit.client.0.smithi053.stdout:0/48: dread d4/fa [0,4194304] 0 2024-09-16T00:50:13.157 INFO:tasks.workunit.client.1.smithi152.stdout:7/464: mknod d9/d31/d64/caa 0 2024-09-16T00:50:13.160 INFO:tasks.workunit.client.1.smithi152.stdout:1/559: creat d9/d3e/d41/d31/d48/d7d/fcf x:0 0 0 2024-09-16T00:50:13.167 INFO:tasks.workunit.client.1.smithi152.stdout:2/453: mkdir d4/d44/d7a/d86/d87/d9c 0 2024-09-16T00:50:13.167 INFO:tasks.workunit.client.0.smithi053.stdout:4/50: mkdir d0/d2/dd 0 2024-09-16T00:50:13.169 INFO:tasks.workunit.client.1.smithi152.stdout:4/587: symlink d2/d1e/d28/db7/lbe 0 2024-09-16T00:50:13.169 INFO:tasks.workunit.client.0.smithi053.stdout:3/93: creat d1/d5/d14/f18 x:0 0 0 2024-09-16T00:50:13.171 INFO:tasks.workunit.client.1.smithi152.stdout:9/457: mkdir d1/d4e/d48/d26/d30/d8f 0 2024-09-16T00:50:13.173 INFO:tasks.workunit.client.0.smithi053.stdout:6/35: symlink d1/lb 0 2024-09-16T00:50:13.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/449: mknod db/d12/d23/d3a/c8c 0 2024-09-16T00:50:13.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/450: write db/d12/d1c/d80/f8a [394573,56351] 0 2024-09-16T00:50:13.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/451: chown db/d12/d1c/c73 48 1 2024-09-16T00:50:13.177 INFO:tasks.workunit.client.0.smithi053.stdout:8/144: symlink d10/d1c/l2f 0 2024-09-16T00:50:13.178 INFO:tasks.workunit.client.0.smithi053.stdout:8/145: chown d10/d1c/l2f 1659696 1 2024-09-16T00:50:13.178 INFO:tasks.workunit.client.0.smithi053.stdout:8/146: creat d10/d21/f30 x:0 0 0 2024-09-16T00:50:13.181 INFO:tasks.workunit.client.0.smithi053.stdout:3/94: truncate d1/d5/f6 1610038 0 2024-09-16T00:50:13.181 INFO:tasks.workunit.client.0.smithi053.stdout:3/95: creat d1/d5/f19 x:0 0 0 2024-09-16T00:50:13.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/465: mknod d9/d31/d64/cab 0 2024-09-16T00:50:13.185 INFO:tasks.workunit.client.0.smithi053.stdout:5/52: unlink d3/l5 0 2024-09-16T00:50:13.185 INFO:tasks.workunit.client.0.smithi053.stdout:5/53: fsync f0 0 2024-09-16T00:50:13.185 INFO:tasks.workunit.client.1.smithi152.stdout:3/443: sync 2024-09-16T00:50:13.186 INFO:tasks.workunit.client.0.smithi053.stdout:4/51: dwrite d0/fc [0,4194304] 0 2024-09-16T00:50:13.186 INFO:tasks.workunit.client.0.smithi053.stdout:4/52: chown d0/f5 0 1 2024-09-16T00:50:13.186 INFO:tasks.workunit.client.1.smithi152.stdout:1/560: stat d9/d3e/d41/l78 0 2024-09-16T00:50:13.189 INFO:tasks.workunit.client.1.smithi152.stdout:2/454: mkdir d4/d19/d20/d9d 0 2024-09-16T00:50:13.191 INFO:tasks.workunit.client.0.smithi053.stdout:8/147: creat d10/d21/d28/f31 x:0 0 0 2024-09-16T00:50:13.191 INFO:tasks.workunit.client.0.smithi053.stdout:8/148: creat d10/d21/d28/f32 x:0 0 0 2024-09-16T00:50:13.191 INFO:tasks.workunit.client.0.smithi053.stdout:6/36: dwrite d1/f9 [0,4194304] 0 2024-09-16T00:50:13.192 INFO:tasks.workunit.client.1.smithi152.stdout:4/588: creat d2/fbf x:0 0 0 2024-09-16T00:50:13.193 INFO:tasks.workunit.client.1.smithi152.stdout:8/323: sync 2024-09-16T00:50:13.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/484: sync 2024-09-16T00:50:13.193 INFO:tasks.workunit.client.1.smithi152.stdout:5/625: sync 2024-09-16T00:50:13.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/485: readlink d3/d6/d2e/d58/l5d 0 2024-09-16T00:50:13.194 INFO:tasks.workunit.client.1.smithi152.stdout:0/486: dread - d3/d6/d64/fa2 zero size 2024-09-16T00:50:13.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/626: write d6/d16/d1f/d65/dd2/fef [387025,30933] 0 2024-09-16T00:50:13.194 INFO:tasks.workunit.client.0.smithi053.stdout:0/49: dwrite d4/f9 [0,4194304] 0 2024-09-16T00:50:13.194 INFO:tasks.workunit.client.1.smithi152.stdout:9/458: symlink d1/d7/d13/l90 0 2024-09-16T00:50:13.195 INFO:tasks.workunit.client.0.smithi053.stdout:3/96: symlink d1/d5/d16/l1a 0 2024-09-16T00:50:13.195 INFO:tasks.workunit.client.0.smithi053.stdout:3/97: read - d1/d5/f19 zero size 2024-09-16T00:50:13.195 INFO:tasks.workunit.client.0.smithi053.stdout:3/98: read - d1/d5/d14/f18 zero size 2024-09-16T00:50:13.195 INFO:tasks.workunit.client.0.smithi053.stdout:3/99: rename d1 to d1/d5/d11/d1b 22 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/452: rename db/d12/c35 to db/d12/d20/d4b/c8d 0 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/453: creat db/d12/d23/f8e x:0 0 0 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/454: readlink db/d28/l29 0 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/455: fdatasync db/d12/f3d 0 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:7/466: truncate d9/d31/d65/f59 921739 0 2024-09-16T00:50:13.197 INFO:tasks.workunit.client.1.smithi152.stdout:7/467: fsync d9/d31/d65/d8a/d41/f50 0 2024-09-16T00:50:13.198 INFO:tasks.workunit.client.1.smithi152.stdout:7/468: write d9/d31/d65/d8a/d41/f58 [365007,36536] 0 2024-09-16T00:50:13.201 INFO:tasks.workunit.client.1.smithi152.stdout:3/444: creat dc/d10/d17/d1c/d50/d55/d6d/f8b x:0 0 0 2024-09-16T00:50:13.201 INFO:tasks.workunit.client.1.smithi152.stdout:3/445: creat dc/d10/d17/d1c/d1f/d22/d2c/d2f/f8c x:0 0 0 2024-09-16T00:50:13.204 INFO:tasks.workunit.client.1.smithi152.stdout:4/589: creat d2/d1e/d28/fc0 x:0 0 0 2024-09-16T00:50:13.205 INFO:tasks.workunit.client.1.smithi152.stdout:4/590: read d2/db/f66 [1214475,16390] 0 2024-09-16T00:50:13.205 INFO:tasks.workunit.client.1.smithi152.stdout:4/591: chown d2/db/c9b 211634 1 2024-09-16T00:50:13.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/324: dwrite dd/d15/f5a [0,4194304] 0 2024-09-16T00:50:13.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/469: fdatasync d9/d31/d65/d8a/d41/f58 0 2024-09-16T00:50:13.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/459: creat d1/d7/d13/d80/f91 x:0 0 0 2024-09-16T00:50:13.212 INFO:tasks.workunit.client.1.smithi152.stdout:3/446: write dc/d10/d17/d1c/d1f/f49 [1145180,9971] 0 2024-09-16T00:50:13.212 INFO:tasks.workunit.client.1.smithi152.stdout:3/447: write dc/d10/d17/f59 [796727,90802] 0 2024-09-16T00:50:13.217 INFO:tasks.workunit.client.1.smithi152.stdout:7/470: write d9/f1f [3973899,10819] 0 2024-09-16T00:50:13.217 INFO:tasks.workunit.client.1.smithi152.stdout:7/471: chown d9/d31/d65/d8a/d41/c5e 1161 1 2024-09-16T00:50:13.217 INFO:tasks.workunit.client.1.smithi152.stdout:5/627: rename d6/d57/d2b/dee/ff0 to d6/d57/d54/ff2 0 2024-09-16T00:50:13.219 INFO:tasks.workunit.client.0.smithi053.stdout:6/37: rename d1/da to d1/dc 0 2024-09-16T00:50:13.224 INFO:tasks.workunit.client.1.smithi152.stdout:6/456: link db/c66 db/d12/d1c/d80/c8f 0 2024-09-16T00:50:13.226 INFO:tasks.workunit.client.0.smithi053.stdout:0/50: creat d4/f10 x:0 0 0 2024-09-16T00:50:13.226 INFO:tasks.workunit.client.0.smithi053.stdout:0/51: readlink d4/ld 0 2024-09-16T00:50:13.227 INFO:tasks.workunit.client.1.smithi152.stdout:1/561: getdents d9/da/da2 0 2024-09-16T00:50:13.228 INFO:tasks.workunit.client.0.smithi053.stdout:3/100: mknod d1/d5/d16/c1c 0 2024-09-16T00:50:13.230 INFO:tasks.workunit.client.0.smithi053.stdout:5/54: symlink d3/lb 0 2024-09-16T00:50:13.232 INFO:tasks.workunit.client.0.smithi053.stdout:4/53: rmdir d0 39 2024-09-16T00:50:13.235 INFO:tasks.workunit.client.1.smithi152.stdout:9/460: mkdir d1/d4e/d48/d26/d92 0 2024-09-16T00:50:13.235 INFO:tasks.workunit.client.1.smithi152.stdout:9/461: dread - d1/d4e/f67 zero size 2024-09-16T00:50:13.238 INFO:tasks.workunit.client.1.smithi152.stdout:3/448: mkdir dc/d10/d17/d1c/d8d 0 2024-09-16T00:50:13.238 INFO:tasks.workunit.client.1.smithi152.stdout:3/449: chown dc/d10/d17/d1c/d50/d63/f64 47 1 2024-09-16T00:50:13.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/149: dwrite d10/f14 [4194304,4194304] 0 2024-09-16T00:50:13.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/150: creat d10/d21/f33 x:0 0 0 2024-09-16T00:50:13.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/151: dread - d10/d21/d28/f31 zero size 2024-09-16T00:50:13.239 INFO:tasks.workunit.client.0.smithi053.stdout:8/152: creat d10/d21/d28/f34 x:0 0 0 2024-09-16T00:50:13.241 INFO:tasks.workunit.client.0.smithi053.stdout:4/54: creat d0/da/fe x:0 0 0 2024-09-16T00:50:13.241 INFO:tasks.workunit.client.1.smithi152.stdout:8/325: dwrite dd/d15/d49/f21 [0,4194304] 0 2024-09-16T00:50:13.241 INFO:tasks.workunit.client.1.smithi152.stdout:8/326: creat dd/d25/f70 x:0 0 0 2024-09-16T00:50:13.241 INFO:tasks.workunit.client.1.smithi152.stdout:3/450: read dc/d10/d17/f26 [2330338,126708] 0 2024-09-16T00:50:13.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/472: mkdir d9/d31/d65/d8a/d41/d46/d7d/dac 0 2024-09-16T00:50:13.245 INFO:tasks.workunit.client.0.smithi053.stdout:0/52: link d4/cf d4/c11 0 2024-09-16T00:50:13.247 INFO:tasks.workunit.client.0.smithi053.stdout:5/55: dread f0 [0,4194304] 0 2024-09-16T00:50:13.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/628: rename d6/d16/d1f/d8c/db8/laa to d6/d57/ddc/lf3 0 2024-09-16T00:50:13.249 INFO:tasks.workunit.client.0.smithi053.stdout:4/55: dread d0/fc [0,4194304] 0 2024-09-16T00:50:13.251 INFO:tasks.workunit.client.1.smithi152.stdout:6/457: symlink db/d12/d20/d4b/l90 0 2024-09-16T00:50:13.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/562: stat d9/d3e/d4b/d50/l89 0 2024-09-16T00:50:13.254 INFO:tasks.workunit.client.0.smithi053.stdout:8/153: truncate fb 3671326 0 2024-09-16T00:50:13.254 INFO:tasks.workunit.client.0.smithi053.stdout:8/154: stat d10/d1c/d2b 0 2024-09-16T00:50:13.255 INFO:tasks.workunit.client.1.smithi152.stdout:4/592: getdents d2/d1e/d28/d7b 0 2024-09-16T00:50:13.256 INFO:tasks.workunit.client.0.smithi053.stdout:3/101: getdents d1/d5/d16 0 2024-09-16T00:50:13.256 INFO:tasks.workunit.client.0.smithi053.stdout:3/102: dread - d1/d5/d14/f18 zero size 2024-09-16T00:50:13.256 INFO:tasks.workunit.client.0.smithi053.stdout:3/103: write d1/d5/d11/f12 [2626281,25103] 0 2024-09-16T00:50:13.259 INFO:tasks.workunit.client.1.smithi152.stdout:9/462: truncate d1/d4e/d48/f3d 1709082 0 2024-09-16T00:50:13.259 INFO:tasks.workunit.client.1.smithi152.stdout:9/463: stat d1/d4e/d48/d66 0 2024-09-16T00:50:13.261 INFO:tasks.workunit.client.1.smithi152.stdout:1/563: write d9/d3e/d41/d31/d48/f70 [2149118,16230] 0 2024-09-16T00:50:13.262 INFO:tasks.workunit.client.0.smithi053.stdout:3/104: symlink d1/d5/d14/l1d 0 2024-09-16T00:50:13.262 INFO:tasks.workunit.client.0.smithi053.stdout:3/105: chown d1/d5/d16/c1c 8 1 2024-09-16T00:50:13.264 INFO:tasks.workunit.client.0.smithi053.stdout:0/53: symlink d4/l12 0 2024-09-16T00:50:13.265 INFO:tasks.workunit.client.0.smithi053.stdout:0/54: chown d4/fa 0 1 2024-09-16T00:50:13.265 INFO:tasks.workunit.client.0.smithi053.stdout:5/56: rmdir d3 39 2024-09-16T00:50:13.266 INFO:tasks.workunit.client.1.smithi152.stdout:3/451: dwrite dc/d10/d47/f4e [0,4194304] 0 2024-09-16T00:50:13.268 INFO:tasks.workunit.client.0.smithi053.stdout:3/106: link d1/d5/cf d1/d5/d11/c1e 0 2024-09-16T00:50:13.268 INFO:tasks.workunit.client.0.smithi053.stdout:3/107: write d1/d5/f19 [673894,96467] 0 2024-09-16T00:50:13.276 INFO:tasks.workunit.client.0.smithi053.stdout:3/108: creat d1/d5/d16/f1f x:0 0 0 2024-09-16T00:50:13.276 INFO:tasks.workunit.client.0.smithi053.stdout:3/109: write d1/d5/d14/f18 [791258,129146] 0 2024-09-16T00:50:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/57: dread f0 [0,4194304] 0 2024-09-16T00:50:13.279 INFO:tasks.workunit.client.0.smithi053.stdout:0/55: mkdir d4/d13 0 2024-09-16T00:50:13.279 INFO:tasks.workunit.client.0.smithi053.stdout:0/56: fdatasync d4/f9 0 2024-09-16T00:50:13.280 INFO:tasks.workunit.client.1.smithi152.stdout:4/593: mknod d2/db/d39/d3c/d76/cc1 0 2024-09-16T00:50:13.282 INFO:tasks.workunit.client.0.smithi053.stdout:3/110: rename d1/d5/l15 to d1/d5/d11/l20 0 2024-09-16T00:50:13.283 INFO:tasks.workunit.client.1.smithi152.stdout:9/464: mkdir d1/d4e/d48/d2b/d93 0 2024-09-16T00:50:13.285 INFO:tasks.workunit.client.0.smithi053.stdout:3/111: truncate d1/d5/f6 1523699 0 2024-09-16T00:50:13.286 INFO:tasks.workunit.client.0.smithi053.stdout:5/58: symlink d3/d7/lc 0 2024-09-16T00:50:13.288 INFO:tasks.workunit.client.0.smithi053.stdout:3/112: creat d1/f21 x:0 0 0 2024-09-16T00:50:13.288 INFO:tasks.workunit.client.0.smithi053.stdout:3/113: readlink d1/d5/l9 0 2024-09-16T00:50:13.289 INFO:tasks.workunit.client.1.smithi152.stdout:8/327: symlink dd/l71 0 2024-09-16T00:50:13.289 INFO:tasks.workunit.client.1.smithi152.stdout:8/328: dread - dd/d25/f30 zero size 2024-09-16T00:50:13.290 INFO:tasks.workunit.client.1.smithi152.stdout:8/329: write dd/d15/d49/f6d [1739501,54504] 0 2024-09-16T00:50:13.290 INFO:tasks.workunit.client.0.smithi053.stdout:5/59: stat d3/f8 0 2024-09-16T00:50:13.290 INFO:tasks.workunit.client.1.smithi152.stdout:1/564: dwrite d9/d3e/d41/d31/d38/f8a [0,4194304] 0 2024-09-16T00:50:13.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/473: rmdir d9/d31/d65 39 2024-09-16T00:50:13.292 INFO:tasks.workunit.client.0.smithi053.stdout:3/114: dread d1/d5/f10 [0,4194304] 0 2024-09-16T00:50:13.292 INFO:tasks.workunit.client.0.smithi053.stdout:3/115: fdatasync d1/d5/d16/f1f 0 2024-09-16T00:50:13.292 INFO:tasks.workunit.client.0.smithi053.stdout:3/116: creat d1/d5/f22 x:0 0 0 2024-09-16T00:50:13.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/629: mknod d6/d16/d1f/d6c/de7/cf4 0 2024-09-16T00:50:13.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/630: fsync d6/d16/d1f/f3e 0 2024-09-16T00:50:13.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/631: write d6/d16/d1f/d65/fe4 [427381,69534] 0 2024-09-16T00:50:13.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/632: getdents d6/d16/d1f/d8c/db8/dbf/ded 0 2024-09-16T00:50:13.298 INFO:tasks.workunit.client.1.smithi152.stdout:6/458: rmdir db 39 2024-09-16T00:50:13.302 INFO:tasks.workunit.client.1.smithi152.stdout:9/465: creat d1/d7/d13/d5d/f94 x:0 0 0 2024-09-16T00:50:13.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/155: dwrite f8 [0,4194304] 0 2024-09-16T00:50:13.308 INFO:tasks.workunit.client.0.smithi053.stdout:8/156: mknod d10/d1c/c35 0 2024-09-16T00:50:13.308 INFO:tasks.workunit.client.0.smithi053.stdout:8/157: write d10/d1c/f26 [3957145,62520] 0 2024-09-16T00:50:13.313 INFO:tasks.workunit.client.0.smithi053.stdout:0/57: dwrite d4/f10 [0,4194304] 0 2024-09-16T00:50:13.313 INFO:tasks.workunit.client.0.smithi053.stdout:3/117: dwrite d1/f21 [0,4194304] 0 2024-09-16T00:50:13.314 INFO:tasks.workunit.client.1.smithi152.stdout:8/330: unlink dd/d50/d29/l6c 0 2024-09-16T00:50:13.314 INFO:tasks.workunit.client.1.smithi152.stdout:8/331: readlink dd/d15/d49/l5e 0 2024-09-16T00:50:13.314 INFO:tasks.workunit.client.1.smithi152.stdout:8/332: chown dd/d23/c34 80628108 1 2024-09-16T00:50:13.314 INFO:tasks.workunit.client.1.smithi152.stdout:8/333: write dd/d23/f24 [85892,99457] 0 2024-09-16T00:50:13.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/594: dwrite d2/db/d39/d3c/d76/db8/f5c [0,4194304] 0 2024-09-16T00:50:13.316 INFO:tasks.workunit.client.1.smithi152.stdout:1/565: creat d9/da/df/dcb/fd0 x:0 0 0 2024-09-16T00:50:13.316 INFO:tasks.workunit.client.1.smithi152.stdout:1/566: write d9/da/df/f86 [1035928,11245] 0 2024-09-16T00:50:13.319 INFO:tasks.workunit.client.0.smithi053.stdout:8/158: write f8 [2250096,35481] 0 2024-09-16T00:50:13.320 INFO:tasks.workunit.client.1.smithi152.stdout:4/595: write d2/db/d39/d3c/d76/db8/f6a [908238,119321] 0 2024-09-16T00:50:13.322 INFO:tasks.workunit.client.0.smithi053.stdout:0/58: dread d4/f9 [0,4194304] 0 2024-09-16T00:50:13.322 INFO:tasks.workunit.client.0.smithi053.stdout:0/59: chown d4/f5 438489773 1 2024-09-16T00:50:13.322 INFO:tasks.workunit.client.0.smithi053.stdout:0/60: chown d4/c11 1627 1 2024-09-16T00:50:13.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/474: mknod d9/d31/d64/d3c/d5b/cad 0 2024-09-16T00:50:13.326 INFO:tasks.workunit.client.1.smithi152.stdout:5/633: mkdir d6/d57/d2b/d50/d64/df5 0 2024-09-16T00:50:13.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/459: mkdir db/d12/d20/d86/d91 0 2024-09-16T00:50:13.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/334: dwrite dd/d15/f62 [0,4194304] 0 2024-09-16T00:50:13.332 INFO:tasks.workunit.client.1.smithi152.stdout:8/335: chown dd/d50/d29/d2f/d5f/f6a 0 1 2024-09-16T00:50:13.332 INFO:tasks.workunit.client.1.smithi152.stdout:8/336: stat dd/d50/d29/d2f/f4b 0 2024-09-16T00:50:13.334 INFO:tasks.workunit.client.1.smithi152.stdout:6/460: write db/d12/d23/d4a/f5f [1320760,35162] 0 2024-09-16T00:50:13.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/466: link d1/d4e/c6c d1/d4e/d48/d2b/d93/c95 0 2024-09-16T00:50:13.338 INFO:tasks.workunit.client.0.smithi053.stdout:8/159: dwrite d10/d21/f30 [0,4194304] 0 2024-09-16T00:50:13.338 INFO:tasks.workunit.client.0.smithi053.stdout:8/160: stat d10/d1c/f26 0 2024-09-16T00:50:13.341 INFO:tasks.workunit.client.1.smithi152.stdout:3/452: rename dc/d10/d17/d1c/d1f/d22/d2c to dc/d10/d17/d1c/d8d/d8e 0 2024-09-16T00:50:13.350 INFO:tasks.workunit.client.0.smithi053.stdout:3/118: symlink d1/d5/d11/l23 0 2024-09-16T00:50:13.350 INFO:tasks.workunit.client.0.smithi053.stdout:3/119: chown d1/d5/f19 2851341 1 2024-09-16T00:50:13.352 INFO:tasks.workunit.client.0.smithi053.stdout:0/61: creat d4/dc/f14 x:0 0 0 2024-09-16T00:50:13.356 INFO:tasks.workunit.client.1.smithi152.stdout:4/596: symlink d2/d1e/d28/lc2 0 2024-09-16T00:50:13.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/475: mknod d9/d80/cae 0 2024-09-16T00:50:13.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/476: write d9/f9f [1570217,28344] 0 2024-09-16T00:50:13.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/477: write d9/d31/d65/d8a/d41/f58 [1506774,55435] 0 2024-09-16T00:50:13.359 INFO:tasks.workunit.client.0.smithi053.stdout:8/161: symlink d10/d1c/l36 0 2024-09-16T00:50:13.364 INFO:tasks.workunit.client.1.smithi152.stdout:6/461: symlink db/d12/d23/d4a/d43/d48/d64/l92 0 2024-09-16T00:50:13.366 INFO:tasks.workunit.client.0.smithi053.stdout:0/62: rename d4/c11 to d4/c15 0 2024-09-16T00:50:13.366 INFO:tasks.workunit.client.0.smithi053.stdout:0/63: fsync d4/f10 0 2024-09-16T00:50:13.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/467: mkdir d1/d4e/d48/d2b/d93/d96 0 2024-09-16T00:50:13.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/468: truncate d1/d7/d13/d80/f86 854405 0 2024-09-16T00:50:13.372 INFO:tasks.workunit.client.1.smithi152.stdout:1/567: rename d9/da/df/f2b to d9/da/fd1 0 2024-09-16T00:50:13.373 INFO:tasks.workunit.client.1.smithi152.stdout:3/453: mknod dc/d10/d17/d1c/d50/d55/d6d/c8f 0 2024-09-16T00:50:13.374 INFO:tasks.workunit.client.1.smithi152.stdout:3/454: readlink dc/d10/d17/d1c/d8d/d8e/d2f/d46/l86 0 2024-09-16T00:50:13.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/597: link d2/db/d39/d3c/fa3 d2/db/d39/d3c/d76/db4/fc3 0 2024-09-16T00:50:13.376 INFO:tasks.workunit.client.1.smithi152.stdout:7/478: truncate d9/d31/d65/d6b/f77 69305 0 2024-09-16T00:50:13.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/462: mknod db/d12/d20/d86/c93 0 2024-09-16T00:50:13.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/463: truncate db/d12/d23/f75 4582233 0 2024-09-16T00:50:13.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/469: mknod d1/d7/d77/d3c/c97 0 2024-09-16T00:50:13.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/470: write d1/d4e/f67 [175769,109382] 0 2024-09-16T00:50:13.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/471: chown d1/d4e/d48/d66/l6d 278618046 1 2024-09-16T00:50:13.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/455: creat dc/d10/d17/d1c/d8d/d8e/d3b/f90 x:0 0 0 2024-09-16T00:50:13.382 INFO:tasks.workunit.client.1.smithi152.stdout:4/598: mknod d2/d1e/d28/d7b/db0/cc4 0 2024-09-16T00:50:13.384 INFO:tasks.workunit.client.1.smithi152.stdout:7/479: symlink d9/d31/d65/d8a/d41/d46/d7d/laf 0 2024-09-16T00:50:13.384 INFO:tasks.workunit.client.1.smithi152.stdout:7/480: truncate d9/d31/d65/f7c 468737 0 2024-09-16T00:50:13.384 INFO:tasks.workunit.client.1.smithi152.stdout:7/481: dread - d9/d31/d64/d3c/f8b zero size 2024-09-16T00:50:13.384 INFO:tasks.workunit.client.1.smithi152.stdout:7/482: chown f7 7502 1 2024-09-16T00:50:13.384 INFO:tasks.workunit.client.1.smithi152.stdout:4/599: chown d2/l11 58317282 1 2024-09-16T00:50:13.385 INFO:tasks.workunit.client.1.smithi152.stdout:7/483: getdents d9/d31/d65/d8a/d41/d46 0 2024-09-16T00:50:13.385 INFO:tasks.workunit.client.1.smithi152.stdout:7/484: fdatasync d9/d31/d64/d3c/f75 0 2024-09-16T00:50:13.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/600: mkdir d2/db/d39/d3c/dc5 0 2024-09-16T00:50:13.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/601: stat d2/db/d39/d3c/d7f/d98/c65 0 2024-09-16T00:50:13.388 INFO:tasks.workunit.client.1.smithi152.stdout:4/602: write d2/db/d39/d3c/d76/db8/f34 [2849413,58314] 0 2024-09-16T00:50:13.388 INFO:tasks.workunit.client.1.smithi152.stdout:6/464: write db/d12/d20/f51 [3660112,25640] 0 2024-09-16T00:50:13.389 INFO:tasks.workunit.client.1.smithi152.stdout:3/456: dread dc/d10/d17/f80 [0,4194304] 0 2024-09-16T00:50:13.389 INFO:tasks.workunit.client.1.smithi152.stdout:3/457: getdents dc/d10/d17/d1c/d8d/d8e/d2f/d46/d77 0 2024-09-16T00:50:13.389 INFO:tasks.workunit.client.1.smithi152.stdout:4/603: symlink d2/db/d39/d3c/d7f/d98/lc6 0 2024-09-16T00:50:13.391 INFO:tasks.workunit.client.1.smithi152.stdout:3/458: creat dc/d10/d17/d1c/d1f/f91 x:0 0 0 2024-09-16T00:50:13.393 INFO:tasks.workunit.client.1.smithi152.stdout:4/604: rename d2/db/d39/f6c to d2/d1e/d28/d7b/fc7 0 2024-09-16T00:50:13.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/465: symlink db/d12/d20/l94 0 2024-09-16T00:50:13.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/466: readlink db/d12/d20/l94 0 2024-09-16T00:50:13.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/467: creat db/d12/d23/d4a/f95 x:0 0 0 2024-09-16T00:50:13.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/468: read - db/d12/d23/d4a/f95 zero size 2024-09-16T00:50:13.396 INFO:tasks.workunit.client.1.smithi152.stdout:6/469: rename db/d12/d23/d4a/d43/d48/d64/l92 to db/d12/d20/d86/d91/l96 0 2024-09-16T00:50:13.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/459: dread f5 [0,4194304] 0 2024-09-16T00:50:13.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/460: truncate f8 10183735 0 2024-09-16T00:50:13.398 INFO:tasks.workunit.client.1.smithi152.stdout:3/461: creat dc/d10/d17/d1c/d8d/d8e/f92 x:0 0 0 2024-09-16T00:50:13.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/472: dread d1/d7/d77/f33 [0,4194304] 0 2024-09-16T00:50:13.424 INFO:tasks.workunit.client.1.smithi152.stdout:9/473: fdatasync d1/d4e/f61 0 2024-09-16T00:50:13.424 INFO:tasks.workunit.client.0.smithi053.stdout:3/120: dread d1/f21 [0,4194304] 0 2024-09-16T00:50:13.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/15: sync 2024-09-16T00:50:13.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/16: creat f3 x:0 0 0 2024-09-16T00:50:13.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/17: creat f4 x:0 0 0 2024-09-16T00:50:13.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/18: chown f3 45067854 1 2024-09-16T00:50:13.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/19: truncate f4 323351 0 2024-09-16T00:50:13.437 INFO:tasks.workunit.client.0.smithi053.stdout:2/20: link f4 f5 0 2024-09-16T00:50:13.442 INFO:tasks.workunit.client.0.smithi053.stdout:2/21: dread f1 [0,4194304] 0 2024-09-16T00:50:13.444 INFO:tasks.workunit.client.0.smithi053.stdout:8/162: dwrite d10/f1d [0,4194304] 0 2024-09-16T00:50:13.444 INFO:tasks.workunit.client.1.smithi152.stdout:5/634: dwrite d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:13.445 INFO:tasks.workunit.client.0.smithi053.stdout:2/22: unlink f4 0 2024-09-16T00:50:13.446 INFO:tasks.workunit.client.0.smithi053.stdout:2/23: chown f1 126 1 2024-09-16T00:50:13.446 INFO:tasks.workunit.client.0.smithi053.stdout:2/24: chown c2 137 1 2024-09-16T00:50:13.450 INFO:tasks.workunit.client.1.smithi152.stdout:5/635: rename d6/c9 to d6/d16/d1f/d8c/cf6 0 2024-09-16T00:50:13.452 INFO:tasks.workunit.client.0.smithi053.stdout:8/163: rename l1 to d10/l37 0 2024-09-16T00:50:13.453 INFO:tasks.workunit.client.0.smithi053.stdout:8/164: write d10/d21/d28/f34 [470777,41742] 0 2024-09-16T00:50:13.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/636: dread d6/d57/d54/f84 [0,4194304] 0 2024-09-16T00:50:13.456 INFO:tasks.workunit.client.1.smithi152.stdout:1/568: dwrite d9/d3e/d4b/d6b/d6d/f81 [4194304,4194304] 0 2024-09-16T00:50:13.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/470: dwrite db/fc [0,4194304] 0 2024-09-16T00:50:13.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/471: readlink db/d12/d20/l94 0 2024-09-16T00:50:13.458 INFO:tasks.workunit.client.1.smithi152.stdout:7/485: dwrite d9/d31/d65/d8a/d41/f50 [0,4194304] 0 2024-09-16T00:50:13.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/605: dwrite d2/db/d39/f59 [0,4194304] 0 2024-09-16T00:50:13.459 INFO:tasks.workunit.client.1.smithi152.stdout:4/606: readlink d2/db/d39/d3c/d7f/l81 0 2024-09-16T00:50:13.460 INFO:tasks.workunit.client.1.smithi152.stdout:9/474: dwrite d1/d4e/d48/f3d [0,4194304] 0 2024-09-16T00:50:13.460 INFO:tasks.workunit.client.0.smithi053.stdout:3/121: dwrite d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:13.461 INFO:tasks.workunit.client.0.smithi053.stdout:8/165: write d10/d21/f30 [1250908,36319] 0 2024-09-16T00:50:13.461 INFO:tasks.workunit.client.0.smithi053.stdout:8/166: creat d10/d21/f38 x:0 0 0 2024-09-16T00:50:13.461 INFO:tasks.workunit.client.0.smithi053.stdout:8/167: fdatasync d10/f19 0 2024-09-16T00:50:13.464 INFO:tasks.workunit.client.1.smithi152.stdout:1/569: creat d9/d3e/d4b/d6b/d6d/fd2 x:0 0 0 2024-09-16T00:50:13.464 INFO:tasks.workunit.client.1.smithi152.stdout:1/570: creat d9/d3e/d4b/fd3 x:0 0 0 2024-09-16T00:50:13.464 INFO:tasks.workunit.client.1.smithi152.stdout:1/571: write d9/d3e/d41/d31/f85 [5206089,59603] 0 2024-09-16T00:50:13.465 INFO:tasks.workunit.client.1.smithi152.stdout:1/572: stat d9/d3e/d4b/d50/l89 0 2024-09-16T00:50:13.469 INFO:tasks.workunit.client.0.smithi053.stdout:8/168: rmdir d10/d1c 39 2024-09-16T00:50:13.471 INFO:tasks.workunit.client.0.smithi053.stdout:3/122: getdents d1/d5 0 2024-09-16T00:50:13.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/637: dwrite d6/d16/d1f/d65/fe4 [0,4194304] 0 2024-09-16T00:50:13.474 INFO:tasks.workunit.client.0.smithi053.stdout:3/123: symlink d1/d5/d11/l24 0 2024-09-16T00:50:13.478 INFO:tasks.workunit.client.0.smithi053.stdout:3/124: creat d1/d5/d11/f25 x:0 0 0 2024-09-16T00:50:13.484 INFO:tasks.workunit.client.0.smithi053.stdout:3/125: link d1/le d1/d5/l26 0 2024-09-16T00:50:13.487 INFO:tasks.workunit.client.0.smithi053.stdout:3/126: dread d1/d5/d14/f18 [0,4194304] 0 2024-09-16T00:50:13.488 INFO:tasks.workunit.client.1.smithi152.stdout:6/472: mkdir db/d12/d1c/d80/d97 0 2024-09-16T00:50:13.491 INFO:tasks.workunit.client.0.smithi053.stdout:8/169: dwrite d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:13.491 INFO:tasks.workunit.client.0.smithi053.stdout:8/170: fdatasync d10/d21/f2c 0 2024-09-16T00:50:13.491 INFO:tasks.workunit.client.0.smithi053.stdout:8/171: truncate d10/f19 2132727 0 2024-09-16T00:50:13.491 INFO:tasks.workunit.client.0.smithi053.stdout:3/127: symlink d1/d5/l27 0 2024-09-16T00:50:13.501 INFO:tasks.workunit.client.1.smithi152.stdout:7/486: rename d9/d31/d65/d8a/d41/d46/f6e to d9/d31/d65/d8a/d41/d46/d7d/fb0 0 2024-09-16T00:50:13.501 INFO:tasks.workunit.client.0.smithi053.stdout:8/172: creat d10/f39 x:0 0 0 2024-09-16T00:50:13.506 INFO:tasks.workunit.client.0.smithi053.stdout:8/173: creat d10/f3a x:0 0 0 2024-09-16T00:50:13.506 INFO:tasks.workunit.client.0.smithi053.stdout:8/174: rename d10 to d10/d21/d3b 22 2024-09-16T00:50:13.508 INFO:tasks.workunit.client.0.smithi053.stdout:3/128: dwrite d1/d5/f10 [0,4194304] 0 2024-09-16T00:50:13.508 INFO:tasks.workunit.client.0.smithi053.stdout:3/129: fdatasync d1/f21 0 2024-09-16T00:50:13.509 INFO:tasks.workunit.client.1.smithi152.stdout:1/573: creat d9/da/da2/fd4 x:0 0 0 2024-09-16T00:50:13.511 INFO:tasks.workunit.client.0.smithi053.stdout:8/175: mkdir d10/d21/d28/d3c 0 2024-09-16T00:50:13.512 INFO:tasks.workunit.client.0.smithi053.stdout:8/176: chown d10/f20 4746 1 2024-09-16T00:50:13.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/638: mknod d6/d16/d1f/d65/d77/cf7 0 2024-09-16T00:50:13.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/639: write d6/d57/d2b/d50/d6e/fbc [729249,77413] 0 2024-09-16T00:50:13.521 INFO:tasks.workunit.client.1.smithi152.stdout:5/640: creat d6/d16/d1f/d8c/ff8 x:0 0 0 2024-09-16T00:50:13.521 INFO:tasks.workunit.client.1.smithi152.stdout:5/641: write d6/d57/d54/f90 [886755,118676] 0 2024-09-16T00:50:13.521 INFO:tasks.workunit.client.1.smithi152.stdout:5/642: truncate d6/d57/d2b/d50/d64/d92/f95 725565 0 2024-09-16T00:50:13.525 INFO:tasks.workunit.client.0.smithi053.stdout:9/107: sync 2024-09-16T00:50:13.529 INFO:tasks.workunit.client.0.smithi053.stdout:9/108: dread d8/f17 [0,4194304] 0 2024-09-16T00:50:13.529 INFO:tasks.workunit.client.1.smithi152.stdout:4/607: rename d2/d1e/d28/d7b/db0/cc4 to d2/db/d39/cc8 0 2024-09-16T00:50:13.531 INFO:tasks.workunit.client.1.smithi152.stdout:5/643: dread d6/d16/d1f/d6c/f88 [0,4194304] 0 2024-09-16T00:50:13.537 INFO:tasks.workunit.client.0.smithi053.stdout:3/130: dwrite d1/d5/d14/f18 [0,4194304] 0 2024-09-16T00:50:13.537 INFO:tasks.workunit.client.0.smithi053.stdout:3/131: write d1/d5/d11/f25 [689592,89139] 0 2024-09-16T00:50:13.537 INFO:tasks.workunit.client.0.smithi053.stdout:8/177: dwrite d10/d1c/f26 [4194304,4194304] 0 2024-09-16T00:50:13.538 INFO:tasks.workunit.client.1.smithi152.stdout:7/487: write d9/d10/f16 [1300391,130321] 0 2024-09-16T00:50:13.539 INFO:tasks.workunit.client.0.smithi053.stdout:9/109: mknod d8/d1c/c24 0 2024-09-16T00:50:13.541 INFO:tasks.workunit.client.1.smithi152.stdout:4/608: write d2/db/d39/d3c/f7c [4168715,94524] 0 2024-09-16T00:50:13.541 INFO:tasks.workunit.client.1.smithi152.stdout:4/609: truncate d2/fbf 908939 0 2024-09-16T00:50:13.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/473: unlink db/d12/d20/f21 0 2024-09-16T00:50:13.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/474: write db/f45 [5320141,24191] 0 2024-09-16T00:50:13.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/475: read - db/d12/d23/f8e zero size 2024-09-16T00:50:13.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/476: stat db/d12/d23/d3a/l7b 0 2024-09-16T00:50:13.544 INFO:tasks.workunit.client.1.smithi152.stdout:6/477: fsync db/d12/d20/d86/f8b 0 2024-09-16T00:50:13.547 INFO:tasks.workunit.client.1.smithi152.stdout:9/475: rename d1/c3a to d1/d7/d13/d5d/d69/c98 0 2024-09-16T00:50:13.549 INFO:tasks.workunit.client.0.smithi053.stdout:3/132: mkdir d1/d5/d14/d28 0 2024-09-16T00:50:13.549 INFO:tasks.workunit.client.0.smithi053.stdout:3/133: write d1/d5/d16/f1f [821024,80029] 0 2024-09-16T00:50:13.550 INFO:tasks.workunit.client.1.smithi152.stdout:7/488: mknod d9/d31/d65/d4b/cb1 0 2024-09-16T00:50:13.550 INFO:tasks.workunit.client.1.smithi152.stdout:4/610: dread d2/d1e/d28/d69/f49 [0,4194304] 0 2024-09-16T00:50:13.550 INFO:tasks.workunit.client.1.smithi152.stdout:7/489: stat d9/d31/d65/d8a/d41 0 2024-09-16T00:50:13.553 INFO:tasks.workunit.client.1.smithi152.stdout:7/490: dread d9/d10/f12 [0,4194304] 0 2024-09-16T00:50:13.554 INFO:tasks.workunit.client.0.smithi053.stdout:8/178: link d10/d1c/f23 d10/d21/d28/d3c/f3d 0 2024-09-16T00:50:13.554 INFO:tasks.workunit.client.1.smithi152.stdout:4/611: dread d2/db/d44/f68 [0,4194304] 0 2024-09-16T00:50:13.555 INFO:tasks.workunit.client.1.smithi152.stdout:5/644: dwrite d6/f7c [0,4194304] 0 2024-09-16T00:50:13.555 INFO:tasks.workunit.client.1.smithi152.stdout:7/491: dread d9/d31/f5f [0,4194304] 0 2024-09-16T00:50:13.555 INFO:tasks.workunit.client.1.smithi152.stdout:7/492: write d9/d31/d65/d6b/f77 [905971,18949] 0 2024-09-16T00:50:13.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/110: symlink d8/d19/l25 0 2024-09-16T00:50:13.558 INFO:tasks.workunit.client.0.smithi053.stdout:9/111: stat d8/ca 0 2024-09-16T00:50:13.560 INFO:tasks.workunit.client.1.smithi152.stdout:9/476: link d1/d4e/f7e d1/d7/f99 0 2024-09-16T00:50:13.562 INFO:tasks.workunit.client.0.smithi053.stdout:3/134: symlink d1/d5/d14/d28/l29 0 2024-09-16T00:50:13.563 INFO:tasks.workunit.client.0.smithi053.stdout:3/135: read - d1/d5/f22 zero size 2024-09-16T00:50:13.563 INFO:tasks.workunit.client.0.smithi053.stdout:3/136: creat d1/d5/d14/f2a x:0 0 0 2024-09-16T00:50:13.563 INFO:tasks.workunit.client.0.smithi053.stdout:3/137: creat d1/d5/d16/f2b x:0 0 0 2024-09-16T00:50:13.563 INFO:tasks.workunit.client.1.smithi152.stdout:0/487: sync 2024-09-16T00:50:13.563 INFO:tasks.workunit.client.1.smithi152.stdout:2/455: sync 2024-09-16T00:50:13.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/138: read d1/d5/f6 [1393654,79754] 0 2024-09-16T00:50:13.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/139: readlink d1/l17 0 2024-09-16T00:50:13.568 INFO:tasks.workunit.client.0.smithi053.stdout:3/140: dread d1/d5/f6 [0,4194304] 0 2024-09-16T00:50:13.570 INFO:tasks.workunit.client.1.smithi152.stdout:5/645: creat d6/d57/d2b/d50/d64/df5/ff9 x:0 0 0 2024-09-16T00:50:13.570 INFO:tasks.workunit.client.1.smithi152.stdout:5/646: creat d6/d57/d2b/d50/d6e/ffa x:0 0 0 2024-09-16T00:50:13.573 INFO:tasks.workunit.client.0.smithi053.stdout:9/112: mkdir d8/d22/d26 0 2024-09-16T00:50:13.573 INFO:tasks.workunit.client.0.smithi053.stdout:9/113: chown f2 8351 1 2024-09-16T00:50:13.575 INFO:tasks.workunit.client.1.smithi152.stdout:1/574: rename d9/d3e/d4b/f5f to d9/da/df/fd5 0 2024-09-16T00:50:13.579 INFO:tasks.workunit.client.1.smithi152.stdout:4/612: dwrite d2/db/d44/f94 [0,4194304] 0 2024-09-16T00:50:13.581 INFO:tasks.workunit.client.0.smithi053.stdout:8/179: link d10/d1c/f23 d10/d21/f3e 0 2024-09-16T00:50:13.581 INFO:tasks.workunit.client.1.smithi152.stdout:2/456: dwrite d4/d19/d20/d28/d2c/f79 [0,4194304] 0 2024-09-16T00:50:13.585 INFO:tasks.workunit.client.0.smithi053.stdout:3/141: mknod d1/c2c 0 2024-09-16T00:50:13.585 INFO:tasks.workunit.client.0.smithi053.stdout:8/180: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:13.588 INFO:tasks.workunit.client.0.smithi053.stdout:9/114: link d8/f11 d8/f27 0 2024-09-16T00:50:13.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/457: dread d4/d19/d20/d28/f2a [0,4194304] 0 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:9/477: symlink d1/d4e/d48/d26/d92/l9a 0 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/337: sync 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:3/462: sync 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/338: chown dd/d15/d69 773 1 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/339: getdents dd/d15/d1a 0 2024-09-16T00:50:13.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/340: write dd/d15/f52 [327481,75736] 0 2024-09-16T00:50:13.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/488: unlink d3/d6/d8/d1d/d23/d25/d2a/f50 0 2024-09-16T00:50:13.602 INFO:tasks.workunit.client.1.smithi152.stdout:0/489: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/fa9 x:0 0 0 2024-09-16T00:50:13.605 INFO:tasks.workunit.client.0.smithi053.stdout:8/181: rmdir d10/d1c 39 2024-09-16T00:50:13.605 INFO:tasks.workunit.client.0.smithi053.stdout:8/182: read - d10/d21/d28/f31 zero size 2024-09-16T00:50:13.607 INFO:tasks.workunit.client.1.smithi152.stdout:5/647: creat d6/d16/d1f/d8c/db8/dbf/ded/ffb x:0 0 0 2024-09-16T00:50:13.607 INFO:tasks.workunit.client.1.smithi152.stdout:5/648: write d6/d57/d2b/d50/d66/fd6 [861589,1927] 0 2024-09-16T00:50:13.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/478: rename db/d12/d20/d86/d91/l96 to db/d12/d23/d4a/d43/d48/d64/l98 0 2024-09-16T00:50:13.612 INFO:tasks.workunit.client.0.smithi053.stdout:9/115: symlink d8/d13/l28 0 2024-09-16T00:50:13.613 INFO:tasks.workunit.client.1.smithi152.stdout:6/479: dread db/d12/d23/f81 [0,4194304] 0 2024-09-16T00:50:13.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/575: mknod d9/d3e/d41/d31/d48/d7d/cd6 0 2024-09-16T00:50:13.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/576: dread - d9/d3e/d41/d31/d38/fb5 zero size 2024-09-16T00:50:13.615 INFO:tasks.workunit.client.0.smithi053.stdout:9/116: write d8/d1c/f1b [589936,79758] 0 2024-09-16T00:50:13.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/613: mkdir d2/d8e/dc9 0 2024-09-16T00:50:13.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/614: write d2/d1e/d28/fc0 [893726,15824] 0 2024-09-16T00:50:13.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/615: chown d2/db/d39/d3c/d76/db8/f6a 1023 1 2024-09-16T00:50:13.622 INFO:tasks.workunit.client.0.smithi053.stdout:8/183: creat d10/f3f x:0 0 0 2024-09-16T00:50:13.622 INFO:tasks.workunit.client.0.smithi053.stdout:8/184: truncate d10/f39 935474 0 2024-09-16T00:50:13.622 INFO:tasks.workunit.client.0.smithi053.stdout:8/185: write d10/d21/d28/f31 [281919,99686] 0 2024-09-16T00:50:13.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/649: dwrite d6/f2d [0,4194304] 0 2024-09-16T00:50:13.628 INFO:tasks.workunit.client.0.smithi053.stdout:8/186: mkdir d10/d1c/d2b/d40 0 2024-09-16T00:50:13.629 INFO:tasks.workunit.client.1.smithi152.stdout:9/478: mkdir d1/d4e/d48/d26/d30/d4f/d50/d83/d9b 0 2024-09-16T00:50:13.629 INFO:tasks.workunit.client.1.smithi152.stdout:9/479: write d1/d4e/d48/d2b/f70 [4837304,35058] 0 2024-09-16T00:50:13.634 INFO:tasks.workunit.client.0.smithi053.stdout:8/187: rename d10/d21/c27 to d10/d21/d28/c41 0 2024-09-16T00:50:13.634 INFO:tasks.workunit.client.0.smithi053.stdout:8/188: creat d10/d21/f42 x:0 0 0 2024-09-16T00:50:13.634 INFO:tasks.workunit.client.0.smithi053.stdout:8/189: truncate d10/f39 1490474 0 2024-09-16T00:50:13.635 INFO:tasks.workunit.client.0.smithi053.stdout:3/142: getdents d1 0 2024-09-16T00:50:13.638 INFO:tasks.workunit.client.1.smithi152.stdout:0/490: mknod d3/d6/d2e/caa 0 2024-09-16T00:50:13.638 INFO:tasks.workunit.client.1.smithi152.stdout:0/491: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fa0 [967006,120914] 0 2024-09-16T00:50:13.640 INFO:tasks.workunit.client.0.smithi053.stdout:8/190: unlink d10/f15 0 2024-09-16T00:50:13.640 INFO:tasks.workunit.client.0.smithi053.stdout:8/191: chown d10/d21/d28/d3c/f3d 3137 1 2024-09-16T00:50:13.640 INFO:tasks.workunit.client.0.smithi053.stdout:8/192: chown d10/d21/d28/l2e 67 1 2024-09-16T00:50:13.644 INFO:tasks.workunit.client.0.smithi053.stdout:3/143: link d1/d5/d16/f1f d1/d5/d14/f2d 0 2024-09-16T00:50:13.646 INFO:tasks.workunit.client.1.smithi152.stdout:1/577: creat d9/d3e/d41/d31/d48/fd7 x:0 0 0 2024-09-16T00:50:13.646 INFO:tasks.workunit.client.1.smithi152.stdout:1/578: chown d9/d3e/d41/d31/d48/fc2 12982 1 2024-09-16T00:50:13.648 INFO:tasks.workunit.client.0.smithi053.stdout:8/193: mknod d10/d1c/c43 0 2024-09-16T00:50:13.648 INFO:tasks.workunit.client.0.smithi053.stdout:8/194: write d10/d21/f33 [821679,60320] 0 2024-09-16T00:50:13.650 INFO:tasks.workunit.client.1.smithi152.stdout:4/616: symlink d2/db/d39/d3c/d7f/d98/lca 0 2024-09-16T00:50:13.650 INFO:tasks.workunit.client.1.smithi152.stdout:4/617: readlink d2/d1e/d28/l51 0 2024-09-16T00:50:13.650 INFO:tasks.workunit.client.1.smithi152.stdout:4/618: write d2/d1e/d28/d69/f49 [214880,14773] 0 2024-09-16T00:50:13.650 INFO:tasks.workunit.client.1.smithi152.stdout:6/480: write db/fe [336270,73644] 0 2024-09-16T00:50:13.650 INFO:tasks.workunit.client.1.smithi152.stdout:6/481: chown db/d12/d23/d4a/d43/f57 451537 1 2024-09-16T00:50:13.651 INFO:tasks.workunit.client.0.smithi053.stdout:3/144: rename d1/d5/l26 to d1/d5/l2e 0 2024-09-16T00:50:13.652 INFO:tasks.workunit.client.0.smithi053.stdout:1/80: sync 2024-09-16T00:50:13.655 INFO:tasks.workunit.client.1.smithi152.stdout:2/458: rename d4/d44/d7a/d86 to d4/d44/d7a/d9e 0 2024-09-16T00:50:13.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/145: creat d1/d5/f2f x:0 0 0 2024-09-16T00:50:13.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/146: write d1/d5/d16/f1f [1086877,55862] 0 2024-09-16T00:50:13.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/147: read - d1/d5/f2f zero size 2024-09-16T00:50:13.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/148: creat d1/d5/d14/f30 x:0 0 0 2024-09-16T00:50:13.662 INFO:tasks.workunit.client.0.smithi053.stdout:1/81: dread d5/dd/f11 [0,4194304] 0 2024-09-16T00:50:13.662 INFO:tasks.workunit.client.0.smithi053.stdout:1/82: write d5/f14 [603619,27871] 0 2024-09-16T00:50:13.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/480: truncate d1/d7/d13/f2c 751173 0 2024-09-16T00:50:13.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/481: write d1/d4e/f7e [148717,88542] 0 2024-09-16T00:50:13.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/463: rmdir dc/d10/d17/d1c/d8d/d8e/d3b 39 2024-09-16T00:50:13.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/464: readlink l9 0 2024-09-16T00:50:13.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/465: fsync dc/d10/d17/f80 0 2024-09-16T00:50:13.669 INFO:tasks.workunit.client.0.smithi053.stdout:1/83: truncate d5/d7/d10/f12 190190 0 2024-09-16T00:50:13.670 INFO:tasks.workunit.client.0.smithi053.stdout:1/84: write d5/f14 [410783,99669] 0 2024-09-16T00:50:13.670 INFO:tasks.workunit.client.0.smithi053.stdout:1/85: chown d5/f14 486783 1 2024-09-16T00:50:13.672 INFO:tasks.workunit.client.1.smithi152.stdout:3/466: dread dc/d10/d17/d1c/d1f/f49 [0,4194304] 0 2024-09-16T00:50:13.673 INFO:tasks.workunit.client.1.smithi152.stdout:8/341: link dd/d15/d1a/f45 dd/f72 0 2024-09-16T00:50:13.673 INFO:tasks.workunit.client.0.smithi053.stdout:8/195: dwrite d10/f20 [0,4194304] 0 2024-09-16T00:50:13.675 INFO:tasks.workunit.client.1.smithi152.stdout:6/482: dwrite db/d12/d23/d4a/d43/d48/f5d [0,4194304] 0 2024-09-16T00:50:13.675 INFO:tasks.workunit.client.1.smithi152.stdout:6/483: write db/d12/d20/f36 [2224933,70547] 0 2024-09-16T00:50:13.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/492: link d3/d6/d51/l87 d3/d6/d64/d6a/d61/lab 0 2024-09-16T00:50:13.677 INFO:tasks.workunit.client.1.smithi152.stdout:1/579: mknod d9/d3e/d41/d31/d38/cd8 0 2024-09-16T00:50:13.678 INFO:tasks.workunit.client.0.smithi053.stdout:8/196: readlink d10/l1a 0 2024-09-16T00:50:13.678 INFO:tasks.workunit.client.0.smithi053.stdout:8/197: creat d10/d21/f44 x:0 0 0 2024-09-16T00:50:13.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/619: creat d2/db/d39/d3c/dc5/fcb x:0 0 0 2024-09-16T00:50:13.680 INFO:tasks.workunit.client.0.smithi053.stdout:3/149: dwrite d1/f21 [0,4194304] 0 2024-09-16T00:50:13.682 INFO:tasks.workunit.client.1.smithi152.stdout:2/459: truncate d4/d44/f4e 3524505 0 2024-09-16T00:50:13.685 INFO:tasks.workunit.client.1.smithi152.stdout:9/482: link d1/d4e/d48/c3e d1/c9c 0 2024-09-16T00:50:13.688 INFO:tasks.workunit.client.1.smithi152.stdout:2/460: dread f2 [0,4194304] 0 2024-09-16T00:50:13.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/467: rename dc/c12 to dc/d10/d17/d1c/d8d/d8e/d2f/c93 0 2024-09-16T00:50:13.689 INFO:tasks.workunit.client.1.smithi152.stdout:3/468: creat dc/d10/d17/d1c/d8d/d8e/f94 x:0 0 0 2024-09-16T00:50:13.689 INFO:tasks.workunit.client.1.smithi152.stdout:3/469: chown dc/d10/d17/d1c/d8d/d8e 262 1 2024-09-16T00:50:13.690 INFO:tasks.workunit.client.0.smithi053.stdout:3/150: mkdir d1/d5/d31 0 2024-09-16T00:50:13.691 INFO:tasks.workunit.client.0.smithi053.stdout:3/151: fdatasync d1/d5/f2f 0 2024-09-16T00:50:13.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/342: unlink dd/d15/c2d 0 2024-09-16T00:50:13.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/343: read - dd/d25/f5d zero size 2024-09-16T00:50:13.694 INFO:tasks.workunit.client.0.smithi053.stdout:8/198: truncate d10/f14 227792 0 2024-09-16T00:50:13.697 INFO:tasks.workunit.client.0.smithi053.stdout:3/152: symlink d1/d5/d14/l32 0 2024-09-16T00:50:13.697 INFO:tasks.workunit.client.0.smithi053.stdout:3/153: write d1/d5/f19 [1256797,44826] 0 2024-09-16T00:50:13.698 INFO:tasks.workunit.client.0.smithi053.stdout:3/154: write d1/d5/d14/f2d [631746,7475] 0 2024-09-16T00:50:13.699 INFO:tasks.workunit.client.0.smithi053.stdout:8/199: creat d10/d21/d28/d3c/f45 x:0 0 0 2024-09-16T00:50:13.705 INFO:tasks.workunit.client.0.smithi053.stdout:3/155: rename d1/d5/d14/d28/l29 to d1/d5/l33 0 2024-09-16T00:50:13.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/200: mknod d10/d1c/d2b/c46 0 2024-09-16T00:50:13.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/201: fsync d10/d21/f42 0 2024-09-16T00:50:13.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/202: write d10/d21/d28/f31 [341200,121844] 0 2024-09-16T00:50:13.707 INFO:tasks.workunit.client.0.smithi053.stdout:3/156: link d1/c2c d1/d5/d16/c34 0 2024-09-16T00:50:13.709 INFO:tasks.workunit.client.0.smithi053.stdout:1/86: write d5/d7/d10/f12 [207776,96247] 0 2024-09-16T00:50:13.709 INFO:tasks.workunit.client.0.smithi053.stdout:1/87: creat d5/d9/f17 x:0 0 0 2024-09-16T00:50:13.711 INFO:tasks.workunit.client.0.smithi053.stdout:8/203: mknod d10/d21/d28/c47 0 2024-09-16T00:50:13.711 INFO:tasks.workunit.client.0.smithi053.stdout:8/204: chown d10/d1c/l1f 265540058 1 2024-09-16T00:50:13.713 INFO:tasks.workunit.client.1.smithi152.stdout:8/344: dwrite dd/d15/f20 [0,4194304] 0 2024-09-16T00:50:13.714 INFO:tasks.workunit.client.1.smithi152.stdout:8/345: creat dd/d50/d29/d2f/d53/f73 x:0 0 0 2024-09-16T00:50:13.715 INFO:tasks.workunit.client.1.smithi152.stdout:6/484: creat db/d12/d1c/d80/d97/f99 x:0 0 0 2024-09-16T00:50:13.716 INFO:tasks.workunit.client.0.smithi053.stdout:3/157: creat d1/d5/d14/d28/f35 x:0 0 0 2024-09-16T00:50:13.723 INFO:tasks.workunit.client.1.smithi152.stdout:0/493: rmdir d3/d6/d8/d1d/d23/d25/d45/d9d 39 2024-09-16T00:50:13.723 INFO:tasks.workunit.client.1.smithi152.stdout:0/494: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fac x:0 0 0 2024-09-16T00:50:13.725 INFO:tasks.workunit.client.0.smithi053.stdout:1/88: mkdir d5/d18 0 2024-09-16T00:50:13.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/580: mkdir d9/d3e/d41/d31/d48/dd9 0 2024-09-16T00:50:13.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/581: readlink d9/d3e/d41/d31/d48/d7d/lcc 0 2024-09-16T00:50:13.728 INFO:tasks.workunit.client.0.smithi053.stdout:8/205: rename d10/l37 to d10/d21/l48 0 2024-09-16T00:50:13.732 INFO:tasks.workunit.client.1.smithi152.stdout:4/620: creat d2/d1e/d28/db7/fcc x:0 0 0 2024-09-16T00:50:13.738 INFO:tasks.workunit.client.1.smithi152.stdout:9/483: mknod d1/d4e/d48/d66/c9d 0 2024-09-16T00:50:13.738 INFO:tasks.workunit.client.1.smithi152.stdout:2/461: mknod d4/d19/d94/c9f 0 2024-09-16T00:50:13.738 INFO:tasks.workunit.client.1.smithi152.stdout:2/462: chown d4/d17/l8c 407626 1 2024-09-16T00:50:13.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/485: dwrite db/fc [0,4194304] 0 2024-09-16T00:50:13.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/486: write f2 [3808250,129138] 0 2024-09-16T00:50:13.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/470: link dc/d10/l51 dc/d10/d17/l95 0 2024-09-16T00:50:13.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/346: dwrite dd/d15/d49/f3c [0,4194304] 0 2024-09-16T00:50:13.753 INFO:tasks.workunit.client.1.smithi152.stdout:7/493: sync 2024-09-16T00:50:13.754 INFO:tasks.workunit.client.1.smithi152.stdout:7/494: fsync d9/d31/d64/d3c/f42 0 2024-09-16T00:50:13.755 INFO:tasks.workunit.client.0.smithi053.stdout:3/158: rename d1/d5/cf to d1/d5/d11/c36 0 2024-09-16T00:50:13.755 INFO:tasks.workunit.client.0.smithi053.stdout:3/159: write d1/d5/f22 [987889,121757] 0 2024-09-16T00:50:13.758 INFO:tasks.workunit.client.1.smithi152.stdout:0/495: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad x:0 0 0 2024-09-16T00:50:13.759 INFO:tasks.workunit.client.1.smithi152.stdout:1/582: rmdir d9/d3e/d4b/d6b/d6d/d82 39 2024-09-16T00:50:13.761 INFO:tasks.workunit.client.0.smithi053.stdout:3/160: symlink d1/d5/d11/l37 0 2024-09-16T00:50:13.763 INFO:tasks.workunit.client.1.smithi152.stdout:9/484: symlink d1/d4e/d48/d66/d76/l9e 0 2024-09-16T00:50:13.763 INFO:tasks.workunit.client.1.smithi152.stdout:5/650: sync 2024-09-16T00:50:13.765 INFO:tasks.workunit.client.0.smithi053.stdout:1/89: dwrite d5/dd/f11 [0,4194304] 0 2024-09-16T00:50:13.765 INFO:tasks.workunit.client.0.smithi053.stdout:8/206: dwrite d10/d21/d28/d3c/f3d [0,4194304] 0 2024-09-16T00:50:13.765 INFO:tasks.workunit.client.1.smithi152.stdout:2/463: mkdir d4/d44/d7a/d9e/da0 0 2024-09-16T00:50:13.765 INFO:tasks.workunit.client.1.smithi152.stdout:4/621: dwrite d2/db/d39/d3c/d76/db8/f24 [4194304,4194304] 0 2024-09-16T00:50:13.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/471: dwrite dc/d10/d17/d1c/d8d/d8e/f94 [0,4194304] 0 2024-09-16T00:50:13.766 INFO:tasks.workunit.client.0.smithi053.stdout:3/161: creat d1/d5/d31/f38 x:0 0 0 2024-09-16T00:50:13.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/496: read d3/d6/d8/d1d/d23/f62 [692222,99898] 0 2024-09-16T00:50:13.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/497: dread d3/d6/d8/d1d/d23/f62 [0,4194304] 0 2024-09-16T00:50:13.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/498: chown d3/d6/d64 146158 1 2024-09-16T00:50:13.773 INFO:tasks.workunit.client.1.smithi152.stdout:7/495: dwrite d9/f5c [0,4194304] 0 2024-09-16T00:50:13.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/90: mkdir d5/dd/d19 0 2024-09-16T00:50:13.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/487: rename db/c66 to db/d12/d20/d4b/c9a 0 2024-09-16T00:50:13.777 INFO:tasks.workunit.client.0.smithi053.stdout:8/207: mkdir d10/d1c/d49 0 2024-09-16T00:50:13.781 INFO:tasks.workunit.client.0.smithi053.stdout:1/91: unlink d5/d9/ff 0 2024-09-16T00:50:13.781 INFO:tasks.workunit.client.1.smithi152.stdout:8/347: mknod dd/d50/d29/d2f/c74 0 2024-09-16T00:50:13.782 INFO:tasks.workunit.client.1.smithi152.stdout:1/583: truncate d9/d3e/d41/f2f 2449092 0 2024-09-16T00:50:13.782 INFO:tasks.workunit.client.0.smithi053.stdout:8/208: unlink d10/d21/f44 0 2024-09-16T00:50:13.785 INFO:tasks.workunit.client.0.smithi053.stdout:1/92: getdents d5/d7/d10 0 2024-09-16T00:50:13.785 INFO:tasks.workunit.client.0.smithi053.stdout:1/93: fsync d5/d7/d10/f15 0 2024-09-16T00:50:13.785 INFO:tasks.workunit.client.0.smithi053.stdout:1/94: creat d5/dd/f1a x:0 0 0 2024-09-16T00:50:13.786 INFO:tasks.workunit.client.0.smithi053.stdout:1/95: chown d5/d7/d10/f15 644838946 1 2024-09-16T00:50:13.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/485: truncate d1/d4e/d34/f62 1026378 0 2024-09-16T00:50:13.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/651: dread d6/f7c [0,4194304] 0 2024-09-16T00:50:13.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/652: write d6/d57/f3c [879699,75553] 0 2024-09-16T00:50:13.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/653: readlink d6/l59 0 2024-09-16T00:50:13.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/654: fdatasync d6/d57/d2b/f4e 0 2024-09-16T00:50:13.788 INFO:tasks.workunit.client.1.smithi152.stdout:7/496: dread f3 [0,4194304] 0 2024-09-16T00:50:13.788 INFO:tasks.workunit.client.1.smithi152.stdout:7/497: fsync f4 0 2024-09-16T00:50:13.788 INFO:tasks.workunit.client.1.smithi152.stdout:2/464: mknod d4/d44/d7a/d9e/d87/d9c/ca1 0 2024-09-16T00:50:13.792 INFO:tasks.workunit.client.1.smithi152.stdout:2/465: dread d4/d19/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:13.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/622: mknod d2/d1e/d28/d7b/ccd 0 2024-09-16T00:50:13.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/623: stat d2/db/d39/d95/f96 0 2024-09-16T00:50:13.793 INFO:tasks.workunit.client.0.smithi053.stdout:3/162: dwrite d1/d5/d16/f1f [0,4194304] 0 2024-09-16T00:50:13.794 INFO:tasks.workunit.client.0.smithi053.stdout:1/96: creat d5/d18/f1b x:0 0 0 2024-09-16T00:50:13.794 INFO:tasks.workunit.client.0.smithi053.stdout:1/97: dread - d5/d9/f17 zero size 2024-09-16T00:50:13.797 INFO:tasks.workunit.client.0.smithi053.stdout:8/209: mkdir d10/d4a 0 2024-09-16T00:50:13.804 INFO:tasks.workunit.client.1.smithi152.stdout:3/472: creat dc/d10/d17/d1c/d50/d55/f96 x:0 0 0 2024-09-16T00:50:13.804 INFO:tasks.workunit.client.1.smithi152.stdout:3/473: readlink dc/d10/d17/d1c/l43 0 2024-09-16T00:50:13.804 INFO:tasks.workunit.client.1.smithi152.stdout:3/474: write dc/f1a [879104,20126] 0 2024-09-16T00:50:13.808 INFO:tasks.workunit.client.1.smithi152.stdout:8/348: dwrite dd/d50/d29/d2f/f31 [0,4194304] 0 2024-09-16T00:50:13.811 INFO:tasks.workunit.client.1.smithi152.stdout:0/499: rename d3/d6/d8/f27 to d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae 0 2024-09-16T00:50:13.812 INFO:tasks.workunit.client.1.smithi152.stdout:0/500: readlink d3/d6/d8/d1d/d23/d4b/d54/l69 0 2024-09-16T00:50:13.812 INFO:tasks.workunit.client.1.smithi152.stdout:0/501: chown d3/d6/d2e/l39 1916381 1 2024-09-16T00:50:13.814 INFO:tasks.workunit.client.1.smithi152.stdout:6/488: link db/d12/c50 db/d12/d23/d4a/d33/c9b 0 2024-09-16T00:50:13.814 INFO:tasks.workunit.client.1.smithi152.stdout:6/489: readlink db/d12/d20/d4b/l90 0 2024-09-16T00:50:13.818 INFO:tasks.workunit.client.0.smithi053.stdout:3/163: dwrite d1/d5/d14/f18 [0,4194304] 0 2024-09-16T00:50:13.818 INFO:tasks.workunit.client.1.smithi152.stdout:1/584: link d9/da/df/f42 d9/d3e/d41/d31/d48/db2/fda 0 2024-09-16T00:50:13.819 INFO:tasks.workunit.client.1.smithi152.stdout:1/585: fsync d9/d3e/d4b/db7/fc0 0 2024-09-16T00:50:13.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:13 smithi053 ceph-mon[27950]: pgmap v7: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 122 MiB/s rd, 155 MiB/s wr, 274 op/s 2024-09-16T00:50:13.819 INFO:tasks.workunit.client.0.smithi053.stdout:8/210: dwrite d10/f24 [0,4194304] 0 2024-09-16T00:50:13.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/486: unlink d1/d4e/d48/l29 0 2024-09-16T00:50:13.826 INFO:tasks.workunit.client.0.smithi053.stdout:1/98: symlink d5/d7/d10/l1c 0 2024-09-16T00:50:13.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/655: stat d6/d16/d1f/d65/l86 0 2024-09-16T00:50:13.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/656: creat d6/d57/d2b/d50/d64/df5/ffc x:0 0 0 2024-09-16T00:50:13.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/657: creat d6/d57/d2b/d50/d6e/ffd x:0 0 0 2024-09-16T00:50:13.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/498: creat d9/d31/d65/d8a/d41/d46/d7d/fb2 x:0 0 0 2024-09-16T00:50:13.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/499: chown d9/d31/d64/d3c/c91 98251411 1 2024-09-16T00:50:13.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/500: truncate d9/d31/d65/f59 1458814 0 2024-09-16T00:50:13.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/466: symlink d4/d44/la2 0 2024-09-16T00:50:13.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/467: write d4/f5e [4327489,79625] 0 2024-09-16T00:50:13.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/468: dread - d4/d19/d94/d8f/f91 zero size 2024-09-16T00:50:13.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/469: chown d4/d19/d20/d9d 5568854 1 2024-09-16T00:50:13.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/470: truncate d4/d19/f5b 4352478 0 2024-09-16T00:50:13.838 INFO:tasks.workunit.client.1.smithi152.stdout:3/475: symlink dc/d10/d17/d1c/d1f/l97 0 2024-09-16T00:50:13.838 INFO:tasks.workunit.client.1.smithi152.stdout:3/476: chown dc/d10/d17/c4b 2416 1 2024-09-16T00:50:13.838 INFO:tasks.workunit.client.1.smithi152.stdout:3/477: stat dc/d10/d17/d1c/c44 0 2024-09-16T00:50:13.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/502: symlink d3/d6/d8/d1d/d23/d25/laf 0 2024-09-16T00:50:13.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/503: stat d3/d6/d8/d1d/d65/d6e 0 2024-09-16T00:50:13.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/504: readlink d3/d6/d8/d1d/d23/d25/d45/d9d/la6 0 2024-09-16T00:50:13.842 INFO:tasks.workunit.client.0.smithi053.stdout:1/99: link d5/dd/f16 d5/d9/f1d 0 2024-09-16T00:50:13.843 INFO:tasks.workunit.client.0.smithi053.stdout:1/100: write d5/dd/f16 [4728991,643] 0 2024-09-16T00:50:13.843 INFO:tasks.workunit.client.1.smithi152.stdout:6/490: dwrite db/d12/d23/d4a/f95 [0,4194304] 0 2024-09-16T00:50:13.844 INFO:tasks.workunit.client.0.smithi053.stdout:6/38: sync 2024-09-16T00:50:13.844 INFO:tasks.workunit.client.0.smithi053.stdout:7/103: sync 2024-09-16T00:50:13.844 INFO:tasks.workunit.client.0.smithi053.stdout:4/56: sync 2024-09-16T00:50:13.844 INFO:tasks.workunit.client.0.smithi053.stdout:4/57: dread - d0/da/fe zero size 2024-09-16T00:50:13.845 INFO:tasks.workunit.client.1.smithi152.stdout:9/487: rename d1/le to d1/l9f 0 2024-09-16T00:50:13.847 INFO:tasks.workunit.client.0.smithi053.stdout:6/39: link d1/f2 d1/fd 0 2024-09-16T00:50:13.847 INFO:tasks.workunit.client.0.smithi053.stdout:6/40: readlink l0 0 2024-09-16T00:50:13.850 INFO:tasks.workunit.client.0.smithi053.stdout:7/104: mknod d1/d3/c21 0 2024-09-16T00:50:13.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/658: truncate d6/d16/f36 148269 0 2024-09-16T00:50:13.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/659: write d6/d16/f27 [4548406,99243] 0 2024-09-16T00:50:13.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/660: stat d6/d57/d2b/f2f 0 2024-09-16T00:50:13.853 INFO:tasks.workunit.client.0.smithi053.stdout:3/164: dwrite d1/d5/f6 [0,4194304] 0 2024-09-16T00:50:13.853 INFO:tasks.workunit.client.0.smithi053.stdout:4/58: rename d0/d2/c9 to d0/cf 0 2024-09-16T00:50:13.855 INFO:tasks.workunit.client.1.smithi152.stdout:7/501: mknod d9/d31/d64/cb3 0 2024-09-16T00:50:13.856 INFO:tasks.workunit.client.1.smithi152.stdout:6/491: dread db/d12/d23/d4a/d43/f57 [4194304,4194304] 0 2024-09-16T00:50:13.856 INFO:tasks.workunit.client.1.smithi152.stdout:6/492: chown db/d12/d23/d4a/d43 609486 1 2024-09-16T00:50:13.856 INFO:tasks.workunit.client.1.smithi152.stdout:6/493: readlink db/d12/l17 0 2024-09-16T00:50:13.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/349: dwrite dd/d50/d29/f58 [0,4194304] 0 2024-09-16T00:50:13.857 INFO:tasks.workunit.client.0.smithi053.stdout:6/41: symlink d1/le 0 2024-09-16T00:50:13.857 INFO:tasks.workunit.client.0.smithi053.stdout:6/42: chown d1/lb 19130 1 2024-09-16T00:50:13.859 INFO:tasks.workunit.client.1.smithi152.stdout:4/624: mkdir d2/db/dce 0 2024-09-16T00:50:13.860 INFO:tasks.workunit.client.0.smithi053.stdout:1/101: write d5/d9/f1d [803159,60013] 0 2024-09-16T00:50:13.862 INFO:tasks.workunit.client.0.smithi053.stdout:7/105: symlink d1/d3/d10/l22 0 2024-09-16T00:50:13.864 INFO:tasks.workunit.client.0.smithi053.stdout:1/102: dread d5/d7/d10/f15 [0,4194304] 0 2024-09-16T00:50:13.866 INFO:tasks.workunit.client.1.smithi152.stdout:3/478: link dc/f15 dc/d10/d17/d1c/d8d/d8e/d2f/d46/d77/f98 0 2024-09-16T00:50:13.866 INFO:tasks.workunit.client.1.smithi152.stdout:3/479: chown dc/d10/f31 242309667 1 2024-09-16T00:50:13.867 INFO:tasks.workunit.client.0.smithi053.stdout:3/165: dwrite d1/d5/f6 [4194304,4194304] 0 2024-09-16T00:50:13.867 INFO:tasks.workunit.client.0.smithi053.stdout:3/166: dread - d1/d5/d16/f2b zero size 2024-09-16T00:50:13.867 INFO:tasks.workunit.client.0.smithi053.stdout:3/167: write d1/d5/d14/d28/f35 [1040055,21146] 0 2024-09-16T00:50:13.867 INFO:tasks.workunit.client.0.smithi053.stdout:3/168: creat d1/d5/d31/f39 x:0 0 0 2024-09-16T00:50:13.868 INFO:tasks.workunit.client.0.smithi053.stdout:4/59: rmdir d0 39 2024-09-16T00:50:13.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/505: rmdir d3/d6/d8/d1d/d65/d6e/d82/da4 39 2024-09-16T00:50:13.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/506: dread - d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 zero size 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/507: chown d3/d6/d8/d9e 49 1 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:2/25: sync 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:9/117: sync 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:5/60: sync 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:0/64: sync 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:9/118: fdatasync d8/d1c/f1b 0 2024-09-16T00:50:13.871 INFO:tasks.workunit.client.0.smithi053.stdout:9/119: creat d8/d13/f29 x:0 0 0 2024-09-16T00:50:13.875 INFO:tasks.workunit.client.0.smithi053.stdout:7/106: creat d1/d3/d10/d14/f23 x:0 0 0 2024-09-16T00:50:13.875 INFO:tasks.workunit.client.0.smithi053.stdout:7/107: dread - d1/d3/f1f zero size 2024-09-16T00:50:13.876 INFO:tasks.workunit.client.0.smithi053.stdout:3/169: write d1/d5/d11/f12 [3693743,59428] 0 2024-09-16T00:50:13.877 INFO:tasks.workunit.client.0.smithi053.stdout:1/103: symlink d5/d18/l1e 0 2024-09-16T00:50:13.877 INFO:tasks.workunit.client.0.smithi053.stdout:1/104: dread - d5/d18/f1b zero size 2024-09-16T00:50:13.877 INFO:tasks.workunit.client.0.smithi053.stdout:1/105: dread - d5/d18/f1b zero size 2024-09-16T00:50:13.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/586: rmdir d9/d3e/d7b 39 2024-09-16T00:50:13.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/587: truncate d9/da/fbf 749264 0 2024-09-16T00:50:13.880 INFO:tasks.workunit.client.1.smithi152.stdout:9/488: mknod d1/d7/d77/d68/ca0 0 2024-09-16T00:50:13.881 INFO:tasks.workunit.client.0.smithi053.stdout:6/43: fsync d1/fd 0 2024-09-16T00:50:13.884 INFO:tasks.workunit.client.0.smithi053.stdout:5/61: dread - d3/f9 zero size 2024-09-16T00:50:13.897 INFO:tasks.workunit.client.0.smithi053.stdout:6/44: dread d1/f2 [0,4194304] 0 2024-09-16T00:50:13.900 INFO:tasks.workunit.client.0.smithi053.stdout:0/65: rename f3 to d4/d13/f16 0 2024-09-16T00:50:13.901 INFO:tasks.workunit.client.0.smithi053.stdout:5/62: dread d3/f8 [4194304,4194304] 0 2024-09-16T00:50:13.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/502: dwrite d9/d31/d64/d3c/d5b/f7a [0,4194304] 0 2024-09-16T00:50:13.904 INFO:tasks.workunit.client.0.smithi053.stdout:9/120: truncate d8/fb 3616402 0 2024-09-16T00:50:13.904 INFO:tasks.workunit.client.0.smithi053.stdout:4/60: dwrite d0/f5 [0,4194304] 0 2024-09-16T00:50:13.905 INFO:tasks.workunit.client.1.smithi152.stdout:9/489: dwrite d1/d7/d77/d32/f49 [0,4194304] 0 2024-09-16T00:50:13.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/661: dread d6/d16/f36 [0,4194304] 0 2024-09-16T00:50:13.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/662: read - d6/d57/d2b/d50/d6e/f97 zero size 2024-09-16T00:50:13.907 INFO:tasks.workunit.client.1.smithi152.stdout:6/494: symlink db/d12/d23/d4a/d43/d59/l9c 0 2024-09-16T00:50:13.907 INFO:tasks.workunit.client.1.smithi152.stdout:6/495: chown db/d12/d23/d4a 39938 1 2024-09-16T00:50:13.908 INFO:tasks.workunit.client.0.smithi053.stdout:7/108: write d1/d3/d10/d14/d15/f1a [191179,59995] 0 2024-09-16T00:50:13.911 INFO:tasks.workunit.client.0.smithi053.stdout:3/170: mkdir d1/d5/d11/d3a 0 2024-09-16T00:50:13.914 INFO:tasks.workunit.client.0.smithi053.stdout:1/106: mkdir d5/d18/d1f 0 2024-09-16T00:50:13.914 INFO:tasks.workunit.client.0.smithi053.stdout:1/107: write d5/f14 [615635,78416] 0 2024-09-16T00:50:13.914 INFO:tasks.workunit.client.0.smithi053.stdout:1/108: chown d5/d7/l8 3243019 1 2024-09-16T00:50:13.914 INFO:tasks.workunit.client.0.smithi053.stdout:1/109: creat d5/d7/f20 x:0 0 0 2024-09-16T00:50:13.915 INFO:tasks.workunit.client.1.smithi152.stdout:8/350: symlink dd/d23/l75 0 2024-09-16T00:50:13.916 INFO:tasks.workunit.client.0.smithi053.stdout:2/26: mkdir d6 0 2024-09-16T00:50:13.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/503: dread d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:13.918 INFO:tasks.workunit.client.1.smithi152.stdout:5/663: read d6/d16/d1f/d65/f89 [179215,18522] 0 2024-09-16T00:50:13.921 INFO:tasks.workunit.client.0.smithi053.stdout:6/45: rename d1/f7 to d1/ff 0 2024-09-16T00:50:13.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/46: dread d1/f6 [0,4194304] 0 2024-09-16T00:50:13.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/47: write d1/f5 [155231,2018] 0 2024-09-16T00:50:13.925 INFO:tasks.workunit.client.0.smithi053.stdout:0/66: unlink d4/fa 0 2024-09-16T00:50:13.927 INFO:tasks.workunit.client.0.smithi053.stdout:3/171: dread d1/d5/d14/f18 [0,4194304] 0 2024-09-16T00:50:13.927 INFO:tasks.workunit.client.0.smithi053.stdout:9/121: dwrite d8/f12 [0,4194304] 0 2024-09-16T00:50:13.927 INFO:tasks.workunit.client.0.smithi053.stdout:3/172: dread - d1/d5/d14/f2a zero size 2024-09-16T00:50:13.929 INFO:tasks.workunit.client.1.smithi152.stdout:9/490: dwrite d1/d4e/d34/f84 [0,4194304] 0 2024-09-16T00:50:13.930 INFO:tasks.workunit.client.1.smithi152.stdout:9/491: chown d1/d7/d13 99462 1 2024-09-16T00:50:13.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/664: write d6/d16/d1f/d65/fe4 [145544,5411] 0 2024-09-16T00:50:13.931 INFO:tasks.workunit.client.1.smithi152.stdout:4/625: mkdir d2/db/d39/d3c/d7f/d98/dcf 0 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:8/351: dwrite dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:8/352: dread - dd/d50/d29/d2f/d53/f73 zero size 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:8/353: fsync dd/d15/f4d 0 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/480: creat dc/d10/d17/d1c/d1f/d22/f99 x:0 0 0 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/481: read - dc/d10/d17/d1c/d1f/d24/f85 zero size 2024-09-16T00:50:13.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/482: fdatasync dc/d10/d17/d1c/d8d/d8e/d2f/f7b 0 2024-09-16T00:50:13.937 INFO:tasks.workunit.client.1.smithi152.stdout:3/483: fsync dc/f35 0 2024-09-16T00:50:13.939 INFO:tasks.workunit.client.1.smithi152.stdout:0/508: unlink d3/d6/d8/d1d/d23/d25/f72 0 2024-09-16T00:50:13.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/509: chown d3/d6/f1f 192002402 1 2024-09-16T00:50:13.942 INFO:tasks.workunit.client.1.smithi152.stdout:1/588: creat d9/d3e/d7b/fdb x:0 0 0 2024-09-16T00:50:13.942 INFO:tasks.workunit.client.1.smithi152.stdout:1/589: creat d9/d3e/d41/d31/d48/d4a/fdc x:0 0 0 2024-09-16T00:50:13.946 INFO:tasks.workunit.client.0.smithi053.stdout:6/48: fsync d1/ff 0 2024-09-16T00:50:13.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:13 smithi152 ceph-mon[33237]: pgmap v7: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 122 MiB/s rd, 155 MiB/s wr, 274 op/s 2024-09-16T00:50:13.949 INFO:tasks.workunit.client.1.smithi152.stdout:1/590: write d9/faf [1822101,1054] 0 2024-09-16T00:50:13.951 INFO:tasks.workunit.client.0.smithi053.stdout:1/110: mkdir d5/d9/d21 0 2024-09-16T00:50:13.951 INFO:tasks.workunit.client.0.smithi053.stdout:1/111: creat d5/d7/f22 x:0 0 0 2024-09-16T00:50:13.951 INFO:tasks.workunit.client.1.smithi152.stdout:3/484: dwrite dc/d10/d17/d1c/d50/d55/f96 [0,4194304] 0 2024-09-16T00:50:13.951 INFO:tasks.workunit.client.1.smithi152.stdout:3/485: write dc/f2d [5130336,106535] 0 2024-09-16T00:50:13.952 INFO:tasks.workunit.client.1.smithi152.stdout:3/486: dread dc/d10/d17/d1c/d8d/d8e/f76 [0,4194304] 0 2024-09-16T00:50:13.952 INFO:tasks.workunit.client.0.smithi053.stdout:2/27: creat d6/f7 x:0 0 0 2024-09-16T00:50:13.958 INFO:tasks.workunit.client.1.smithi152.stdout:6/496: rename db/d12/d23/f8e to db/d12/d1c/d80/d97/f9d 0 2024-09-16T00:50:13.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/504: truncate d9/f5c 2022850 0 2024-09-16T00:50:13.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/505: stat d9/d31/d64/f35 0 2024-09-16T00:50:13.965 INFO:tasks.workunit.client.0.smithi053.stdout:1/112: dwrite d5/d9/f17 [0,4194304] 0 2024-09-16T00:50:13.965 INFO:tasks.workunit.client.0.smithi053.stdout:9/122: symlink d8/l2a 0 2024-09-16T00:50:13.969 INFO:tasks.workunit.client.0.smithi053.stdout:3/173: mkdir d1/d5/d31/d3b 0 2024-09-16T00:50:13.969 INFO:tasks.workunit.client.0.smithi053.stdout:3/174: chown d1/d5/d11/l23 119470 1 2024-09-16T00:50:13.970 INFO:tasks.workunit.client.1.smithi152.stdout:9/492: symlink d1/d4e/d48/d26/d58/la1 0 2024-09-16T00:50:13.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/175: creat d1/d5/d14/f3c x:0 0 0 2024-09-16T00:50:13.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/176: readlink d1/d5/l33 0 2024-09-16T00:50:13.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/177: creat d1/d5/d31/f3d x:0 0 0 2024-09-16T00:50:13.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/178: write d1/d5/d14/f3c [586816,23473] 0 2024-09-16T00:50:13.971 INFO:tasks.workunit.client.1.smithi152.stdout:2/471: sync 2024-09-16T00:50:13.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/472: readlink d4/l4a 0 2024-09-16T00:50:13.972 INFO:tasks.workunit.client.0.smithi053.stdout:5/63: rename f0 to d3/fd 0 2024-09-16T00:50:13.973 INFO:tasks.workunit.client.1.smithi152.stdout:2/473: dread d4/d19/d20/f47 [0,4194304] 0 2024-09-16T00:50:13.973 INFO:tasks.workunit.client.1.smithi152.stdout:2/474: write d4/d17/d3e/f89 [541031,120351] 0 2024-09-16T00:50:13.973 INFO:tasks.workunit.client.0.smithi053.stdout:1/113: dread d5/dd/f16 [0,4194304] 0 2024-09-16T00:50:13.975 INFO:tasks.workunit.client.0.smithi053.stdout:1/114: truncate d5/d7/d10/f12 599646 0 2024-09-16T00:50:13.975 INFO:tasks.workunit.client.0.smithi053.stdout:7/109: mknod d1/d3/d10/d14/d15/c24 0 2024-09-16T00:50:13.975 INFO:tasks.workunit.client.0.smithi053.stdout:7/110: creat d1/d18/f25 x:0 0 0 2024-09-16T00:50:13.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/665: mknod d6/d16/cfe 0 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/111: dread d1/d3/d10/d14/f16 [0,4194304] 0 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/112: creat d1/d18/f26 x:0 0 0 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/113: chown d1/d3/d10/d14 124861818 1 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/114: chown d1 786390 1 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/115: write d1/d18/f25 [797428,37756] 0 2024-09-16T00:50:13.978 INFO:tasks.workunit.client.0.smithi053.stdout:3/179: read d1/d5/f6 [5931670,20415] 0 2024-09-16T00:50:13.979 INFO:tasks.workunit.client.0.smithi053.stdout:3/180: write d1/d5/d11/f25 [724698,93758] 0 2024-09-16T00:50:13.979 INFO:tasks.workunit.client.0.smithi053.stdout:3/181: creat d1/d5/f3e x:0 0 0 2024-09-16T00:50:13.979 INFO:tasks.workunit.client.0.smithi053.stdout:3/182: creat d1/d5/d16/f3f x:0 0 0 2024-09-16T00:50:13.979 INFO:tasks.workunit.client.0.smithi053.stdout:6/49: unlink d1/f6 0 2024-09-16T00:50:13.979 INFO:tasks.workunit.client.0.smithi053.stdout:6/50: fdatasync d1/f9 0 2024-09-16T00:50:13.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/666: dread d6/fe [0,4194304] 0 2024-09-16T00:50:13.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/667: chown d6/d57/d2b/d50/d66/fd6 18 1 2024-09-16T00:50:13.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/626: mkdir d2/db/dce/dd0 0 2024-09-16T00:50:13.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/627: truncate d2/db/d39/d3c/d76/db8/f79 1675469 0 2024-09-16T00:50:13.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/628: read d2/f4 [3346142,24649] 0 2024-09-16T00:50:13.981 INFO:tasks.workunit.client.1.smithi152.stdout:4/629: chown d2/db/d39/d3c/d76/db8/f24 8034812 1 2024-09-16T00:50:13.981 INFO:tasks.workunit.client.1.smithi152.stdout:4/630: creat d2/db/d39/fd1 x:0 0 0 2024-09-16T00:50:13.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/51: dread d1/ff [0,4194304] 0 2024-09-16T00:50:13.983 INFO:tasks.workunit.client.1.smithi152.stdout:2/475: write d4/d19/f27 [1822601,100560] 0 2024-09-16T00:50:13.983 INFO:tasks.workunit.client.1.smithi152.stdout:2/476: chown d4/d17 0 1 2024-09-16T00:50:13.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/354: unlink dd/d15/d49/f2b 0 2024-09-16T00:50:13.987 INFO:tasks.workunit.client.0.smithi053.stdout:0/67: rename d4/fb to d4/f17 0 2024-09-16T00:50:13.987 INFO:tasks.workunit.client.0.smithi053.stdout:0/68: chown d4/dc 952 1 2024-09-16T00:50:13.989 INFO:tasks.workunit.client.1.smithi152.stdout:0/510: mkdir d3/d6/d8/d1d/d65/db0 0 2024-09-16T00:50:13.989 INFO:tasks.workunit.client.1.smithi152.stdout:0/511: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fb1 x:0 0 0 2024-09-16T00:50:13.993 INFO:tasks.workunit.client.0.smithi053.stdout:6/52: dread d1/fd [0,4194304] 0 2024-09-16T00:50:13.996 INFO:tasks.workunit.client.0.smithi053.stdout:2/28: write f0 [684359,108688] 0 2024-09-16T00:50:13.998 INFO:tasks.workunit.client.1.smithi152.stdout:1/591: mkdir d9/d3e/d4b/db7/ddd 0 2024-09-16T00:50:13.998 INFO:tasks.workunit.client.1.smithi152.stdout:1/592: fdatasync d9/d3e/f49 0 2024-09-16T00:50:14.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/61: rename d0/fc to d0/da/f10 0 2024-09-16T00:50:14.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/62: write d0/da/f10 [4936848,120115] 0 2024-09-16T00:50:14.005 INFO:tasks.workunit.client.0.smithi053.stdout:5/64: creat d3/d7/fe x:0 0 0 2024-09-16T00:50:14.006 INFO:tasks.workunit.client.0.smithi053.stdout:9/123: dwrite d8/f1f [0,4194304] 0 2024-09-16T00:50:14.006 INFO:tasks.workunit.client.0.smithi053.stdout:9/124: write d8/fc [4622481,54999] 0 2024-09-16T00:50:14.008 INFO:tasks.workunit.client.0.smithi053.stdout:1/115: symlink d5/d7/d10/l23 0 2024-09-16T00:50:14.008 INFO:tasks.workunit.client.1.smithi152.stdout:7/506: dwrite d9/d31/d65/d8a/d41/f50 [0,4194304] 0 2024-09-16T00:50:14.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/477: dwrite d4/d19/d20/d28/f2a [4194304,4194304] 0 2024-09-16T00:50:14.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/478: truncate d4/d44/d7a/f8a 378948 0 2024-09-16T00:50:14.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/487: creat dc/d10/d17/d1c/d8d/d8e/d3b/d6f/f9a x:0 0 0 2024-09-16T00:50:14.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/488: creat dc/d10/d17/d5a/d68/f9b x:0 0 0 2024-09-16T00:50:14.011 INFO:tasks.workunit.client.1.smithi152.stdout:6/497: creat db/d12/d23/d4a/d43/d48/f9e x:0 0 0 2024-09-16T00:50:14.015 INFO:tasks.workunit.client.0.smithi053.stdout:9/125: dread f6 [0,4194304] 0 2024-09-16T00:50:14.015 INFO:tasks.workunit.client.0.smithi053.stdout:9/126: readlink d8/d13/l21 0 2024-09-16T00:50:14.016 INFO:tasks.workunit.client.1.smithi152.stdout:9/493: mkdir d1/d4e/d48/d26/d30/d4f/da2 0 2024-09-16T00:50:14.017 INFO:tasks.workunit.client.1.smithi152.stdout:9/494: write d1/d4e/d48/d2b/f4d [1355122,94949] 0 2024-09-16T00:50:14.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/668: mknod d6/d16/d1f/d6c/cff 0 2024-09-16T00:50:14.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/669: chown d6/d16/d1f/d6c/fe5 7 1 2024-09-16T00:50:14.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/670: truncate d6/d16/d1f/fe9 327148 0 2024-09-16T00:50:14.019 INFO:tasks.workunit.client.1.smithi152.stdout:5/671: truncate d6/d16/f36 173233 0 2024-09-16T00:50:14.022 INFO:tasks.workunit.client.0.smithi053.stdout:3/183: link d1/f21 d1/d5/f40 0 2024-09-16T00:50:14.022 INFO:tasks.workunit.client.0.smithi053.stdout:3/184: write d1/d5/f3e [793537,14359] 0 2024-09-16T00:50:14.022 INFO:tasks.workunit.client.0.smithi053.stdout:3/185: creat d1/d5/d31/f41 x:0 0 0 2024-09-16T00:50:14.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/631: symlink d2/d1e/d28/d7b/db0/ld2 0 2024-09-16T00:50:14.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/632: chown d2/f6 3 1 2024-09-16T00:50:14.024 INFO:tasks.workunit.client.0.smithi053.stdout:0/69: mknod d4/dc/c18 0 2024-09-16T00:50:14.024 INFO:tasks.workunit.client.0.smithi053.stdout:0/70: creat d4/dc/f19 x:0 0 0 2024-09-16T00:50:14.025 INFO:tasks.workunit.client.0.smithi053.stdout:9/127: write d8/f1f [3048466,35226] 0 2024-09-16T00:50:14.026 INFO:tasks.workunit.client.1.smithi152.stdout:9/495: dread d1/d7/f8d [0,4194304] 0 2024-09-16T00:50:14.027 INFO:tasks.workunit.client.1.smithi152.stdout:8/355: symlink dd/d50/d29/l76 0 2024-09-16T00:50:14.028 INFO:tasks.workunit.client.1.smithi152.stdout:4/633: dread d2/db/d44/f53 [0,4194304] 0 2024-09-16T00:50:14.030 INFO:tasks.workunit.client.1.smithi152.stdout:0/512: symlink d3/d6/d8/d1d/d23/d25/d2a/d5c/lb2 0 2024-09-16T00:50:14.035 INFO:tasks.workunit.client.1.smithi152.stdout:1/593: rename d9/c20 to d9/d3e/d4b/d6b/d6d/d82/cde 0 2024-09-16T00:50:14.037 INFO:tasks.workunit.client.1.smithi152.stdout:4/634: write d2/db/d39/d3c/d76/db8/f4a [3282818,39942] 0 2024-09-16T00:50:14.039 INFO:tasks.workunit.client.0.smithi053.stdout:9/128: dread d8/f12 [0,4194304] 0 2024-09-16T00:50:14.046 INFO:tasks.workunit.client.0.smithi053.stdout:4/63: symlink d0/l11 0 2024-09-16T00:50:14.048 INFO:tasks.workunit.client.1.smithi152.stdout:7/507: symlink d9/d31/d64/d3c/lb4 0 2024-09-16T00:50:14.048 INFO:tasks.workunit.client.1.smithi152.stdout:7/508: chown d9/d31/d65/d8a/d41/d46/fa2 3113 1 2024-09-16T00:50:14.049 INFO:tasks.workunit.client.1.smithi152.stdout:7/509: dread d9/d31/d65/d4b/f66 [0,4194304] 0 2024-09-16T00:50:14.049 INFO:tasks.workunit.client.1.smithi152.stdout:7/510: readlink d9/d31/d65/d8a/d41/d46/d7d/laf 0 2024-09-16T00:50:14.049 INFO:tasks.workunit.client.1.smithi152.stdout:7/511: write d9/d10/f9d [450512,20421] 0 2024-09-16T00:50:14.053 INFO:tasks.workunit.client.1.smithi152.stdout:0/513: dwrite d3/d6/d8/d1d/d23/d25/d2a/d5c/fa9 [0,4194304] 0 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/514: chown d3/d6/d8/d1d/d23/f62 10861 1 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/515: chown d3/d6/la 10731 1 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/516: truncate d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad 311916 0 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/517: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fb1 [739066,42195] 0 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/518: readlink d3/d6/d8/d1d/l7a 0 2024-09-16T00:50:14.054 INFO:tasks.workunit.client.0.smithi053.stdout:1/116: symlink d5/d9/l24 0 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.0.smithi053.stdout:9/129: dwrite f4 [0,4194304] 0 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.0.smithi053.stdout:1/117: dread - d5/d18/f1b zero size 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.0.smithi053.stdout:1/118: chown d5/d7/d10 2386 1 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.0.smithi053.stdout:1/119: stat d5/d7/d10/f15 0 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.0.smithi053.stdout:1/120: write d5/d9/f1d [2468654,71027] 0 2024-09-16T00:50:14.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/489: mknod dc/d10/d17/d1c/d8d/c9c 0 2024-09-16T00:50:14.057 INFO:tasks.workunit.client.1.smithi152.stdout:6/498: mknod db/d12/d23/d4a/d43/d48/d6a/c9f 0 2024-09-16T00:50:14.064 INFO:tasks.workunit.client.0.smithi053.stdout:3/186: mkdir d1/d5/d31/d42 0 2024-09-16T00:50:14.064 INFO:tasks.workunit.client.0.smithi053.stdout:3/187: read - d1/d5/d31/f41 zero size 2024-09-16T00:50:14.064 INFO:tasks.workunit.client.0.smithi053.stdout:1/121: write d5/dd/f11 [339344,126641] 0 2024-09-16T00:50:14.068 INFO:tasks.workunit.client.0.smithi053.stdout:0/71: symlink d4/dc/l1a 0 2024-09-16T00:50:14.069 INFO:tasks.workunit.client.0.smithi053.stdout:2/29: getdents d6 0 2024-09-16T00:50:14.071 INFO:tasks.workunit.client.1.smithi152.stdout:5/672: link d6/d57/d2b/f2f d6/d16/d1f/d65/d77/f100 0 2024-09-16T00:50:14.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/673: creat d6/d16/d1f/d8c/db8/dbf/ded/f101 x:0 0 0 2024-09-16T00:50:14.073 INFO:tasks.workunit.client.1.smithi152.stdout:9/496: creat d1/d7/d77/fa3 x:0 0 0 2024-09-16T00:50:14.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/490: dwrite dc/d10/d17/d1c/d8d/d8e/d2f/f8c [0,4194304] 0 2024-09-16T00:50:14.075 INFO:tasks.workunit.client.1.smithi152.stdout:8/356: truncate dd/d50/d29/d2f/f31 1305075 0 2024-09-16T00:50:14.075 INFO:tasks.workunit.client.1.smithi152.stdout:8/357: truncate dd/d25/f48 1429643 0 2024-09-16T00:50:14.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/497: read d1/d4e/d48/d2b/f70 [956414,94615] 0 2024-09-16T00:50:14.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/498: fsync d1/f8b 0 2024-09-16T00:50:14.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/499: creat d1/d4e/d48/d66/d76/fa4 x:0 0 0 2024-09-16T00:50:14.083 INFO:tasks.workunit.client.1.smithi152.stdout:4/635: symlink d2/db/dce/ld3 0 2024-09-16T00:50:14.087 INFO:tasks.workunit.client.1.smithi152.stdout:3/491: dwrite dc/ff [0,4194304] 0 2024-09-16T00:50:14.087 INFO:tasks.workunit.client.1.smithi152.stdout:3/492: read dc/f1a [945019,113298] 0 2024-09-16T00:50:14.088 INFO:tasks.workunit.client.1.smithi152.stdout:3/493: dread dc/d10/d17/d1c/d8d/d8e/d3b/f5e [0,4194304] 0 2024-09-16T00:50:14.089 INFO:tasks.workunit.client.1.smithi152.stdout:3/494: write dc/d10/d17/d5a/d68/f9b [204225,36205] 0 2024-09-16T00:50:14.089 INFO:tasks.workunit.client.1.smithi152.stdout:7/512: getdents d9/d31/d65/d8a/d41/d46 0 2024-09-16T00:50:14.090 INFO:tasks.workunit.client.0.smithi053.stdout:4/64: rmdir d0 39 2024-09-16T00:50:14.090 INFO:tasks.workunit.client.0.smithi053.stdout:4/65: chown d0/da/fe 293223 1 2024-09-16T00:50:14.090 INFO:tasks.workunit.client.0.smithi053.stdout:4/66: fdatasync d0/da/fe 0 2024-09-16T00:50:14.092 INFO:tasks.workunit.client.0.smithi053.stdout:5/65: symlink d3/lf 0 2024-09-16T00:50:14.097 INFO:tasks.workunit.client.1.smithi152.stdout:0/519: rename d3/f21 to d3/d6/d64/d6a/fb3 0 2024-09-16T00:50:14.098 INFO:tasks.workunit.client.0.smithi053.stdout:9/130: getdents d8/d22 0 2024-09-16T00:50:14.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/499: symlink db/d12/d23/d4a/d33/la0 0 2024-09-16T00:50:14.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/500: truncate db/d12/f7d 819234 0 2024-09-16T00:50:14.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/501: chown db/d12/d20/f3e 28392294 1 2024-09-16T00:50:14.104 INFO:tasks.workunit.client.0.smithi053.stdout:1/122: symlink d5/d9/l25 0 2024-09-16T00:50:14.104 INFO:tasks.workunit.client.0.smithi053.stdout:1/123: readlink d5/d7/d10/l23 0 2024-09-16T00:50:14.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/674: mkdir d6/d16/d1f/d6c/de7/d102 0 2024-09-16T00:50:14.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/675: chown d6/d57/d54/l7f 61662 1 2024-09-16T00:50:14.109 INFO:tasks.workunit.client.1.smithi152.stdout:5/676: chown d6/d16/d1f/db5/lb9 0 1 2024-09-16T00:50:14.109 INFO:tasks.workunit.client.0.smithi053.stdout:9/131: write f4 [3740004,116989] 0 2024-09-16T00:50:14.111 INFO:tasks.workunit.client.1.smithi152.stdout:6/502: write db/d12/d23/d4a/f5f [1941648,52021] 0 2024-09-16T00:50:14.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/520: dread d3/d6/d8/d1d/d23/d25/d2a/f8d [0,4194304] 0 2024-09-16T00:50:14.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/521: chown d3/d6/c22 5671 1 2024-09-16T00:50:14.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/522: chown d3/c11 0 1 2024-09-16T00:50:14.112 INFO:tasks.workunit.client.0.smithi053.stdout:7/116: rename d1/d18 to d1/d3/d10/d14/d27 0 2024-09-16T00:50:14.113 INFO:tasks.workunit.client.0.smithi053.stdout:5/66: write d3/f4 [1689140,127819] 0 2024-09-16T00:50:14.113 INFO:tasks.workunit.client.0.smithi053.stdout:5/67: creat d3/d7/f10 x:0 0 0 2024-09-16T00:50:14.113 INFO:tasks.workunit.client.0.smithi053.stdout:1/124: dread d5/d9/f17 [0,4194304] 0 2024-09-16T00:50:14.117 INFO:tasks.workunit.client.0.smithi053.stdout:3/188: rmdir d1/d5/d14 39 2024-09-16T00:50:14.117 INFO:tasks.workunit.client.1.smithi152.stdout:3/495: dwrite f7 [0,4194304] 0 2024-09-16T00:50:14.117 INFO:tasks.workunit.client.1.smithi152.stdout:3/496: read - dc/d10/d17/d1c/d8d/d8e/d3b/f90 zero size 2024-09-16T00:50:14.117 INFO:tasks.workunit.client.1.smithi152.stdout:3/497: chown dc/d10/d17/d1c/d8d/d8e/d3b/c79 117921384 1 2024-09-16T00:50:14.117 INFO:tasks.workunit.client.1.smithi152.stdout:3/498: write dc/d10/d17/d1c/d1f/d24/f85 [411483,1446] 0 2024-09-16T00:50:14.118 INFO:tasks.workunit.client.0.smithi053.stdout:0/72: rename d4/dc/f19 to d4/dc/f1b 0 2024-09-16T00:50:14.118 INFO:tasks.workunit.client.0.smithi053.stdout:0/73: stat d4/f5 0 2024-09-16T00:50:14.122 INFO:tasks.workunit.client.0.smithi053.stdout:4/67: dwrite d0/f5 [0,4194304] 0 2024-09-16T00:50:14.125 INFO:tasks.workunit.client.0.smithi053.stdout:2/30: link f5 d6/f8 0 2024-09-16T00:50:14.128 INFO:tasks.workunit.client.0.smithi053.stdout:6/53: rename l0 to d1/dc/l10 0 2024-09-16T00:50:14.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/189: link d1/d5/la d1/d5/d16/l43 0 2024-09-16T00:50:14.131 INFO:tasks.workunit.client.0.smithi053.stdout:3/190: write d1/d5/d31/f38 [349935,88844] 0 2024-09-16T00:50:14.132 INFO:tasks.workunit.client.0.smithi053.stdout:4/68: write d0/da/f10 [2345672,48644] 0 2024-09-16T00:50:14.133 INFO:tasks.workunit.client.1.smithi152.stdout:1/594: link d9/da/df/f42 d9/da/df/fdf 0 2024-09-16T00:50:14.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/677: dwrite d6/f32 [0,4194304] 0 2024-09-16T00:50:14.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/678: truncate d6/f8 4700850 0 2024-09-16T00:50:14.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/679: readlink d6/d57/d2b/d50/d6e/ldf 0 2024-09-16T00:50:14.137 INFO:tasks.workunit.client.1.smithi152.stdout:9/500: mkdir d1/d7/d77/d32/da5 0 2024-09-16T00:50:14.138 INFO:tasks.workunit.client.1.smithi152.stdout:5/680: write d6/d16/d8b/fe3 [334519,84887] 0 2024-09-16T00:50:14.138 INFO:tasks.workunit.client.0.smithi053.stdout:6/54: mkdir d1/dc/d11 0 2024-09-16T00:50:14.138 INFO:tasks.workunit.client.1.smithi152.stdout:4/636: creat d2/db/dce/fd4 x:0 0 0 2024-09-16T00:50:14.140 INFO:tasks.workunit.client.0.smithi053.stdout:3/191: creat d1/d5/d31/d3b/f44 x:0 0 0 2024-09-16T00:50:14.142 INFO:tasks.workunit.client.1.smithi152.stdout:7/513: creat d9/d31/fb5 x:0 0 0 2024-09-16T00:50:14.142 INFO:tasks.workunit.client.1.smithi152.stdout:7/514: getdents d9/d31/d65/d8a/d41/d46/d7d/d86/d97 0 2024-09-16T00:50:14.142 INFO:tasks.workunit.client.1.smithi152.stdout:7/515: read - d9/d31/d65/f28 zero size 2024-09-16T00:50:14.142 INFO:tasks.workunit.client.0.smithi053.stdout:4/69: rename d0/l3 to d0/l12 0 2024-09-16T00:50:14.142 INFO:tasks.workunit.client.0.smithi053.stdout:4/70: dread - d0/da/fe zero size 2024-09-16T00:50:14.143 INFO:tasks.workunit.client.0.smithi053.stdout:4/71: read - d0/da/fe zero size 2024-09-16T00:50:14.143 INFO:tasks.workunit.client.1.smithi152.stdout:6/503: write db/d12/d20/f72 [671071,34338] 0 2024-09-16T00:50:14.144 INFO:tasks.workunit.client.0.smithi053.stdout:7/117: rename d1/d3/d10/l22 to d1/d3/d10/d14/d15/l28 0 2024-09-16T00:50:14.144 INFO:tasks.workunit.client.0.smithi053.stdout:7/118: write d1/d3/d10/d14/d27/f20 [219036,95518] 0 2024-09-16T00:50:14.145 INFO:tasks.workunit.client.1.smithi152.stdout:8/358: getdents dd/d25 0 2024-09-16T00:50:14.147 INFO:tasks.workunit.client.0.smithi053.stdout:6/55: creat d1/dc/f12 x:0 0 0 2024-09-16T00:50:14.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/595: creat d9/d3e/d4b/db7/dc4/fe0 x:0 0 0 2024-09-16T00:50:14.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/596: write d9/d3e/d41/d31/d48/fc2 [381284,48244] 0 2024-09-16T00:50:14.151 INFO:tasks.workunit.client.0.smithi053.stdout:3/192: mknod d1/d5/d16/c45 0 2024-09-16T00:50:14.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/501: rmdir d1/d4e/d48/d26/d58/d7b 0 2024-09-16T00:50:14.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/502: dread - d1/d7/d77/fa3 zero size 2024-09-16T00:50:14.153 INFO:tasks.workunit.client.0.smithi053.stdout:4/72: creat d0/d2/dd/f13 x:0 0 0 2024-09-16T00:50:14.153 INFO:tasks.workunit.client.0.smithi053.stdout:4/73: dread - d0/d2/dd/f13 zero size 2024-09-16T00:50:14.154 INFO:tasks.workunit.client.1.smithi152.stdout:5/681: dread - d6/d16/d1f/f9e zero size 2024-09-16T00:50:14.155 INFO:tasks.workunit.client.1.smithi152.stdout:8/359: dread dd/d15/d49/f22 [0,4194304] 0 2024-09-16T00:50:14.155 INFO:tasks.workunit.client.1.smithi152.stdout:4/637: creat d2/db/d39/d3c/d7f/d98/fd5 x:0 0 0 2024-09-16T00:50:14.160 INFO:tasks.workunit.client.0.smithi053.stdout:4/74: symlink d0/da/l14 0 2024-09-16T00:50:14.160 INFO:tasks.workunit.client.0.smithi053.stdout:4/75: truncate d0/da/fe 582335 0 2024-09-16T00:50:14.161 INFO:tasks.workunit.client.1.smithi152.stdout:0/523: dwrite d3/d6/d64/d6a/f4c [0,4194304] 0 2024-09-16T00:50:14.161 INFO:tasks.workunit.client.1.smithi152.stdout:0/524: chown d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 895324322 1 2024-09-16T00:50:14.162 INFO:tasks.workunit.client.0.smithi053.stdout:9/132: dwrite d8/fc [0,4194304] 0 2024-09-16T00:50:14.162 INFO:tasks.workunit.client.0.smithi053.stdout:9/133: write d8/f11 [942395,95617] 0 2024-09-16T00:50:14.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/499: dwrite dc/f15 [0,4194304] 0 2024-09-16T00:50:14.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/500: creat dc/d10/d17/d5a/d68/f9d x:0 0 0 2024-09-16T00:50:14.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/504: mknod db/d12/d23/d4a/d43/d59/ca1 0 2024-09-16T00:50:14.163 INFO:tasks.workunit.client.0.smithi053.stdout:0/74: dwrite d4/dc/f1b [0,4194304] 0 2024-09-16T00:50:14.164 INFO:tasks.workunit.client.0.smithi053.stdout:1/125: dwrite d5/d7/d10/f15 [0,4194304] 0 2024-09-16T00:50:14.164 INFO:tasks.workunit.client.0.smithi053.stdout:1/126: getdents d5/d18/d1f 0 2024-09-16T00:50:14.164 INFO:tasks.workunit.client.0.smithi053.stdout:3/193: write d1/d5/d14/f3c [172165,3352] 0 2024-09-16T00:50:14.165 INFO:tasks.workunit.client.0.smithi053.stdout:5/68: rename d3/d7/fe to d3/f11 0 2024-09-16T00:50:14.166 INFO:tasks.workunit.client.1.smithi152.stdout:8/360: dread dd/d23/f24 [0,4194304] 0 2024-09-16T00:50:14.166 INFO:tasks.workunit.client.1.smithi152.stdout:8/361: dread - dd/d25/f5d zero size 2024-09-16T00:50:14.168 INFO:tasks.workunit.client.1.smithi152.stdout:1/597: unlink d9/da/da2/fb6 0 2024-09-16T00:50:14.168 INFO:tasks.workunit.client.0.smithi053.stdout:8/211: sync 2024-09-16T00:50:14.169 INFO:tasks.workunit.client.1.smithi152.stdout:5/682: symlink d6/d57/d2b/dee/l103 0 2024-09-16T00:50:14.171 INFO:tasks.workunit.client.0.smithi053.stdout:4/76: link d0/d2/dd/f13 d0/f15 0 2024-09-16T00:50:14.173 INFO:tasks.workunit.client.0.smithi053.stdout:3/194: dread d1/d5/d16/f1f [0,4194304] 0 2024-09-16T00:50:14.174 INFO:tasks.workunit.client.1.smithi152.stdout:4/638: truncate d2/d1e/d28/d69/f49 3466459 0 2024-09-16T00:50:14.174 INFO:tasks.workunit.client.1.smithi152.stdout:9/503: dwrite d1/d4e/d34/f39 [0,4194304] 0 2024-09-16T00:50:14.176 INFO:tasks.workunit.client.0.smithi053.stdout:0/75: read d4/dc/f1b [2251767,119336] 0 2024-09-16T00:50:14.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/516: getdents d9/d31/d65/d8a/d41/d46/d7d 0 2024-09-16T00:50:14.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/517: write d9/f23 [547075,122254] 0 2024-09-16T00:50:14.177 INFO:tasks.workunit.client.0.smithi053.stdout:9/134: dread d8/f11 [0,4194304] 0 2024-09-16T00:50:14.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/479: sync 2024-09-16T00:50:14.180 INFO:tasks.workunit.client.1.smithi152.stdout:5/683: dread d6/fb [0,4194304] 0 2024-09-16T00:50:14.180 INFO:tasks.workunit.client.1.smithi152.stdout:5/684: fsync d6/d57/d2b/d50/d64/d92/fc6 0 2024-09-16T00:50:14.181 INFO:tasks.workunit.client.0.smithi053.stdout:2/31: getdents d6 0 2024-09-16T00:50:14.186 INFO:tasks.workunit.client.0.smithi053.stdout:0/76: read d4/d13/f16 [3714708,34157] 0 2024-09-16T00:50:14.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/135: write d8/fb [938266,55712] 0 2024-09-16T00:50:14.190 INFO:tasks.workunit.client.0.smithi053.stdout:0/77: write d4/f9 [752703,25392] 0 2024-09-16T00:50:14.191 INFO:tasks.workunit.client.1.smithi152.stdout:0/525: rename d3/d6/d8/d1d/d23/d25/d45/d9d to d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4 0 2024-09-16T00:50:14.191 INFO:tasks.workunit.client.1.smithi152.stdout:0/526: truncate d3/d6/fa3 473357 0 2024-09-16T00:50:14.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/501: mkdir dc/d10/d17/d1c/d1f/d9e 0 2024-09-16T00:50:14.195 INFO:tasks.workunit.client.1.smithi152.stdout:3/502: read dc/d10/d17/d1c/f23 [327579,87955] 0 2024-09-16T00:50:14.196 INFO:tasks.workunit.client.1.smithi152.stdout:3/503: fdatasync dc/d10/d17/f59 0 2024-09-16T00:50:14.196 INFO:tasks.workunit.client.1.smithi152.stdout:3/504: chown dc/d10/d17/d1c/d8d/d8e/c88 210177 1 2024-09-16T00:50:14.196 INFO:tasks.workunit.client.1.smithi152.stdout:6/505: readlink db/d12/d20/l2f 0 2024-09-16T00:50:14.197 INFO:tasks.workunit.client.0.smithi053.stdout:3/195: dwrite d1/d5/d14/f30 [0,4194304] 0 2024-09-16T00:50:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/527: dread d3/d6/d8/d1d/f26 [0,4194304] 0 2024-09-16T00:50:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:2/480: dwrite d4/d19/d20/f47 [0,4194304] 0 2024-09-16T00:50:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/528: write d3/d6/d64/fa2 [981288,51307] 0 2024-09-16T00:50:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:8/362: mkdir dd/d25/d77 0 2024-09-16T00:50:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:8/363: creat dd/d50/d29/d2f/d5f/f78 x:0 0 0 2024-09-16T00:50:14.200 INFO:tasks.workunit.client.0.smithi053.stdout:7/119: rmdir d1/d3/d10/d14 39 2024-09-16T00:50:14.200 INFO:tasks.workunit.client.0.smithi053.stdout:7/120: fsync d1/d3/d10/f1e 0 2024-09-16T00:50:14.201 INFO:tasks.workunit.client.1.smithi152.stdout:1/598: creat d9/d3e/d41/d31/d48/db2/fe1 x:0 0 0 2024-09-16T00:50:14.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/504: link d1/d4e/d48/d26/d30/l8c d1/d7/d13/d5d/la6 0 2024-09-16T00:50:14.209 INFO:tasks.workunit.client.1.smithi152.stdout:7/518: unlink d9/f5c 0 2024-09-16T00:50:14.209 INFO:tasks.workunit.client.1.smithi152.stdout:7/519: write d9/d31/d65/d8a/f55 [1943936,69039] 0 2024-09-16T00:50:14.211 INFO:tasks.workunit.client.0.smithi053.stdout:1/127: rename d5/dd/f11 to d5/dd/d19/f26 0 2024-09-16T00:50:14.211 INFO:tasks.workunit.client.0.smithi053.stdout:1/128: chown d5/dd/f16 4 1 2024-09-16T00:50:14.211 INFO:tasks.workunit.client.0.smithi053.stdout:1/129: write d5/dd/f1a [144439,90515] 0 2024-09-16T00:50:14.211 INFO:tasks.workunit.client.0.smithi053.stdout:1/130: stat d5/lb 0 2024-09-16T00:50:14.213 INFO:tasks.workunit.client.1.smithi152.stdout:4/639: rename d2/d1e/d28/d69/c60 to d2/db/d39/d3c/d7f/cd6 0 2024-09-16T00:50:14.213 INFO:tasks.workunit.client.1.smithi152.stdout:4/640: fsync d2/d41/f72 0 2024-09-16T00:50:14.218 INFO:tasks.workunit.client.1.smithi152.stdout:3/505: link dc/c36 dc/d10/d17/d5a/c9f 0 2024-09-16T00:50:14.218 INFO:tasks.workunit.client.1.smithi152.stdout:3/506: creat dc/d10/d17/d1c/d1f/d22/fa0 x:0 0 0 2024-09-16T00:50:14.219 INFO:tasks.workunit.client.1.smithi152.stdout:9/505: dwrite d1/d4e/d34/f62 [0,4194304] 0 2024-09-16T00:50:14.219 INFO:tasks.workunit.client.1.smithi152.stdout:9/506: truncate d1/f89 313413 0 2024-09-16T00:50:14.219 INFO:tasks.workunit.client.1.smithi152.stdout:9/507: write d1/d4e/d48/d66/d76/fa4 [115743,66262] 0 2024-09-16T00:50:14.219 INFO:tasks.workunit.client.1.smithi152.stdout:9/508: chown d1/f31 48984 1 2024-09-16T00:50:14.223 INFO:tasks.workunit.client.1.smithi152.stdout:7/520: dread d9/d31/d64/d3c/f78 [0,4194304] 0 2024-09-16T00:50:14.224 INFO:tasks.workunit.client.1.smithi152.stdout:3/507: dread f3 [4194304,4194304] 0 2024-09-16T00:50:14.225 INFO:tasks.workunit.client.1.smithi152.stdout:3/508: readlink dc/d10/l82 0 2024-09-16T00:50:14.226 INFO:tasks.workunit.client.0.smithi053.stdout:4/77: symlink d0/da/l16 0 2024-09-16T00:50:14.230 INFO:tasks.workunit.client.0.smithi053.stdout:1/131: dwrite d5/f14 [0,4194304] 0 2024-09-16T00:50:14.232 INFO:tasks.workunit.client.0.smithi053.stdout:2/32: mkdir d6/d9 0 2024-09-16T00:50:14.236 INFO:tasks.workunit.client.1.smithi152.stdout:8/364: truncate dd/d15/d49/f21 2430777 0 2024-09-16T00:50:14.238 INFO:tasks.workunit.client.0.smithi053.stdout:9/136: mkdir d8/d1c/d2b 0 2024-09-16T00:50:14.239 INFO:tasks.workunit.client.1.smithi152.stdout:1/599: truncate d9/d3e/fba 2098352 0 2024-09-16T00:50:14.239 INFO:tasks.workunit.client.1.smithi152.stdout:1/600: fsync d9/d3e/d41/f8d 0 2024-09-16T00:50:14.239 INFO:tasks.workunit.client.1.smithi152.stdout:1/601: creat d9/d3e/d4b/db7/dc4/fe2 x:0 0 0 2024-09-16T00:50:14.241 INFO:tasks.workunit.client.1.smithi152.stdout:4/641: dwrite d2/db/d39/d3c/f75 [0,4194304] 0 2024-09-16T00:50:14.242 INFO:tasks.workunit.client.1.smithi152.stdout:6/506: write db/d12/d20/f46 [2718976,63503] 0 2024-09-16T00:50:14.242 INFO:tasks.workunit.client.1.smithi152.stdout:5/685: rename d6/d16/d1f/d8c/cf6 to d6/d16/c104 0 2024-09-16T00:50:14.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/481: rename d4/d19 to d4/d19/d94/da3 22 2024-09-16T00:50:14.242 INFO:tasks.workunit.client.1.smithi152.stdout:5/686: chown d6/d16/d1f/d65/dd2 4 1 2024-09-16T00:50:14.245 INFO:tasks.workunit.client.0.smithi053.stdout:0/78: rename d4/d13/f16 to d4/d13/f1c 0 2024-09-16T00:50:14.253 INFO:tasks.workunit.client.1.smithi152.stdout:9/509: unlink d1/l11 0 2024-09-16T00:50:14.254 INFO:tasks.workunit.client.0.smithi053.stdout:3/196: link d1/d5/d11/f25 d1/d5/d11/f46 0 2024-09-16T00:50:14.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/642: dread d2/db/d44/f94 [0,4194304] 0 2024-09-16T00:50:14.255 INFO:tasks.workunit.client.1.smithi152.stdout:8/365: dwrite dd/d15/f4d [0,4194304] 0 2024-09-16T00:50:14.255 INFO:tasks.workunit.client.1.smithi152.stdout:5/687: write d6/d57/d2b/d50/d64/d92/f9a [3606800,44424] 0 2024-09-16T00:50:14.256 INFO:tasks.workunit.client.0.smithi053.stdout:7/121: truncate d1/d3/d10/f1e 2783721 0 2024-09-16T00:50:14.259 INFO:tasks.workunit.client.1.smithi152.stdout:3/509: mkdir dc/d10/d17/d5a/d68/da1 0 2024-09-16T00:50:14.262 INFO:tasks.workunit.client.0.smithi053.stdout:5/69: getdents d3/d7 0 2024-09-16T00:50:14.262 INFO:tasks.workunit.client.0.smithi053.stdout:5/70: chown d3/f9 11667251 1 2024-09-16T00:50:14.262 INFO:tasks.workunit.client.0.smithi053.stdout:5/71: truncate d3/f11 225479 0 2024-09-16T00:50:14.270 INFO:tasks.workunit.client.1.smithi152.stdout:5/688: dwrite d6/d57/ddc/fea [0,4194304] 0 2024-09-16T00:50:14.271 INFO:tasks.workunit.client.0.smithi053.stdout:1/132: truncate d5/dd/f16 1978897 0 2024-09-16T00:50:14.275 INFO:tasks.workunit.client.0.smithi053.stdout:2/33: symlink d6/d9/la 0 2024-09-16T00:50:14.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/137: mkdir d8/d1c/d2b/d2c 0 2024-09-16T00:50:14.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/138: fdatasync d8/f11 0 2024-09-16T00:50:14.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/139: write d8/fb [3652429,113798] 0 2024-09-16T00:50:14.281 INFO:tasks.workunit.client.1.smithi152.stdout:1/602: write d9/da/df/f42 [882507,30452] 0 2024-09-16T00:50:14.282 INFO:tasks.workunit.client.0.smithi053.stdout:0/79: getdents d4/d13 0 2024-09-16T00:50:14.282 INFO:tasks.workunit.client.0.smithi053.stdout:0/80: truncate d4/dc/f14 559484 0 2024-09-16T00:50:14.284 INFO:tasks.workunit.client.0.smithi053.stdout:3/197: unlink d1/l17 0 2024-09-16T00:50:14.286 INFO:tasks.workunit.client.0.smithi053.stdout:7/122: symlink d1/d3/d10/l29 0 2024-09-16T00:50:14.288 INFO:tasks.workunit.client.0.smithi053.stdout:5/72: dwrite d3/f11 [0,4194304] 0 2024-09-16T00:50:14.288 INFO:tasks.workunit.client.0.smithi053.stdout:5/73: fdatasync d3/f4 0 2024-09-16T00:50:14.290 INFO:tasks.workunit.client.1.smithi152.stdout:5/689: dwrite d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:14.290 INFO:tasks.workunit.client.0.smithi053.stdout:4/78: rmdir d0/da 39 2024-09-16T00:50:14.290 INFO:tasks.workunit.client.0.smithi053.stdout:4/79: chown d0/l11 802 1 2024-09-16T00:50:14.293 INFO:tasks.workunit.client.0.smithi053.stdout:1/133: getdents d5/d7/d10 0 2024-09-16T00:50:14.294 INFO:tasks.workunit.client.0.smithi053.stdout:1/134: write d5/dd/d19/f26 [517287,116364] 0 2024-09-16T00:50:14.295 INFO:tasks.workunit.client.0.smithi053.stdout:2/34: symlink d6/d9/lb 0 2024-09-16T00:50:14.296 INFO:tasks.workunit.client.0.smithi053.stdout:2/35: read d6/f8 [106866,37086] 0 2024-09-16T00:50:14.296 INFO:tasks.workunit.client.0.smithi053.stdout:2/36: write d6/f8 [951915,109368] 0 2024-09-16T00:50:14.298 INFO:tasks.workunit.client.0.smithi053.stdout:9/140: rename d8/d13/l21 to d8/d1c/l2d 0 2024-09-16T00:50:14.300 INFO:tasks.workunit.client.0.smithi053.stdout:0/81: mkdir d4/d13/d1d 0 2024-09-16T00:50:14.302 INFO:tasks.workunit.client.0.smithi053.stdout:3/198: mkdir d1/d5/d16/d47 0 2024-09-16T00:50:14.304 INFO:tasks.workunit.client.0.smithi053.stdout:3/199: dread d1/d5/f22 [0,4194304] 0 2024-09-16T00:50:14.304 INFO:tasks.workunit.client.0.smithi053.stdout:3/200: fdatasync d1/d5/d11/f25 0 2024-09-16T00:50:14.314 INFO:tasks.workunit.client.0.smithi053.stdout:4/80: mkdir d0/d17 0 2024-09-16T00:50:14.315 INFO:tasks.workunit.client.0.smithi053.stdout:1/135: mknod d5/dd/d19/c27 0 2024-09-16T00:50:14.317 INFO:tasks.workunit.client.0.smithi053.stdout:2/37: write f3 [184465,129992] 0 2024-09-16T00:50:14.320 INFO:tasks.workunit.client.1.smithi152.stdout:6/507: mknod db/d12/d23/d4a/d43/d48/d64/ca2 0 2024-09-16T00:50:14.322 INFO:tasks.workunit.client.0.smithi053.stdout:9/141: rename d8/d13/c1e to d8/d19/c2e 0 2024-09-16T00:50:14.322 INFO:tasks.workunit.client.0.smithi053.stdout:1/136: dread f2 [0,4194304] 0 2024-09-16T00:50:14.324 INFO:tasks.workunit.client.1.smithi152.stdout:2/482: mkdir d4/d19/d94/d93/da4 0 2024-09-16T00:50:14.326 INFO:tasks.workunit.client.0.smithi053.stdout:0/82: mkdir d4/dc/d1e 0 2024-09-16T00:50:14.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/529: rename d3/d6/d8/d1d/d23/d25/d2a/d5c/f99 to d3/d6/d8/d1d/d23/d25/d45/d6f/da7/fb5 0 2024-09-16T00:50:14.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/530: write d3/d6/fa3 [537872,82762] 0 2024-09-16T00:50:14.330 INFO:tasks.workunit.client.0.smithi053.stdout:4/81: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:14.333 INFO:tasks.workunit.client.0.smithi053.stdout:7/123: mkdir d1/d2a 0 2024-09-16T00:50:14.333 INFO:tasks.workunit.client.0.smithi053.stdout:7/124: fdatasync d1/d3/d10/d14/d15/f1a 0 2024-09-16T00:50:14.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/510: creat d1/d4e/d48/d2b/d93/fa7 x:0 0 0 2024-09-16T00:50:14.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/511: truncate d1/d7/d13/f2c 958602 0 2024-09-16T00:50:14.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/512: chown d1/d4e/d48 492068409 1 2024-09-16T00:50:14.338 INFO:tasks.workunit.client.1.smithi152.stdout:4/643: mknod d2/db/d39/d3c/d7f/d8b/cd7 0 2024-09-16T00:50:14.344 INFO:tasks.workunit.client.0.smithi053.stdout:5/74: dwrite d3/f6 [0,4194304] 0 2024-09-16T00:50:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:8/366: link dd/d15/d49/f6d dd/d25/f79 0 2024-09-16T00:50:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:8/367: creat dd/d15/f7a x:0 0 0 2024-09-16T00:50:14.350 INFO:tasks.workunit.client.0.smithi053.stdout:9/142: link d8/d13/l23 d8/d22/d26/l2f 0 2024-09-16T00:50:14.351 INFO:tasks.workunit.client.1.smithi152.stdout:3/510: creat dc/d10/fa2 x:0 0 0 2024-09-16T00:50:14.351 INFO:tasks.workunit.client.1.smithi152.stdout:3/511: readlink dc/d10/d17/d1c/d50/l89 0 2024-09-16T00:50:14.351 INFO:tasks.workunit.client.1.smithi152.stdout:3/512: read - dc/d10/d17/d1c/d8d/d8e/d3b/d6f/f9a zero size 2024-09-16T00:50:14.351 INFO:tasks.workunit.client.1.smithi152.stdout:3/513: write dc/d10/d17/d1c/d1f/d24/f65 [3209374,8289] 0 2024-09-16T00:50:14.355 INFO:tasks.workunit.client.0.smithi053.stdout:5/75: unlink d3/fd 0 2024-09-16T00:50:14.358 INFO:tasks.workunit.client.0.smithi053.stdout:7/125: symlink d1/d3/d10/d14/d15/l2b 0 2024-09-16T00:50:14.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/143: dread f2 [8388608,4194304] 0 2024-09-16T00:50:14.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/144: stat d8/l10 0 2024-09-16T00:50:14.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/145: readlink d8/d13/l28 0 2024-09-16T00:50:14.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/146: fdatasync d8/fb 0 2024-09-16T00:50:14.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/147: write d8/f1d [293702,15863] 0 2024-09-16T00:50:14.362 INFO:tasks.workunit.client.1.smithi152.stdout:2/483: mkdir d4/d19/d20/d28/d2c/d77/da5 0 2024-09-16T00:50:14.362 INFO:tasks.workunit.client.1.smithi152.stdout:6/508: getdents db/d12/d23/d4a/d43/d48/d64 0 2024-09-16T00:50:14.363 INFO:tasks.workunit.client.0.smithi053.stdout:5/76: mkdir d3/d7/d12 0 2024-09-16T00:50:14.363 INFO:tasks.workunit.client.0.smithi053.stdout:7/126: dread d1/d3/d10/d14/d27/f25 [0,4194304] 0 2024-09-16T00:50:14.366 INFO:tasks.workunit.client.0.smithi053.stdout:5/77: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:14.366 INFO:tasks.workunit.client.0.smithi053.stdout:0/83: dwrite d4/f17 [0,4194304] 0 2024-09-16T00:50:14.366 INFO:tasks.workunit.client.0.smithi053.stdout:4/82: dwrite d0/f15 [0,4194304] 0 2024-09-16T00:50:14.368 INFO:tasks.workunit.client.0.smithi053.stdout:1/137: dwrite d5/d18/f1b [0,4194304] 0 2024-09-16T00:50:14.369 INFO:tasks.workunit.client.0.smithi053.stdout:7/127: mkdir d1/d3/d10/d14/d27/d2c 0 2024-09-16T00:50:14.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/644: chown d2/l25 14522 1 2024-09-16T00:50:14.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/645: write d2/db/d39/f93 [441160,26632] 0 2024-09-16T00:50:14.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/531: write d3/d6/d51/f57 [2552227,130624] 0 2024-09-16T00:50:14.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/514: dwrite dc/d10/d17/d1c/d8d/d8e/f92 [0,4194304] 0 2024-09-16T00:50:14.384 INFO:tasks.workunit.client.1.smithi152.stdout:2/484: mkdir d4/d19/d94/d93/da4/da6 0 2024-09-16T00:50:14.385 INFO:tasks.workunit.client.0.smithi053.stdout:9/148: dwrite d8/f11 [0,4194304] 0 2024-09-16T00:50:14.385 INFO:tasks.workunit.client.0.smithi053.stdout:9/149: read d8/d1c/f1b [340686,19676] 0 2024-09-16T00:50:14.387 INFO:tasks.workunit.client.0.smithi053.stdout:4/83: rename d0/l12 to d0/l18 0 2024-09-16T00:50:14.388 INFO:tasks.workunit.client.1.smithi152.stdout:6/509: link db/d12/d1c/f89 db/d12/d23/d4a/d33/fa3 0 2024-09-16T00:50:14.389 INFO:tasks.workunit.client.1.smithi152.stdout:6/510: write db/d12/d1c/d80/f7a [1089223,112508] 0 2024-09-16T00:50:14.391 INFO:tasks.workunit.client.0.smithi053.stdout:0/84: rename d4/d13/d1d to d4/dc/d1e/d1f 0 2024-09-16T00:50:14.393 INFO:tasks.workunit.client.0.smithi053.stdout:1/138: dwrite d5/dd/f1a [0,4194304] 0 2024-09-16T00:50:14.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/485: dread d4/d19/f5b [0,4194304] 0 2024-09-16T00:50:14.394 INFO:tasks.workunit.client.0.smithi053.stdout:4/84: dread d0/f5 [0,4194304] 0 2024-09-16T00:50:14.394 INFO:tasks.workunit.client.0.smithi053.stdout:9/150: dread d8/f27 [0,4194304] 0 2024-09-16T00:50:14.394 INFO:tasks.workunit.client.1.smithi152.stdout:1/603: rename d9/da/c14 to d9/d3e/d41/d31/d48/d4a/ce3 0 2024-09-16T00:50:14.402 INFO:tasks.workunit.client.0.smithi053.stdout:0/85: dread d4/f10 [0,4194304] 0 2024-09-16T00:50:14.402 INFO:tasks.workunit.client.0.smithi053.stdout:7/128: truncate d1/d3/d10/f1e 2263913 0 2024-09-16T00:50:14.402 INFO:tasks.workunit.client.0.smithi053.stdout:7/129: write d1/d3/d10/d14/f23 [185852,106032] 0 2024-09-16T00:50:14.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/511: dwrite db/d12/d20/d86/f8b [0,4194304] 0 2024-09-16T00:50:14.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/512: stat db/d12/d23/d4a/d43/d48/d6a/f82 0 2024-09-16T00:50:14.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/532: mkdir d3/d6/d8/d1d/d65/db0/db6 0 2024-09-16T00:50:14.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/521: sync 2024-09-16T00:50:14.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/522: dread d9/d31/d65/d8a/d41/f62 [0,4194304] 0 2024-09-16T00:50:14.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/523: chown d9/d31/d65/d8a/d41/d46/d7d/fb0 93 1 2024-09-16T00:50:14.409 INFO:tasks.workunit.client.0.smithi053.stdout:5/78: getdents d3/d7 0 2024-09-16T00:50:14.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/515: creat dc/d10/d17/d5a/fa3 x:0 0 0 2024-09-16T00:50:14.414 INFO:tasks.workunit.client.1.smithi152.stdout:2/486: mkdir d4/d19/d20/d28/d2c/d77/da7 0 2024-09-16T00:50:14.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/690: rename d6/d57/d2b/fac to d6/d57/ddc/f105 0 2024-09-16T00:50:14.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/691: truncate d6/d57/d2b/f4e 313828 0 2024-09-16T00:50:14.420 INFO:tasks.workunit.client.1.smithi152.stdout:7/524: write d9/f37 [3866996,102288] 0 2024-09-16T00:50:14.421 INFO:tasks.workunit.client.0.smithi053.stdout:7/130: dwrite d1/d3/d10/d14/f23 [0,4194304] 0 2024-09-16T00:50:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:6/513: rmdir db/d12/d20/d4b 39 2024-09-16T00:50:14.426 INFO:tasks.workunit.client.1.smithi152.stdout:0/533: mkdir d3/d6/d6d/db7 0 2024-09-16T00:50:14.429 INFO:tasks.workunit.client.1.smithi152.stdout:3/516: mknod dc/d10/d17/d1c/d8d/d8e/d3b/ca4 0 2024-09-16T00:50:14.429 INFO:tasks.workunit.client.1.smithi152.stdout:3/517: fsync f7 0 2024-09-16T00:50:14.433 INFO:tasks.workunit.client.0.smithi053.stdout:1/139: mknod d5/dd/d19/c28 0 2024-09-16T00:50:14.434 INFO:tasks.workunit.client.0.smithi053.stdout:1/140: fdatasync f2 0 2024-09-16T00:50:14.434 INFO:tasks.workunit.client.1.smithi152.stdout:2/487: symlink d4/d44/d7a/d9e/d87/la8 0 2024-09-16T00:50:14.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/368: rename dd/d15/d1a/f43 to dd/d15/d49/f7b 0 2024-09-16T00:50:14.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/85: rename d0/da/l16 to d0/d2/l19 0 2024-09-16T00:50:14.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/86: fdatasync d0/da/fe 0 2024-09-16T00:50:14.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/87: readlink d0/d2/l19 0 2024-09-16T00:50:14.439 INFO:tasks.workunit.client.1.smithi152.stdout:3/518: read dc/fe [490884,123582] 0 2024-09-16T00:50:14.439 INFO:tasks.workunit.client.1.smithi152.stdout:3/519: chown dc/d10/d17/d1c/d1f/f2a 41 1 2024-09-16T00:50:14.441 INFO:tasks.workunit.client.1.smithi152.stdout:5/692: unlink d6/d16/d1f/fe9 0 2024-09-16T00:50:14.444 INFO:tasks.workunit.client.0.smithi053.stdout:9/151: unlink d8/d13/c15 0 2024-09-16T00:50:14.445 INFO:tasks.workunit.client.1.smithi152.stdout:8/369: write dd/d23/f3e [2327171,97716] 0 2024-09-16T00:50:14.445 INFO:tasks.workunit.client.1.smithi152.stdout:8/370: chown dd/d50/d29/d2f/f31 456841 1 2024-09-16T00:50:14.447 INFO:tasks.workunit.client.0.smithi053.stdout:0/86: mknod d4/dc/d1e/c20 0 2024-09-16T00:50:14.451 INFO:tasks.workunit.client.1.smithi152.stdout:2/488: dwrite d4/d44/f96 [0,4194304] 0 2024-09-16T00:50:14.451 INFO:tasks.workunit.client.1.smithi152.stdout:2/489: write d4/d44/d7a/d9e/d66/f97 [185858,76544] 0 2024-09-16T00:50:14.454 INFO:tasks.workunit.client.0.smithi053.stdout:5/79: chown d3/d7/f10 32141 1 2024-09-16T00:50:14.454 INFO:tasks.workunit.client.0.smithi053.stdout:5/80: write d3/d7/f10 [391954,95039] 0 2024-09-16T00:50:14.460 INFO:tasks.workunit.client.0.smithi053.stdout:1/141: mknod d5/d7/d10/c29 0 2024-09-16T00:50:14.461 INFO:tasks.workunit.client.1.smithi152.stdout:7/525: mkdir d9/db6 0 2024-09-16T00:50:14.462 INFO:tasks.workunit.client.0.smithi053.stdout:4/88: symlink d0/d17/l1a 0 2024-09-16T00:50:14.463 INFO:tasks.workunit.client.1.smithi152.stdout:6/514: truncate f9 451004 0 2024-09-16T00:50:14.465 INFO:tasks.workunit.client.0.smithi053.stdout:9/152: link d8/fc d8/f30 0 2024-09-16T00:50:14.466 INFO:tasks.workunit.client.1.smithi152.stdout:0/534: symlink d3/d6/d8/lb8 0 2024-09-16T00:50:14.469 INFO:tasks.workunit.client.0.smithi053.stdout:9/153: dread f4 [0,4194304] 0 2024-09-16T00:50:14.470 INFO:tasks.workunit.client.1.smithi152.stdout:6/515: write db/fc [3056509,101013] 0 2024-09-16T00:50:14.472 INFO:tasks.workunit.client.1.smithi152.stdout:4/646: rename d2/db/dce/dd0 to d2/d41/dd8 0 2024-09-16T00:50:14.473 INFO:tasks.workunit.client.1.smithi152.stdout:4/647: write d2/f4 [598156,87993] 0 2024-09-16T00:50:14.477 INFO:tasks.workunit.client.0.smithi053.stdout:7/131: mknod d1/d3/d10/d14/d15/c2d 0 2024-09-16T00:50:14.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/520: truncate f5 2301687 0 2024-09-16T00:50:14.481 INFO:tasks.workunit.client.0.smithi053.stdout:1/142: unlink d5/dd/f16 0 2024-09-16T00:50:14.482 INFO:tasks.workunit.client.1.smithi152.stdout:5/693: truncate d6/d16/d8b/fe3 11950 0 2024-09-16T00:50:14.482 INFO:tasks.workunit.client.1.smithi152.stdout:5/694: readlink d6/d16/d1f/l35 0 2024-09-16T00:50:14.486 INFO:tasks.workunit.client.0.smithi053.stdout:4/89: unlink d0/da/f10 0 2024-09-16T00:50:14.488 INFO:tasks.workunit.client.1.smithi152.stdout:8/371: link dd/d23/f3e dd/d25/d77/f7c 0 2024-09-16T00:50:14.491 INFO:tasks.workunit.client.0.smithi053.stdout:0/87: symlink d4/d13/l21 0 2024-09-16T00:50:14.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/513: sync 2024-09-16T00:50:14.497 INFO:tasks.workunit.client.0.smithi053.stdout:9/154: dwrite d8/f17 [4194304,4194304] 0 2024-09-16T00:50:14.498 INFO:tasks.workunit.client.1.smithi152.stdout:2/490: mkdir d4/d19/d20/d28/d8b/da9 0 2024-09-16T00:50:14.498 INFO:tasks.workunit.client.1.smithi152.stdout:3/521: dwrite dc/d10/d17/d1c/d1f/f91 [0,4194304] 0 2024-09-16T00:50:14.500 INFO:tasks.workunit.client.0.smithi053.stdout:1/143: truncate d5/d9/f17 204783 0 2024-09-16T00:50:14.500 INFO:tasks.workunit.client.0.smithi053.stdout:1/144: stat d5/dd/f1a 0 2024-09-16T00:50:14.501 INFO:tasks.workunit.client.0.smithi053.stdout:4/90: write d0/f15 [1119986,6017] 0 2024-09-16T00:50:14.501 INFO:tasks.workunit.client.1.smithi152.stdout:7/526: mknod d9/cb7 0 2024-09-16T00:50:14.502 INFO:tasks.workunit.client.0.smithi053.stdout:0/88: fsync d4/d13/f1c 0 2024-09-16T00:50:14.506 INFO:tasks.workunit.client.0.smithi053.stdout:5/81: rename d3/f11 to d3/f13 0 2024-09-16T00:50:14.509 INFO:tasks.workunit.client.0.smithi053.stdout:9/155: dread d8/f1f [0,4194304] 0 2024-09-16T00:50:14.510 INFO:tasks.workunit.client.0.smithi053.stdout:7/132: mknod d1/c2e 0 2024-09-16T00:50:14.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/145: creat d5/d9/d21/f2a x:0 0 0 2024-09-16T00:50:14.516 INFO:tasks.workunit.client.1.smithi152.stdout:0/535: dread d3/d6/d51/f85 [0,4194304] 0 2024-09-16T00:50:14.523 INFO:tasks.workunit.client.0.smithi053.stdout:5/82: creat d3/d7/d12/f14 x:0 0 0 2024-09-16T00:50:14.527 INFO:tasks.workunit.client.0.smithi053.stdout:7/133: creat d1/d3/d10/d14/f2f x:0 0 0 2024-09-16T00:50:14.528 INFO:tasks.workunit.client.0.smithi053.stdout:1/146: dread d5/f14 [0,4194304] 0 2024-09-16T00:50:14.532 INFO:tasks.workunit.client.1.smithi152.stdout:5/695: mkdir d6/d16/d1f/d6c/de2/d106 0 2024-09-16T00:50:14.532 INFO:tasks.workunit.client.1.smithi152.stdout:5/696: dread - d6/d16/d1f/d8c/db8/feb zero size 2024-09-16T00:50:14.532 INFO:tasks.workunit.client.0.smithi053.stdout:4/91: dwrite d0/f5 [4194304,4194304] 0 2024-09-16T00:50:14.533 INFO:tasks.workunit.client.0.smithi053.stdout:0/89: dwrite d4/f10 [4194304,4194304] 0 2024-09-16T00:50:14.534 INFO:tasks.workunit.client.1.smithi152.stdout:8/372: mknod dd/d25/c7d 0 2024-09-16T00:50:14.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/373: truncate dd/d15/f68 40244 0 2024-09-16T00:50:14.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/374: chown dd/d50/d29/d2f/c74 6032 1 2024-09-16T00:50:14.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/375: fsync dd/d15/f4a 0 2024-09-16T00:50:14.535 INFO:tasks.workunit.client.0.smithi053.stdout:5/83: chown d3/la 50 1 2024-09-16T00:50:14.537 INFO:tasks.workunit.client.0.smithi053.stdout:9/156: dwrite d8/fb [0,4194304] 0 2024-09-16T00:50:14.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/514: mkdir d1/d7/d77/d32/da5/da8 0 2024-09-16T00:50:14.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/515: write d1/d7/d13/d5d/f6b [5138730,37505] 0 2024-09-16T00:50:14.537 INFO:tasks.workunit.client.0.smithi053.stdout:7/134: truncate d1/d3/d10/d14/d15/f1d 866661 0 2024-09-16T00:50:14.537 INFO:tasks.workunit.client.0.smithi053.stdout:7/135: truncate d1/d3/f1f 674491 0 2024-09-16T00:50:14.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/136: dread d1/d3/d10/d14/f16 [0,4194304] 0 2024-09-16T00:50:14.542 INFO:tasks.workunit.client.0.smithi053.stdout:1/147: dread f2 [0,4194304] 0 2024-09-16T00:50:14.542 INFO:tasks.workunit.client.0.smithi053.stdout:1/148: write d5/d7/f22 [173510,53962] 0 2024-09-16T00:50:14.543 INFO:tasks.workunit.client.1.smithi152.stdout:2/491: mkdir d4/d19/d20/d34/daa 0 2024-09-16T00:50:14.543 INFO:tasks.workunit.client.1.smithi152.stdout:2/492: chown d4/d19/d20/l42 68799972 1 2024-09-16T00:50:14.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/92: creat d0/d2/f1b x:0 0 0 2024-09-16T00:50:14.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/93: write d0/f15 [2416984,125707] 0 2024-09-16T00:50:14.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/94: creat d0/d2/dd/f1c x:0 0 0 2024-09-16T00:50:14.546 INFO:tasks.workunit.client.1.smithi152.stdout:3/522: mkdir dc/d10/d17/d5a/d68/da5 0 2024-09-16T00:50:14.547 INFO:tasks.workunit.client.0.smithi053.stdout:0/90: dread d4/dc/f1b [0,4194304] 0 2024-09-16T00:50:14.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/527: symlink d9/d31/d65/lb8 0 2024-09-16T00:50:14.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/528: fsync d9/f9f 0 2024-09-16T00:50:14.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/529: read d9/d31/d64/d3c/f42 [2380497,91567] 0 2024-09-16T00:50:14.555 INFO:tasks.workunit.client.0.smithi053.stdout:0/91: dread d4/f10 [0,4194304] 0 2024-09-16T00:50:14.555 INFO:tasks.workunit.client.0.smithi053.stdout:0/92: chown d4/dc/le 2 1 2024-09-16T00:50:14.555 INFO:tasks.workunit.client.1.smithi152.stdout:6/516: getdents db/d12/d1c/d80/d97 0 2024-09-16T00:50:14.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/157: mkdir d8/d19/d31 0 2024-09-16T00:50:14.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/158: read - d8/d13/f20 zero size 2024-09-16T00:50:14.560 INFO:tasks.workunit.client.1.smithi152.stdout:1/604: rename d9/d3e/d41/d31/d38/c73 to d9/da/df/ce4 0 2024-09-16T00:50:14.560 INFO:tasks.workunit.client.1.smithi152.stdout:1/605: chown d9/d3e/d4b/d6b/d6d/fd2 238 1 2024-09-16T00:50:14.562 INFO:tasks.workunit.client.0.smithi053.stdout:9/159: dread f6 [0,4194304] 0 2024-09-16T00:50:14.562 INFO:tasks.workunit.client.0.smithi053.stdout:7/137: creat d1/d3/d10/d14/d27/f30 x:0 0 0 2024-09-16T00:50:14.562 INFO:tasks.workunit.client.0.smithi053.stdout:7/138: readlink d1/l8 0 2024-09-16T00:50:14.563 INFO:tasks.workunit.client.1.smithi152.stdout:2/493: write d4/d17/f41 [4045040,126472] 0 2024-09-16T00:50:14.563 INFO:tasks.workunit.client.0.smithi053.stdout:7/139: dread d1/d3/f1f [0,4194304] 0 2024-09-16T00:50:14.564 INFO:tasks.workunit.client.1.smithi152.stdout:0/536: symlink d3/d6/d2e/lb9 0 2024-09-16T00:50:14.565 INFO:tasks.workunit.client.1.smithi152.stdout:0/537: fdatasync d3/d6/f2f 0 2024-09-16T00:50:14.565 INFO:tasks.workunit.client.1.smithi152.stdout:0/538: fsync d3/d6/d64/fa2 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/539: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4 74 1 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/540: stat d3/d6/d8/d1d/d65/d6e/d82/c83 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/541: chown d3/d6/d8/f40 7503 1 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/542: write d3/d6/d8/d1d/d23/d25/d2a/d5c/f67 [223446,44357] 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/543: stat d3/d6/d8/lb8 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/544: chown d3/d6/d8/d1d/d23/d25/d2a/f5b 73 1 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/545: write d3/d6/d51/f57 [4190233,42639] 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/546: read d3/d6/d8/d1d/d23/f3b [1353434,114180] 0 2024-09-16T00:50:14.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/547: read - d3/d6/d8/d1d/d23/d25/d2a/d5c/f9f zero size 2024-09-16T00:50:14.567 INFO:tasks.workunit.client.1.smithi152.stdout:5/697: mknod d6/d16/d1f/d65/c107 0 2024-09-16T00:50:14.570 INFO:tasks.workunit.client.1.smithi152.stdout:8/376: rmdir dd/d50 39 2024-09-16T00:50:14.570 INFO:tasks.workunit.client.1.smithi152.stdout:8/377: read - dd/d25/f30 zero size 2024-09-16T00:50:14.571 INFO:tasks.workunit.client.0.smithi053.stdout:0/93: mkdir d4/dc/d1e/d22 0 2024-09-16T00:50:14.573 INFO:tasks.workunit.client.1.smithi152.stdout:9/516: mknod d1/d7/d13/d80/ca9 0 2024-09-16T00:50:14.573 INFO:tasks.workunit.client.1.smithi152.stdout:9/517: fsync d1/d4e/d34/f84 0 2024-09-16T00:50:14.574 INFO:tasks.workunit.client.0.smithi053.stdout:7/140: link d1/c2e d1/d3/d10/d14/d27/c31 0 2024-09-16T00:50:14.575 INFO:tasks.workunit.client.0.smithi053.stdout:1/149: dwrite d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:14.576 INFO:tasks.workunit.client.0.smithi053.stdout:0/94: mkdir d4/dc/d23 0 2024-09-16T00:50:14.579 INFO:tasks.workunit.client.0.smithi053.stdout:7/141: symlink d1/d2a/l32 0 2024-09-16T00:50:14.583 INFO:tasks.workunit.client.1.smithi152.stdout:7/530: mkdir d9/d31/d64/d3c/db9 0 2024-09-16T00:50:14.583 INFO:tasks.workunit.client.0.smithi053.stdout:1/150: truncate d5/dd/f1a 1481965 0 2024-09-16T00:50:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/606: rename d9/d3e/d41/c61 to d9/d3e/d7b/ce5 0 2024-09-16T00:50:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/607: read - d9/d3e/d41/d31/d48/d4a/f91 zero size 2024-09-16T00:50:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/608: truncate d9/d3e/d41/d31/d48/d4a/f5b 4961530 0 2024-09-16T00:50:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:8/378: dread dd/d23/f24 [0,4194304] 0 2024-09-16T00:50:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:6/517: dwrite db/d12/d1c/d80/d97/f9d [0,4194304] 0 2024-09-16T00:50:14.587 INFO:tasks.workunit.client.0.smithi053.stdout:0/95: mkdir d4/dc/d23/d24 0 2024-09-16T00:50:14.588 INFO:tasks.workunit.client.1.smithi152.stdout:2/494: truncate d4/d19/d20/d28/d2c/f79 223168 0 2024-09-16T00:50:14.588 INFO:tasks.workunit.client.1.smithi152.stdout:2/495: stat d4/d19/d94/c9f 0 2024-09-16T00:50:14.588 INFO:tasks.workunit.client.0.smithi053.stdout:7/142: mknod d1/d2a/c33 0 2024-09-16T00:50:14.590 INFO:tasks.workunit.client.1.smithi152.stdout:0/548: rmdir d3/d6/d64/d6a/d61 39 2024-09-16T00:50:14.590 INFO:tasks.workunit.client.0.smithi053.stdout:1/151: mknod d5/dd/d19/c2b 0 2024-09-16T00:50:14.595 INFO:tasks.workunit.client.1.smithi152.stdout:3/523: truncate dc/d10/d17/d1c/d1f/f91 449237 0 2024-09-16T00:50:14.595 INFO:tasks.workunit.client.0.smithi053.stdout:0/96: truncate d4/d13/f1c 1759164 0 2024-09-16T00:50:14.599 INFO:tasks.workunit.client.1.smithi152.stdout:7/531: unlink d9/d31/d64/d3c/c8f 0 2024-09-16T00:50:14.599 INFO:tasks.workunit.client.1.smithi152.stdout:7/532: chown d9/d31/d64/cb3 2113699356 1 2024-09-16T00:50:14.600 INFO:tasks.workunit.client.0.smithi053.stdout:1/152: mkdir d5/d7/d10/d2c 0 2024-09-16T00:50:14.602 INFO:tasks.workunit.client.1.smithi152.stdout:0/549: mkdir d3/d6/d6d/db7/dba 0 2024-09-16T00:50:14.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/524: mknod dc/d10/d17/d1c/d1f/d9e/ca6 0 2024-09-16T00:50:14.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/609: link d9/d3e/d41/d31/d48/d7d/lcc d9/da/le6 0 2024-09-16T00:50:14.609 INFO:tasks.workunit.client.1.smithi152.stdout:1/610: unlink d9/d3e/d4b/d50/f76 0 2024-09-16T00:50:14.610 INFO:tasks.workunit.client.1.smithi152.stdout:0/550: mkdir d3/d6/d51/dbb 0 2024-09-16T00:50:14.610 INFO:tasks.workunit.client.1.smithi152.stdout:0/551: stat d3/d6/d8/f84 0 2024-09-16T00:50:14.611 INFO:tasks.workunit.client.1.smithi152.stdout:7/533: dread d9/d31/d65/d4b/f81 [0,4194304] 0 2024-09-16T00:50:14.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/611: unlink d9/d3e/d4b/d6b/l6c 0 2024-09-16T00:50:14.613 INFO:tasks.workunit.client.1.smithi152.stdout:0/552: mknod d3/d6/d8/d1d/d23/d25/d45/cbc 0 2024-09-16T00:50:14.617 INFO:tasks.workunit.client.1.smithi152.stdout:0/553: unlink d3/l1b 0 2024-09-16T00:50:14.617 INFO:tasks.workunit.client.1.smithi152.stdout:0/554: write d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 [512710,48813] 0 2024-09-16T00:50:14.619 INFO:tasks.workunit.client.1.smithi152.stdout:0/555: symlink d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/lbd 0 2024-09-16T00:50:14.623 INFO:tasks.workunit.client.1.smithi152.stdout:0/556: rename d3/d6/d51/l87 to d3/d6/d8/d1d/d23/d4b/lbe 0 2024-09-16T00:50:14.627 INFO:tasks.workunit.client.1.smithi152.stdout:0/557: mkdir d3/d6/d51/dbb/dbf 0 2024-09-16T00:50:14.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/534: dread d9/d31/d64/d3c/d5b/f7a [0,4194304] 0 2024-09-16T00:50:14.663 INFO:tasks.workunit.client.1.smithi152.stdout:4/648: sync 2024-09-16T00:50:14.663 INFO:tasks.workunit.client.1.smithi152.stdout:4/649: creat d2/d1e/fd9 x:0 0 0 2024-09-16T00:50:14.670 INFO:tasks.workunit.client.0.smithi053.stdout:4/95: dwrite d0/d2/dd/f13 [0,4194304] 0 2024-09-16T00:50:14.670 INFO:tasks.workunit.client.0.smithi053.stdout:5/84: dwrite d3/f6 [0,4194304] 0 2024-09-16T00:50:14.671 INFO:tasks.workunit.client.1.smithi152.stdout:6/518: dwrite db/f31 [0,4194304] 0 2024-09-16T00:50:14.671 INFO:tasks.workunit.client.0.smithi053.stdout:9/160: dwrite d8/f27 [4194304,4194304] 0 2024-09-16T00:50:14.671 INFO:tasks.workunit.client.0.smithi053.stdout:9/161: write d8/d1c/f1b [2121461,120444] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/518: dwrite d1/fb [0,4194304] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/519: write d1/d7/d13/d80/f91 [927826,64361] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/520: readlink d1/d7/d77/d32/l40 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:2/496: dwrite d4/d44/d7a/f7e [0,4194304] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:2/497: write d4/f16 [3606422,41243] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:4/650: dread d2/db/d39/d3c/f75 [0,4194304] 0 2024-09-16T00:50:14.674 INFO:tasks.workunit.client.1.smithi152.stdout:4/651: write d2/db/dce/fd4 [831768,2097] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.1.smithi152.stdout:1/612: dwrite d9/f19 [0,4194304] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.1.smithi152.stdout:1/613: chown d9/d3e/d4b/d50/c92 0 1 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.1.smithi152.stdout:1/614: creat d9/d3e/d4b/db7/dc4/fe7 x:0 0 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.1.smithi152.stdout:3/525: dwrite dc/f2d [0,4194304] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.0.smithi053.stdout:7/143: dwrite d1/d3/d10/d14/f16 [0,4194304] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.0.smithi053.stdout:7/144: write d1/d3/d10/d14/d15/f1d [1392706,55895] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.0.smithi053.stdout:0/97: dwrite d4/f10 [4194304,4194304] 0 2024-09-16T00:50:14.675 INFO:tasks.workunit.client.0.smithi053.stdout:1/153: dwrite d5/d9/f1d [0,4194304] 0 2024-09-16T00:50:14.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/535: dwrite d9/d31/d65/d8a/d41/f58 [0,4194304] 0 2024-09-16T00:50:14.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/536: truncate d9/d31/d65/d8a/d41/f62 821210 0 2024-09-16T00:50:14.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/537: truncate d9/d31/fb5 272704 0 2024-09-16T00:50:14.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/538: read f4 [3360755,94249] 0 2024-09-16T00:50:14.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/519: unlink db/d12/d1c/l6b 0 2024-09-16T00:50:14.677 INFO:tasks.workunit.client.1.smithi152.stdout:6/520: truncate db/d12/d20/f7e 1008667 0 2024-09-16T00:50:14.677 INFO:tasks.workunit.client.1.smithi152.stdout:6/521: fsync db/d12/d23/d4a/f5f 0 2024-09-16T00:50:14.677 INFO:tasks.workunit.client.0.smithi053.stdout:1/154: dread d5/d9/f17 [0,4194304] 0 2024-09-16T00:50:14.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/162: creat d8/d22/d26/f32 x:0 0 0 2024-09-16T00:50:14.686 INFO:tasks.workunit.client.0.smithi053.stdout:9/163: chown d8/f27 17 1 2024-09-16T00:50:14.686 INFO:tasks.workunit.client.1.smithi152.stdout:4/652: write d2/db/d39/f59 [918629,85703] 0 2024-09-16T00:50:14.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/526: dread dc/d10/d17/d1c/d8d/d8e/f2e [0,4194304] 0 2024-09-16T00:50:14.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/527: dread - dc/d10/d17/d1c/d50/d55/d6d/f8b zero size 2024-09-16T00:50:14.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/528: readlink dc/d10/d17/d1c/l1e 0 2024-09-16T00:50:14.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/529: write dc/f15 [6901815,86755] 0 2024-09-16T00:50:14.703 INFO:tasks.workunit.client.0.smithi053.stdout:9/164: read d8/f17 [2247034,71625] 0 2024-09-16T00:50:14.706 INFO:tasks.workunit.client.0.smithi053.stdout:4/96: dwrite d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:14.713 INFO:tasks.workunit.client.1.smithi152.stdout:7/539: dwrite d9/d31/fb5 [0,4194304] 0 2024-09-16T00:50:14.713 INFO:tasks.workunit.client.1.smithi152.stdout:3/530: dwrite dc/d10/d17/d1c/d8d/d8e/d3b/d6f/f7d [0,4194304] 0 2024-09-16T00:50:14.713 INFO:tasks.workunit.client.1.smithi152.stdout:3/531: read - dc/d10/d17/d1c/d1f/d22/fa0 zero size 2024-09-16T00:50:14.714 INFO:tasks.workunit.client.0.smithi053.stdout:5/85: dwrite d3/f9 [0,4194304] 0 2024-09-16T00:50:14.714 INFO:tasks.workunit.client.0.smithi053.stdout:5/86: getdents d3/d7 0 2024-09-16T00:50:14.714 INFO:tasks.workunit.client.0.smithi053.stdout:7/145: dwrite d1/d3/d10/d14/d15/f1a [0,4194304] 0 2024-09-16T00:50:14.723 INFO:tasks.workunit.client.1.smithi152.stdout:7/540: write d9/f25 [7992897,39462] 0 2024-09-16T00:50:14.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/653: mknod d2/db/d39/d3c/dc5/cda 0 2024-09-16T00:50:14.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/654: creat d2/db/dce/fdb x:0 0 0 2024-09-16T00:50:14.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/655: fdatasync d2/db/d39/d3c/f85 0 2024-09-16T00:50:14.732 INFO:tasks.workunit.client.0.smithi053.stdout:0/98: mkdir d4/dc/d25 0 2024-09-16T00:50:14.732 INFO:tasks.workunit.client.0.smithi053.stdout:0/99: fsync d4/dc/f14 0 2024-09-16T00:50:14.732 INFO:tasks.workunit.client.0.smithi053.stdout:0/100: read d4/dc/f1b [518496,5506] 0 2024-09-16T00:50:14.732 INFO:tasks.workunit.client.0.smithi053.stdout:0/101: write d4/dc/f14 [1582392,4591] 0 2024-09-16T00:50:14.735 INFO:tasks.workunit.client.0.smithi053.stdout:9/165: creat d8/d1c/f33 x:0 0 0 2024-09-16T00:50:14.735 INFO:tasks.workunit.client.0.smithi053.stdout:9/166: creat d8/d13/f34 x:0 0 0 2024-09-16T00:50:14.735 INFO:tasks.workunit.client.0.smithi053.stdout:9/167: write d8/d13/f20 [713242,2926] 0 2024-09-16T00:50:14.736 INFO:tasks.workunit.client.0.smithi053.stdout:9/168: creat d8/f35 x:0 0 0 2024-09-16T00:50:14.736 INFO:tasks.workunit.client.0.smithi053.stdout:9/169: write d8/f12 [4832255,83449] 0 2024-09-16T00:50:14.740 INFO:tasks.workunit.client.1.smithi152.stdout:1/615: getdents d9/d3e/d4b/db7/dc4 0 2024-09-16T00:50:14.740 INFO:tasks.workunit.client.1.smithi152.stdout:1/616: truncate d9/da/df/f69 332710 0 2024-09-16T00:50:14.743 INFO:tasks.workunit.client.0.smithi053.stdout:4/97: mkdir d0/d2/d1d 0 2024-09-16T00:50:14.750 INFO:tasks.workunit.client.0.smithi053.stdout:6/56: sync 2024-09-16T00:50:14.751 INFO:tasks.workunit.client.0.smithi053.stdout:3/201: sync 2024-09-16T00:50:14.751 INFO:tasks.workunit.client.0.smithi053.stdout:2/38: sync 2024-09-16T00:50:14.751 INFO:tasks.workunit.client.0.smithi053.stdout:8/212: sync 2024-09-16T00:50:14.751 INFO:tasks.workunit.client.0.smithi053.stdout:8/213: creat d10/d21/f4b x:0 0 0 2024-09-16T00:50:14.756 INFO:tasks.workunit.client.0.smithi053.stdout:9/170: dwrite f2 [0,4194304] 0 2024-09-16T00:50:14.758 INFO:tasks.workunit.client.0.smithi053.stdout:8/214: read d10/f1e [2074923,60208] 0 2024-09-16T00:50:14.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/532: symlink dc/d10/d17/d5a/d68/da5/la7 0 2024-09-16T00:50:14.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/533: chown dc/d10/d17/c4b 3 1 2024-09-16T00:50:14.764 INFO:tasks.workunit.client.1.smithi152.stdout:3/534: write dc/d10/d17/d1c/d8d/d8e/d2f/f7b [362663,76295] 0 2024-09-16T00:50:14.765 INFO:tasks.workunit.client.0.smithi053.stdout:7/146: mknod d1/d3/d10/d14/c34 0 2024-09-16T00:50:14.766 INFO:tasks.workunit.client.1.smithi152.stdout:7/541: mknod d9/d31/d65/d8a/d90/cba 0 2024-09-16T00:50:14.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/522: getdents db/d12/d1c 0 2024-09-16T00:50:14.771 INFO:tasks.workunit.client.0.smithi053.stdout:0/102: link d4/dc/le d4/dc/d25/l26 0 2024-09-16T00:50:14.773 INFO:tasks.workunit.client.1.smithi152.stdout:5/698: sync 2024-09-16T00:50:14.773 INFO:tasks.workunit.client.1.smithi152.stdout:8/379: sync 2024-09-16T00:50:14.773 INFO:tasks.workunit.client.1.smithi152.stdout:5/699: creat d6/d57/d54/f108 x:0 0 0 2024-09-16T00:50:14.773 INFO:tasks.workunit.client.1.smithi152.stdout:5/700: creat d6/d57/d2b/f109 x:0 0 0 2024-09-16T00:50:14.776 INFO:tasks.workunit.client.1.smithi152.stdout:1/617: creat d9/da/fe8 x:0 0 0 2024-09-16T00:50:14.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/618: write d9/da/df/f86 [1571273,13063] 0 2024-09-16T00:50:14.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/619: readlink d9/d3e/d4b/d6b/d6d/d97/lb9 0 2024-09-16T00:50:14.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/620: fdatasync d9/da/df/f27 0 2024-09-16T00:50:14.781 INFO:tasks.workunit.client.0.smithi053.stdout:4/98: rmdir d0 39 2024-09-16T00:50:14.782 INFO:tasks.workunit.client.0.smithi053.stdout:4/99: truncate d0/d2/dd/f1c 156804 0 2024-09-16T00:50:14.782 INFO:tasks.workunit.client.0.smithi053.stdout:4/100: write d0/d2/dd/f1c [419571,5730] 0 2024-09-16T00:50:14.782 INFO:tasks.workunit.client.0.smithi053.stdout:3/202: link d1/d5/d16/l43 d1/d5/d11/d3a/l48 0 2024-09-16T00:50:14.784 INFO:tasks.workunit.client.0.smithi053.stdout:6/57: creat d1/dc/d11/f13 x:0 0 0 2024-09-16T00:50:14.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/535: creat dc/d10/d17/d1c/d8d/d8e/d2f/d46/fa8 x:0 0 0 2024-09-16T00:50:14.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/536: chown dc/d10/d17/d5a/c9f 7488 1 2024-09-16T00:50:14.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/537: truncate dc/d10/d17/d4f/f60 252437 0 2024-09-16T00:50:14.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/538: chown dc/d10/l42 166755319 1 2024-09-16T00:50:14.786 INFO:tasks.workunit.client.0.smithi053.stdout:2/39: chown f1 7729 1 2024-09-16T00:50:14.787 INFO:tasks.workunit.client.0.smithi053.stdout:2/40: fsync f1 0 2024-09-16T00:50:14.787 INFO:tasks.workunit.client.0.smithi053.stdout:2/41: write f0 [232698,96714] 0 2024-09-16T00:50:14.788 INFO:tasks.workunit.client.1.smithi152.stdout:8/380: rename dd/d23/f24 to dd/d50/d29/f7e 0 2024-09-16T00:50:14.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/381: chown dd/d50/d29/f58 66295060 1 2024-09-16T00:50:14.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/382: truncate dd/d15/f7a 509092 0 2024-09-16T00:50:14.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/383: creat dd/d50/d29/d2f/d5f/f7f x:0 0 0 2024-09-16T00:50:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:9/171: symlink d8/d22/d26/l36 0 2024-09-16T00:50:14.795 INFO:tasks.workunit.client.1.smithi152.stdout:7/542: dwrite d9/d31/d65/d8a/f4a [0,4194304] 0 2024-09-16T00:50:14.796 INFO:tasks.workunit.client.0.smithi053.stdout:3/203: read d1/d5/f10 [939862,66898] 0 2024-09-16T00:50:14.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/42: read f1 [999730,118271] 0 2024-09-16T00:50:14.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/43: fdatasync f3 0 2024-09-16T00:50:14.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/44: read f3 [240228,7473] 0 2024-09-16T00:50:14.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/45: write d6/f7 [885045,125504] 0 2024-09-16T00:50:14.798 INFO:tasks.workunit.client.1.smithi152.stdout:5/701: rmdir d6/d16/d1f/d6c/de7/d102 0 2024-09-16T00:50:14.799 INFO:tasks.workunit.client.1.smithi152.stdout:6/523: dwrite db/d12/d1c/d80/d97/f9d [0,4194304] 0 2024-09-16T00:50:14.800 INFO:tasks.workunit.client.0.smithi053.stdout:5/87: rename d3/lb to d3/d7/l15 0 2024-09-16T00:50:14.801 INFO:tasks.workunit.client.1.smithi152.stdout:4/656: getdents d2/db/d39 0 2024-09-16T00:50:14.801 INFO:tasks.workunit.client.1.smithi152.stdout:4/657: readlink d2/db/d39/d3c/d7f/d8b/lbb 0 2024-09-16T00:50:14.803 INFO:tasks.workunit.client.0.smithi053.stdout:9/172: dread d8/f17 [0,4194304] 0 2024-09-16T00:50:14.803 INFO:tasks.workunit.client.0.smithi053.stdout:9/173: write d8/d1c/f1b [2666137,42258] 0 2024-09-16T00:50:14.803 INFO:tasks.workunit.client.0.smithi053.stdout:0/103: dwrite d4/f10 [4194304,4194304] 0 2024-09-16T00:50:14.808 INFO:tasks.workunit.client.1.smithi152.stdout:3/539: mknod dc/d10/d17/d1c/d50/d63/ca9 0 2024-09-16T00:50:14.810 INFO:tasks.workunit.client.0.smithi053.stdout:9/174: write f6 [3039475,124681] 0 2024-09-16T00:50:14.810 INFO:tasks.workunit.client.0.smithi053.stdout:3/204: dwrite d1/d5/f6 [4194304,4194304] 0 2024-09-16T00:50:14.812 INFO:tasks.workunit.client.0.smithi053.stdout:5/88: write d3/f13 [2852711,41920] 0 2024-09-16T00:50:14.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/384: creat dd/d50/d29/f80 x:0 0 0 2024-09-16T00:50:14.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/385: chown dd/d25/d77/f7c 305 1 2024-09-16T00:50:14.824 INFO:tasks.workunit.client.0.smithi053.stdout:7/147: getdents d1/d3 0 2024-09-16T00:50:14.825 INFO:tasks.workunit.client.1.smithi152.stdout:7/543: creat d9/d31/d65/d8a/d90/fbb x:0 0 0 2024-09-16T00:50:14.827 INFO:tasks.workunit.client.0.smithi053.stdout:5/89: dwrite d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:14.827 INFO:tasks.workunit.client.0.smithi053.stdout:5/90: write d3/f9 [4634903,64239] 0 2024-09-16T00:50:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:5/702: mkdir d6/d57/d2b/d50/d64/df5/d10a 0 2024-09-16T00:50:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:5/703: chown d6/d16/d8b 79779 1 2024-09-16T00:50:14.829 INFO:tasks.workunit.client.0.smithi053.stdout:4/101: mkdir d0/d2/d1e 0 2024-09-16T00:50:14.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/544: write d9/f1b [295009,86638] 0 2024-09-16T00:50:14.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/545: fdatasync d9/d31/d65/d8a/d90/fbb 0 2024-09-16T00:50:14.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/546: chown d9/d31/d64/d3c/c83 14 1 2024-09-16T00:50:14.835 INFO:tasks.workunit.client.0.smithi053.stdout:8/215: getdents d10/d21 0 2024-09-16T00:50:14.837 INFO:tasks.workunit.client.1.smithi152.stdout:5/704: dread d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:14.839 INFO:tasks.workunit.client.0.smithi053.stdout:2/46: mkdir d6/d9/dc 0 2024-09-16T00:50:14.842 INFO:tasks.workunit.client.1.smithi152.stdout:7/547: dread f4 [0,4194304] 0 2024-09-16T00:50:14.842 INFO:tasks.workunit.client.1.smithi152.stdout:7/548: stat d9/d31/d65/d8a/d41/d46/c87 0 2024-09-16T00:50:14.844 INFO:tasks.workunit.client.0.smithi053.stdout:0/104: rmdir d4/dc/d1e 39 2024-09-16T00:50:14.844 INFO:tasks.workunit.client.0.smithi053.stdout:0/105: write d4/f9 [244092,2053] 0 2024-09-16T00:50:14.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/524: mknod db/d12/d1c/ca4 0 2024-09-16T00:50:14.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/525: chown db/d12/d23/d4a/d43/d48/f9e 27 1 2024-09-16T00:50:14.846 INFO:tasks.workunit.client.0.smithi053.stdout:9/175: mkdir d8/d19/d31/d37 0 2024-09-16T00:50:14.848 INFO:tasks.workunit.client.0.smithi053.stdout:3/205: symlink d1/l49 0 2024-09-16T00:50:14.848 INFO:tasks.workunit.client.0.smithi053.stdout:3/206: write d1/d5/d16/f3f [113360,121512] 0 2024-09-16T00:50:14.850 INFO:tasks.workunit.client.1.smithi152.stdout:3/540: mkdir dc/d10/d17/d1c/d50/daa 0 2024-09-16T00:50:14.852 INFO:tasks.workunit.client.1.smithi152.stdout:8/386: mknod dd/d15/d69/c81 0 2024-09-16T00:50:14.854 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:14 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:14.854 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:14 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:14.854 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:14 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:14.854 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:14 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:14.856 INFO:tasks.workunit.client.0.smithi053.stdout:0/106: dread d4/f17 [0,4194304] 0 2024-09-16T00:50:14.856 INFO:tasks.workunit.client.0.smithi053.stdout:7/148: unlink d1/d3/d10/d14/d27/f25 0 2024-09-16T00:50:14.856 INFO:tasks.workunit.client.0.smithi053.stdout:0/107: readlink d4/dc/l1a 0 2024-09-16T00:50:14.856 INFO:tasks.workunit.client.0.smithi053.stdout:7/149: write d1/d3/f5 [8728266,46428] 0 2024-09-16T00:50:14.859 INFO:tasks.workunit.client.1.smithi152.stdout:7/549: rmdir d9/d10/da5 39 2024-09-16T00:50:14.859 INFO:tasks.workunit.client.1.smithi152.stdout:7/550: chown d9/d10/da5/ca7 0 1 2024-09-16T00:50:14.860 INFO:tasks.workunit.client.0.smithi053.stdout:9/176: dread f2 [0,4194304] 0 2024-09-16T00:50:14.860 INFO:tasks.workunit.client.0.smithi053.stdout:9/177: truncate d8/d13/f34 751572 0 2024-09-16T00:50:14.860 INFO:tasks.workunit.client.0.smithi053.stdout:9/178: dread - d8/d13/f29 zero size 2024-09-16T00:50:14.860 INFO:tasks.workunit.client.0.smithi053.stdout:3/207: dread d1/d5/f19 [0,4194304] 0 2024-09-16T00:50:14.860 INFO:tasks.workunit.client.0.smithi053.stdout:3/208: fdatasync d1/d5/d11/f25 0 2024-09-16T00:50:14.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/558: sync 2024-09-16T00:50:14.866 INFO:tasks.workunit.client.1.smithi152.stdout:1/621: rmdir d9/da/da2 39 2024-09-16T00:50:14.867 INFO:tasks.workunit.client.1.smithi152.stdout:8/387: write dd/f42 [3497577,38097] 0 2024-09-16T00:50:14.868 INFO:tasks.workunit.client.1.smithi152.stdout:6/526: dwrite db/d12/d23/d4a/f5a [0,4194304] 0 2024-09-16T00:50:14.868 INFO:tasks.workunit.client.0.smithi053.stdout:0/108: dread d4/f17 [0,4194304] 0 2024-09-16T00:50:14.868 INFO:tasks.workunit.client.0.smithi053.stdout:5/91: mknod d3/d7/d12/c16 0 2024-09-16T00:50:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:3/541: mknod dc/d10/cab 0 2024-09-16T00:50:14.871 INFO:tasks.workunit.client.0.smithi053.stdout:4/102: symlink d0/l1f 0 2024-09-16T00:50:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:5/705: rename d6/f30 to d6/d16/d1f/f10b 0 2024-09-16T00:50:14.873 INFO:tasks.workunit.client.0.smithi053.stdout:6/58: rmdir d1/dc/d11 39 2024-09-16T00:50:14.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/559: creat d3/d6/d6d/db7/fc0 x:0 0 0 2024-09-16T00:50:14.876 INFO:tasks.workunit.client.0.smithi053.stdout:8/216: creat d10/f4c x:0 0 0 2024-09-16T00:50:14.876 INFO:tasks.workunit.client.0.smithi053.stdout:8/217: read d10/d21/f30 [4005133,9072] 0 2024-09-16T00:50:14.876 INFO:tasks.workunit.client.0.smithi053.stdout:8/218: stat d10/d1c/c35 0 2024-09-16T00:50:14.876 INFO:tasks.workunit.client.0.smithi053.stdout:8/219: write d10/d21/d28/d3c/f45 [812175,129043] 0 2024-09-16T00:50:14.878 INFO:tasks.workunit.client.0.smithi053.stdout:0/109: write d4/f10 [2583164,91721] 0 2024-09-16T00:50:14.878 INFO:tasks.workunit.client.0.smithi053.stdout:0/110: write d4/dc/f1b [4584189,9060] 0 2024-09-16T00:50:14.880 INFO:tasks.workunit.client.0.smithi053.stdout:2/47: rename d6/d9/dc to d6/d9/dd 0 2024-09-16T00:50:14.880 INFO:tasks.workunit.client.0.smithi053.stdout:2/48: write d6/f7 [1109622,77548] 0 2024-09-16T00:50:14.882 INFO:tasks.workunit.client.0.smithi053.stdout:7/150: dwrite d1/d3/d10/f1e [0,4194304] 0 2024-09-16T00:50:14.883 INFO:tasks.workunit.client.0.smithi053.stdout:9/179: rmdir d8/d22 39 2024-09-16T00:50:14.885 INFO:tasks.workunit.client.0.smithi053.stdout:0/111: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:14.886 INFO:tasks.workunit.client.1.smithi152.stdout:5/706: dread d6/d57/d2b/d50/d66/f87 [0,4194304] 0 2024-09-16T00:50:14.886 INFO:tasks.workunit.client.1.smithi152.stdout:5/707: write d6/d57/d2b/fe8 [538497,9089] 0 2024-09-16T00:50:14.886 INFO:tasks.workunit.client.1.smithi152.stdout:7/551: dwrite d9/d31/d65/f69 [0,4194304] 0 2024-09-16T00:50:14.886 INFO:tasks.workunit.client.1.smithi152.stdout:7/552: creat d9/fbc x:0 0 0 2024-09-16T00:50:14.887 INFO:tasks.workunit.client.0.smithi053.stdout:3/209: rename d1/d5/d14/l1d to d1/d5/d31/d3b/l4a 0 2024-09-16T00:50:14.887 INFO:tasks.workunit.client.0.smithi053.stdout:3/210: truncate d1/d5/d31/f41 470596 0 2024-09-16T00:50:14.890 INFO:tasks.workunit.client.1.smithi152.stdout:6/527: creat db/d12/d1c/fa5 x:0 0 0 2024-09-16T00:50:14.890 INFO:tasks.workunit.client.1.smithi152.stdout:6/528: chown db/d12/d23/d4a/d43/d48/d6a/l7c 8080 1 2024-09-16T00:50:14.891 INFO:tasks.workunit.client.0.smithi053.stdout:4/103: mkdir d0/d2/d1d/d20 0 2024-09-16T00:50:14.891 INFO:tasks.workunit.client.0.smithi053.stdout:4/104: readlink d0/d17/l1a 0 2024-09-16T00:50:14.894 INFO:tasks.workunit.client.0.smithi053.stdout:6/59: symlink d1/dc/d11/l14 0 2024-09-16T00:50:14.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/388: creat dd/d15/d1a/f82 x:0 0 0 2024-09-16T00:50:14.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/389: read - dd/d50/d29/f80 zero size 2024-09-16T00:50:14.899 INFO:tasks.workunit.client.1.smithi152.stdout:3/542: mknod dc/d10/d17/d5a/d68/cac 0 2024-09-16T00:50:14.900 INFO:tasks.workunit.client.1.smithi152.stdout:3/543: chown dc/d10/d17/d1c/d8d/d8e/d3b 11495 1 2024-09-16T00:50:14.900 INFO:tasks.workunit.client.1.smithi152.stdout:3/544: dread - dc/d10/d17/d1c/d50/d55/d6d/f8b zero size 2024-09-16T00:50:14.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/560: rmdir d3/d6/d8/d1d/d23/d25/d45/d6f/da7 39 2024-09-16T00:50:14.903 INFO:tasks.workunit.client.1.smithi152.stdout:6/529: read db/d12/f1a [1347769,72386] 0 2024-09-16T00:50:14.903 INFO:tasks.workunit.client.1.smithi152.stdout:6/530: stat db/d12/d1c/l25 0 2024-09-16T00:50:14.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/622: getdents d9/da/df/dcb 0 2024-09-16T00:50:14.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/623: read - d9/da/df/dcb/fc7 zero size 2024-09-16T00:50:14.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/624: chown d9/da/df/dcb 1280 1 2024-09-16T00:50:14.910 INFO:tasks.workunit.client.1.smithi152.stdout:3/545: dread dc/d10/d17/f80 [4194304,4194304] 0 2024-09-16T00:50:14.910 INFO:tasks.workunit.client.1.smithi152.stdout:3/546: truncate dc/d10/d17/d1c/d1f/d22/f72 1516139 0 2024-09-16T00:50:14.912 INFO:tasks.workunit.client.0.smithi053.stdout:9/180: mknod d8/d22/d26/c38 0 2024-09-16T00:50:14.913 INFO:tasks.workunit.client.1.smithi152.stdout:3/547: dread dc/d10/d17/d1c/d1f/d24/f85 [0,4194304] 0 2024-09-16T00:50:14.913 INFO:tasks.workunit.client.1.smithi152.stdout:3/548: chown dc/d10/d17/d1c/d8d/d8e/d2f 1 1 2024-09-16T00:50:14.916 INFO:tasks.workunit.client.1.smithi152.stdout:5/708: rename d6/d57/d2b/d50/c8e to d6/d57/d2b/d50/d66/df1/c10c 0 2024-09-16T00:50:14.919 INFO:tasks.workunit.client.1.smithi152.stdout:7/553: creat d9/d10/da5/fbd x:0 0 0 2024-09-16T00:50:14.921 INFO:tasks.workunit.client.1.smithi152.stdout:8/390: link dd/d15/f5a dd/d25/f83 0 2024-09-16T00:50:14.921 INFO:tasks.workunit.client.1.smithi152.stdout:8/391: chown dd/d15/d49 163825 1 2024-09-16T00:50:14.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/561: symlink d3/d6/d2e/lc1 0 2024-09-16T00:50:14.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/562: fsync d3/d6/d64/f95 0 2024-09-16T00:50:14.925 INFO:tasks.workunit.client.1.smithi152.stdout:6/531: rmdir db/d12/d23/d4a/d43/d48/d6a 39 2024-09-16T00:50:14.925 INFO:tasks.workunit.client.1.smithi152.stdout:6/532: write f9 [1005031,44061] 0 2024-09-16T00:50:14.925 INFO:tasks.workunit.client.1.smithi152.stdout:6/533: chown db/d12/d1c/f5c 3 1 2024-09-16T00:50:14.926 INFO:tasks.workunit.client.0.smithi053.stdout:5/92: mknod d3/c17 0 2024-09-16T00:50:14.928 INFO:tasks.workunit.client.1.smithi152.stdout:1/625: read d9/da/fd1 [97635,56120] 0 2024-09-16T00:50:14.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/105: creat d0/d17/f21 x:0 0 0 2024-09-16T00:50:14.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/106: chown d0/d17/f21 168259536 1 2024-09-16T00:50:14.931 INFO:tasks.workunit.client.0.smithi053.stdout:2/49: dwrite f5 [0,4194304] 0 2024-09-16T00:50:14.932 INFO:tasks.workunit.client.1.smithi152.stdout:5/709: mkdir d6/d16/d10d 0 2024-09-16T00:50:14.937 INFO:tasks.workunit.client.1.smithi152.stdout:7/554: link d9/d31/d64/d3c/d5b/f7a d9/d31/fbe 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:0/112: dwrite d4/f17 [0,4194304] 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:0/113: readlink d4/dc/l1a 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:6/60: dwrite d1/f5 [0,4194304] 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:7/151: dwrite d1/d3/d10/d14/d27/f30 [0,4194304] 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:9/181: dwrite f4 [0,4194304] 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:9/182: readlink d8/d13/l28 0 2024-09-16T00:50:14.938 INFO:tasks.workunit.client.0.smithi053.stdout:9/183: stat d8/ce 0 2024-09-16T00:50:14.939 INFO:tasks.workunit.client.0.smithi053.stdout:9/184: stat d8/f35 0 2024-09-16T00:50:14.939 INFO:tasks.workunit.client.0.smithi053.stdout:3/211: rmdir d1/d5/d31 39 2024-09-16T00:50:14.939 INFO:tasks.workunit.client.1.smithi152.stdout:0/563: mkdir d3/d6/d4e/dc2 0 2024-09-16T00:50:14.940 INFO:tasks.workunit.client.0.smithi053.stdout:4/107: rename d0/l11 to d0/l22 0 2024-09-16T00:50:14.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/564: dread d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad [0,4194304] 0 2024-09-16T00:50:14.941 INFO:tasks.workunit.client.0.smithi053.stdout:4/108: write d0/d2/dd/f1c [89250,41528] 0 2024-09-16T00:50:14.941 INFO:tasks.workunit.client.0.smithi053.stdout:4/109: fsync d0/f5 0 2024-09-16T00:50:14.941 INFO:tasks.workunit.client.0.smithi053.stdout:4/110: creat d0/d2/f23 x:0 0 0 2024-09-16T00:50:14.941 INFO:tasks.workunit.client.0.smithi053.stdout:4/111: creat d0/d17/f24 x:0 0 0 2024-09-16T00:50:14.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/626: rename d9/da/df/f1e to d9/d3e/d41/d31/d48/d7d/fe9 0 2024-09-16T00:50:14.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/627: chown d9/d3e/d41/d31/d38/cab 873969030 1 2024-09-16T00:50:14.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/710: mkdir d6/d16/d10d/d10e 0 2024-09-16T00:50:14.950 INFO:tasks.workunit.client.0.smithi053.stdout:2/50: rename f1 to d6/d9/fe 0 2024-09-16T00:50:14.950 INFO:tasks.workunit.client.0.smithi053.stdout:2/51: chown d6/f7 0 1 2024-09-16T00:50:14.953 INFO:tasks.workunit.client.1.smithi152.stdout:0/565: write d3/d6/d64/d6a/fb3 [8192127,79216] 0 2024-09-16T00:50:14.953 INFO:tasks.workunit.client.1.smithi152.stdout:0/566: readlink d3/d6/d2e/l39 0 2024-09-16T00:50:14.954 INFO:tasks.workunit.client.1.smithi152.stdout:9/521: sync 2024-09-16T00:50:14.954 INFO:tasks.workunit.client.1.smithi152.stdout:4/658: sync 2024-09-16T00:50:14.954 INFO:tasks.workunit.client.1.smithi152.stdout:2/498: sync 2024-09-16T00:50:14.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/555: truncate d9/d10/f36 314133 0 2024-09-16T00:50:14.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/534: dwrite f2 [0,4194304] 0 2024-09-16T00:50:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:8/392: dwrite f3 [0,4194304] 0 2024-09-16T00:50:14.964 INFO:tasks.workunit.client.0.smithi053.stdout:5/93: dwrite d3/f8 [4194304,4194304] 0 2024-09-16T00:50:14.964 INFO:tasks.workunit.client.0.smithi053.stdout:5/94: stat d3/f9 0 2024-09-16T00:50:14.966 INFO:tasks.workunit.client.1.smithi152.stdout:9/522: rename d1/f89 to d1/d4e/d48/d26/d58/faa 0 2024-09-16T00:50:14.971 INFO:tasks.workunit.client.1.smithi152.stdout:7/556: symlink d9/d31/d64/lbf 0 2024-09-16T00:50:14.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/628: link d9/da/df/dcb/fd0 d9/da/df/fea 0 2024-09-16T00:50:14.975 INFO:tasks.workunit.client.0.smithi053.stdout:4/112: dwrite d0/f15 [0,4194304] 0 2024-09-16T00:50:14.975 INFO:tasks.workunit.client.0.smithi053.stdout:9/185: getdents d8/d19/d31 0 2024-09-16T00:50:14.979 INFO:tasks.workunit.client.1.smithi152.stdout:6/535: rename db/f45 to db/d12/d20/d86/d91/fa6 0 2024-09-16T00:50:14.979 INFO:tasks.workunit.client.1.smithi152.stdout:6/536: stat db/d12/d23/d4a/d43/d48/f53 0 2024-09-16T00:50:14.980 INFO:tasks.workunit.client.0.smithi053.stdout:3/212: creat d1/d5/d16/d47/f4b x:0 0 0 2024-09-16T00:50:14.980 INFO:tasks.workunit.client.0.smithi053.stdout:5/95: dread d3/f8 [4194304,4194304] 0 2024-09-16T00:50:14.981 INFO:tasks.workunit.client.1.smithi152.stdout:9/523: rmdir d1/d7/d77/d3c 39 2024-09-16T00:50:14.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/659: dwrite d2/db/d39/d3c/d7f/d98/f74 [0,4194304] 0 2024-09-16T00:50:14.986 INFO:tasks.workunit.client.1.smithi152.stdout:5/711: dwrite d6/d16/d1f/d65/fe1 [0,4194304] 0 2024-09-16T00:50:14.991 INFO:tasks.workunit.client.1.smithi152.stdout:1/629: link d9/da/df/f27 d9/d3e/d4b/d6b/d6d/d97/feb 0 2024-09-16T00:50:14.993 INFO:tasks.workunit.client.0.smithi053.stdout:6/61: getdents d1 0 2024-09-16T00:50:14.994 INFO:tasks.workunit.client.1.smithi152.stdout:0/567: dwrite d3/d6/d64/d6a/fb3 [0,4194304] 0 2024-09-16T00:50:14.994 INFO:tasks.workunit.client.1.smithi152.stdout:2/499: dwrite d4/d17/f3b [0,4194304] 0 2024-09-16T00:50:14.995 INFO:tasks.workunit.client.1.smithi152.stdout:6/537: mknod db/d12/d1c/ca7 0 2024-09-16T00:50:14.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/213: mkdir d1/d5/d16/d47/d4c 0 2024-09-16T00:50:14.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/214: creat d1/d5/d16/f4d x:0 0 0 2024-09-16T00:50:15.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/660: rename d2/db/d39/d3c/c7e to d2/db/d39/d3c/d76/db4/cdc 0 2024-09-16T00:50:15.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/557: mkdir d9/d10/dc0 0 2024-09-16T00:50:15.008 INFO:tasks.workunit.client.0.smithi053.stdout:6/62: creat d1/f15 x:0 0 0 2024-09-16T00:50:15.008 INFO:tasks.workunit.client.0.smithi053.stdout:6/63: dread - d1/f15 zero size 2024-09-16T00:50:15.009 INFO:tasks.workunit.client.1.smithi152.stdout:1/630: symlink d9/d3e/d41/d31/d48/d4a/dc1/lec 0 2024-09-16T00:50:15.010 INFO:tasks.workunit.client.0.smithi053.stdout:3/215: dread d1/d5/f40 [0,4194304] 0 2024-09-16T00:50:15.010 INFO:tasks.workunit.client.0.smithi053.stdout:3/216: chown d1/d5/l9 1 1 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/217: write d1/d5/d14/f3c [866829,72385] 0 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/218: getdents d1/d5/d31/d42 0 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/219: dread - d1/d5/d16/d47/f4b zero size 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/220: write d1/d5/d14/f18 [5206955,103471] 0 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:5/96: symlink d3/l18 0 2024-09-16T00:50:15.011 INFO:tasks.workunit.client.0.smithi053.stdout:5/97: creat d3/d7/d12/f19 x:0 0 0 2024-09-16T00:50:15.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/538: mkdir db/da8 0 2024-09-16T00:50:15.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/539: read db/d28/f3c [891185,46408] 0 2024-09-16T00:50:15.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/540: readlink db/d12/d23/d4a/l4f 0 2024-09-16T00:50:15.013 INFO:tasks.workunit.client.1.smithi152.stdout:5/712: dwrite d6/d57/d54/fde [0,4194304] 0 2024-09-16T00:50:15.013 INFO:tasks.workunit.client.1.smithi152.stdout:9/524: dwrite d1/d59/f2f [0,4194304] 0 2024-09-16T00:50:15.017 INFO:tasks.workunit.client.1.smithi152.stdout:6/541: dread db/d12/d20/d86/d91/fa6 [4194304,4194304] 0 2024-09-16T00:50:15.017 INFO:tasks.workunit.client.1.smithi152.stdout:6/542: write db/d12/d23/d4a/d43/d48/f9e [502674,85234] 0 2024-09-16T00:50:15.018 INFO:tasks.workunit.client.0.smithi053.stdout:3/221: dread d1/d5/f6 [4194304,4194304] 0 2024-09-16T00:50:15.019 INFO:tasks.workunit.client.0.smithi053.stdout:7/152: rename d1/d3/d10 to d1/d35 0 2024-09-16T00:50:15.020 INFO:tasks.workunit.client.0.smithi053.stdout:2/52: rename d6 to d6/d9/dd/df 22 2024-09-16T00:50:15.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/525: read d1/d7/d13/d5d/f6b [902706,90920] 0 2024-09-16T00:50:15.027 INFO:tasks.workunit.client.0.smithi053.stdout:2/53: dread f0 [0,4194304] 0 2024-09-16T00:50:15.028 INFO:tasks.workunit.client.1.smithi152.stdout:2/500: rename d4/l4a to d4/d19/d94/d93/lab 0 2024-09-16T00:50:15.029 INFO:tasks.workunit.client.1.smithi152.stdout:4/661: mknod d2/d1e/d28/d69/cdd 0 2024-09-16T00:50:15.034 INFO:tasks.workunit.client.1.smithi152.stdout:7/558: unlink d9/f1f 0 2024-09-16T00:50:15.048 INFO:tasks.workunit.client.1.smithi152.stdout:2/501: dwrite d4/d19/f72 [0,4194304] 0 2024-09-16T00:50:15.085 INFO:tasks.workunit.client.1.smithi152.stdout:1/631: creat d9/d3e/d4b/d6b/d6d/d82/fed x:0 0 0 2024-09-16T00:50:15.089 INFO:tasks.workunit.client.1.smithi152.stdout:0/568: getdents d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98 0 2024-09-16T00:50:15.098 INFO:tasks.workunit.client.1.smithi152.stdout:5/713: mkdir d6/d16/d1f/d6c/de2/d10f 0 2024-09-16T00:50:15.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/543: mknod db/d12/d23/d4a/d43/d48/ca9 0 2024-09-16T00:50:15.105 INFO:tasks.workunit.client.1.smithi152.stdout:0/569: dwrite d3/d6/d8/d1d/d65/d6e/d82/f91 [0,4194304] 0 2024-09-16T00:50:15.105 INFO:tasks.workunit.client.1.smithi152.stdout:0/570: chown d3/d6/d8/f3d 4 1 2024-09-16T00:50:15.107 INFO:tasks.workunit.client.0.smithi053.stdout:2/54: creat d6/d9/dd/f10 x:0 0 0 2024-09-16T00:50:15.111 INFO:tasks.workunit.client.1.smithi152.stdout:9/526: link d1/d4e/d34/f84 d1/d4e/d48/d2b/d93/d96/fab 0 2024-09-16T00:50:15.111 INFO:tasks.workunit.client.1.smithi152.stdout:9/527: dread - d1/d4e/d48/d2b/d93/fa7 zero size 2024-09-16T00:50:15.112 INFO:tasks.workunit.client.0.smithi053.stdout:2/55: dread d6/d9/fe [0,4194304] 0 2024-09-16T00:50:15.123 INFO:tasks.workunit.client.0.smithi053.stdout:5/98: rmdir d3/d7/d12 39 2024-09-16T00:50:15.143 INFO:tasks.workunit.client.1.smithi152.stdout:2/502: truncate d4/d44/f96 3989440 0 2024-09-16T00:50:15.151 INFO:tasks.workunit.client.1.smithi152.stdout:2/503: write d4/d17/d3e/f4b [3102271,110613] 0 2024-09-16T00:50:15.151 INFO:tasks.workunit.client.1.smithi152.stdout:2/504: write d4/f9 [4195462,13961] 0 2024-09-16T00:50:15.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/505: dread d4/d19/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:15.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/506: truncate d4/f9 4759286 0 2024-09-16T00:50:15.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/507: dwrite d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:15.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/508: write d4/d17/f1d [254228,106967] 0 2024-09-16T00:50:15.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/56: rmdir d6/d9 39 2024-09-16T00:50:15.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/57: write d6/d9/dd/f10 [587554,24039] 0 2024-09-16T00:50:15.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/99: symlink d3/d7/d12/l1a 0 2024-09-16T00:50:15.181 INFO:tasks.workunit.client.0.smithi053.stdout:5/100: fsync d3/f13 0 2024-09-16T00:50:15.193 INFO:tasks.workunit.client.0.smithi053.stdout:5/101: creat d3/f1b x:0 0 0 2024-09-16T00:50:15.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:14 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:15.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:14 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:15.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:14 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:15.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:14 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:15.197 INFO:tasks.workunit.client.0.smithi053.stdout:4/113: rename d0/d17 to d0/d2/dd/d25 0 2024-09-16T00:50:15.199 INFO:tasks.workunit.client.0.smithi053.stdout:5/102: creat d3/f1c x:0 0 0 2024-09-16T00:50:15.206 INFO:tasks.workunit.client.0.smithi053.stdout:4/114: rename d0/d2/d1d/d20 to d0/d2/d26 0 2024-09-16T00:50:15.211 INFO:tasks.workunit.client.0.smithi053.stdout:5/103: mknod d3/d7/d12/c1d 0 2024-09-16T00:50:15.221 INFO:tasks.workunit.client.0.smithi053.stdout:4/115: mknod d0/da/c27 0 2024-09-16T00:50:15.221 INFO:tasks.workunit.client.0.smithi053.stdout:4/116: creat d0/d2/f28 x:0 0 0 2024-09-16T00:50:15.221 INFO:tasks.workunit.client.0.smithi053.stdout:4/117: chown d0/d2/d1e 1 1 2024-09-16T00:50:15.226 INFO:tasks.workunit.client.0.smithi053.stdout:5/104: rmdir d3/d7/d12 39 2024-09-16T00:50:15.239 INFO:tasks.workunit.client.0.smithi053.stdout:4/118: link d0/l22 d0/l29 0 2024-09-16T00:50:15.243 INFO:tasks.workunit.client.0.smithi053.stdout:2/58: rmdir d6/d9/dd 39 2024-09-16T00:50:15.243 INFO:tasks.workunit.client.0.smithi053.stdout:5/105: dwrite d3/f8 [4194304,4194304] 0 2024-09-16T00:50:15.244 INFO:tasks.workunit.client.0.smithi053.stdout:2/59: write d6/f8 [4234690,117254] 0 2024-09-16T00:50:15.246 INFO:tasks.workunit.client.0.smithi053.stdout:6/64: rename d1/f2 to d1/dc/d11/f16 0 2024-09-16T00:50:15.246 INFO:tasks.workunit.client.0.smithi053.stdout:6/65: dread - d1/dc/f12 zero size 2024-09-16T00:50:15.246 INFO:tasks.workunit.client.0.smithi053.stdout:6/66: dread - d1/dc/f12 zero size 2024-09-16T00:50:15.246 INFO:tasks.workunit.client.0.smithi053.stdout:6/67: chown d1/dc/d11 251 1 2024-09-16T00:50:15.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 -- 172.21.15.53:0/3387512228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 msgr2=0x7f8a700ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 --2- 172.21.15.53:0/3387512228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a700ff560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009910 tx=0x7f8a60009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 -- 172.21.15.53:0/3387512228 shutdown_connections 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 --2- 172.21.15.53:0/3387512228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a70100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 --2- 172.21.15.53:0/3387512228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a700ff560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 -- 172.21.15.53:0/3387512228 >> 172.21.15.53:0/3387512228 conn(0x7f8a700fa7a0 msgr2=0x7f8a700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.260+0000 7f8a75a97700 1 -- 172.21.15.53:0/3387512228 shutdown_connections 2024-09-16T00:50:15.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.261+0000 7f8a75a97700 1 -- 172.21.15.53:0/3387512228 wait complete. 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 Processor -- start 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 -- start start 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a7019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7019cd80 con 0x7f8a701003f0 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a75a97700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7019cec0 con 0x7f8a700ff150 2024-09-16T00:50:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:56730/0 (socket says 172.21.15.53:56730) 2024-09-16T00:50:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.262+0000 7f8a6f7fe700 1 -- 172.21.15.53:0/2027059052 learned_addr learned my addr 172.21.15.53:0/2027059052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6effd700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a7019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6f7fe700 1 -- 172.21.15.53:0/2027059052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 msgr2=0x7f8a7019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6f7fe700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a7019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6f7fe700 1 -- 172.21.15.53:0/2027059052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009520 con 0x7f8a700ff150 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6effd700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a7019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.263+0000 7f8a6f7fe700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a60006010 tx=0x7f8a6000f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.264+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6001d070 con 0x7f8a700ff150 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.264+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a6000b5a0 con 0x7f8a700ff150 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.264+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600095f0 con 0x7f8a700ff150 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.264+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7006ac10 con 0x7f8a700ff150 2024-09-16T00:50:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.264+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a60017630 con 0x7f8a700ff150 2024-09-16T00:50:15.267 INFO:tasks.workunit.client.0.smithi053.stdout:2/60: link d6/f7 d6/f11 0 2024-09-16T00:50:15.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.265+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 46602+0+0 (secure 0 0 0) 0x7f8a60017860 con 0x7f8a700ff150 2024-09-16T00:50:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.265+0000 7f8a6cff9700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 0x7f8a5803ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.265+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f8a6004fda0 con 0x7f8a700ff150 2024-09-16T00:50:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.265+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c005320 con 0x7f8a700ff150 2024-09-16T00:50:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.265+0000 7f8a6effd700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 0x7f8a5803ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.266+0000 7f8a6effd700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 0x7f8a5803ba50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a64009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:15.272 INFO:tasks.workunit.client.0.smithi053.stdout:5/106: symlink d3/l1e 0 2024-09-16T00:50:15.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.271+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f8a60020370 con 0x7f8a700ff150 2024-09-16T00:50:15.277 INFO:tasks.workunit.client.0.smithi053.stdout:2/61: creat d6/d9/f12 x:0 0 0 2024-09-16T00:50:15.281 INFO:tasks.workunit.client.1.smithi152.stdout:1/632: unlink d9/d3e/d4b/db7/dc4/fe0 0 2024-09-16T00:50:15.283 INFO:tasks.workunit.client.0.smithi053.stdout:6/68: mknod d1/c17 0 2024-09-16T00:50:15.285 INFO:tasks.workunit.client.1.smithi152.stdout:5/714: stat d6/d16/d1f/c26 0 2024-09-16T00:50:15.287 INFO:tasks.workunit.client.0.smithi053.stdout:5/107: rename d3/f1c to d3/d7/f1f 0 2024-09-16T00:50:15.289 INFO:tasks.workunit.client.1.smithi152.stdout:6/544: rename db/d12/d23/d4a/d43/d48/f53 to db/d12/d20/d86/faa 0 2024-09-16T00:50:15.291 INFO:tasks.workunit.client.0.smithi053.stdout:6/69: creat d1/dc/f18 x:0 0 0 2024-09-16T00:50:15.294 INFO:tasks.workunit.client.0.smithi053.stdout:2/62: dwrite d6/d9/fe [0,4194304] 0 2024-09-16T00:50:15.294 INFO:tasks.workunit.client.0.smithi053.stdout:5/108: creat d3/f20 x:0 0 0 2024-09-16T00:50:15.297 INFO:tasks.workunit.client.1.smithi152.stdout:0/571: creat d3/d6/d8/d1d/d65/db0/db6/fc3 x:0 0 0 2024-09-16T00:50:15.297 INFO:tasks.workunit.client.1.smithi152.stdout:0/572: chown d3/d6/d8/d1d/d23/c86 7005392 1 2024-09-16T00:50:15.297 INFO:tasks.workunit.client.1.smithi152.stdout:0/573: write d3/d6/d8/ff [2353776,77208] 0 2024-09-16T00:50:15.306 INFO:tasks.workunit.client.1.smithi152.stdout:6/545: dwrite db/d12/d23/d4a/d43/d48/f7f [0,4194304] 0 2024-09-16T00:50:15.307 INFO:tasks.workunit.client.1.smithi152.stdout:7/559: link d9/d31/c38 d9/d10/cc1 0 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:5/109: creat d3/d7/d12/f21 x:0 0 0 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:5/110: chown d3/d7/f1f 0 1 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:5/111: rename d3/d7 to d3/d7/d22 22 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:5/112: creat d3/d7/d12/f23 x:0 0 0 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:2/63: dread d6/d9/dd/f10 [0,4194304] 0 2024-09-16T00:50:15.309 INFO:tasks.workunit.client.0.smithi053.stdout:2/64: write f0 [980809,93647] 0 2024-09-16T00:50:15.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/509: creat d4/d19/d20/d9d/fac x:0 0 0 2024-09-16T00:50:15.319 INFO:tasks.workunit.client.1.smithi152.stdout:5/715: symlink d6/d16/d1f/d8c/l110 0 2024-09-16T00:50:15.320 INFO:tasks.workunit.client.1.smithi152.stdout:0/574: dwrite d3/d6/d8/d1d/d23/d25/d45/f5f [4194304,4194304] 0 2024-09-16T00:50:15.320 INFO:tasks.workunit.client.0.smithi053.stdout:6/70: dwrite d1/dc/d11/f16 [0,4194304] 0 2024-09-16T00:50:15.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/393: sync 2024-09-16T00:50:15.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/394: fsync dd/d23/f55 0 2024-09-16T00:50:15.326 INFO:tasks.workunit.client.1.smithi152.stdout:3/549: sync 2024-09-16T00:50:15.326 INFO:tasks.workunit.client.1.smithi152.stdout:3/550: stat dc/d10/d17/d5a/d68/f7c 0 2024-09-16T00:50:15.326 INFO:tasks.workunit.client.1.smithi152.stdout:1/633: dread d9/da/f1d [0,4194304] 0 2024-09-16T00:50:15.328 INFO:tasks.workunit.client.0.smithi053.stdout:2/65: dwrite d6/d9/f12 [0,4194304] 0 2024-09-16T00:50:15.331 INFO:tasks.workunit.client.1.smithi152.stdout:6/546: mkdir db/d12/d23/d4a/d43/d48/d64/dab 0 2024-09-16T00:50:15.333 INFO:tasks.workunit.client.0.smithi053.stdout:5/113: dwrite d3/f1b [0,4194304] 0 2024-09-16T00:50:15.333 INFO:tasks.workunit.client.1.smithi152.stdout:7/560: getdents d9/d31/d64/d3c/d5b 0 2024-09-16T00:50:15.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/528: rename d1/d4e/d48/f3d to d1/d7/d77/d32/da5/da8/fac 0 2024-09-16T00:50:15.343 INFO:tasks.workunit.client.0.smithi053.stdout:5/114: dread d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:15.344 INFO:tasks.workunit.client.0.smithi053.stdout:6/71: truncate d1/ff 294878 0 2024-09-16T00:50:15.352 INFO:tasks.workunit.client.1.smithi152.stdout:3/551: creat dc/d10/d17/d1c/d8d/d8e/d2f/d46/d77/fad x:0 0 0 2024-09-16T00:50:15.353 INFO:tasks.workunit.client.1.smithi152.stdout:5/716: dread d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:15.354 INFO:tasks.workunit.client.0.smithi053.stdout:2/66: link c2 d6/c13 0 2024-09-16T00:50:15.356 INFO:tasks.workunit.client.0.smithi053.stdout:5/115: mkdir d3/d7/d24 0 2024-09-16T00:50:15.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/561: dwrite f2 [0,4194304] 0 2024-09-16T00:50:15.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/562: fsync d9/f93 0 2024-09-16T00:50:15.358 INFO:tasks.workunit.client.0.smithi053.stdout:2/67: mkdir d6/d9/d14 0 2024-09-16T00:50:15.362 INFO:tasks.workunit.client.1.smithi152.stdout:1/634: creat d9/d3e/d4b/d50/fee x:0 0 0 2024-09-16T00:50:15.362 INFO:tasks.workunit.client.1.smithi152.stdout:1/635: fdatasync d9/d3e/d4b/d6b/d6d/d82/f8e 0 2024-09-16T00:50:15.363 INFO:tasks.workunit.client.0.smithi053.stdout:6/72: dwrite d1/f15 [0,4194304] 0 2024-09-16T00:50:15.366 INFO:tasks.workunit.client.0.smithi053.stdout:2/68: rename d6/f11 to d6/d9/d14/f15 0 2024-09-16T00:50:15.374 INFO:tasks.workunit.client.1.smithi152.stdout:9/529: creat d1/d7/d13/fad x:0 0 0 2024-09-16T00:50:15.375 INFO:tasks.workunit.client.0.smithi053.stdout:6/73: symlink d1/dc/d11/l19 0 2024-09-16T00:50:15.378 INFO:tasks.workunit.client.1.smithi152.stdout:2/510: rmdir d4/d44/d7a 39 2024-09-16T00:50:15.378 INFO:tasks.workunit.client.1.smithi152.stdout:2/511: dread - d4/d19/d94/d93/f99 zero size 2024-09-16T00:50:15.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/552: mkdir dc/d5c/dae 0 2024-09-16T00:50:15.384 INFO:tasks.workunit.client.1.smithi152.stdout:3/553: dread dc/d10/d17/d1c/d8d/d8e/d3b/f57 [0,4194304] 0 2024-09-16T00:50:15.385 INFO:tasks.workunit.client.1.smithi152.stdout:5/717: mknod d6/d57/c111 0 2024-09-16T00:50:15.385 INFO:tasks.workunit.client.1.smithi152.stdout:5/718: stat d6/d57/f3c 0 2024-09-16T00:50:15.386 INFO:tasks.workunit.client.0.smithi053.stdout:4/119: getdents d0/d2/d1d 0 2024-09-16T00:50:15.386 INFO:tasks.workunit.client.1.smithi152.stdout:9/530: dread d1/f31 [0,4194304] 0 2024-09-16T00:50:15.387 INFO:tasks.workunit.client.1.smithi152.stdout:9/531: chown d1/d4e/d48/d26/d58/la1 270270 1 2024-09-16T00:50:15.389 INFO:tasks.workunit.client.1.smithi152.stdout:7/563: dwrite d9/d31/d64/d3c/d5b/f7a [4194304,4194304] 0 2024-09-16T00:50:15.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/564: dread - d9/d31/d65/d8a/d41/d46/fa2 zero size 2024-09-16T00:50:15.390 INFO:tasks.workunit.client.1.smithi152.stdout:1/636: dwrite d9/da/fd1 [0,4194304] 0 2024-09-16T00:50:15.390 INFO:tasks.workunit.client.0.smithi053.stdout:5/116: dwrite d3/d7/f1f [0,4194304] 0 2024-09-16T00:50:15.391 INFO:tasks.workunit.client.0.smithi053.stdout:4/120: symlink d0/d2/d1d/l2a 0 2024-09-16T00:50:15.391 INFO:tasks.workunit.client.0.smithi053.stdout:6/74: write d1/f5 [295508,73259] 0 2024-09-16T00:50:15.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/512: creat d4/d44/d7a/d9e/d87/d9c/fad x:0 0 0 2024-09-16T00:50:15.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/513: read d4/f9 [4138515,62614] 0 2024-09-16T00:50:15.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/514: chown d4/d19/f4f 995 1 2024-09-16T00:50:15.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/515: creat d4/d44/d7a/d9e/d87/d9c/fae x:0 0 0 2024-09-16T00:50:15.396 INFO:tasks.workunit.client.1.smithi152.stdout:2/516: write d4/d19/d94/d8f/f91 [39499,35506] 0 2024-09-16T00:50:15.397 INFO:tasks.workunit.client.1.smithi152.stdout:1/637: dread d9/faf [0,4194304] 0 2024-09-16T00:50:15.397 INFO:tasks.workunit.client.1.smithi152.stdout:1/638: write d9/d3e/d41/d31/d48/d4a/f93 [4384973,47256] 0 2024-09-16T00:50:15.400 INFO:tasks.workunit.client.0.smithi053.stdout:5/117: mkdir d3/d7/d12/d25 0 2024-09-16T00:50:15.402 INFO:tasks.workunit.client.1.smithi152.stdout:5/719: symlink d6/d57/d54/l112 0 2024-09-16T00:50:15.402 INFO:tasks.workunit.client.1.smithi152.stdout:5/720: chown d6/d16/caf 15964081 1 2024-09-16T00:50:15.405 INFO:tasks.workunit.client.1.smithi152.stdout:5/721: dread d6/d57/d2b/f4e [0,4194304] 0 2024-09-16T00:50:15.405 INFO:tasks.workunit.client.1.smithi152.stdout:5/722: chown d6/d57/c3a 29 1 2024-09-16T00:50:15.405 INFO:tasks.workunit.client.1.smithi152.stdout:5/723: readlink d6/d57/d2b/d50/d6e/ldf 0 2024-09-16T00:50:15.405 INFO:tasks.workunit.client.1.smithi152.stdout:5/724: chown d6/f40 1017 1 2024-09-16T00:50:15.406 INFO:tasks.workunit.client.0.smithi053.stdout:4/121: rename d0/da/fe to d0/d2/d26/f2b 0 2024-09-16T00:50:15.409 INFO:tasks.workunit.client.1.smithi152.stdout:9/532: link d1/d4e/d48/d2b/d7c/c85 d1/d4e/d48/d26/d30/d4f/d50/d83/cae 0 2024-09-16T00:50:15.417 INFO:tasks.workunit.client.1.smithi152.stdout:8/395: creat dd/d50/d29/f84 x:0 0 0 2024-09-16T00:50:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/725: dwrite d6/fb [0,4194304] 0 2024-09-16T00:50:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/726: chown d6/d57/d54/l112 49 1 2024-09-16T00:50:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/727: chown d6/d57/d2b/d50/d64/df5/ffc 13991 1 2024-09-16T00:50:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:2/517: creat d4/d44/d7a/d9e/faf x:0 0 0 2024-09-16T00:50:15.425 INFO:tasks.workunit.client.0.smithi053.stdout:5/118: mknod d3/c26 0 2024-09-16T00:50:15.427 INFO:tasks.workunit.client.0.smithi053.stdout:4/122: rmdir d0/d2/dd 39 2024-09-16T00:50:15.429 INFO:tasks.workunit.client.1.smithi152.stdout:9/533: rename d1/d7/d77/d68/ca0 to d1/caf 0 2024-09-16T00:50:15.429 INFO:tasks.workunit.client.1.smithi152.stdout:9/534: truncate d1/d7/d77/fa3 917197 0 2024-09-16T00:50:15.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/396: rename dd/d25/f83 to dd/d25/f85 0 2024-09-16T00:50:15.438 INFO:tasks.workunit.client.1.smithi152.stdout:2/518: dwrite d4/d19/d94/d93/f99 [0,4194304] 0 2024-09-16T00:50:15.441 INFO:tasks.workunit.client.0.smithi053.stdout:4/123: unlink d0/d2/l19 0 2024-09-16T00:50:15.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/728: rename d6/l59 to d6/l113 0 2024-09-16T00:50:15.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/729: rename d6/d57/d2b/d50/d64/df5/d10a to d6/d57/d2b/d50/d64/df5/d10a/d114 22 2024-09-16T00:50:15.445 INFO:tasks.workunit.client.1.smithi152.stdout:1/639: getdents d9/d3e/d41/d31/d38 0 2024-09-16T00:50:15.445 INFO:tasks.workunit.client.1.smithi152.stdout:1/640: creat d9/fef x:0 0 0 2024-09-16T00:50:15.449 INFO:tasks.workunit.client.0.smithi053.stdout:4/124: unlink d0/d2/dd/f1c 0 2024-09-16T00:50:15.449 INFO:tasks.workunit.client.0.smithi053.stdout:4/125: write d0/d2/f23 [497368,96426] 0 2024-09-16T00:50:15.449 INFO:tasks.workunit.client.0.smithi053.stdout:4/126: fdatasync d0/d2/dd/f13 0 2024-09-16T00:50:15.449 INFO:tasks.workunit.client.0.smithi053.stdout:4/127: write d0/d2/dd/d25/f24 [670221,93589] 0 2024-09-16T00:50:15.450 INFO:tasks.workunit.client.1.smithi152.stdout:8/397: dwrite dd/d15/d1a/f3a [0,4194304] 0 2024-09-16T00:50:15.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/535: rmdir d1/d4e/d48/d26/d30/d4f/d50 39 2024-09-16T00:50:15.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/730: write d6/f32 [1701229,13408] 0 2024-09-16T00:50:15.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/731: dread - d6/d57/d2b/d50/d64/f6f zero size 2024-09-16T00:50:15.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/732: chown d6/d57/f7a 5692 1 2024-09-16T00:50:15.455 INFO:tasks.workunit.client.0.smithi053.stdout:4/128: creat d0/d2/d26/f2c x:0 0 0 2024-09-16T00:50:15.455 INFO:tasks.workunit.client.0.smithi053.stdout:4/129: readlink d0/l1f 0 2024-09-16T00:50:15.459 INFO:tasks.workunit.client.1.smithi152.stdout:8/398: write dd/d50/d29/d2f/d53/f65 [4190117,68705] 0 2024-09-16T00:50:15.459 INFO:tasks.workunit.client.1.smithi152.stdout:8/399: fsync dd/d50/d29/d2f/d5f/f7f 0 2024-09-16T00:50:15.461 INFO:tasks.workunit.client.1.smithi152.stdout:2/519: creat d4/d19/d20/d28/d2c/d77/da7/fb0 x:0 0 0 2024-09-16T00:50:15.465 INFO:tasks.workunit.client.1.smithi152.stdout:9/536: dwrite d1/d4e/d34/f84 [4194304,4194304] 0 2024-09-16T00:50:15.465 INFO:tasks.workunit.client.1.smithi152.stdout:9/537: chown d1/d7/d77/d32 28084748 1 2024-09-16T00:50:15.466 INFO:tasks.workunit.client.1.smithi152.stdout:1/641: unlink d9/d3e/d41/d31/d48/c4f 0 2024-09-16T00:50:15.466 INFO:tasks.workunit.client.1.smithi152.stdout:1/642: write d9/d3e/d41/f87 [1562334,123509] 0 2024-09-16T00:50:15.477 INFO:tasks.workunit.client.1.smithi152.stdout:9/538: dread d1/f44 [0,4194304] 0 2024-09-16T00:50:15.477 INFO:tasks.workunit.client.1.smithi152.stdout:9/539: truncate d1/d7/f99 1148968 0 2024-09-16T00:50:15.479 INFO:tasks.workunit.client.1.smithi152.stdout:1/643: dwrite d9/d3e/d4b/d6b/d6d/d97/fc6 [0,4194304] 0 2024-09-16T00:50:15.481 INFO:tasks.workunit.client.0.smithi053.stdout:7/153: creat d1/f36 x:0 0 0 2024-09-16T00:50:15.481 INFO:tasks.workunit.client.1.smithi152.stdout:1/644: dread d9/d3e/d41/f8d [0,4194304] 0 2024-09-16T00:50:15.482 INFO:tasks.workunit.client.1.smithi152.stdout:2/520: creat d4/d19/d20/d28/fb1 x:0 0 0 2024-09-16T00:50:15.483 INFO:tasks.workunit.client.1.smithi152.stdout:2/521: fdatasync d4/d44/d7a/d9e/f7f 0 2024-09-16T00:50:15.485 INFO:tasks.workunit.client.0.smithi053.stdout:7/154: creat d1/d35/d14/d27/f37 x:0 0 0 2024-09-16T00:50:15.490 INFO:tasks.workunit.client.0.smithi053.stdout:7/155: getdents d1/d3 0 2024-09-16T00:50:15.494 INFO:tasks.workunit.client.0.smithi053.stdout:7/156: unlink d1/c2e 0 2024-09-16T00:50:15.496 INFO:tasks.workunit.client.1.smithi152.stdout:9/540: symlink d1/d4e/d48/d66/lb0 0 2024-09-16T00:50:15.496 INFO:tasks.workunit.client.1.smithi152.stdout:9/541: fdatasync d1/d4e/f67 0 2024-09-16T00:50:15.497 INFO:tasks.workunit.client.0.smithi053.stdout:7/157: creat d1/d35/d14/f38 x:0 0 0 2024-09-16T00:50:15.503 INFO:tasks.workunit.client.0.smithi053.stdout:7/158: link d1/d35/l1c d1/l39 0 2024-09-16T00:50:15.504 INFO:tasks.workunit.client.1.smithi152.stdout:5/733: getdents d6/d57/d2b/d50/d64 0 2024-09-16T00:50:15.507 INFO:tasks.workunit.client.1.smithi152.stdout:1/645: mkdir d9/d3e/d7b/df0 0 2024-09-16T00:50:15.507 INFO:tasks.workunit.client.1.smithi152.stdout:1/646: dread - d9/d3e/d41/d31/d48/db2/fe1 zero size 2024-09-16T00:50:15.509 INFO:tasks.workunit.client.0.smithi053.stdout:7/159: getdents d1/d35/d14/d15 0 2024-09-16T00:50:15.509 INFO:tasks.workunit.client.0.smithi053.stdout:7/160: fsync d1/d35/d14/d27/f30 0 2024-09-16T00:50:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:2/522: rename d4/d19/d94/c6b to d4/d19/d20/cb2 0 2024-09-16T00:50:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:4/662: sync 2024-09-16T00:50:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:4/663: creat d2/d41/fde x:0 0 0 2024-09-16T00:50:15.512 INFO:tasks.workunit.client.0.smithi053.stdout:7/161: chown d1/ca 6073418 1 2024-09-16T00:50:15.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/542: mknod d1/d7/d77/d32/da5/da8/cb1 0 2024-09-16T00:50:15.515 INFO:tasks.workunit.client.0.smithi053.stdout:7/162: creat d1/f3a x:0 0 0 2024-09-16T00:50:15.517 INFO:tasks.workunit.client.1.smithi152.stdout:2/523: dread d4/d44/d7a/d9e/f75 [0,4194304] 0 2024-09-16T00:50:15.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/734: chown d6/d16/d1f/l51 40460 1 2024-09-16T00:50:15.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/735: chown d6/d16/d1f/d8c/db8 163 1 2024-09-16T00:50:15.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/736: truncate d6/d57/d2b/d50/d64/df5/ffc 389717 0 2024-09-16T00:50:15.530 INFO:tasks.workunit.client.1.smithi152.stdout:6/547: truncate db/d12/d23/d4a/d43/d48/f7f 2008145 0 2024-09-16T00:50:15.532 INFO:tasks.workunit.client.1.smithi152.stdout:1/647: mkdir d9/d3e/d4b/db7/dc4/df1 0 2024-09-16T00:50:15.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/554: symlink dc/d10/laf 0 2024-09-16T00:50:15.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/555: chown dc/d10/d47/f4e 183 1 2024-09-16T00:50:15.534 INFO:tasks.workunit.client.0.smithi053.stdout:7/163: creat d1/d2a/f3b x:0 0 0 2024-09-16T00:50:15.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/164: read - d1/d35/d14/f2f zero size 2024-09-16T00:50:15.538 INFO:tasks.workunit.client.1.smithi152.stdout:3/556: dread f5 [0,4194304] 0 2024-09-16T00:50:15.538 INFO:tasks.workunit.client.1.smithi152.stdout:3/557: chown dc/d10/d17/f59 277270779 1 2024-09-16T00:50:15.538 INFO:tasks.workunit.client.1.smithi152.stdout:3/558: readlink dc/d10/d17/d1c/d1f/d22/l4c 0 2024-09-16T00:50:15.538 INFO:tasks.workunit.client.1.smithi152.stdout:3/559: write dc/d10/d17/d1c/d1f/d22/fa0 [647316,11584] 0 2024-09-16T00:50:15.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/165: creat d1/d3/f3c x:0 0 0 2024-09-16T00:50:15.543 INFO:tasks.workunit.client.1.smithi152.stdout:5/737: dwrite d6/d16/d1f/db5/dd3/fd4 [0,4194304] 0 2024-09-16T00:50:15.543 INFO:tasks.workunit.client.1.smithi152.stdout:4/664: creat d2/db/d39/d3c/d7f/d8b/fdf x:0 0 0 2024-09-16T00:50:15.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/166: creat d1/d35/f3d x:0 0 0 2024-09-16T00:50:15.549 INFO:tasks.workunit.client.1.smithi152.stdout:9/543: mknod d1/cb2 0 2024-09-16T00:50:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/548: rename db/d12/d23/f75 to db/d12/d23/fac 0 2024-09-16T00:50:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/549: chown db/d12/d23/d4a/c2b 303061863 1 2024-09-16T00:50:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/550: fdatasync db/d12/f1a 0 2024-09-16T00:50:15.553 INFO:tasks.workunit.client.0.smithi053.stdout:7/167: creat d1/d35/d14/d15/f3e x:0 0 0 2024-09-16T00:50:15.554 INFO:tasks.workunit.client.0.smithi053.stdout:7/168: stat d1/d35/d14/f16 0 2024-09-16T00:50:15.554 INFO:tasks.workunit.client.1.smithi152.stdout:1/648: rmdir d9/da/df/dcb 39 2024-09-16T00:50:15.554 INFO:tasks.workunit.client.1.smithi152.stdout:1/649: chown d9/d3e/d41/d31/d48/d7d/fbb 189123973 1 2024-09-16T00:50:15.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/560: creat dc/d10/d17/d4f/fb0 x:0 0 0 2024-09-16T00:50:15.556 INFO:tasks.workunit.client.0.smithi053.stdout:7/169: creat d1/f3f x:0 0 0 2024-09-16T00:50:15.559 INFO:tasks.workunit.client.1.smithi152.stdout:4/665: dwrite d2/d1e/fd9 [0,4194304] 0 2024-09-16T00:50:15.560 INFO:tasks.workunit.client.0.smithi053.stdout:7/170: creat d1/d35/d14/d27/d2c/f40 x:0 0 0 2024-09-16T00:50:15.560 INFO:tasks.workunit.client.0.smithi053.stdout:7/171: creat d1/d35/d14/f41 x:0 0 0 2024-09-16T00:50:15.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/738: rmdir d6/d57/d2b 39 2024-09-16T00:50:15.563 INFO:tasks.workunit.client.1.smithi152.stdout:5/739: read d6/d57/f7a [433325,33882] 0 2024-09-16T00:50:15.563 INFO:tasks.workunit.client.1.smithi152.stdout:9/544: getdents d1/d4e/d48/d2b 0 2024-09-16T00:50:15.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/650: dread d9/d3e/d41/d31/d48/d4a/f54 [0,4194304] 0 2024-09-16T00:50:15.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/651: fsync d9/da/df/f30 0 2024-09-16T00:50:15.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/652: write d9/da/fe8 [427458,97879] 0 2024-09-16T00:50:15.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/551: creat db/d12/d23/d3a/fad x:0 0 0 2024-09-16T00:50:15.569 INFO:tasks.workunit.client.1.smithi152.stdout:3/561: read dc/d10/d17/d1c/d8d/d8e/d3b/d6f/f7d [1792549,11584] 0 2024-09-16T00:50:15.572 INFO:tasks.workunit.client.0.smithi053.stdout:2/69: getdents d6 0 2024-09-16T00:50:15.574 INFO:tasks.workunit.client.1.smithi152.stdout:5/740: rmdir d6/d57/d2b/d50/d66/df1 39 2024-09-16T00:50:15.574 INFO:tasks.workunit.client.1.smithi152.stdout:5/741: stat d6/fa2 0 2024-09-16T00:50:15.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/545: creat d1/d7/d77/fb3 x:0 0 0 2024-09-16T00:50:15.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/653: mkdir d9/da/df/dcb/df2 0 2024-09-16T00:50:15.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/654: creat d9/d3e/d41/ff3 x:0 0 0 2024-09-16T00:50:15.581 INFO:tasks.workunit.client.1.smithi152.stdout:3/562: mknod dc/d10/d17/d1c/d8d/d8e/d2f/d46/cb1 0 2024-09-16T00:50:15.584 INFO:tasks.workunit.client.0.smithi053.stdout:6/75: getdents d1/dc/d11 0 2024-09-16T00:50:15.584 INFO:tasks.workunit.client.0.smithi053.stdout:6/76: fdatasync d1/dc/f12 0 2024-09-16T00:50:15.587 INFO:tasks.workunit.client.0.smithi053.stdout:7/172: dwrite d1/f36 [0,4194304] 0 2024-09-16T00:50:15.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/742: truncate d6/d57/d2b/d50/d6e/fbc 345653 0 2024-09-16T00:50:15.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/743: creat d6/d16/d1f/d65/d77/f115 x:0 0 0 2024-09-16T00:50:15.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/563: dread dc/f15 [0,4194304] 0 2024-09-16T00:50:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/564: stat dc/d10/d17/d1c/d1f/d24 0 2024-09-16T00:50:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/565: fsync dc/d10/fa2 0 2024-09-16T00:50:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:9/546: mknod d1/d7/d13/d5d/cb4 0 2024-09-16T00:50:15.590 INFO:tasks.workunit.client.0.smithi053.stdout:6/77: dread d1/f5 [0,4194304] 0 2024-09-16T00:50:15.596 INFO:tasks.workunit.client.1.smithi152.stdout:1/655: creat d9/d3e/ff4 x:0 0 0 2024-09-16T00:50:15.597 INFO:tasks.workunit.client.1.smithi152.stdout:3/566: dread dc/d10/d17/d1c/d1f/f49 [0,4194304] 0 2024-09-16T00:50:15.598 INFO:tasks.workunit.client.0.smithi053.stdout:7/173: link d1/d35/d14/d15/c2d d1/d2a/c42 0 2024-09-16T00:50:15.598 INFO:tasks.workunit.client.0.smithi053.stdout:7/174: write d1/d3/f3c [925507,121343] 0 2024-09-16T00:50:15.601 INFO:tasks.workunit.client.1.smithi152.stdout:3/567: dread dc/d10/d17/d5a/d68/f7c [0,4194304] 0 2024-09-16T00:50:15.601 INFO:tasks.workunit.client.0.smithi053.stdout:6/78: truncate d1/dc/d11/f16 2399861 0 2024-09-16T00:50:15.602 INFO:tasks.workunit.client.0.smithi053.stdout:2/70: dwrite d6/d9/d14/f15 [0,4194304] 0 2024-09-16T00:50:15.602 INFO:tasks.workunit.client.1.smithi152.stdout:6/552: dwrite db/d12/d23/d3a/fad [0,4194304] 0 2024-09-16T00:50:15.606 INFO:tasks.workunit.client.0.smithi053.stdout:7/175: unlink d1/d35/f3d 0 2024-09-16T00:50:15.606 INFO:tasks.workunit.client.0.smithi053.stdout:7/176: fdatasync d1/f3f 0 2024-09-16T00:50:15.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/79: symlink d1/dc/d11/l1a 0 2024-09-16T00:50:15.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/80: chown d1/f5 42829 1 2024-09-16T00:50:15.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/81: chown d1/dc/f18 49262 1 2024-09-16T00:50:15.614 INFO:tasks.workunit.client.1.smithi152.stdout:3/568: dwrite dc/d10/d17/d1c/d1f/d24/f65 [0,4194304] 0 2024-09-16T00:50:15.619 INFO:tasks.workunit.client.1.smithi152.stdout:9/547: rename d1/f44 to d1/d4e/d48/d2b/d93/d96/fb5 0 2024-09-16T00:50:15.622 INFO:tasks.workunit.client.0.smithi053.stdout:2/71: truncate d6/d9/dd/f10 231807 0 2024-09-16T00:50:15.627 INFO:tasks.workunit.client.0.smithi053.stdout:7/177: rename d1/d35/d14/d27/f20 to d1/d35/d14/f43 0 2024-09-16T00:50:15.630 INFO:tasks.workunit.client.0.smithi053.stdout:6/82: creat d1/f1b x:0 0 0 2024-09-16T00:50:15.634 INFO:tasks.workunit.client.0.smithi053.stdout:2/72: creat d6/d9/dd/f16 x:0 0 0 2024-09-16T00:50:15.634 INFO:tasks.workunit.client.0.smithi053.stdout:2/73: chown f5 21832852 1 2024-09-16T00:50:15.635 INFO:tasks.workunit.client.1.smithi152.stdout:9/548: stat d1/d4e/c51 0 2024-09-16T00:50:15.636 INFO:tasks.workunit.client.1.smithi152.stdout:9/549: fsync d1/d4e/d48/d26/d58/faa 0 2024-09-16T00:50:15.640 INFO:tasks.workunit.client.1.smithi152.stdout:1/656: rename d9/d3e/d4b/d6b/d6d/l9f to d9/d3e/d41/d31/d48/dd9/lf5 0 2024-09-16T00:50:15.642 INFO:tasks.workunit.client.1.smithi152.stdout:9/550: mknod d1/d4e/d48/d66/cb6 0 2024-09-16T00:50:15.643 INFO:tasks.workunit.client.0.smithi053.stdout:2/74: dread f0 [0,4194304] 0 2024-09-16T00:50:15.643 INFO:tasks.workunit.client.0.smithi053.stdout:7/178: dwrite d1/d35/d14/f43 [0,4194304] 0 2024-09-16T00:50:15.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/553: rename db/d12/d20/d86/faa to db/d12/d1c/fae 0 2024-09-16T00:50:15.654 INFO:tasks.workunit.client.1.smithi152.stdout:1/657: mknod d9/d3e/d41/d31/d48/db2/cf6 0 2024-09-16T00:50:15.659 INFO:tasks.workunit.client.0.smithi053.stdout:7/179: link d1/d35/l1c d1/d35/d14/d27/l44 0 2024-09-16T00:50:15.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/551: dwrite d1/d7/d13/f73 [0,4194304] 0 2024-09-16T00:50:15.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/552: chown d1/fb 757 1 2024-09-16T00:50:15.662 INFO:tasks.workunit.client.1.smithi152.stdout:6/554: unlink db/d12/d1c/d80/f8a 0 2024-09-16T00:50:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.662+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a5c000bf0 con 0x7f8a580395a0 2024-09-16T00:50:15.664 INFO:tasks.workunit.client.1.smithi152.stdout:1/658: symlink d9/da/da2/lf7 0 2024-09-16T00:50:15.664 INFO:tasks.workunit.client.1.smithi152.stdout:1/659: write d9/d3e/d7b/fa9 [797088,84743] 0 2024-09-16T00:50:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.663+0000 7f8a6cff9700 1 -- 172.21.15.53:0/2027059052 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8a5c000bf0 con 0x7f8a580395a0 2024-09-16T00:50:15.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/180: dread d1/d35/d14/f16 [0,4194304] 0 2024-09-16T00:50:15.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/569: rename dc/d10/d17/d1c/d8d/d8e/d3b to dc/d10/d17/d5a/db2 0 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 msgr2=0x7f8a5803ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 0x7f8a5803ba50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a64009260 comp rx=0 tx=0).stop 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 msgr2=0x7f8a7019c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a60006010 tx=0x7f8a6000f9e0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 shutdown_connections 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f8a580395a0 0x7f8a5803ba50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a700ff150 0x7f8a7019c220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 --2- 172.21.15.53:0/2027059052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a701003f0 0x7f8a7019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 >> 172.21.15.53:0/2027059052 conn(0x7f8a700fa7a0 msgr2=0x7f8a70103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.666+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 shutdown_connections 2024-09-16T00:50:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.667+0000 7f8a75a97700 1 -- 172.21.15.53:0/2027059052 wait complete. 2024-09-16T00:50:15.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/553: link d1/d7/d13/l90 d1/d7/d77/lb7 0 2024-09-16T00:50:15.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/555: getdents db/d12/d20 0 2024-09-16T00:50:15.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/556: fsync db/d12/d23/f81 0 2024-09-16T00:50:15.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/557: chown db/d12/d1c/d80/c58 30 1 2024-09-16T00:50:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:1/660: rename d9/d3e/d41/d31/l5c to d9/d3e/d4b/db7/lf8 0 2024-09-16T00:50:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:1/661: read - d9/d3e/d4b/d6b/f79 zero size 2024-09-16T00:50:15.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/570: symlink dc/d10/d17/d5a/db2/d6f/d74/lb3 0 2024-09-16T00:50:15.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/571: readlink l1 0 2024-09-16T00:50:15.684 INFO:tasks.workunit.client.0.smithi053.stdout:7/181: dwrite d1/d3/f5 [4194304,4194304] 0 2024-09-16T00:50:15.684 INFO:tasks.workunit.client.0.smithi053.stdout:7/182: fdatasync d1/d35/d14/f16 0 2024-09-16T00:50:15.684 INFO:tasks.workunit.client.1.smithi152.stdout:9/554: symlink d1/d7/d13/d80/lb8 0 2024-09-16T00:50:15.686 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:50:15.688 INFO:tasks.workunit.client.1.smithi152.stdout:6/558: creat db/d12/faf x:0 0 0 2024-09-16T00:50:15.689 INFO:tasks.workunit.client.0.smithi053.stdout:7/183: write d1/d35/d14/f16 [940699,52240] 0 2024-09-16T00:50:15.689 INFO:tasks.workunit.client.1.smithi152.stdout:1/662: creat d9/d3e/d4b/db7/dc4/df1/ff9 x:0 0 0 2024-09-16T00:50:15.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/555: creat d1/d4e/d48/d26/d30/d4f/da2/fb9 x:0 0 0 2024-09-16T00:50:15.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/556: truncate d1/d7/d13/d80/f86 949012 0 2024-09-16T00:50:15.695 INFO:tasks.workunit.client.1.smithi152.stdout:6/559: truncate db/f1e 870745 0 2024-09-16T00:50:15.695 INFO:tasks.workunit.client.1.smithi152.stdout:6/560: getdents db/da8 0 2024-09-16T00:50:15.695 INFO:tasks.workunit.client.1.smithi152.stdout:6/561: fsync db/d12/f7d 0 2024-09-16T00:50:15.697 INFO:tasks.workunit.client.1.smithi152.stdout:9/557: mkdir d1/d4e/d48/d26/d30/dba 0 2024-09-16T00:50:15.697 INFO:tasks.workunit.client.1.smithi152.stdout:9/558: chown d1/d7/d77/fb3 49 1 2024-09-16T00:50:15.698 INFO:tasks.workunit.client.1.smithi152.stdout:1/663: dread d9/d3e/d4b/d6b/d6d/f81 [0,4194304] 0 2024-09-16T00:50:15.699 INFO:tasks.workunit.client.1.smithi152.stdout:1/664: write d9/d3e/d41/f3b [684561,66035] 0 2024-09-16T00:50:15.701 INFO:tasks.workunit.client.1.smithi152.stdout:6/562: dread db/d12/d1c/d80/d97/f9d [0,4194304] 0 2024-09-16T00:50:15.705 INFO:tasks.workunit.client.1.smithi152.stdout:7/565: sync 2024-09-16T00:50:15.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/575: sync 2024-09-16T00:50:15.706 INFO:tasks.workunit.client.1.smithi152.stdout:1/665: rmdir d9/d3e/d4b/d50 39 2024-09-16T00:50:15.708 INFO:tasks.workunit.client.1.smithi152.stdout:9/559: write d1/d7/d77/d32/da5/da8/fac [1665078,35789] 0 2024-09-16T00:50:15.708 INFO:tasks.workunit.client.1.smithi152.stdout:9/560: write d1/d7/d13/d80/f86 [1958093,79436] 0 2024-09-16T00:50:15.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/566: unlink d9/d31/d64/d3c/c91 0 2024-09-16T00:50:15.712 INFO:tasks.workunit.client.1.smithi152.stdout:9/561: link d1/d4e/d48/d2b/f70 d1/d4e/d48/d26/d92/fbb 0 2024-09-16T00:50:15.714 INFO:tasks.workunit.client.1.smithi152.stdout:9/562: rename d1/d4e/d48/d66/d76/f81 to d1/d4e/d48/d2b/d7c/fbc 0 2024-09-16T00:50:15.715 INFO:tasks.workunit.client.1.smithi152.stdout:9/563: fsync d1/d7/d13/f27 0 2024-09-16T00:50:15.715 INFO:tasks.workunit.client.1.smithi152.stdout:4/666: rmdir d2/db/d39/d3c/d7f/d8b 39 2024-09-16T00:50:15.717 INFO:tasks.workunit.client.1.smithi152.stdout:4/667: rename d2/db/d39/d3c/d76/db8/f1c to d2/db/dce/fe0 0 2024-09-16T00:50:15.719 INFO:tasks.workunit.client.1.smithi152.stdout:1/666: read d9/d3e/d41/d31/d48/f6e [3581750,12634] 0 2024-09-16T00:50:15.719 INFO:tasks.workunit.client.1.smithi152.stdout:0/576: dread d3/d6/d8/d1d/d23/d25/d45/f5f [4194304,4194304] 0 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/577: write d3/d6/f42 [1003716,106319] 0 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/668: symlink d2/d1e/d28/d7b/le1 0 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/669: read d2/f16 [602502,61876] 0 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/670: read - d2/db/d39/d3c/d7f/d98/fd5 zero size 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/671: fdatasync d2/db/d39/d3c/dc5/fcb 0 2024-09-16T00:50:15.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/672: fdatasync d2/d1e/f84 0 2024-09-16T00:50:15.721 INFO:tasks.workunit.client.1.smithi152.stdout:9/564: dread d1/d59/f2f [0,4194304] 0 2024-09-16T00:50:15.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/667: creat d9/da/df/dcb/df2/ffa x:0 0 0 2024-09-16T00:50:15.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/184: getdents d1 0 2024-09-16T00:50:15.730 INFO:tasks.workunit.client.0.smithi053.stdout:7/185: unlink d1/d35/d14/f23 0 2024-09-16T00:50:15.732 INFO:tasks.workunit.client.0.smithi053.stdout:7/186: write d1/d35/d14/d27/d2c/f40 [600130,57170] 0 2024-09-16T00:50:15.733 INFO:tasks.workunit.client.1.smithi152.stdout:7/567: dwrite d9/d31/d65/d8a/d41/d46/fa2 [0,4194304] 0 2024-09-16T00:50:15.734 INFO:tasks.workunit.client.1.smithi152.stdout:6/563: dwrite db/f40 [4194304,4194304] 0 2024-09-16T00:50:15.735 INFO:tasks.workunit.client.0.smithi053.stdout:7/187: mknod d1/c45 0 2024-09-16T00:50:15.735 INFO:tasks.workunit.client.0.smithi053.stdout:7/188: creat d1/d35/f46 x:0 0 0 2024-09-16T00:50:15.742 INFO:tasks.workunit.client.0.smithi053.stdout:7/189: symlink d1/d35/d14/d15/l47 0 2024-09-16T00:50:15.742 INFO:tasks.workunit.client.0.smithi053.stdout:7/190: creat d1/d35/d14/d15/f48 x:0 0 0 2024-09-16T00:50:15.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/568: unlink d9/d31/d64/d3c/l9b 0 2024-09-16T00:50:15.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/564: creat db/d12/d20/d4b/fb0 x:0 0 0 2024-09-16T00:50:15.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/565: fdatasync db/d12/d20/f46 0 2024-09-16T00:50:15.748 INFO:tasks.workunit.client.1.smithi152.stdout:6/566: creat db/d12/d1c/fb1 x:0 0 0 2024-09-16T00:50:15.748 INFO:tasks.workunit.client.1.smithi152.stdout:1/668: getdents d9/d3e/d41 0 2024-09-16T00:50:15.748 INFO:tasks.workunit.client.1.smithi152.stdout:1/669: chown d9/d3e/d41/d31/d48/f65 4 1 2024-09-16T00:50:15.752 INFO:tasks.workunit.client.0.smithi053.stdout:7/191: rmdir d1/d3 39 2024-09-16T00:50:15.752 INFO:tasks.workunit.client.1.smithi152.stdout:0/578: dwrite d3/d6/d8/f1c [0,4194304] 0 2024-09-16T00:50:15.752 INFO:tasks.workunit.client.1.smithi152.stdout:0/579: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e 86 1 2024-09-16T00:50:15.753 INFO:tasks.workunit.client.0.smithi053.stdout:7/192: fsync d1/d35/d14/f16 0 2024-09-16T00:50:15.753 INFO:tasks.workunit.client.1.smithi152.stdout:9/565: dwrite d1/d7/f8d [4194304,4194304] 0 2024-09-16T00:50:15.758 INFO:tasks.workunit.client.0.smithi053.stdout:6/83: fsync d1/dc/d11/f16 0 2024-09-16T00:50:15.758 INFO:tasks.workunit.client.0.smithi053.stdout:6/84: write d1/dc/f12 [307302,109211] 0 2024-09-16T00:50:15.758 INFO:tasks.workunit.client.1.smithi152.stdout:7/569: mkdir d9/d31/d64/d3c/db9/dc2 0 2024-09-16T00:50:15.762 INFO:tasks.workunit.client.1.smithi152.stdout:6/567: symlink db/d12/d1c/d80/lb2 0 2024-09-16T00:50:15.762 INFO:tasks.workunit.client.1.smithi152.stdout:6/568: chown db/d12/d23/d4a/d43/d48/f9e 1 1 2024-09-16T00:50:15.763 INFO:tasks.workunit.client.1.smithi152.stdout:8/400: sync 2024-09-16T00:50:15.763 INFO:tasks.workunit.client.1.smithi152.stdout:8/401: stat dd/d50/c37 0 2024-09-16T00:50:15.764 INFO:tasks.workunit.client.0.smithi053.stdout:6/85: creat d1/dc/d11/f1c x:0 0 0 2024-09-16T00:50:15.764 INFO:tasks.workunit.client.0.smithi053.stdout:6/86: chown d1/dc/d11/l14 3749039 1 2024-09-16T00:50:15.764 INFO:tasks.workunit.client.0.smithi053.stdout:6/87: dread - d1/f1b zero size 2024-09-16T00:50:15.766 INFO:tasks.workunit.client.0.smithi053.stdout:2/75: truncate d6/d9/dd/f10 457602 0 2024-09-16T00:50:15.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/580: creat d3/d6/d8/fc4 x:0 0 0 2024-09-16T00:50:15.769 INFO:tasks.workunit.client.0.smithi053.stdout:6/88: chown d1/l3 588 1 2024-09-16T00:50:15.773 INFO:tasks.workunit.client.1.smithi152.stdout:9/566: mkdir d1/d7/d13/d5d/dbd 0 2024-09-16T00:50:15.773 INFO:tasks.workunit.client.1.smithi152.stdout:9/567: write d1/d7/d13/f37 [5413794,17977] 0 2024-09-16T00:50:15.773 INFO:tasks.workunit.client.1.smithi152.stdout:9/568: getdents d1/d7/d13/d5d/dbd 0 2024-09-16T00:50:15.774 INFO:tasks.workunit.client.0.smithi053.stdout:6/89: mknod d1/c1d 0 2024-09-16T00:50:15.775 INFO:tasks.workunit.client.0.smithi053.stdout:2/76: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:15.776 INFO:tasks.workunit.client.1.smithi152.stdout:7/570: rename d9/d10/c8d to d9/d31/d65/cc3 0 2024-09-16T00:50:15.776 INFO:tasks.workunit.client.1.smithi152.stdout:7/571: fsync d9/d31/d65/d6b/f77 0 2024-09-16T00:50:15.776 INFO:tasks.workunit.client.1.smithi152.stdout:2/524: sync 2024-09-16T00:50:15.778 INFO:tasks.workunit.client.1.smithi152.stdout:6/569: mkdir db/d28/db3 0 2024-09-16T00:50:15.778 INFO:tasks.workunit.client.1.smithi152.stdout:6/570: fsync db/d12/d23/fac 0 2024-09-16T00:50:15.779 INFO:tasks.workunit.client.0.smithi053.stdout:6/90: mkdir d1/dc/d1e 0 2024-09-16T00:50:15.781 INFO:tasks.workunit.client.1.smithi152.stdout:8/402: mknod dd/d15/d1a/c86 0 2024-09-16T00:50:15.782 INFO:tasks.workunit.client.0.smithi053.stdout:2/77: mknod d6/d9/dd/c17 0 2024-09-16T00:50:15.782 INFO:tasks.workunit.client.0.smithi053.stdout:2/78: read f0 [1901022,57483] 0 2024-09-16T00:50:15.785 INFO:tasks.workunit.client.0.smithi053.stdout:7/193: symlink d1/d35/d14/d27/l49 0 2024-09-16T00:50:15.785 INFO:tasks.workunit.client.0.smithi053.stdout:7/194: write d1/d35/d14/f2f [535710,69718] 0 2024-09-16T00:50:15.785 INFO:tasks.workunit.client.0.smithi053.stdout:7/195: stat d1/d35/d14 0 2024-09-16T00:50:15.785 INFO:tasks.workunit.client.0.smithi053.stdout:7/196: write d1/d2a/f3b [492411,82218] 0 2024-09-16T00:50:15.792 INFO:tasks.workunit.client.0.smithi053.stdout:2/79: creat d6/f18 x:0 0 0 2024-09-16T00:50:15.795 INFO:tasks.workunit.client.0.smithi053.stdout:6/91: mknod d1/c1f 0 2024-09-16T00:50:15.796 INFO:tasks.workunit.client.1.smithi152.stdout:1/670: getdents d9/d3e 0 2024-09-16T00:50:15.798 INFO:tasks.workunit.client.1.smithi152.stdout:1/671: write d9/da/df/fdf [24694,69523] 0 2024-09-16T00:50:15.799 INFO:tasks.workunit.client.0.smithi053.stdout:2/80: truncate d6/f7 2756252 0 2024-09-16T00:50:15.801 INFO:tasks.workunit.client.0.smithi053.stdout:6/92: symlink d1/dc/d1e/l20 0 2024-09-16T00:50:15.804 INFO:tasks.workunit.client.1.smithi152.stdout:9/569: rename d1/d4e/d48/c3e to d1/d4e/d48/d26/d30/d4f/da2/cbe 0 2024-09-16T00:50:15.807 INFO:tasks.workunit.client.1.smithi152.stdout:7/572: mkdir d9/d31/dc4 0 2024-09-16T00:50:15.808 INFO:tasks.workunit.client.0.smithi053.stdout:6/93: mknod d1/c21 0 2024-09-16T00:50:15.809 INFO:tasks.workunit.client.1.smithi152.stdout:5/744: sync 2024-09-16T00:50:15.811 INFO:tasks.workunit.client.1.smithi152.stdout:2/525: creat d4/d19/d94/fb3 x:0 0 0 2024-09-16T00:50:15.812 INFO:tasks.workunit.client.1.smithi152.stdout:6/571: rmdir db/d28/d84 0 2024-09-16T00:50:15.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/403: creat dd/d15/d69/f87 x:0 0 0 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:7/197: dwrite d1/d2a/f3b [0,4194304] 0 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:8/220: sync 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:0/114: sync 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:9/186: sync 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:1/155: sync 2024-09-16T00:50:15.819 INFO:tasks.workunit.client.0.smithi053.stdout:3/222: sync 2024-09-16T00:50:15.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/573: creat d9/d31/fc5 x:0 0 0 2024-09-16T00:50:15.826 INFO:tasks.workunit.client.1.smithi152.stdout:5/745: mknod d6/d57/ddc/c116 0 2024-09-16T00:50:15.826 INFO:tasks.workunit.client.1.smithi152.stdout:8/404: read dd/d50/d29/f58 [371477,62191] 0 2024-09-16T00:50:15.826 INFO:tasks.workunit.client.1.smithi152.stdout:2/526: getdents d4/d19/d94/d93/da4 0 2024-09-16T00:50:15.827 INFO:tasks.workunit.client.1.smithi152.stdout:1/672: dwrite d9/d3e/d41/f4e [0,4194304] 0 2024-09-16T00:50:15.827 INFO:tasks.workunit.client.1.smithi152.stdout:1/673: write d9/da/df/f75 [5087334,73299] 0 2024-09-16T00:50:15.830 INFO:tasks.workunit.client.1.smithi152.stdout:9/570: dwrite d1/d7/d13/d80/f86 [0,4194304] 0 2024-09-16T00:50:15.832 INFO:tasks.workunit.client.0.smithi053.stdout:8/221: creat d10/d1c/d2b/d40/f4d x:0 0 0 2024-09-16T00:50:15.832 INFO:tasks.workunit.client.0.smithi053.stdout:8/222: dread - d10/d21/f2c zero size 2024-09-16T00:50:15.834 INFO:tasks.workunit.client.1.smithi152.stdout:6/572: getdents db/d12/d20/d86 0 2024-09-16T00:50:15.834 INFO:tasks.workunit.client.1.smithi152.stdout:6/573: stat db/d12/d1c/d80/d97 0 2024-09-16T00:50:15.835 INFO:tasks.workunit.client.0.smithi053.stdout:1/156: dread d5/d7/d10/f15 [0,4194304] 0 2024-09-16T00:50:15.835 INFO:tasks.workunit.client.0.smithi053.stdout:1/157: write d5/d9/d21/f2a [126042,68415] 0 2024-09-16T00:50:15.835 INFO:tasks.workunit.client.0.smithi053.stdout:1/158: creat d5/d7/f2d x:0 0 0 2024-09-16T00:50:15.836 INFO:tasks.workunit.client.1.smithi152.stdout:7/574: write f2 [802764,113059] 0 2024-09-16T00:50:15.838 INFO:tasks.workunit.client.0.smithi053.stdout:0/115: mkdir d4/dc/d23/d24/d27 0 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/805770772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8107a40 msgr2=0x7fbfe8107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/805770772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8107a40 0x7fbfe8107e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009910 tx=0x7fbfdc009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/805770772 shutdown_connections 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/805770772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8107a40 0x7fbfe8107e90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/805770772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8106840 0x7fbfe8106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/805770772 >> 172.21.15.53:0/805770772 conn(0x7fbfe8075800 msgr2=0x7fbfe8077c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/805770772 shutdown_connections 2024-09-16T00:50:15.843 INFO:tasks.workunit.client.0.smithi053.stdout:9/187: link d8/d1c/f1b d8/f39 0 2024-09-16T00:50:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.840+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/805770772 wait complete. 2024-09-16T00:50:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.841+0000 7fbfeeb9b700 1 Processor -- start 2024-09-16T00:50:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.841+0000 7fbfeeb9b700 1 -- start start 2024-09-16T00:50:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.841+0000 7fbfeeb9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfeeb9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8107a40 0x7fbfe819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfeeb9b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe819cce0 con 0x7fbfe8106840 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfeeb9b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe819ce20 con 0x7fbfe8107a40 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48498/0 (socket says 172.21.15.53:48498) 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 -- 172.21.15.53:0/2655035903 learned_addr learned my addr 172.21.15.53:0/2655035903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfe7fff700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8107a40 0x7fbfe819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 -- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8107a40 msgr2=0x7fbfe819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8107a40 0x7fbfe819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.842+0000 7fbfec937700 1 -- 172.21.15.53:0/2655035903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0095f0 con 0x7fbfe8106840 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfec937700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800b480 tx=0x7fbfd800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd80118c0 con 0x7fbfe8106840 2024-09-16T00:50:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe81a18d0 con 0x7fbfe8106840 2024-09-16T00:50:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe81a1e20 con 0x7fbfe8106840 2024-09-16T00:50:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbfd8010380 con 0x7fbfe8106840 2024-09-16T00:50:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.843+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfd800f4f0 con 0x7fbfe8106840 2024-09-16T00:50:15.847 INFO:tasks.workunit.client.0.smithi053.stdout:7/198: mkdir d1/d35/d4a 0 2024-09-16T00:50:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.845+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4005320 con 0x7fbfe8106840 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/746: creat d6/d16/d10d/d10e/f117 x:0 0 0 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/747: write d6/d16/d1f/d65/d77/f100 [9247227,73342] 0 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/748: getdents d6/d57/d2b/d50/d64/df5/d10a 0 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/749: chown d6/d16/d1f/d65/d77 578236580 1 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/750: read - d6/fa2 zero size 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:9/571: dread d1/d7/d77/d32/da5/da8/fac [0,4194304] 0 2024-09-16T00:50:15.848 INFO:tasks.workunit.client.1.smithi152.stdout:2/527: dread d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:15.851 INFO:tasks.workunit.client.0.smithi053.stdout:3/223: dwrite d1/d5/d11/f46 [0,4194304] 0 2024-09-16T00:50:15.853 INFO:tasks.workunit.client.0.smithi053.stdout:8/223: rename d10/d21/f38 to d10/d1c/d2b/f4e 0 2024-09-16T00:50:15.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.846+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 46602+0+0 (secure 0 0 0) 0x7fbfd800f720 con 0x7fbfe8106840 2024-09-16T00:50:15.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.846+0000 7fbfe5ffb700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 0x7fbfd003ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:15.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.846+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fbfd8017b90 con 0x7fbfe8106840 2024-09-16T00:50:15.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.847+0000 7fbfe7fff700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 0x7fbfd003ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:15.854 INFO:tasks.workunit.client.1.smithi152.stdout:2/528: dread f2 [0,4194304] 0 2024-09-16T00:50:15.854 INFO:tasks.workunit.client.1.smithi152.stdout:2/529: stat d4/d19/d94/d8f/f91 0 2024-09-16T00:50:15.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.851+0000 7fbfe7fff700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 0x7fbfd003ba50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0059d0 tx=0x7fbfdc005920 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:15.855 INFO:tasks.workunit.client.1.smithi152.stdout:8/405: mkdir dd/d50/d88 0 2024-09-16T00:50:15.855 INFO:tasks.workunit.client.1.smithi152.stdout:8/406: creat dd/d15/d69/f89 x:0 0 0 2024-09-16T00:50:15.857 INFO:tasks.workunit.client.1.smithi152.stdout:2/530: write d4/d44/d7a/d9e/d66/f97 [34338,84027] 0 2024-09-16T00:50:15.857 INFO:tasks.workunit.client.1.smithi152.stdout:2/531: write d4/d17/d3e/f4b [2337348,82314] 0 2024-09-16T00:50:15.858 INFO:tasks.workunit.client.0.smithi053.stdout:8/224: dread d10/f14 [0,4194304] 0 2024-09-16T00:50:15.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.856+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbfd801acc0 con 0x7fbfe8106840 2024-09-16T00:50:15.862 INFO:tasks.workunit.client.0.smithi053.stdout:9/188: creat d8/d19/f3a x:0 0 0 2024-09-16T00:50:15.866 INFO:tasks.workunit.client.1.smithi152.stdout:6/574: unlink db/d12/d1c/d80/d97/f9d 0 2024-09-16T00:50:15.869 INFO:tasks.workunit.client.0.smithi053.stdout:0/116: dwrite d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:15.871 INFO:tasks.workunit.client.0.smithi053.stdout:3/224: mkdir d1/d4e 0 2024-09-16T00:50:15.872 INFO:tasks.workunit.client.0.smithi053.stdout:7/199: dwrite d1/d35/d14/d27/d2c/f40 [0,4194304] 0 2024-09-16T00:50:15.872 INFO:tasks.workunit.client.1.smithi152.stdout:7/575: truncate d9/d10/f9d 350404 0 2024-09-16T00:50:15.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/576: readlink d9/l3e 0 2024-09-16T00:50:15.873 INFO:tasks.workunit.client.1.smithi152.stdout:6/575: dread db/d28/f3c [0,4194304] 0 2024-09-16T00:50:15.874 INFO:tasks.workunit.client.0.smithi053.stdout:6/94: getdents d1/dc/d11 0 2024-09-16T00:50:15.877 INFO:tasks.workunit.client.0.smithi053.stdout:8/225: mkdir d10/d4a/d4f 0 2024-09-16T00:50:15.877 INFO:tasks.workunit.client.0.smithi053.stdout:8/226: chown d10/d1c/f23 2 1 2024-09-16T00:50:15.879 INFO:tasks.workunit.client.0.smithi053.stdout:1/159: rmdir d5/d9/d21 39 2024-09-16T00:50:15.886 INFO:tasks.workunit.client.1.smithi152.stdout:5/751: symlink d6/d57/d2b/d50/d64/df5/d10a/l118 0 2024-09-16T00:50:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:15.883+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7fbfd800f720 con 0x7fbfe8106840 2024-09-16T00:50:15.889 INFO:tasks.workunit.client.1.smithi152.stdout:7/577: dwrite d9/d31/d65/d4b/f66 [0,4194304] 0 2024-09-16T00:50:15.889 INFO:tasks.workunit.client.0.smithi053.stdout:9/189: symlink d8/l3b 0 2024-09-16T00:50:15.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/752: write d6/d16/d1f/d6c/f88 [1223126,61907] 0 2024-09-16T00:50:15.902 INFO:tasks.workunit.client.0.smithi053.stdout:0/117: mknod d4/dc/c28 0 2024-09-16T00:50:15.904 INFO:tasks.workunit.client.1.smithi152.stdout:0/581: truncate d3/d6/d8/f1c 3342826 0 2024-09-16T00:50:15.908 INFO:tasks.workunit.client.0.smithi053.stdout:3/225: unlink d1/d5/f10 0 2024-09-16T00:50:15.908 INFO:tasks.workunit.client.0.smithi053.stdout:3/226: fdatasync d1/d5/d16/f3f 0 2024-09-16T00:50:15.911 INFO:tasks.workunit.client.0.smithi053.stdout:8/227: dwrite d10/d1c/f26 [4194304,4194304] 0 2024-09-16T00:50:15.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/532: rename d4/d17/d3e/l6f to d4/d19/d20/d9d/lb4 0 2024-09-16T00:50:15.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/533: creat d4/d19/d20/d28/d2c/d77/da7/fb5 x:0 0 0 2024-09-16T00:50:15.911 INFO:tasks.workunit.client.1.smithi152.stdout:7/578: dwrite d9/d31/fbe [8388608,4194304] 0 2024-09-16T00:50:15.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/81: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:15.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/82: truncate f0 4738674 0 2024-09-16T00:50:15.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/83: stat d6/d9/dd/f16 0 2024-09-16T00:50:15.919 INFO:tasks.workunit.client.0.smithi053.stdout:7/200: mknod d1/d35/d14/d15/c4b 0 2024-09-16T00:50:15.921 INFO:tasks.workunit.client.1.smithi152.stdout:6/576: mknod db/d12/d23/d4a/d33/cb4 0 2024-09-16T00:50:15.922 INFO:tasks.workunit.client.0.smithi053.stdout:6/95: symlink d1/dc/l22 0 2024-09-16T00:50:15.922 INFO:tasks.workunit.client.0.smithi053.stdout:6/96: stat d1/dc/d1e 0 2024-09-16T00:50:15.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/97: getdents d1/dc/d11 0 2024-09-16T00:50:15.923 INFO:tasks.workunit.client.0.smithi053.stdout:3/227: dread d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:15.924 INFO:tasks.workunit.client.1.smithi152.stdout:5/753: dwrite d6/d16/d1f/d65/d77/fd8 [0,4194304] 0 2024-09-16T00:50:15.924 INFO:tasks.workunit.client.1.smithi152.stdout:5/754: write d6/d16/d1f/f2e [1391546,38098] 0 2024-09-16T00:50:15.931 INFO:tasks.workunit.client.1.smithi152.stdout:2/534: dwrite d4/d44/d7a/d9e/faf [0,4194304] 0 2024-09-16T00:50:15.933 INFO:tasks.workunit.client.1.smithi152.stdout:8/407: truncate dd/f1f 2612804 0 2024-09-16T00:50:15.933 INFO:tasks.workunit.client.1.smithi152.stdout:8/408: read dd/d50/d29/d2f/d53/f65 [3026780,34626] 0 2024-09-16T00:50:15.933 INFO:tasks.workunit.client.1.smithi152.stdout:8/409: stat dd/f38 0 2024-09-16T00:50:15.933 INFO:tasks.workunit.client.1.smithi152.stdout:2/535: dread d4/d19/d94/d8f/f91 [0,4194304] 0 2024-09-16T00:50:15.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/582: symlink d3/d6/d8/d1d/d23/d25/d45/lc5 0 2024-09-16T00:50:15.940 INFO:tasks.workunit.client.1.smithi152.stdout:7/579: creat d9/d31/d64/d3c/db9/fc6 x:0 0 0 2024-09-16T00:50:15.941 INFO:tasks.workunit.client.0.smithi053.stdout:3/228: dwrite d1/d5/d14/f18 [0,4194304] 0 2024-09-16T00:50:15.943 INFO:tasks.workunit.client.0.smithi053.stdout:1/160: rename d5/dd/d19/c2b to d5/d9/c2e 0 2024-09-16T00:50:15.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/577: symlink db/d12/d20/lb5 0 2024-09-16T00:50:15.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/578: readlink db/d12/d20/lb5 0 2024-09-16T00:50:15.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/579: dread - db/d12/d1c/d80/d97/f99 zero size 2024-09-16T00:50:15.945 INFO:tasks.workunit.client.0.smithi053.stdout:9/190: mknod d8/d22/c3c 0 2024-09-16T00:50:15.949 INFO:tasks.workunit.client.1.smithi152.stdout:7/580: dread d9/d31/d65/d8a/f4a [0,4194304] 0 2024-09-16T00:50:15.954 INFO:tasks.workunit.client.0.smithi053.stdout:8/228: unlink d10/d21/d28/l2d 0 2024-09-16T00:50:15.955 INFO:tasks.workunit.client.1.smithi152.stdout:5/755: creat d6/d16/d10d/f119 x:0 0 0 2024-09-16T00:50:15.957 INFO:tasks.workunit.client.0.smithi053.stdout:2/84: symlink d6/d9/d14/l19 0 2024-09-16T00:50:15.965 INFO:tasks.workunit.client.0.smithi053.stdout:7/201: creat d1/d35/d4a/f4c x:0 0 0 2024-09-16T00:50:15.966 INFO:tasks.workunit.client.0.smithi053.stdout:6/98: readlink d1/lb 0 2024-09-16T00:50:15.971 INFO:tasks.workunit.client.1.smithi152.stdout:8/410: rename dd/d15/c6e to dd/d50/d29/d2f/c8a 0 2024-09-16T00:50:15.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/229: stat d1/le 0 2024-09-16T00:50:15.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/536: truncate d4/d19/d20/d28/d2c/f31 2327338 0 2024-09-16T00:50:15.978 INFO:tasks.workunit.client.0.smithi053.stdout:1/161: unlink d5/d18/l1e 0 2024-09-16T00:50:15.979 INFO:tasks.workunit.client.1.smithi152.stdout:0/583: rmdir d3/d6/d51/dbb 39 2024-09-16T00:50:15.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/99: dwrite d1/f5 [0,4194304] 0 2024-09-16T00:50:15.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/100: dread - d1/dc/f18 zero size 2024-09-16T00:50:15.982 INFO:tasks.workunit.client.0.smithi053.stdout:0/118: rename d4/f5 to d4/dc/d1e/d22/f29 0 2024-09-16T00:50:15.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/580: creat db/d12/d23/d4a/d43/d48/d6a/fb6 x:0 0 0 2024-09-16T00:50:15.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/581: dread - db/d12/d20/f2d zero size 2024-09-16T00:50:15.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/582: read - db/d12/d1c/d80/d97/f99 zero size 2024-09-16T00:50:15.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/583: stat db/d12 0 2024-09-16T00:50:15.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/584: getdents db/da8 0 2024-09-16T00:50:15.984 INFO:tasks.workunit.client.0.smithi053.stdout:9/191: mknod d8/d22/d26/c3d 0 2024-09-16T00:50:15.987 INFO:tasks.workunit.client.0.smithi053.stdout:8/229: mkdir d10/d1c/d2b/d40/d50 0 2024-09-16T00:50:15.987 INFO:tasks.workunit.client.0.smithi053.stdout:8/230: fdatasync d10/d21/f2c 0 2024-09-16T00:50:15.991 INFO:tasks.workunit.client.1.smithi152.stdout:7/581: rename d9/d80/d82/l89 to d9/d31/d64/d3c/lc7 0 2024-09-16T00:50:15.992 INFO:tasks.workunit.client.0.smithi053.stdout:8/231: dread d10/f1e [0,4194304] 0 2024-09-16T00:50:15.992 INFO:tasks.workunit.client.0.smithi053.stdout:8/232: write d10/f4c [754360,127064] 0 2024-09-16T00:50:15.992 INFO:tasks.workunit.client.0.smithi053.stdout:2/85: rmdir d6/d9/d14 39 2024-09-16T00:50:15.992 INFO:tasks.workunit.client.0.smithi053.stdout:2/86: chown d6/d9/d14/f15 30118 1 2024-09-16T00:50:15.992 INFO:tasks.workunit.client.0.smithi053.stdout:2/87: read f0 [2760453,105150] 0 2024-09-16T00:50:15.993 INFO:tasks.workunit.client.0.smithi053.stdout:2/88: write f0 [3938718,11389] 0 2024-09-16T00:50:15.993 INFO:tasks.workunit.client.1.smithi152.stdout:6/585: dread db/d28/f32 [0,4194304] 0 2024-09-16T00:50:15.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/411: link dd/d50/d29/d2f/c74 dd/d15/d69/c8b 0 2024-09-16T00:50:15.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/412: fdatasync dd/d15/f7a 0 2024-09-16T00:50:15.994 INFO:tasks.workunit.client.0.smithi053.stdout:3/230: symlink d1/d5/d16/d47/d4c/l4f 0 2024-09-16T00:50:15.994 INFO:tasks.workunit.client.0.smithi053.stdout:3/231: truncate d1/d5/d16/f1f 4870288 0 2024-09-16T00:50:15.996 INFO:tasks.workunit.client.0.smithi053.stdout:1/162: symlink d5/d7/l2f 0 2024-09-16T00:50:15.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/537: unlink d4/d17/f3b 0 2024-09-16T00:50:16.000 INFO:tasks.workunit.client.0.smithi053.stdout:2/89: write f5 [3612803,90356] 0 2024-09-16T00:50:16.001 INFO:tasks.workunit.client.1.smithi152.stdout:3/572: sync 2024-09-16T00:50:16.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/673: sync 2024-09-16T00:50:16.003 INFO:tasks.workunit.client.1.smithi152.stdout:8/413: write dd/d50/d29/d2f/f4b [1179670,17437] 0 2024-09-16T00:50:16.004 INFO:tasks.workunit.client.0.smithi053.stdout:2/90: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:16.005 INFO:tasks.workunit.client.0.smithi053.stdout:6/101: unlink d1/dc/f12 0 2024-09-16T00:50:16.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/756: rmdir d6/d57/ddc 39 2024-09-16T00:50:16.010 INFO:tasks.workunit.client.0.smithi053.stdout:0/119: rename d4/dc/d23/d24 to d4/dc/d23/d2a 0 2024-09-16T00:50:16.010 INFO:tasks.workunit.client.0.smithi053.stdout:0/120: write d4/f10 [2203961,60812] 0 2024-09-16T00:50:16.011 INFO:tasks.workunit.client.0.smithi053.stdout:1/163: write d5/d9/f1d [340306,113678] 0 2024-09-16T00:50:16.011 INFO:tasks.workunit.client.0.smithi053.stdout:1/164: chown d5/d9/f17 208 1 2024-09-16T00:50:16.012 INFO:tasks.workunit.client.1.smithi152.stdout:6/586: dwrite db/d12/d23/d4a/d43/d48/f4d [0,4194304] 0 2024-09-16T00:50:16.015 INFO:tasks.workunit.client.1.smithi152.stdout:7/582: rename d9/l29 to d9/d10/dc0/lc8 0 2024-09-16T00:50:16.015 INFO:tasks.workunit.client.0.smithi053.stdout:5/119: sync 2024-09-16T00:50:16.015 INFO:tasks.workunit.client.0.smithi053.stdout:5/120: write d3/f13 [2130100,32681] 0 2024-09-16T00:50:16.016 INFO:tasks.workunit.client.0.smithi053.stdout:9/192: mknod d8/d19/c3e 0 2024-09-16T00:50:16.017 INFO:tasks.workunit.client.0.smithi053.stdout:0/121: dread d4/dc/f1b [0,4194304] 0 2024-09-16T00:50:16.017 INFO:tasks.workunit.client.0.smithi053.stdout:0/122: chown d4/dc/d1e/d22/f29 7678 1 2024-09-16T00:50:16.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/573: dread dc/d10/d17/d1c/d50/d63/f64 [0,4194304] 0 2024-09-16T00:50:16.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/574: stat dc/fe 0 2024-09-16T00:50:16.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/575: fsync dc/d10/d17/d5a/d68/f9b 0 2024-09-16T00:50:16.018 INFO:tasks.workunit.client.1.smithi152.stdout:2/538: mknod d4/d19/cb6 0 2024-09-16T00:50:16.020 INFO:tasks.workunit.client.0.smithi053.stdout:8/233: unlink d10/f4c 0 2024-09-16T00:50:16.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/674: unlink d2/db/d39/f59 0 2024-09-16T00:50:16.025 INFO:tasks.workunit.client.0.smithi053.stdout:1/165: dread f2 [0,4194304] 0 2024-09-16T00:50:16.027 INFO:tasks.workunit.client.0.smithi053.stdout:4/130: sync 2024-09-16T00:50:16.027 INFO:tasks.workunit.client.0.smithi053.stdout:4/131: readlink d0/d2/lb 0 2024-09-16T00:50:16.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/102: dwrite d1/dc/d11/f13 [0,4194304] 0 2024-09-16T00:50:16.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/103: write d1/ff [658336,93103] 0 2024-09-16T00:50:16.032 INFO:tasks.workunit.client.1.smithi152.stdout:5/757: mkdir d6/d57/ddc/d11a 0 2024-09-16T00:50:16.033 INFO:tasks.workunit.client.1.smithi152.stdout:8/414: dwrite dd/d15/d49/f22 [4194304,4194304] 0 2024-09-16T00:50:16.035 INFO:tasks.workunit.client.0.smithi053.stdout:3/232: mkdir d1/d5/d16/d47/d4c/d50 0 2024-09-16T00:50:16.038 INFO:tasks.workunit.client.0.smithi053.stdout:9/193: dwrite d8/f27 [0,4194304] 0 2024-09-16T00:50:16.038 INFO:tasks.workunit.client.0.smithi053.stdout:9/194: creat d8/d19/f3f x:0 0 0 2024-09-16T00:50:16.038 INFO:tasks.workunit.client.0.smithi053.stdout:9/195: stat d8/d13/f20 0 2024-09-16T00:50:16.040 INFO:tasks.workunit.client.0.smithi053.stdout:2/91: unlink d6/d9/dd/c17 0 2024-09-16T00:50:16.043 INFO:tasks.workunit.client.1.smithi152.stdout:6/587: mkdir db/da8/db7 0 2024-09-16T00:50:16.045 INFO:tasks.workunit.client.0.smithi053.stdout:0/123: truncate d4/dc/d1e/d22/f29 912762 0 2024-09-16T00:50:16.045 INFO:tasks.workunit.client.0.smithi053.stdout:0/124: chown d4/dc/l1a 1280645 1 2024-09-16T00:50:16.045 INFO:tasks.workunit.client.0.smithi053.stdout:1/166: dwrite d5/d9/f17 [0,4194304] 0 2024-09-16T00:50:16.046 INFO:tasks.workunit.client.0.smithi053.stdout:4/132: dwrite d0/d2/f23 [0,4194304] 0 2024-09-16T00:50:16.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/92: dread f5 [0,4194304] 0 2024-09-16T00:50:16.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/93: creat d6/d9/dd/f1a x:0 0 0 2024-09-16T00:50:16.049 INFO:tasks.workunit.client.0.smithi053.stdout:8/234: link d10/d1c/c2a d10/d21/c51 0 2024-09-16T00:50:16.050 INFO:tasks.workunit.client.0.smithi053.stdout:2/94: dread f3 [0,4194304] 0 2024-09-16T00:50:16.054 INFO:tasks.workunit.client.0.smithi053.stdout:0/125: write d4/f17 [589318,19661] 0 2024-09-16T00:50:16.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/576: symlink dc/d10/d17/d1c/d50/d55/lb4 0 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: pgmap v8: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 95 MiB/s rd, 120 MiB/s wr, 212 op/s 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: Standby manager daemon smithi053.cjiiek started 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/crt"}]: dispatch 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/key"}]: dispatch 2024-09-16T00:50:16.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:15 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:50:16.058 INFO:tasks.workunit.client.0.smithi053.stdout:6/104: truncate d1/fd 2767362 0 2024-09-16T00:50:16.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/539: mkdir d4/d19/d20/d28/d8b/da9/db7 0 2024-09-16T00:50:16.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/540: chown d4/d19/d20/cb2 1091 1 2024-09-16T00:50:16.063 INFO:tasks.workunit.client.0.smithi053.stdout:3/233: rename d1/d5/d31/d3b/l4a to d1/l51 0 2024-09-16T00:50:16.065 INFO:tasks.workunit.client.0.smithi053.stdout:0/126: read d4/f10 [7978534,119343] 0 2024-09-16T00:50:16.068 INFO:tasks.workunit.client.1.smithi152.stdout:4/675: link d2/db/dce/fdb d2/d1e/d28/d7b/fe2 0 2024-09-16T00:50:16.068 INFO:tasks.workunit.client.1.smithi152.stdout:5/758: symlink d6/l11b 0 2024-09-16T00:50:16.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/415: symlink dd/d25/l8c 0 2024-09-16T00:50:16.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/416: stat dd/d50/d29/f58 0 2024-09-16T00:50:16.073 INFO:tasks.workunit.client.0.smithi053.stdout:9/196: creat d8/d22/f40 x:0 0 0 2024-09-16T00:50:16.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/541: dwrite d4/d19/d20/d28/d2c/f7b [0,4194304] 0 2024-09-16T00:50:16.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/588: symlink db/d12/d20/lb8 0 2024-09-16T00:50:16.077 INFO:tasks.workunit.client.0.smithi053.stdout:0/127: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:16.077 INFO:tasks.workunit.client.0.smithi053.stdout:5/121: truncate d3/f4 1244228 0 2024-09-16T00:50:16.077 INFO:tasks.workunit.client.0.smithi053.stdout:5/122: readlink d3/d7/lc 0 2024-09-16T00:50:16.077 INFO:tasks.workunit.client.0.smithi053.stdout:5/123: write d3/f20 [332676,918] 0 2024-09-16T00:50:16.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/577: rename dc/d10/d17/d1c/d1f/d22 to dc/d10/d17/d5a/db2/d6f/d74/db5 0 2024-09-16T00:50:16.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/578: chown dc/d10/d17/d5a/d68/f9b 1101110 1 2024-09-16T00:50:16.080 INFO:tasks.workunit.client.0.smithi053.stdout:1/167: mkdir d5/d7/d10/d2c/d30 0 2024-09-16T00:50:16.089 INFO:tasks.workunit.client.1.smithi152.stdout:5/759: mkdir d6/d16/d11c 0 2024-09-16T00:50:16.089 INFO:tasks.workunit.client.1.smithi152.stdout:5/760: chown d6/d57/ddc/d11a 16 1 2024-09-16T00:50:16.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/417: rmdir dd/d25/d77 39 2024-09-16T00:50:16.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/418: write dd/d15/d1a/f82 [404052,31331] 0 2024-09-16T00:50:16.093 INFO:tasks.workunit.client.0.smithi053.stdout:8/235: rmdir d10/d4a/d4f 0 2024-09-16T00:50:16.095 INFO:tasks.workunit.client.0.smithi053.stdout:2/95: mknod d6/d9/d14/c1b 0 2024-09-16T00:50:16.095 INFO:tasks.workunit.client.0.smithi053.stdout:2/96: truncate d6/d9/fe 4852716 0 2024-09-16T00:50:16.097 INFO:tasks.workunit.client.1.smithi152.stdout:2/542: rmdir d4/d19/d94/d93/da4/da6 0 2024-09-16T00:50:16.097 INFO:tasks.workunit.client.1.smithi152.stdout:2/543: chown d4/d17/l8c 0 1 2024-09-16T00:50:16.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/589: creat db/d12/d20/fb9 x:0 0 0 2024-09-16T00:50:16.101 INFO:tasks.workunit.client.1.smithi152.stdout:8/419: symlink dd/d50/d88/l8d 0 2024-09-16T00:50:16.102 INFO:tasks.workunit.client.0.smithi053.stdout:3/234: mknod d1/d5/d16/d47/d4c/d50/c52 0 2024-09-16T00:50:16.104 INFO:tasks.workunit.client.0.smithi053.stdout:3/235: write d1/d5/f3e [767175,118942] 0 2024-09-16T00:50:16.104 INFO:tasks.workunit.client.0.smithi053.stdout:3/236: chown d1/d5/d14/f2d 3 1 2024-09-16T00:50:16.104 INFO:tasks.workunit.client.1.smithi152.stdout:2/544: mkdir d4/d19/d20/d28/d2c/d77/da7/db8 0 2024-09-16T00:50:16.106 INFO:tasks.workunit.client.0.smithi053.stdout:9/197: creat d8/d1c/d2b/d2c/f41 x:0 0 0 2024-09-16T00:50:16.107 INFO:tasks.workunit.client.0.smithi053.stdout:0/128: mknod d4/dc/d1e/c2b 0 2024-09-16T00:50:16.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/420: write dd/d50/d29/d2f/f3d [771942,18769] 0 2024-09-16T00:50:16.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/421: dread - dd/f38 zero size 2024-09-16T00:50:16.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/422: truncate dd/d50/d29/d2f/d5f/f6a 705458 0 2024-09-16T00:50:16.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/423: readlink dd/d50/d29/d2f/l40 0 2024-09-16T00:50:16.108 INFO:tasks.workunit.client.1.smithi152.stdout:5/761: dread d6/fa5 [0,4194304] 0 2024-09-16T00:50:16.109 INFO:tasks.workunit.client.0.smithi053.stdout:1/168: dwrite d5/dd/d19/f26 [0,4194304] 0 2024-09-16T00:50:16.109 INFO:tasks.workunit.client.0.smithi053.stdout:1/169: write d5/d7/f22 [1215317,41651] 0 2024-09-16T00:50:16.109 INFO:tasks.workunit.client.0.smithi053.stdout:1/170: creat d5/dd/f31 x:0 0 0 2024-09-16T00:50:16.109 INFO:tasks.workunit.client.1.smithi152.stdout:8/424: dread dd/d15/f68 [0,4194304] 0 2024-09-16T00:50:16.110 INFO:tasks.workunit.client.1.smithi152.stdout:2/545: unlink d4/c24 0 2024-09-16T00:50:16.110 INFO:tasks.workunit.client.1.smithi152.stdout:2/546: truncate d4/d19/d20/d28/d2c/d77/da7/fb5 404450 0 2024-09-16T00:50:16.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/590: dread db/d12/d23/d4a/f5a [0,4194304] 0 2024-09-16T00:50:16.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/591: dread - db/d12/d20/d4b/f4e zero size 2024-09-16T00:50:16.116 INFO:tasks.workunit.client.0.smithi053.stdout:8/236: stat d10/d21/l22 0 2024-09-16T00:50:16.118 INFO:tasks.workunit.client.1.smithi152.stdout:5/762: fsync d6/d16/d1f/f56 0 2024-09-16T00:50:16.118 INFO:tasks.workunit.client.1.smithi152.stdout:5/763: dread - d6/d57/d2b/d50/d6e/fc1 zero size 2024-09-16T00:50:16.118 INFO:tasks.workunit.client.1.smithi152.stdout:5/764: creat d6/d16/d1f/db5/dd3/f11d x:0 0 0 2024-09-16T00:50:16.122 INFO:tasks.workunit.client.0.smithi053.stdout:1/171: write d5/d7/f20 [1397010,59000] 0 2024-09-16T00:50:16.124 INFO:tasks.workunit.client.0.smithi053.stdout:4/133: rename d0/l22 to d0/d2/d1d/l2d 0 2024-09-16T00:50:16.125 INFO:tasks.workunit.client.0.smithi053.stdout:9/198: symlink d8/d1c/d2b/d2c/l42 0 2024-09-16T00:50:16.136 INFO:tasks.workunit.client.0.smithi053.stdout:8/237: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:16.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/547: dwrite d4/d44/d7a/f7c [0,4194304] 0 2024-09-16T00:50:16.142 INFO:tasks.workunit.client.0.smithi053.stdout:4/134: write d0/f15 [91622,52288] 0 2024-09-16T00:50:16.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/124: link d3/d7/d12/f23 d3/f27 0 2024-09-16T00:50:16.144 INFO:tasks.workunit.client.0.smithi053.stdout:6/105: rename d1/f1b to d1/dc/d11/f23 0 2024-09-16T00:50:16.145 INFO:tasks.workunit.client.1.smithi152.stdout:8/425: rmdir dd/d50/d29/d2f/d53 39 2024-09-16T00:50:16.146 INFO:tasks.workunit.client.0.smithi053.stdout:9/199: creat d8/d19/d31/f43 x:0 0 0 2024-09-16T00:50:16.151 INFO:tasks.workunit.client.1.smithi152.stdout:2/548: symlink d4/d44/d7a/d9e/d66/lb9 0 2024-09-16T00:50:16.152 INFO:tasks.workunit.client.0.smithi053.stdout:5/125: creat d3/d7/d24/f28 x:0 0 0 2024-09-16T00:50:16.153 INFO:tasks.workunit.client.1.smithi152.stdout:8/426: rmdir dd/d25/d77 39 2024-09-16T00:50:16.155 INFO:tasks.workunit.client.0.smithi053.stdout:2/97: rename d6/d9/fe to d6/d9/dd/f1c 0 2024-09-16T00:50:16.156 INFO:tasks.workunit.client.0.smithi053.stdout:2/98: chown c2 76033446 1 2024-09-16T00:50:16.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/549: symlink d4/d19/d94/d93/da4/lba 0 2024-09-16T00:50:16.165 INFO:tasks.workunit.client.1.smithi152.stdout:8/427: link dd/d15/d69/c81 dd/d15/d49/c8e 0 2024-09-16T00:50:16.165 INFO:tasks.workunit.client.1.smithi152.stdout:5/765: dwrite d6/d16/f4d [4194304,4194304] 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:5/766: write d6/d57/d2b/f47 [2124670,97286] 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/592: dwrite db/d12/d23/fac [4194304,4194304] 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/593: truncate db/d12/d23/d4a/d43/d48/d6a/f82 992446 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/594: read - db/d12/faf zero size 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/595: getdents db/da8/db7 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/596: write db/d12/d23/d4a/d33/f38 [1972425,103953] 0 2024-09-16T00:50:16.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/550: rename d4/d17/d3e/l43 to d4/d17/lbb 0 2024-09-16T00:50:16.167 INFO:tasks.workunit.client.0.smithi053.stdout:0/129: dwrite d4/d13/f1c [0,4194304] 0 2024-09-16T00:50:16.167 INFO:tasks.workunit.client.0.smithi053.stdout:9/200: symlink d8/d22/l44 0 2024-09-16T00:50:16.167 INFO:tasks.workunit.client.0.smithi053.stdout:9/201: readlink d8/d19/l25 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:9/202: creat d8/d22/d26/f45 x:0 0 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:9/203: fsync d8/d13/f20 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/237: dwrite d1/d5/d31/f38 [0,4194304] 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/238: read d1/d5/d31/f41 [239737,55164] 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/239: write d1/d5/d31/d3b/f44 [270782,93846] 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:8/238: mkdir d10/d52 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:8/239: readlink d10/d1c/l36 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.0.smithi053.stdout:1/172: dwrite d5/dd/f31 [0,4194304] 0 2024-09-16T00:50:16.168 INFO:tasks.workunit.client.1.smithi152.stdout:1/674: sync 2024-09-16T00:50:16.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/428: symlink dd/d15/d69/l8f 0 2024-09-16T00:50:16.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/429: dread - dd/d50/d29/f80 zero size 2024-09-16T00:50:16.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/430: fdatasync dd/d25/f79 0 2024-09-16T00:50:16.174 INFO:tasks.workunit.client.0.smithi053.stdout:4/135: rename d0/d2/d1d/l2a to d0/d2/l2e 0 2024-09-16T00:50:16.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/597: write db/d12/d20/d86/f8b [3906262,90809] 0 2024-09-16T00:50:16.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/598: read db/d12/f14 [1449784,89738] 0 2024-09-16T00:50:16.177 INFO:tasks.workunit.client.0.smithi053.stdout:6/106: rename d1/lb to d1/l24 0 2024-09-16T00:50:16.178 INFO:tasks.workunit.client.0.smithi053.stdout:1/173: write d5/f14 [3542764,115862] 0 2024-09-16T00:50:16.182 INFO:tasks.workunit.client.0.smithi053.stdout:0/130: creat d4/dc/d1e/f2c x:0 0 0 2024-09-16T00:50:16.183 INFO:tasks.workunit.client.1.smithi152.stdout:2/551: dread d4/d44/d7a/d9e/faf [0,4194304] 0 2024-09-16T00:50:16.186 INFO:tasks.workunit.client.0.smithi053.stdout:5/126: dwrite d3/d7/d12/f19 [0,4194304] 0 2024-09-16T00:50:16.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/204: link d8/f12 d8/f46 0 2024-09-16T00:50:16.188 INFO:tasks.workunit.client.1.smithi152.stdout:5/767: dwrite d6/d57/d2b/d50/d6e/ffd [0,4194304] 0 2024-09-16T00:50:16.189 INFO:tasks.workunit.client.0.smithi053.stdout:5/127: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:16.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/99: dwrite d6/f8 [4194304,4194304] 0 2024-09-16T00:50:16.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/100: creat d6/d9/f1d x:0 0 0 2024-09-16T00:50:16.190 INFO:tasks.workunit.client.0.smithi053.stdout:3/240: dread d1/d5/f3e [0,4194304] 0 2024-09-16T00:50:16.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/240: symlink d10/d52/l53 0 2024-09-16T00:50:16.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/241: stat d10/d1c/d2b/c46 0 2024-09-16T00:50:16.195 INFO:tasks.workunit.client.0.smithi053.stdout:3/241: dread d1/d5/d14/d28/f35 [0,4194304] 0 2024-09-16T00:50:16.197 INFO:tasks.workunit.client.1.smithi152.stdout:1/675: readlink d9/da/le 0 2024-09-16T00:50:16.197 INFO:tasks.workunit.client.1.smithi152.stdout:1/676: fsync d9/d3e/d7b/fdb 0 2024-09-16T00:50:16.197 INFO:tasks.workunit.client.1.smithi152.stdout:5/768: write d6/d16/d1f/d6c/f73 [2339832,102823] 0 2024-09-16T00:50:16.200 INFO:tasks.workunit.client.0.smithi053.stdout:4/136: symlink d0/d2/dd/l2f 0 2024-09-16T00:50:16.201 INFO:tasks.workunit.client.1.smithi152.stdout:6/599: mkdir db/dba 0 2024-09-16T00:50:16.203 INFO:tasks.workunit.client.1.smithi152.stdout:2/552: truncate d4/d19/f78 2768932 0 2024-09-16T00:50:16.204 INFO:tasks.workunit.client.0.smithi053.stdout:3/242: dread d1/d5/d16/f1f [0,4194304] 0 2024-09-16T00:50:16.205 INFO:tasks.workunit.client.0.smithi053.stdout:4/137: dread d0/d2/dd/d25/f24 [0,4194304] 0 2024-09-16T00:50:16.206 INFO:tasks.workunit.client.0.smithi053.stdout:1/174: unlink d5/f14 0 2024-09-16T00:50:16.212 INFO:tasks.workunit.client.1.smithi152.stdout:6/600: dread db/d12/d1c/f5c [0,4194304] 0 2024-09-16T00:50:16.212 INFO:tasks.workunit.client.1.smithi152.stdout:1/677: symlink d9/lfb 0 2024-09-16T00:50:16.216 INFO:tasks.workunit.client.1.smithi152.stdout:5/769: mknod d6/d16/d1f/d8c/db8/c11e 0 2024-09-16T00:50:16.216 INFO:tasks.workunit.client.1.smithi152.stdout:5/770: fdatasync d6/d57/d2b/d50/d64/df5/ffc 0 2024-09-16T00:50:16.220 INFO:tasks.workunit.client.1.smithi152.stdout:8/431: getdents dd/d23 0 2024-09-16T00:50:16.220 INFO:tasks.workunit.client.1.smithi152.stdout:8/432: chown dd/f72 11924 1 2024-09-16T00:50:16.220 INFO:tasks.workunit.client.1.smithi152.stdout:8/433: chown dd/f39 261356462 1 2024-09-16T00:50:16.221 INFO:tasks.workunit.client.1.smithi152.stdout:8/434: dread dd/d15/f68 [0,4194304] 0 2024-09-16T00:50:16.222 INFO:tasks.workunit.client.0.smithi053.stdout:9/205: truncate d8/f17 3349080 0 2024-09-16T00:50:16.225 INFO:tasks.workunit.client.0.smithi053.stdout:5/128: rmdir d3/d7/d12/d25 0 2024-09-16T00:50:16.226 INFO:tasks.workunit.client.0.smithi053.stdout:6/107: dwrite d1/f9 [0,4194304] 0 2024-09-16T00:50:16.227 INFO:tasks.workunit.client.1.smithi152.stdout:2/553: dwrite d4/d44/d7a/f8a [0,4194304] 0 2024-09-16T00:50:16.227 INFO:tasks.workunit.client.1.smithi152.stdout:2/554: fsync d4/d19/f4f 0 2024-09-16T00:50:16.232 INFO:tasks.workunit.client.0.smithi053.stdout:8/242: mkdir d10/d4a/d54 0 2024-09-16T00:50:16.232 INFO:tasks.workunit.client.0.smithi053.stdout:8/243: chown d10/f20 474 1 2024-09-16T00:50:16.232 INFO:tasks.workunit.client.0.smithi053.stdout:8/244: readlink d10/d1c/l36 0 2024-09-16T00:50:16.234 INFO:tasks.workunit.client.0.smithi053.stdout:5/129: write d3/f1b [377931,86438] 0 2024-09-16T00:50:16.234 INFO:tasks.workunit.client.0.smithi053.stdout:5/130: write d3/f20 [1216671,64546] 0 2024-09-16T00:50:16.234 INFO:tasks.workunit.client.0.smithi053.stdout:5/131: rename d3/d7 to d3/d7/d29 22 2024-09-16T00:50:16.234 INFO:tasks.workunit.client.0.smithi053.stdout:5/132: write d3/f27 [468112,77314] 0 2024-09-16T00:50:16.239 INFO:tasks.workunit.client.0.smithi053.stdout:3/243: link d1/d5/l27 d1/d5/d11/l53 0 2024-09-16T00:50:16.240 INFO:tasks.workunit.client.1.smithi152.stdout:6/601: mknod db/da8/db7/cbb 0 2024-09-16T00:50:16.242 INFO:tasks.workunit.client.0.smithi053.stdout:4/138: mknod d0/c30 0 2024-09-16T00:50:16.243 INFO:tasks.workunit.client.1.smithi152.stdout:1/678: chown d9/da/f72 0 1 2024-09-16T00:50:16.244 INFO:tasks.workunit.client.1.smithi152.stdout:1/679: creat d9/d3e/d4b/d6b/d6d/ffc x:0 0 0 2024-09-16T00:50:16.244 INFO:tasks.workunit.client.0.smithi053.stdout:1/175: symlink d5/l32 0 2024-09-16T00:50:16.246 INFO:tasks.workunit.client.0.smithi053.stdout:0/131: mkdir d4/d13/d2d 0 2024-09-16T00:50:16.248 INFO:tasks.workunit.client.0.smithi053.stdout:9/206: truncate f2 4426256 0 2024-09-16T00:50:16.248 INFO:tasks.workunit.client.0.smithi053.stdout:9/207: dread - d8/d13/f29 zero size 2024-09-16T00:50:16.253 INFO:tasks.workunit.client.0.smithi053.stdout:6/108: link d1/f5 d1/dc/d11/f25 0 2024-09-16T00:50:16.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/555: symlink d4/d19/d20/lbc 0 2024-09-16T00:50:16.258 INFO:tasks.workunit.client.1.smithi152.stdout:2/556: fdatasync d4/d19/f4f 0 2024-09-16T00:50:16.260 INFO:tasks.workunit.client.1.smithi152.stdout:9/572: sync 2024-09-16T00:50:16.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/680: rename d9/d3e/d41/d31/d48/d4a/f91 to d9/d3e/d4b/d6b/d6d/d97/ffd 0 2024-09-16T00:50:16.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/681: readlink d9/d3e/d41/d31/d48/d4a/la4 0 2024-09-16T00:50:16.266 INFO:tasks.workunit.client.0.smithi053.stdout:8/245: creat d10/d52/f55 x:0 0 0 2024-09-16T00:50:16.269 INFO:tasks.workunit.client.1.smithi152.stdout:8/435: mknod dd/c90 0 2024-09-16T00:50:16.270 INFO:tasks.workunit.client.1.smithi152.stdout:8/436: dread - dd/d15/d69/f89 zero size 2024-09-16T00:50:16.270 INFO:tasks.workunit.client.1.smithi152.stdout:8/437: write dd/d50/d29/f58 [3323126,8536] 0 2024-09-16T00:50:16.270 INFO:tasks.workunit.client.1.smithi152.stdout:8/438: dread - dd/d50/d29/f84 zero size 2024-09-16T00:50:16.270 INFO:tasks.workunit.client.1.smithi152.stdout:8/439: chown dd/d25/f70 54102214 1 2024-09-16T00:50:16.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/602: getdents db/d12/d23/d4a/d43/d48/d6a 0 2024-09-16T00:50:16.277 INFO:tasks.workunit.client.0.smithi053.stdout:6/109: dread d1/dc/d11/f16 [0,4194304] 0 2024-09-16T00:50:16.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/133: creat d3/d7/f2a x:0 0 0 2024-09-16T00:50:16.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/134: truncate d3/d7/d24/f28 969121 0 2024-09-16T00:50:16.278 INFO:tasks.workunit.client.0.smithi053.stdout:5/135: chown c2 1 1 2024-09-16T00:50:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.276+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfd4000bf0 con 0x7fbfd00395a0 2024-09-16T00:50:16.278 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: pgmap v8: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 95 MiB/s rd, 120 MiB/s wr, 212 op/s 2024-09-16T00:50:16.278 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: Standby manager daemon smithi053.cjiiek started 2024-09-16T00:50:16.278 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/crt"}]: dispatch 2024-09-16T00:50:16.278 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:50:16.279 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/key"}]: dispatch 2024-09-16T00:50:16.279 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:15 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/2' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:50:16.279 INFO:tasks.workunit.client.0.smithi053.stdout:8/246: write fb [367373,121160] 0 2024-09-16T00:50:16.279 INFO:tasks.workunit.client.0.smithi053.stdout:8/247: dread - d10/d21/f4b zero size 2024-09-16T00:50:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.278+0000 7fbfe5ffb700 1 -- 172.21.15.53:0/2655035903 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fbfd4000bf0 con 0x7fbfd00395a0 2024-09-16T00:50:16.280 INFO:tasks.workunit.client.1.smithi152.stdout:9/573: creat d1/d4e/d48/d26/d30/d8f/fbf x:0 0 0 2024-09-16T00:50:16.280 INFO:tasks.workunit.client.1.smithi152.stdout:9/574: write d1/d4e/d48/d2b/d93/fa7 [785994,21067] 0 2024-09-16T00:50:16.282 INFO:tasks.workunit.client.0.smithi053.stdout:3/244: mkdir d1/d54 0 2024-09-16T00:50:16.285 INFO:tasks.workunit.client.0.smithi053.stdout:4/139: mkdir d0/d31 0 2024-09-16T00:50:16.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 msgr2=0x7fbfd003ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 0x7fbfd003ba50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0059d0 tx=0x7fbfdc005920 comp rx=0 tx=0).stop 2024-09-16T00:50:16.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 msgr2=0x7fbfe819c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800b480 tx=0x7fbfd800b840 comp rx=0 tx=0).stop 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 shutdown_connections 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7fbfd00395a0 0x7fbfd003ba50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfe8106840 0x7fbfe819c180 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 --2- 172.21.15.53:0/2655035903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfe8107a40 0x7fbfe819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.284+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 >> 172.21.15.53:0/2655035903 conn(0x7fbfe8075800 msgr2=0x7fbfe810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.285+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 shutdown_connections 2024-09-16T00:50:16.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.285+0000 7fbfeeb9b700 1 -- 172.21.15.53:0/2655035903 wait complete. 2024-09-16T00:50:16.290 INFO:tasks.workunit.client.0.smithi053.stdout:1/176: rename d5/d7/d10/d2c to d5/d18/d33 0 2024-09-16T00:50:16.293 INFO:tasks.workunit.client.0.smithi053.stdout:9/208: creat d8/d1c/d2b/f47 x:0 0 0 2024-09-16T00:50:16.293 INFO:tasks.workunit.client.0.smithi053.stdout:9/209: creat d8/d1c/d2b/d2c/f48 x:0 0 0 2024-09-16T00:50:16.293 INFO:tasks.workunit.client.0.smithi053.stdout:0/132: mknod d4/dc/d23/d2a/c2e 0 2024-09-16T00:50:16.295 INFO:tasks.workunit.client.1.smithi152.stdout:2/557: dwrite d4/f5e [0,4194304] 0 2024-09-16T00:50:16.295 INFO:tasks.workunit.client.1.smithi152.stdout:2/558: chown d4/d19/d20/d28/c71 690880491 1 2024-09-16T00:50:16.296 INFO:tasks.workunit.client.1.smithi152.stdout:1/682: dwrite d9/d3e/d41/f3b [0,4194304] 0 2024-09-16T00:50:16.296 INFO:tasks.workunit.client.1.smithi152.stdout:9/575: dread d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:16.296 INFO:tasks.workunit.client.1.smithi152.stdout:9/576: write d1/d4e/d48/d2b/f70 [3210734,54033] 0 2024-09-16T00:50:16.297 INFO:tasks.workunit.client.1.smithi152.stdout:9/577: chown d1/d7/d13/d80/lb8 43 1 2024-09-16T00:50:16.297 INFO:tasks.workunit.client.1.smithi152.stdout:9/578: write d1/d4e/d34/f62 [4789541,59644] 0 2024-09-16T00:50:16.297 INFO:tasks.workunit.client.1.smithi152.stdout:8/440: dwrite dd/f72 [0,4194304] 0 2024-09-16T00:50:16.298 INFO:tasks.workunit.client.0.smithi053.stdout:4/140: dread d0/d2/f23 [0,4194304] 0 2024-09-16T00:50:16.299 INFO:tasks.workunit.client.0.smithi053.stdout:4/141: readlink d0/l4 0 2024-09-16T00:50:16.301 INFO:tasks.workunit.client.1.smithi152.stdout:4/676: sync 2024-09-16T00:50:16.301 INFO:tasks.workunit.client.1.smithi152.stdout:0/584: sync 2024-09-16T00:50:16.302 INFO:tasks.workunit.client.1.smithi152.stdout:0/585: readlink d3/d6/d8/d1d/l7a 0 2024-09-16T00:50:16.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/583: sync 2024-09-16T00:50:16.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/559: getdents d4/d44/d7a/d9e/d66 0 2024-09-16T00:50:16.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/560: chown d4/d17/f3a 1652 1 2024-09-16T00:50:16.304 INFO:tasks.workunit.client.0.smithi053.stdout:2/101: rmdir d6/d9 39 2024-09-16T00:50:16.305 INFO:tasks.workunit.client.1.smithi152.stdout:8/441: write dd/d25/f79 [1117667,1237] 0 2024-09-16T00:50:16.305 INFO:tasks.workunit.client.1.smithi152.stdout:8/442: chown dd/d15/d49/f3c 332 1 2024-09-16T00:50:16.305 INFO:tasks.workunit.client.1.smithi152.stdout:8/443: stat dd/f39 0 2024-09-16T00:50:16.306 INFO:tasks.workunit.client.0.smithi053.stdout:3/245: dwrite d1/f21 [0,4194304] 0 2024-09-16T00:50:16.306 INFO:tasks.workunit.client.0.smithi053.stdout:3/246: chown d1/d5/d14/f18 3 1 2024-09-16T00:50:16.306 INFO:tasks.workunit.client.0.smithi053.stdout:3/247: creat d1/d5/d11/f55 x:0 0 0 2024-09-16T00:50:16.307 INFO:tasks.workunit.client.0.smithi053.stdout:3/248: write d1/d5/d31/f3d [661814,94814] 0 2024-09-16T00:50:16.312 INFO:tasks.workunit.client.1.smithi152.stdout:6/603: dwrite db/d12/f14 [0,4194304] 0 2024-09-16T00:50:16.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/683: link d9/da/df/l35 d9/d3e/d41/d31/d48/d4a/lfe 0 2024-09-16T00:50:16.317 INFO:tasks.workunit.client.1.smithi152.stdout:6/604: dread db/d12/d1c/f3f [0,4194304] 0 2024-09-16T00:50:16.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/605: chown f9 158601363 1 2024-09-16T00:50:16.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/606: fsync db/d12/d1c/d80/f7a 0 2024-09-16T00:50:16.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/607: chown db/d12/d23/d4a/f5a 297879602 1 2024-09-16T00:50:16.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/608: read - db/d12/d1c/d80/d97/f99 zero size 2024-09-16T00:50:16.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/609: fdatasync db/d12/d20/f7e 0 2024-09-16T00:50:16.323 INFO:tasks.workunit.client.1.smithi152.stdout:9/579: unlink d1/d4e/d34/f84 0 2024-09-16T00:50:16.332 INFO:tasks.workunit.client.1.smithi152.stdout:4/677: rename d2/db/d39/cc8 to d2/d8e/ce3 0 2024-09-16T00:50:16.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/561: creat d4/d19/d94/d93/da4/fbd x:0 0 0 2024-09-16T00:50:16.335 INFO:tasks.workunit.client.1.smithi152.stdout:3/579: sync 2024-09-16T00:50:16.336 INFO:tasks.workunit.client.1.smithi152.stdout:3/580: truncate dc/d10/d17/d1c/d8d/d8e/f84 187812 0 2024-09-16T00:50:16.341 INFO:tasks.workunit.client.1.smithi152.stdout:6/610: dwrite db/d12/faf [0,4194304] 0 2024-09-16T00:50:16.341 INFO:tasks.workunit.client.0.smithi053.stdout:1/177: dwrite d5/d9/f1d [0,4194304] 0 2024-09-16T00:50:16.342 INFO:tasks.workunit.client.1.smithi152.stdout:8/444: creat dd/d25/f91 x:0 0 0 2024-09-16T00:50:16.342 INFO:tasks.workunit.client.0.smithi053.stdout:9/210: dwrite d8/f1d [0,4194304] 0 2024-09-16T00:50:16.342 INFO:tasks.workunit.client.1.smithi152.stdout:0/586: dwrite d3/d6/d8/d1d/d23/d25/d45/f5f [0,4194304] 0 2024-09-16T00:50:16.350 INFO:tasks.workunit.client.1.smithi152.stdout:1/684: link d9/d3e/f49 d9/d3e/d41/d31/d48/dd9/fff 0 2024-09-16T00:50:16.352 INFO:tasks.workunit.client.0.smithi053.stdout:5/136: mkdir d3/d7/d2b 0 2024-09-16T00:50:16.352 INFO:tasks.workunit.client.1.smithi152.stdout:1/685: write d9/da/df/f46 [177418,110697] 0 2024-09-16T00:50:16.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/580: mkdir d1/d4e/d48/d26/dc0 0 2024-09-16T00:50:16.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/678: dwrite d2/db/d39/d95/f96 [0,4194304] 0 2024-09-16T00:50:16.355 INFO:tasks.workunit.client.0.smithi053.stdout:8/248: mknod d10/d1c/d2b/d40/d50/c56 0 2024-09-16T00:50:16.355 INFO:tasks.workunit.client.0.smithi053.stdout:8/249: read d10/f14 [114794,34190] 0 2024-09-16T00:50:16.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/584: rename d9/f9f to d9/d31/d65/d6b/fc9 0 2024-09-16T00:50:16.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/562: dread - d4/d19/d20/d28/d2c/d77/da7/fb0 zero size 2024-09-16T00:50:16.362 INFO:tasks.workunit.client.0.smithi053.stdout:0/133: creat d4/dc/d25/f2f x:0 0 0 2024-09-16T00:50:16.369 INFO:tasks.workunit.client.0.smithi053.stdout:4/142: unlink d0/d2/d1d/l2d 0 2024-09-16T00:50:16.369 INFO:tasks.workunit.client.0.smithi053.stdout:4/143: truncate d0/d2/dd/d25/f21 182296 0 2024-09-16T00:50:16.369 INFO:tasks.workunit.client.0.smithi053.stdout:5/137: dread d3/f8 [4194304,4194304] 0 2024-09-16T00:50:16.370 INFO:tasks.workunit.client.1.smithi152.stdout:8/445: mkdir dd/d15/d1a/d92 0 2024-09-16T00:50:16.370 INFO:tasks.workunit.client.1.smithi152.stdout:2/563: dread d4/d19/d20/d28/f68 [0,4194304] 0 2024-09-16T00:50:16.370 INFO:tasks.workunit.client.1.smithi152.stdout:2/564: write d4/d44/d7a/d9e/d66/f97 [614226,630] 0 2024-09-16T00:50:16.371 INFO:tasks.workunit.client.0.smithi053.stdout:2/102: creat d6/d9/f1e x:0 0 0 2024-09-16T00:50:16.371 INFO:tasks.workunit.client.0.smithi053.stdout:2/103: chown f5 136674800 1 2024-09-16T00:50:16.375 INFO:tasks.workunit.client.0.smithi053.stdout:8/250: dread d10/d21/f3e [0,4194304] 0 2024-09-16T00:50:16.378 INFO:tasks.workunit.client.1.smithi152.stdout:8/446: write dd/d15/f18 [3004828,94155] 0 2024-09-16T00:50:16.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/581: dwrite dc/f15 [8388608,4194304] 0 2024-09-16T00:50:16.381 INFO:tasks.workunit.client.0.smithi053.stdout:3/249: symlink d1/d5/d16/d47/l56 0 2024-09-16T00:50:16.382 INFO:tasks.workunit.client.1.smithi152.stdout:9/581: dwrite d1/d7/d77/d32/f49 [0,4194304] 0 2024-09-16T00:50:16.382 INFO:tasks.workunit.client.1.smithi152.stdout:9/582: truncate d1/d7/d13/f27 5530163 0 2024-09-16T00:50:16.384 INFO:tasks.workunit.client.1.smithi152.stdout:0/587: dwrite d3/d6/d8/d1d/d23/d4b/d54/f90 [4194304,4194304] 0 2024-09-16T00:50:16.384 INFO:tasks.workunit.client.0.smithi053.stdout:1/178: truncate d5/dd/f1a 1214219 0 2024-09-16T00:50:16.384 INFO:tasks.workunit.client.0.smithi053.stdout:1/179: chown d5/c6 52 1 2024-09-16T00:50:16.392 INFO:tasks.workunit.client.1.smithi152.stdout:3/582: write dc/d10/d17/d1c/d8d/d8e/d2f/f48 [3516584,17256] 0 2024-09-16T00:50:16.392 INFO:tasks.workunit.client.1.smithi152.stdout:3/583: dread - dc/d10/d17/d5a/db2/d6f/d74/db5/f99 zero size 2024-09-16T00:50:16.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/584: fdatasync dc/d10/d17/f37 0 2024-09-16T00:50:16.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/585: chown dc/d10/d17/d1c/d1f 1187 1 2024-09-16T00:50:16.396 INFO:tasks.workunit.client.1.smithi152.stdout:0/588: dread d3/d6/d8/d1d/d23/d25/d2a/d5c/fa9 [0,4194304] 0 2024-09-16T00:50:16.396 INFO:tasks.workunit.client.1.smithi152.stdout:0/589: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fa0 [1093416,119432] 0 2024-09-16T00:50:16.396 INFO:tasks.workunit.client.0.smithi053.stdout:1/180: dread d5/d9/f1d [0,4194304] 0 2024-09-16T00:50:16.398 INFO:tasks.workunit.client.1.smithi152.stdout:4/679: link d2/d1e/d28/d69/cdd d2/d1e/d28/db7/ce4 0 2024-09-16T00:50:16.400 INFO:tasks.workunit.client.1.smithi152.stdout:1/686: rename d9/f84 to d9/d3e/d41/d31/d48/d4a/f100 0 2024-09-16T00:50:16.403 INFO:tasks.workunit.client.1.smithi152.stdout:7/585: symlink d9/d10/da5/lca 0 2024-09-16T00:50:16.403 INFO:tasks.workunit.client.1.smithi152.stdout:7/586: creat d9/d31/fcb x:0 0 0 2024-09-16T00:50:16.408 INFO:tasks.workunit.client.1.smithi152.stdout:8/447: mknod dd/d50/d88/c93 0 2024-09-16T00:50:16.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/565: dwrite d4/d19/d94/d8f/f91 [0,4194304] 0 2024-09-16T00:50:16.409 INFO:tasks.workunit.client.0.smithi053.stdout:8/251: dwrite f8 [0,4194304] 0 2024-09-16T00:50:16.412 INFO:tasks.workunit.client.0.smithi053.stdout:6/110: rename d1/c8 to d1/dc/c26 0 2024-09-16T00:50:16.412 INFO:tasks.workunit.client.0.smithi053.stdout:4/144: rename d0/d2/d26 to d0/d2/d26/d32 22 2024-09-16T00:50:16.417 INFO:tasks.workunit.client.0.smithi053.stdout:0/134: creat d4/f30 x:0 0 0 2024-09-16T00:50:16.417 INFO:tasks.workunit.client.0.smithi053.stdout:0/135: chown d4/dc/d1e/c2b 3117 1 2024-09-16T00:50:16.418 INFO:tasks.workunit.client.0.smithi053.stdout:8/252: dread d10/d21/f30 [0,4194304] 0 2024-09-16T00:50:16.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/583: symlink d1/d4e/d48/d26/d30/dba/lc1 0 2024-09-16T00:50:16.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/584: creat d1/d4e/d48/d26/d30/d4f/da2/fc2 x:0 0 0 2024-09-16T00:50:16.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/448: read dd/f39 [1272946,93792] 0 2024-09-16T00:50:16.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/449: chown dd/f42 571766 1 2024-09-16T00:50:16.420 INFO:tasks.workunit.client.0.smithi053.stdout:5/138: unlink d3/d7/d12/c16 0 2024-09-16T00:50:16.420 INFO:tasks.workunit.client.1.smithi152.stdout:7/587: dwrite d9/d31/f5f [0,4194304] 0 2024-09-16T00:50:16.421 INFO:tasks.workunit.client.0.smithi053.stdout:6/111: read d1/f15 [490932,128055] 0 2024-09-16T00:50:16.422 INFO:tasks.workunit.client.0.smithi053.stdout:2/104: rmdir d6/d9/dd 39 2024-09-16T00:50:16.426 INFO:tasks.workunit.client.1.smithi152.stdout:3/586: mknod dc/d5c/cb6 0 2024-09-16T00:50:16.426 INFO:tasks.workunit.client.0.smithi053.stdout:3/250: truncate d1/d5/d31/f41 258292 0 2024-09-16T00:50:16.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/590: mkdir d3/d6/d8/d1d/d65/db0/dc6 0 2024-09-16T00:50:16.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/591: readlink d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/la6 0 2024-09-16T00:50:16.430 INFO:tasks.workunit.client.0.smithi053.stdout:1/181: creat d5/dd/d19/f34 x:0 0 0 2024-09-16T00:50:16.435 INFO:tasks.workunit.client.0.smithi053.stdout:9/211: getdents d8/d1c/d2b 0 2024-09-16T00:50:16.435 INFO:tasks.workunit.client.1.smithi152.stdout:4/680: symlink d2/db/d39/le5 0 2024-09-16T00:50:16.438 INFO:tasks.workunit.client.1.smithi152.stdout:3/587: write f7 [7246450,69540] 0 2024-09-16T00:50:16.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/145: dwrite d0/d2/dd/d25/f21 [0,4194304] 0 2024-09-16T00:50:16.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/687: unlink d9/d3e/d41/d31/d48/db2/ccd 0 2024-09-16T00:50:16.447 INFO:tasks.workunit.client.0.smithi053.stdout:8/253: symlink d10/d1c/l57 0 2024-09-16T00:50:16.449 INFO:tasks.workunit.client.0.smithi053.stdout:7/202: sync 2024-09-16T00:50:16.450 INFO:tasks.workunit.client.0.smithi053.stdout:7/203: stat d1/d3/f5 0 2024-09-16T00:50:16.450 INFO:tasks.workunit.client.0.smithi053.stdout:7/204: dread - d1/d35/d14/f41 zero size 2024-09-16T00:50:16.450 INFO:tasks.workunit.client.0.smithi053.stdout:7/205: chown d1 10 1 2024-09-16T00:50:16.451 INFO:tasks.workunit.client.0.smithi053.stdout:5/139: creat d3/f2c x:0 0 0 2024-09-16T00:50:16.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/688: dread d9/d3e/d41/d31/d48/f55 [0,4194304] 0 2024-09-16T00:50:16.452 INFO:tasks.workunit.client.1.smithi152.stdout:5/771: sync 2024-09-16T00:50:16.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/772: chown d6/d57/d2b/d50/d66/cb1 4385470 1 2024-09-16T00:50:16.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/773: stat d6/fa5 0 2024-09-16T00:50:16.453 INFO:tasks.workunit.client.1.smithi152.stdout:5/774: stat d6/d57/d2b/dee/l103 0 2024-09-16T00:50:16.453 INFO:tasks.workunit.client.0.smithi053.stdout:6/112: mknod d1/dc/d1e/c27 0 2024-09-16T00:50:16.453 INFO:tasks.workunit.client.0.smithi053.stdout:6/113: chown d1/dc/d11/l1a 14743455 1 2024-09-16T00:50:16.454 INFO:tasks.workunit.client.1.smithi152.stdout:7/588: dwrite d9/d31/d65/d8a/d90/fa4 [0,4194304] 0 2024-09-16T00:50:16.454 INFO:tasks.workunit.client.1.smithi152.stdout:0/592: dwrite d3/d6/d51/f57 [0,4194304] 0 2024-09-16T00:50:16.456 INFO:tasks.workunit.client.0.smithi053.stdout:2/105: dwrite d6/d9/dd/f1c [4194304,4194304] 0 2024-09-16T00:50:16.456 INFO:tasks.workunit.client.0.smithi053.stdout:2/106: dread - d6/f18 zero size 2024-09-16T00:50:16.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/140: dread d3/d7/d12/f23 [0,4194304] 0 2024-09-16T00:50:16.458 INFO:tasks.workunit.client.0.smithi053.stdout:1/182: link d5/d18/f1b d5/d18/d1f/f35 0 2024-09-16T00:50:16.462 INFO:tasks.workunit.client.0.smithi053.stdout:9/212: mkdir d8/d1c/d2b/d49 0 2024-09-16T00:50:16.462 INFO:tasks.workunit.client.1.smithi152.stdout:5/775: dread d6/d16/d1f/f10b [0,4194304] 0 2024-09-16T00:50:16.465 INFO:tasks.workunit.client.1.smithi152.stdout:2/566: truncate d4/d19/d20/d28/d2c/d77/da7/fb5 124995 0 2024-09-16T00:50:16.465 INFO:tasks.workunit.client.1.smithi152.stdout:2/567: chown d4/d17/d3e 59864 1 2024-09-16T00:50:16.465 INFO:tasks.workunit.client.1.smithi152.stdout:2/568: readlink d4/d17/lbb 0 2024-09-16T00:50:16.466 INFO:tasks.workunit.client.1.smithi152.stdout:2/569: write d4/d44/d7a/d9e/d87/d9c/fae [824032,117327] 0 2024-09-16T00:50:16.466 INFO:tasks.workunit.client.1.smithi152.stdout:2/570: chown d4/d19/d94/c70 0 1 2024-09-16T00:50:16.468 INFO:tasks.workunit.client.0.smithi053.stdout:5/141: dread d3/d7/d12/f19 [0,4194304] 0 2024-09-16T00:50:16.476 INFO:tasks.workunit.client.0.smithi053.stdout:4/146: dread d0/d2/dd/d25/f24 [0,4194304] 0 2024-09-16T00:50:16.477 INFO:tasks.workunit.client.0.smithi053.stdout:0/136: symlink d4/d13/l31 0 2024-09-16T00:50:16.477 INFO:tasks.workunit.client.0.smithi053.stdout:0/137: chown d4/l12 3 1 2024-09-16T00:50:16.480 INFO:tasks.workunit.client.0.smithi053.stdout:1/183: dwrite d5/d18/d1f/f35 [0,4194304] 0 2024-09-16T00:50:16.480 INFO:tasks.workunit.client.1.smithi152.stdout:5/776: dwrite d6/fa5 [0,4194304] 0 2024-09-16T00:50:16.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/777: write d6/d57/f3c [4426546,66918] 0 2024-09-16T00:50:16.482 INFO:tasks.workunit.client.0.smithi053.stdout:8/254: mkdir d10/d1c/d2b/d58 0 2024-09-16T00:50:16.484 INFO:tasks.workunit.client.0.smithi053.stdout:0/138: write d4/d13/f1c [3585781,31717] 0 2024-09-16T00:50:16.488 INFO:tasks.workunit.client.0.smithi053.stdout:6/114: mknod d1/dc/d1e/c28 0 2024-09-16T00:50:16.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.487+0000 7f32c49fe700 1 -- 172.21.15.53:0/3544063561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 msgr2=0x7f32c0100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.487+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3544063561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0100790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009910 tx=0x7f32b4009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 -- 172.21.15.53:0/3544063561 shutdown_connections 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3544063561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0100790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3544063561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c00ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 -- 172.21.15.53:0/3544063561 >> 172.21.15.53:0/3544063561 conn(0x7f32c00fa6d0 msgr2=0x7f32c00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 -- 172.21.15.53:0/3544063561 shutdown_connections 2024-09-16T00:50:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.488+0000 7f32c49fe700 1 -- 172.21.15.53:0/3544063561 wait complete. 2024-09-16T00:50:16.491 INFO:tasks.workunit.client.0.smithi053.stdout:2/107: getdents d6/d9/dd 0 2024-09-16T00:50:16.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/778: write d6/d16/d1f/d6c/fbd [1555864,70712] 0 2024-09-16T00:50:16.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/779: fsync d6/d57/d2b/d50/d64/fa4 0 2024-09-16T00:50:16.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 Processor -- start 2024-09-16T00:50:16.492 INFO:tasks.workunit.client.0.smithi053.stdout:6/115: write d1/fd [1977885,20498] 0 2024-09-16T00:50:16.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 -- start start 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c0195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0196630 con 0x7f32c0100340 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32c49fe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0196770 con 0x7f32c00ff140 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32be59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c0195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32bdd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48510/0 (socket says 172.21.15.53:48510) 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.490+0000 7f32bdd9b700 1 -- 172.21.15.53:0/3435640002 learned_addr learned my addr 172.21.15.53:0/3435640002 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32bdd9b700 1 -- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 msgr2=0x7f32c0195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32bdd9b700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c0195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32bdd9b700 1 -- 172.21.15.53:0/3435640002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40095f0 con 0x7f32c0100340 2024-09-16T00:50:16.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32be59c700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c0195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:50:16.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32bdd9b700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f32b400fa00 tx=0x7f32b400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:16.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b401d070 con 0x7f32c0100340 2024-09-16T00:50:16.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c006a8b0 con 0x7f32c0100340 2024-09-16T00:50:16.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c006ada0 con 0x7f32c0100340 2024-09-16T00:50:16.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.491+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32b4005640 con 0x7f32c0100340 2024-09-16T00:50:16.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.492+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b4017630 con 0x7f32c0100340 2024-09-16T00:50:16.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.493+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0108d90 con 0x7f32c0100340 2024-09-16T00:50:16.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.494+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f32b4003680 con 0x7f32c0100340 2024-09-16T00:50:16.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/450: unlink dd/l71 0 2024-09-16T00:50:16.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.494+0000 7f32af7fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 0x7f32a806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:16.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.495+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f32b408e5d0 con 0x7f32c0100340 2024-09-16T00:50:16.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.495+0000 7f32be59c700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 0x7f32a806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:16.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.496+0000 7f32be59c700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 0x7f32a806faf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f32c01001a0 tx=0x7f32b0009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:16.499 INFO:tasks.workunit.client.0.smithi053.stdout:6/116: dread d1/dc/d11/f16 [0,4194304] 0 2024-09-16T00:50:16.500 INFO:tasks.workunit.client.0.smithi053.stdout:5/142: creat d3/f2d x:0 0 0 2024-09-16T00:50:16.501 INFO:tasks.workunit.client.0.smithi053.stdout:4/147: chown d0/c30 4609943 1 2024-09-16T00:50:16.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/681: creat d2/db/fe6 x:0 0 0 2024-09-16T00:50:16.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/682: fdatasync d2/db/d39/d3c/fa3 0 2024-09-16T00:50:16.503 INFO:tasks.workunit.client.1.smithi152.stdout:4/683: creat d2/d41/fe7 x:0 0 0 2024-09-16T00:50:16.503 INFO:tasks.workunit.client.1.smithi152.stdout:4/684: fsync d2/d1e/d28/d7b/fc7 0 2024-09-16T00:50:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.501+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f32b405b760 con 0x7f32c0100340 2024-09-16T00:50:16.507 INFO:tasks.workunit.client.0.smithi053.stdout:1/184: rename l3 to d5/d18/d1f/l36 0 2024-09-16T00:50:16.509 INFO:tasks.workunit.client.0.smithi053.stdout:8/255: mknod d10/d4a/c59 0 2024-09-16T00:50:16.510 INFO:tasks.workunit.client.0.smithi053.stdout:8/256: fdatasync d10/d21/d28/f34 0 2024-09-16T00:50:16.512 INFO:tasks.workunit.client.0.smithi053.stdout:0/139: unlink d4/dc/d1e/f2c 0 2024-09-16T00:50:16.512 INFO:tasks.workunit.client.0.smithi053.stdout:0/140: chown d4/c15 346 1 2024-09-16T00:50:16.512 INFO:tasks.workunit.client.0.smithi053.stdout:0/141: read - d4/dc/d25/f2f zero size 2024-09-16T00:50:16.512 INFO:tasks.workunit.client.0.smithi053.stdout:0/142: creat d4/dc/d25/f32 x:0 0 0 2024-09-16T00:50:16.512 INFO:tasks.workunit.client.0.smithi053.stdout:0/143: fsync d4/dc/f1b 0 2024-09-16T00:50:16.513 INFO:tasks.workunit.client.1.smithi152.stdout:7/589: symlink d9/d31/d65/d8a/lcc 0 2024-09-16T00:50:16.514 INFO:tasks.workunit.client.0.smithi053.stdout:7/206: link d1/d35/d14/d27/f37 d1/d35/d14/d27/d2c/f4d 0 2024-09-16T00:50:16.514 INFO:tasks.workunit.client.0.smithi053.stdout:7/207: chown d1/d2a/f3b 0 1 2024-09-16T00:50:16.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/593: symlink d3/d6/d8/d1d/d23/d25/d2a/lc7 0 2024-09-16T00:50:16.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/594: write d3/d6/d8/d1d/d65/db0/db6/fc3 [958316,98106] 0 2024-09-16T00:50:16.516 INFO:tasks.workunit.client.1.smithi152.stdout:7/590: dread d9/f23 [0,4194304] 0 2024-09-16T00:50:16.517 INFO:tasks.workunit.client.0.smithi053.stdout:2/108: link d6/d9/f12 d6/d9/d14/f1f 0 2024-09-16T00:50:16.518 INFO:tasks.workunit.client.0.smithi053.stdout:1/185: write d5/dd/d19/f26 [428338,5937] 0 2024-09-16T00:50:16.518 INFO:tasks.workunit.client.0.smithi053.stdout:1/186: chown d5/dd/d19/f34 3 1 2024-09-16T00:50:16.518 INFO:tasks.workunit.client.0.smithi053.stdout:1/187: chown d5/d7/d10/c29 0 1 2024-09-16T00:50:16.519 INFO:tasks.workunit.client.1.smithi152.stdout:0/595: write d3/d6/d6d/f8e [6184684,23207] 0 2024-09-16T00:50:16.522 INFO:tasks.workunit.client.0.smithi053.stdout:9/213: rmdir d8/d19 39 2024-09-16T00:50:16.522 INFO:tasks.workunit.client.0.smithi053.stdout:9/214: stat f4 0 2024-09-16T00:50:16.525 INFO:tasks.workunit.client.0.smithi053.stdout:2/109: read d6/d9/d14/f1f [2753949,33611] 0 2024-09-16T00:50:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:2/571: creat d4/d19/d20/d28/d2c/d77/da5/fbe x:0 0 0 2024-09-16T00:50:16.526 INFO:tasks.workunit.client.0.smithi053.stdout:1/188: dread d5/dd/d19/f26 [0,4194304] 0 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/117: getdents d1/dc 0 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/118: dread - d1/dc/d11/f1c zero size 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/119: fsync d1/dc/d11/f23 0 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/120: fdatasync d1/dc/d11/f13 0 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/121: dread - d1/dc/f18 zero size 2024-09-16T00:50:16.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/122: write d1/ff [1151571,101829] 0 2024-09-16T00:50:16.530 INFO:tasks.workunit.client.0.smithi053.stdout:9/215: dread d8/f46 [0,4194304] 0 2024-09-16T00:50:16.533 INFO:tasks.workunit.client.0.smithi053.stdout:4/148: symlink d0/d2/d1e/l33 0 2024-09-16T00:50:16.533 INFO:tasks.workunit.client.0.smithi053.stdout:4/149: creat d0/d2/f34 x:0 0 0 2024-09-16T00:50:16.534 INFO:tasks.workunit.client.1.smithi152.stdout:5/780: mkdir d6/d57/ddc/d11a/d11f 0 2024-09-16T00:50:16.536 INFO:tasks.workunit.client.1.smithi152.stdout:9/585: rmdir d1/d7/d13/d80 39 2024-09-16T00:50:16.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/451: rename dd/d15/d69/c8b to dd/d15/d69/c94 0 2024-09-16T00:50:16.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/452: fsync dd/d15/f7a 0 2024-09-16T00:50:16.541 INFO:tasks.workunit.client.0.smithi053.stdout:0/144: creat d4/dc/d23/d2a/d27/f33 x:0 0 0 2024-09-16T00:50:16.541 INFO:tasks.workunit.client.0.smithi053.stdout:0/145: chown d4/dc/c28 19 1 2024-09-16T00:50:16.546 INFO:tasks.workunit.client.0.smithi053.stdout:2/110: mknod d6/d9/c20 0 2024-09-16T00:50:16.547 INFO:tasks.workunit.client.1.smithi152.stdout:1/689: rmdir d9/d3e/d7b 39 2024-09-16T00:50:16.549 INFO:tasks.workunit.client.0.smithi053.stdout:1/189: creat d5/d7/d10/f37 x:0 0 0 2024-09-16T00:50:16.550 INFO:tasks.workunit.client.1.smithi152.stdout:8/453: dread dd/f39 [0,4194304] 0 2024-09-16T00:50:16.550 INFO:tasks.workunit.client.1.smithi152.stdout:8/454: fsync dd/d50/d29/f80 0 2024-09-16T00:50:16.552 INFO:tasks.workunit.client.0.smithi053.stdout:6/123: mknod d1/dc/d1e/c29 0 2024-09-16T00:50:16.554 INFO:tasks.workunit.client.0.smithi053.stdout:5/143: rename d3/f1b to d3/f2e 0 2024-09-16T00:50:16.554 INFO:tasks.workunit.client.0.smithi053.stdout:5/144: readlink d3/d7/l15 0 2024-09-16T00:50:16.556 INFO:tasks.workunit.client.0.smithi053.stdout:9/216: dwrite d8/d19/d31/f43 [0,4194304] 0 2024-09-16T00:50:16.556 INFO:tasks.workunit.client.1.smithi152.stdout:7/591: link d9/d31/d65/d8a/f55 d9/d31/d64/d3c/db9/dc2/fcd 0 2024-09-16T00:50:16.556 INFO:tasks.workunit.client.1.smithi152.stdout:9/586: dwrite d1/d4e/d48/d66/d76/fa4 [0,4194304] 0 2024-09-16T00:50:16.558 INFO:tasks.workunit.client.1.smithi152.stdout:9/587: dread d1/d4e/d48/d2b/d93/fa7 [0,4194304] 0 2024-09-16T00:50:16.559 INFO:tasks.workunit.client.0.smithi053.stdout:4/150: creat d0/d2/dd/d25/f35 x:0 0 0 2024-09-16T00:50:16.560 INFO:tasks.workunit.client.0.smithi053.stdout:4/151: chown d0/d2/d1d 28 1 2024-09-16T00:50:16.561 INFO:tasks.workunit.client.1.smithi152.stdout:0/596: link d3/d6/d64/d6a/fb3 d3/d6/d8/d9e/fc8 0 2024-09-16T00:50:16.561 INFO:tasks.workunit.client.0.smithi053.stdout:8/257: getdents d10/d1c/d2b/d40 0 2024-09-16T00:50:16.562 INFO:tasks.workunit.client.0.smithi053.stdout:7/208: dread d1/d35/d14/d27/f30 [0,4194304] 0 2024-09-16T00:50:16.562 INFO:tasks.workunit.client.0.smithi053.stdout:7/209: fdatasync d1/d35/d14/d15/f1d 0 2024-09-16T00:50:16.563 INFO:tasks.workunit.client.1.smithi152.stdout:2/572: fsync d4/d19/d20/d28/d2c/f79 0 2024-09-16T00:50:16.565 INFO:tasks.workunit.client.0.smithi053.stdout:6/124: dread d1/fd [0,4194304] 0 2024-09-16T00:50:16.567 INFO:tasks.workunit.client.1.smithi152.stdout:9/588: read d1/d7/d77/d32/f49 [4025991,77742] 0 2024-09-16T00:50:16.568 INFO:tasks.workunit.client.1.smithi152.stdout:5/781: creat d6/d16/d1f/d6c/de2/d106/f120 x:0 0 0 2024-09-16T00:50:16.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/592: dread d9/f25 [4194304,4194304] 0 2024-09-16T00:50:16.572 INFO:tasks.workunit.client.0.smithi053.stdout:5/145: mkdir d3/d7/d2b/d2f 0 2024-09-16T00:50:16.573 INFO:tasks.workunit.client.0.smithi053.stdout:5/146: creat d3/d7/d24/f30 x:0 0 0 2024-09-16T00:50:16.573 INFO:tasks.workunit.client.0.smithi053.stdout:5/147: truncate d3/f20 1307680 0 2024-09-16T00:50:16.573 INFO:tasks.workunit.client.1.smithi152.stdout:2/573: dread d4/d19/f25 [0,4194304] 0 2024-09-16T00:50:16.577 INFO:tasks.workunit.client.1.smithi152.stdout:5/782: write d6/d16/f23 [1274166,94220] 0 2024-09-16T00:50:16.583 INFO:tasks.workunit.client.0.smithi053.stdout:4/152: creat d0/d2/d1d/f36 x:0 0 0 2024-09-16T00:50:16.584 INFO:tasks.workunit.client.1.smithi152.stdout:0/597: rmdir d3/d6/d8/d1d/d23 39 2024-09-16T00:50:16.585 INFO:tasks.workunit.client.1.smithi152.stdout:6/611: sync 2024-09-16T00:50:16.586 INFO:tasks.workunit.client.0.smithi053.stdout:8/258: creat d10/d1c/d49/f5a x:0 0 0 2024-09-16T00:50:16.586 INFO:tasks.workunit.client.0.smithi053.stdout:8/259: getdents d10/d1c/d2b/d58 0 2024-09-16T00:50:16.586 INFO:tasks.workunit.client.0.smithi053.stdout:8/260: write d10/f14 [226787,10651] 0 2024-09-16T00:50:16.586 INFO:tasks.workunit.client.0.smithi053.stdout:8/261: fdatasync d10/f20 0 2024-09-16T00:50:16.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/589: mkdir d1/d4e/d48/d26/dc0/dc3 0 2024-09-16T00:50:16.589 INFO:tasks.workunit.client.0.smithi053.stdout:7/210: symlink d1/d35/d14/l4e 0 2024-09-16T00:50:16.590 INFO:tasks.workunit.client.1.smithi152.stdout:7/593: creat d9/d10/dc0/fce x:0 0 0 2024-09-16T00:50:16.592 INFO:tasks.workunit.client.1.smithi152.stdout:2/574: mknod d4/d44/d7a/cbf 0 2024-09-16T00:50:16.594 INFO:tasks.workunit.client.0.smithi053.stdout:6/125: unlink d1/dc/l10 0 2024-09-16T00:50:16.595 INFO:tasks.workunit.client.1.smithi152.stdout:5/783: mkdir d6/d16/d121 0 2024-09-16T00:50:16.597 INFO:tasks.workunit.client.0.smithi053.stdout:0/146: rename d4/dc/d23 to d4/dc/d25/d34 0 2024-09-16T00:50:16.597 INFO:tasks.workunit.client.0.smithi053.stdout:0/147: stat d4/dc/d1e/c20 0 2024-09-16T00:50:16.599 INFO:tasks.workunit.client.1.smithi152.stdout:7/594: write d9/d31/fbe [4204343,82883] 0 2024-09-16T00:50:16.600 INFO:tasks.workunit.client.0.smithi053.stdout:2/111: getdents d6/d9 0 2024-09-16T00:50:16.600 INFO:tasks.workunit.client.1.smithi152.stdout:0/598: link d3/d6/d64/f80 d3/d6/d8/d1d/d65/db0/fc9 0 2024-09-16T00:50:16.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/612: mkdir db/d12/d23/d3a/dbc 0 2024-09-16T00:50:16.605 INFO:tasks.workunit.client.1.smithi152.stdout:9/590: rename d1/d4e/d48/d26/d30/dba to d1/d4e/d48/d26/d30/d8f/dc4 0 2024-09-16T00:50:16.606 INFO:tasks.workunit.client.0.smithi053.stdout:5/148: symlink d3/d7/d24/l31 0 2024-09-16T00:50:16.607 INFO:tasks.workunit.client.1.smithi152.stdout:2/575: chown d4/d19/d20/d28/d2c/c3c 343 1 2024-09-16T00:50:16.607 INFO:tasks.workunit.client.1.smithi152.stdout:2/576: fdatasync d4/d19/d20/d28/f52 0 2024-09-16T00:50:16.609 INFO:tasks.workunit.client.0.smithi053.stdout:4/153: mkdir d0/d2/dd/d25/d37 0 2024-09-16T00:50:16.609 INFO:tasks.workunit.client.0.smithi053.stdout:4/154: chown d0/d2/d1d 109 1 2024-09-16T00:50:16.609 INFO:tasks.workunit.client.0.smithi053.stdout:4/155: write d0/d2/dd/d25/f35 [538738,119981] 0 2024-09-16T00:50:16.609 INFO:tasks.workunit.client.0.smithi053.stdout:4/156: truncate d0/d2/f28 335642 0 2024-09-16T00:50:16.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/126: creat d1/dc/d1e/f2a x:0 0 0 2024-09-16T00:50:16.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/613: dread db/d12/f1a [0,4194304] 0 2024-09-16T00:50:16.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/614: chown db/d12/d23/d4a/d43/d48/ca9 27680898 1 2024-09-16T00:50:16.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/615: chown db/d28/db3 635155929 1 2024-09-16T00:50:16.612 INFO:tasks.workunit.client.1.smithi152.stdout:7/595: write d9/d31/f5f [4095762,9897] 0 2024-09-16T00:50:16.613 INFO:tasks.workunit.client.1.smithi152.stdout:7/596: readlink d9/l21 0 2024-09-16T00:50:16.613 INFO:tasks.workunit.client.1.smithi152.stdout:9/591: mkdir d1/d7/d77/d32/da5/da8/dc5 0 2024-09-16T00:50:16.613 INFO:tasks.workunit.client.1.smithi152.stdout:9/592: chown d1/d4e/d48/d66/c9d 1353755 1 2024-09-16T00:50:16.614 INFO:tasks.workunit.client.0.smithi053.stdout:9/217: rename d8/d22/f40 to d8/d19/f4a 0 2024-09-16T00:50:16.616 INFO:tasks.workunit.client.0.smithi053.stdout:0/148: mknod d4/dc/d1e/c35 0 2024-09-16T00:50:16.617 INFO:tasks.workunit.client.0.smithi053.stdout:2/112: symlink d6/d9/d14/l21 0 2024-09-16T00:50:16.618 INFO:tasks.workunit.client.0.smithi053.stdout:2/113: chown d6/d9 258063533 1 2024-09-16T00:50:16.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/149: creat d3/f32 x:0 0 0 2024-09-16T00:50:16.621 INFO:tasks.workunit.client.0.smithi053.stdout:4/157: creat d0/f38 x:0 0 0 2024-09-16T00:50:16.623 INFO:tasks.workunit.client.0.smithi053.stdout:6/127: creat d1/f2b x:0 0 0 2024-09-16T00:50:16.623 INFO:tasks.workunit.client.0.smithi053.stdout:6/128: write d1/dc/f18 [680496,109601] 0 2024-09-16T00:50:16.623 INFO:tasks.workunit.client.0.smithi053.stdout:6/129: write d1/dc/d11/f1c [747417,99936] 0 2024-09-16T00:50:16.625 INFO:tasks.workunit.client.0.smithi053.stdout:9/218: rmdir d8/d19/d31 39 2024-09-16T00:50:16.625 INFO:tasks.workunit.client.0.smithi053.stdout:8/262: dwrite d10/f3f [0,4194304] 0 2024-09-16T00:50:16.625 INFO:tasks.workunit.client.0.smithi053.stdout:7/211: dwrite d1/d35/d4a/f4c [0,4194304] 0 2024-09-16T00:50:16.625 INFO:tasks.workunit.client.1.smithi152.stdout:0/599: dwrite d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad [0,4194304] 0 2024-09-16T00:50:16.625 INFO:tasks.workunit.client.1.smithi152.stdout:0/600: creat d3/d6/d8/fca x:0 0 0 2024-09-16T00:50:16.626 INFO:tasks.workunit.client.1.smithi152.stdout:0/601: write d3/d6/d8/d1d/d23/d4b/d54/f90 [2819554,33380] 0 2024-09-16T00:50:16.627 INFO:tasks.workunit.client.0.smithi053.stdout:0/149: rename d4/dc/c28 to d4/dc/c36 0 2024-09-16T00:50:16.628 INFO:tasks.workunit.client.0.smithi053.stdout:0/150: write d4/dc/d1e/d22/f29 [5091271,91269] 0 2024-09-16T00:50:16.629 INFO:tasks.workunit.client.1.smithi152.stdout:5/784: rmdir d6/d57 39 2024-09-16T00:50:16.631 INFO:tasks.workunit.client.0.smithi053.stdout:2/114: mknod d6/d9/d14/c22 0 2024-09-16T00:50:16.633 INFO:tasks.workunit.client.1.smithi152.stdout:6/616: creat db/d12/d20/d86/d91/fbd x:0 0 0 2024-09-16T00:50:16.633 INFO:tasks.workunit.client.1.smithi152.stdout:6/617: write db/d12/f1a [3191401,91878] 0 2024-09-16T00:50:16.634 INFO:tasks.workunit.client.0.smithi053.stdout:5/150: mkdir d3/d7/d24/d33 0 2024-09-16T00:50:16.636 INFO:tasks.workunit.client.1.smithi152.stdout:7/597: getdents d9/d31/d64/d3c/db9/dc2 0 2024-09-16T00:50:16.639 INFO:tasks.workunit.client.0.smithi053.stdout:2/115: dread d6/d9/dd/f1c [0,4194304] 0 2024-09-16T00:50:16.639 INFO:tasks.workunit.client.0.smithi053.stdout:2/116: stat d6/d9/d14/l19 0 2024-09-16T00:50:16.640 INFO:tasks.workunit.client.0.smithi053.stdout:6/130: rename d1/ff to d1/dc/d11/f2c 0 2024-09-16T00:50:16.642 INFO:tasks.workunit.client.1.smithi152.stdout:9/593: link d1/d7/d77/f33 d1/d4e/d48/d2b/d93/fc6 0 2024-09-16T00:50:16.642 INFO:tasks.workunit.client.1.smithi152.stdout:9/594: write d1/d7/d77/d32/f49 [3280501,55466] 0 2024-09-16T00:50:16.643 INFO:tasks.workunit.client.0.smithi053.stdout:9/219: mknod d8/d19/d31/d37/c4b 0 2024-09-16T00:50:16.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/577: symlink d4/d19/d20/d28/d2c/lc0 0 2024-09-16T00:50:16.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/578: fdatasync d4/d19/d20/d28/f68 0 2024-09-16T00:50:16.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/579: readlink d4/d19/d20/l42 0 2024-09-16T00:50:16.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/580: chown d4/d19/d20/d28/d2c/d77/c90 65244 1 2024-09-16T00:50:16.650 INFO:tasks.workunit.client.0.smithi053.stdout:4/158: dread d0/f5 [4194304,4194304] 0 2024-09-16T00:50:16.651 INFO:tasks.workunit.client.0.smithi053.stdout:8/263: mkdir d10/d52/d5b 0 2024-09-16T00:50:16.651 INFO:tasks.workunit.client.1.smithi152.stdout:7/598: write d9/d31/d65/d8a/d41/f50 [226984,83045] 0 2024-09-16T00:50:16.651 INFO:tasks.workunit.client.1.smithi152.stdout:7/599: rename d9 to d9/d31/d64/d3c/dcf 22 2024-09-16T00:50:16.654 INFO:tasks.workunit.client.0.smithi053.stdout:5/151: dwrite d3/d7/d12/f19 [0,4194304] 0 2024-09-16T00:50:16.654 INFO:tasks.workunit.client.0.smithi053.stdout:5/152: chown d3/d7/d12/f21 7490475 1 2024-09-16T00:50:16.656 INFO:tasks.workunit.client.0.smithi053.stdout:7/212: truncate d1/d35/d14/d27/f30 2926097 0 2024-09-16T00:50:16.661 INFO:tasks.workunit.client.0.smithi053.stdout:0/151: creat d4/dc/d25/d34/d2a/d27/f37 x:0 0 0 2024-09-16T00:50:16.668 INFO:tasks.workunit.client.0.smithi053.stdout:9/220: stat d8/d1c/l2d 0 2024-09-16T00:50:16.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/618: truncate db/f18 7827758 0 2024-09-16T00:50:16.670 INFO:tasks.workunit.client.0.smithi053.stdout:4/159: chown d0/cf 29699 1 2024-09-16T00:50:16.672 INFO:tasks.workunit.client.1.smithi152.stdout:9/595: creat d1/d4e/d48/fc7 x:0 0 0 2024-09-16T00:50:16.676 INFO:tasks.workunit.client.0.smithi053.stdout:6/131: dwrite d1/f9 [0,4194304] 0 2024-09-16T00:50:16.677 INFO:tasks.workunit.client.0.smithi053.stdout:7/213: dwrite d1/d35/d14/d27/d2c/f4d [0,4194304] 0 2024-09-16T00:50:16.677 INFO:tasks.workunit.client.0.smithi053.stdout:0/152: write d4/dc/f14 [2405152,48376] 0 2024-09-16T00:50:16.677 INFO:tasks.workunit.client.0.smithi053.stdout:0/153: write d4/f30 [858046,2531] 0 2024-09-16T00:50:16.678 INFO:tasks.workunit.client.0.smithi053.stdout:5/153: rename d3/d7/d24/d33 to d3/d7/d24/d34 0 2024-09-16T00:50:16.679 INFO:tasks.workunit.client.0.smithi053.stdout:2/117: dwrite f3 [0,4194304] 0 2024-09-16T00:50:16.679 INFO:tasks.workunit.client.0.smithi053.stdout:2/118: truncate d6/d9/f1e 380854 0 2024-09-16T00:50:16.679 INFO:tasks.workunit.client.0.smithi053.stdout:2/119: stat d6/d9/dd/f10 0 2024-09-16T00:50:16.679 INFO:tasks.workunit.client.0.smithi053.stdout:2/120: creat d6/f23 x:0 0 0 2024-09-16T00:50:16.680 INFO:tasks.workunit.client.1.smithi152.stdout:7/600: mkdir d9/d31/d64/d3c/d5b/dd0 0 2024-09-16T00:50:16.682 INFO:tasks.workunit.client.0.smithi053.stdout:9/221: mkdir d8/d4c 0 2024-09-16T00:50:16.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/602: getdents d3/d6/d8/d1d/d65/d6e/d82 0 2024-09-16T00:50:16.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/603: chown d3/d6/f8a 260457 1 2024-09-16T00:50:16.686 INFO:tasks.workunit.client.0.smithi053.stdout:8/264: rename d10/c12 to d10/d21/d28/c5c 0 2024-09-16T00:50:16.687 INFO:tasks.workunit.client.0.smithi053.stdout:8/265: fdatasync d10/f39 0 2024-09-16T00:50:16.687 INFO:tasks.workunit.client.0.smithi053.stdout:2/121: dread f3 [0,4194304] 0 2024-09-16T00:50:16.687 INFO:tasks.workunit.client.0.smithi053.stdout:8/266: write d10/d21/f2c [222034,100240] 0 2024-09-16T00:50:16.687 INFO:tasks.workunit.client.0.smithi053.stdout:2/122: write d6/d9/f1d [655913,128607] 0 2024-09-16T00:50:16.692 INFO:tasks.workunit.client.0.smithi053.stdout:4/160: dread d0/d2/dd/f13 [0,4194304] 0 2024-09-16T00:50:16.693 INFO:tasks.workunit.client.0.smithi053.stdout:6/132: mknod d1/dc/d1e/c2d 0 2024-09-16T00:50:16.693 INFO:tasks.workunit.client.0.smithi053.stdout:6/133: stat d1/dc/d11/f25 0 2024-09-16T00:50:16.695 INFO:tasks.workunit.client.0.smithi053.stdout:5/154: dwrite d3/f2e [4194304,4194304] 0 2024-09-16T00:50:16.698 INFO:tasks.workunit.client.1.smithi152.stdout:5/785: getdents d6/d16/d1f/d8c/db8 0 2024-09-16T00:50:16.698 INFO:tasks.workunit.client.1.smithi152.stdout:5/786: readlink d6/d16/d1f/d6c/lb3 0 2024-09-16T00:50:16.699 INFO:tasks.workunit.client.0.smithi053.stdout:7/214: mkdir d1/d2a/d4f 0 2024-09-16T00:50:16.700 INFO:tasks.workunit.client.1.smithi152.stdout:6/619: mkdir db/d12/d23/d4a/d33/dbe 0 2024-09-16T00:50:16.702 INFO:tasks.workunit.client.1.smithi152.stdout:9/596: creat d1/d7/fc8 x:0 0 0 2024-09-16T00:50:16.706 INFO:tasks.workunit.client.1.smithi152.stdout:2/581: link d4/d19/f72 d4/d19/d20/d28/d2c/fc1 0 2024-09-16T00:50:16.714 INFO:tasks.workunit.client.1.smithi152.stdout:0/604: mkdir d3/d6/d8/d9e/dcb 0 2024-09-16T00:50:16.716 INFO:tasks.workunit.client.0.smithi053.stdout:5/155: dread d3/f13 [0,4194304] 0 2024-09-16T00:50:16.718 INFO:tasks.workunit.client.0.smithi053.stdout:2/123: dwrite d6/f7 [0,4194304] 0 2024-09-16T00:50:16.718 INFO:tasks.workunit.client.0.smithi053.stdout:2/124: chown d6/d9/dd/f16 33 1 2024-09-16T00:50:16.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/787: getdents d6/d16/d1f 0 2024-09-16T00:50:16.721 INFO:tasks.workunit.client.1.smithi152.stdout:6/620: symlink db/d12/d20/d4b/lbf 0 2024-09-16T00:50:16.722 INFO:tasks.workunit.client.0.smithi053.stdout:9/222: mknod d8/c4d 0 2024-09-16T00:50:16.724 INFO:tasks.workunit.client.1.smithi152.stdout:3/588: sync 2024-09-16T00:50:16.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/685: sync 2024-09-16T00:50:16.725 INFO:tasks.workunit.client.0.smithi053.stdout:6/134: dwrite d1/dc/d11/f1c [0,4194304] 0 2024-09-16T00:50:16.725 INFO:tasks.workunit.client.1.smithi152.stdout:9/597: unlink d1/d4e/d48/d26/d30/d4f/da2/fc2 0 2024-09-16T00:50:16.725 INFO:tasks.workunit.client.1.smithi152.stdout:6/621: dread db/d12/d20/f72 [0,4194304] 0 2024-09-16T00:50:16.727 INFO:tasks.workunit.client.1.smithi152.stdout:5/788: write d6/d57/d2b/f31 [1781220,37904] 0 2024-09-16T00:50:16.727 INFO:tasks.workunit.client.0.smithi053.stdout:8/267: truncate d10/d1c/f26 844470 0 2024-09-16T00:50:16.729 INFO:tasks.workunit.client.0.smithi053.stdout:4/161: readlink d0/l1f 0 2024-09-16T00:50:16.731 INFO:tasks.workunit.client.0.smithi053.stdout:7/215: dwrite d1/d35/f1e [4194304,4194304] 0 2024-09-16T00:50:16.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/582: dwrite d4/d19/d20/d28/f50 [0,4194304] 0 2024-09-16T00:50:16.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/583: write d4/f16 [3621381,1134] 0 2024-09-16T00:50:16.735 INFO:tasks.workunit.client.0.smithi053.stdout:6/135: dread d1/dc/d11/f25 [0,4194304] 0 2024-09-16T00:50:16.739 INFO:tasks.workunit.client.0.smithi053.stdout:0/154: rmdir d4/dc/d25 39 2024-09-16T00:50:16.741 INFO:tasks.workunit.client.1.smithi152.stdout:7/601: rmdir d9/d10 39 2024-09-16T00:50:16.741 INFO:tasks.workunit.client.1.smithi152.stdout:7/602: fsync d9/d10/f16 0 2024-09-16T00:50:16.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/789: dwrite d6/d57/d2b/fe8 [0,4194304] 0 2024-09-16T00:50:16.745 INFO:tasks.workunit.client.1.smithi152.stdout:0/605: symlink d3/d6/d51/dbb/lcc 0 2024-09-16T00:50:16.745 INFO:tasks.workunit.client.1.smithi152.stdout:0/606: write d3/f19 [4953788,9294] 0 2024-09-16T00:50:16.749 INFO:tasks.workunit.client.0.smithi053.stdout:2/125: unlink d6/d9/lb 0 2024-09-16T00:50:16.750 INFO:tasks.workunit.client.0.smithi053.stdout:4/162: dwrite d0/d2/dd/d25/f35 [0,4194304] 0 2024-09-16T00:50:16.750 INFO:tasks.workunit.client.0.smithi053.stdout:4/163: fsync d0/d2/d26/f2c 0 2024-09-16T00:50:16.750 INFO:tasks.workunit.client.1.smithi152.stdout:3/589: mknod dc/d10/d17/d1c/d50/d55/cb7 0 2024-09-16T00:50:16.752 INFO:tasks.workunit.client.0.smithi053.stdout:9/223: truncate d8/d19/d31/f43 702517 0 2024-09-16T00:50:16.753 INFO:tasks.workunit.client.1.smithi152.stdout:6/622: symlink db/d12/d23/d3a/dbc/lc0 0 2024-09-16T00:50:16.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/598: unlink d1/f31 0 2024-09-16T00:50:16.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/599: truncate d1/d4e/d48/d26/d92/fbb 5792905 0 2024-09-16T00:50:16.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/600: write d1/d7/d77/fb3 [170654,9253] 0 2024-09-16T00:50:16.761 INFO:tasks.workunit.client.0.smithi053.stdout:7/216: mkdir d1/d35/d14/d27/d2c/d50 0 2024-09-16T00:50:16.764 INFO:tasks.workunit.client.0.smithi053.stdout:6/136: creat d1/dc/d11/f2e x:0 0 0 2024-09-16T00:50:16.765 INFO:tasks.workunit.client.1.smithi152.stdout:1/690: sync 2024-09-16T00:50:16.765 INFO:tasks.workunit.client.1.smithi152.stdout:8/455: sync 2024-09-16T00:50:16.766 INFO:tasks.workunit.client.0.smithi053.stdout:0/155: unlink d4/dc/c18 0 2024-09-16T00:50:16.768 INFO:tasks.workunit.client.1.smithi152.stdout:2/584: creat d4/d19/d20/d28/d2c/d77/da7/db8/fc2 x:0 0 0 2024-09-16T00:50:16.775 INFO:tasks.workunit.client.0.smithi053.stdout:2/126: mknod d6/c24 0 2024-09-16T00:50:16.778 INFO:tasks.workunit.client.1.smithi152.stdout:5/790: mkdir d6/d57/ddc/d122 0 2024-09-16T00:50:16.781 INFO:tasks.workunit.client.0.smithi053.stdout:4/164: mkdir d0/d2/dd/d25/d39 0 2024-09-16T00:50:16.781 INFO:tasks.workunit.client.0.smithi053.stdout:4/165: truncate d0/d2/d26/f2c 80912 0 2024-09-16T00:50:16.782 INFO:tasks.workunit.client.0.smithi053.stdout:9/224: truncate d8/d1c/d2b/d2c/f41 731164 0 2024-09-16T00:50:16.782 INFO:tasks.workunit.client.1.smithi152.stdout:2/585: write d4/d44/d7a/f7c [2586215,26734] 0 2024-09-16T00:50:16.785 INFO:tasks.workunit.client.1.smithi152.stdout:0/607: rmdir d3/d6/d6d/db7/dba 0 2024-09-16T00:50:16.785 INFO:tasks.workunit.client.0.smithi053.stdout:6/137: dwrite d1/f15 [0,4194304] 0 2024-09-16T00:50:16.785 INFO:tasks.workunit.client.0.smithi053.stdout:6/138: write d1/dc/d11/f2e [489114,121331] 0 2024-09-16T00:50:16.785 INFO:tasks.workunit.client.0.smithi053.stdout:6/139: fdatasync d1/f9 0 2024-09-16T00:50:16.786 INFO:tasks.workunit.client.0.smithi053.stdout:8/268: truncate d10/d1c/f26 894039 0 2024-09-16T00:50:16.787 INFO:tasks.workunit.client.1.smithi152.stdout:4/686: getdents d2 0 2024-09-16T00:50:16.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/601: dwrite d1/d7/d13/f2c [0,4194304] 0 2024-09-16T00:50:16.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/602: write d1/d7/d13/fad [307542,30679] 0 2024-09-16T00:50:16.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/603: readlink d1/d7/d13/d5d/d69/l6a 0 2024-09-16T00:50:16.789 INFO:tasks.workunit.client.0.smithi053.stdout:7/217: truncate d1/d35/d14/d27/f37 1252681 0 2024-09-16T00:50:16.789 INFO:tasks.workunit.client.0.smithi053.stdout:7/218: chown d1/lf 1277 1 2024-09-16T00:50:16.789 INFO:tasks.workunit.client.1.smithi152.stdout:6/623: mknod db/d12/d20/cc1 0 2024-09-16T00:50:16.792 INFO:tasks.workunit.client.0.smithi053.stdout:9/225: write d8/f27 [3686076,99175] 0 2024-09-16T00:50:16.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/691: mknod d9/d3e/d41/d31/d48/d7d/c101 0 2024-09-16T00:50:16.796 INFO:tasks.workunit.client.0.smithi053.stdout:5/156: link d3/f2e d3/f35 0 2024-09-16T00:50:16.799 INFO:tasks.workunit.client.0.smithi053.stdout:2/127: creat d6/d9/f25 x:0 0 0 2024-09-16T00:50:16.800 INFO:tasks.workunit.client.1.smithi152.stdout:5/791: dwrite d6/d57/d54/f70 [0,4194304] 0 2024-09-16T00:50:16.801 INFO:tasks.workunit.client.1.smithi152.stdout:0/608: unlink d3/d6/d2e/l41 0 2024-09-16T00:50:16.803 INFO:tasks.workunit.client.0.smithi053.stdout:4/166: rename d0/d2/d1e/l33 to d0/d2/dd/d25/d37/l3a 0 2024-09-16T00:50:16.803 INFO:tasks.workunit.client.0.smithi053.stdout:4/167: write d0/d2/d1d/f36 [866160,126413] 0 2024-09-16T00:50:16.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/692: write d9/da/df/f27 [476690,63500] 0 2024-09-16T00:50:16.806 INFO:tasks.workunit.client.1.smithi152.stdout:8/456: dwrite dd/d15/d1a/f3f [0,4194304] 0 2024-09-16T00:50:16.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/693: chown d9/da/df/ce4 1000 0 2024-09-16T00:50:16.807 INFO:tasks.workunit.client.1.smithi152.stdout:9/604: rename d1/d4e/d48/d26/dc0 to d1/d7/d77/d3c/dc9 0 2024-09-16T00:50:16.808 INFO:tasks.workunit.client.0.smithi053.stdout:6/140: truncate d1/dc/d11/f13 2198864 0 2024-09-16T00:50:16.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/624: mkdir db/d12/d23/d4a/d43/d59/d67/dc2 0 2024-09-16T00:50:16.813 INFO:tasks.workunit.client.0.smithi053.stdout:8/269: creat d10/d1c/d2b/f5d x:0 0 0 2024-09-16T00:50:16.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/457: dread dd/d15/d49/f13 [0,4194304] 0 2024-09-16T00:50:16.817 INFO:tasks.workunit.client.0.smithi053.stdout:7/219: symlink d1/d35/d4a/l51 0 2024-09-16T00:50:16.817 INFO:tasks.workunit.client.0.smithi053.stdout:7/220: dread - d1/f3f zero size 2024-09-16T00:50:16.821 INFO:tasks.workunit.client.0.smithi053.stdout:6/141: dread d1/f9 [0,4194304] 0 2024-09-16T00:50:16.822 INFO:tasks.workunit.client.0.smithi053.stdout:9/226: symlink d8/d1c/d2b/d49/l4e 0 2024-09-16T00:50:16.825 INFO:tasks.workunit.client.0.smithi053.stdout:2/128: dwrite f5 [4194304,4194304] 0 2024-09-16T00:50:16.825 INFO:tasks.workunit.client.0.smithi053.stdout:2/129: readlink d6/d9/d14/l21 0 2024-09-16T00:50:16.825 INFO:tasks.workunit.client.0.smithi053.stdout:2/130: getdents d6/d9/dd 0 2024-09-16T00:50:16.825 INFO:tasks.workunit.client.0.smithi053.stdout:2/131: readlink d6/d9/la 0 2024-09-16T00:50:16.826 INFO:tasks.workunit.client.1.smithi152.stdout:5/792: getdents d6/d57/d2b/d50 0 2024-09-16T00:50:16.826 INFO:tasks.workunit.client.1.smithi152.stdout:5/793: chown d6/d16/d1f/d8c/cca 34863521 1 2024-09-16T00:50:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:4/687: mkdir d2/db/de8 0 2024-09-16T00:50:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:4/688: dread - d2/d1e/d28/d7b/fa1 zero size 2024-09-16T00:50:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:4/689: dread - d2/db/d39/d3c/f77 zero size 2024-09-16T00:50:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:4/690: fsync d2/db/d39/f93 0 2024-09-16T00:50:16.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/609: dwrite d3/d6/d8/f1c [0,4194304] 0 2024-09-16T00:50:16.837 INFO:tasks.workunit.client.1.smithi152.stdout:1/694: mknod d9/d3e/d7b/c102 0 2024-09-16T00:50:16.837 INFO:tasks.workunit.client.0.smithi053.stdout:0/156: rmdir d4 39 2024-09-16T00:50:16.837 INFO:tasks.workunit.client.0.smithi053.stdout:0/157: chown d4/dc/d25/d34/d2a/c2e 0 1 2024-09-16T00:50:16.840 INFO:tasks.workunit.client.1.smithi152.stdout:9/605: unlink d1/d7/d77/d32/c45 0 2024-09-16T00:50:16.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/691: dread d2/d1e/d28/f30 [0,4194304] 0 2024-09-16T00:50:16.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/692: chown d2/d1e/l9a 5470 1 2024-09-16T00:50:16.842 INFO:tasks.workunit.client.0.smithi053.stdout:5/157: mknod d3/d7/d24/c36 0 2024-09-16T00:50:16.842 INFO:tasks.workunit.client.0.smithi053.stdout:5/158: write d3/f2d [791019,13890] 0 2024-09-16T00:50:16.842 INFO:tasks.workunit.client.1.smithi152.stdout:9/606: dread d1/d4e/f67 [0,4194304] 0 2024-09-16T00:50:16.845 INFO:tasks.workunit.client.1.smithi152.stdout:4/693: dread d2/db/d39/d3c/f58 [0,4194304] 0 2024-09-16T00:50:16.845 INFO:tasks.workunit.client.1.smithi152.stdout:8/458: rename dd/f39 to dd/d50/d29/d2f/f95 0 2024-09-16T00:50:16.846 INFO:tasks.workunit.client.0.smithi053.stdout:4/168: getdents d0/d2/d1e 0 2024-09-16T00:50:16.847 INFO:tasks.workunit.client.0.smithi053.stdout:4/169: write d0/d2/d26/f2c [282084,95342] 0 2024-09-16T00:50:16.847 INFO:tasks.workunit.client.0.smithi053.stdout:4/170: write d0/d2/f28 [726839,85651] 0 2024-09-16T00:50:16.847 INFO:tasks.workunit.client.0.smithi053.stdout:4/171: chown d0/d2/d26/f2c 11697 1 2024-09-16T00:50:16.854 INFO:tasks.workunit.client.0.smithi053.stdout:2/132: mkdir d6/d9/dd/d26 0 2024-09-16T00:50:16.855 INFO:tasks.workunit.client.1.smithi152.stdout:5/794: dwrite d6/d16/d1f/d65/d77/fb2 [0,4194304] 0 2024-09-16T00:50:16.856 INFO:tasks.workunit.client.1.smithi152.stdout:0/610: link d3/d6/d8/d1d/d23/d25/d2a/ca8 d3/d6/d8/d1d/d23/d25/d45/d6f/da7/ccd 0 2024-09-16T00:50:16.857 INFO:tasks.workunit.client.0.smithi053.stdout:8/270: dwrite d10/d21/d28/d3c/f45 [0,4194304] 0 2024-09-16T00:50:16.857 INFO:tasks.workunit.client.0.smithi053.stdout:8/271: creat d10/d1c/d2b/f5e x:0 0 0 2024-09-16T00:50:16.859 INFO:tasks.workunit.client.0.smithi053.stdout:0/158: unlink d4/dc/le 0 2024-09-16T00:50:16.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/695: link d9/d3e/d41/d31/f8f d9/d3e/f103 0 2024-09-16T00:50:16.863 INFO:tasks.workunit.client.1.smithi152.stdout:6/625: dwrite db/d12/d20/d86/f8b [0,4194304] 0 2024-09-16T00:50:16.863 INFO:tasks.workunit.client.0.smithi053.stdout:9/227: dwrite d8/d22/d26/f45 [0,4194304] 0 2024-09-16T00:50:16.865 INFO:tasks.workunit.client.0.smithi053.stdout:5/159: mkdir d3/d7/d2b/d37 0 2024-09-16T00:50:16.865 INFO:tasks.workunit.client.0.smithi053.stdout:5/160: creat d3/d7/d12/f38 x:0 0 0 2024-09-16T00:50:16.866 INFO:tasks.workunit.client.0.smithi053.stdout:2/133: dread f5 [0,4194304] 0 2024-09-16T00:50:16.866 INFO:tasks.workunit.client.0.smithi053.stdout:2/134: read f5 [8514,17385] 0 2024-09-16T00:50:16.868 INFO:tasks.workunit.client.1.smithi152.stdout:0/611: dread d3/d6/f17 [0,4194304] 0 2024-09-16T00:50:16.869 INFO:tasks.workunit.client.1.smithi152.stdout:9/607: mkdir d1/d7/dca 0 2024-09-16T00:50:16.869 INFO:tasks.workunit.client.1.smithi152.stdout:9/608: write d1/f8b [440058,68573] 0 2024-09-16T00:50:16.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/612: dread d3/d6/d64/fa2 [0,4194304] 0 2024-09-16T00:50:16.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/613: chown d3/d6/c18 29602 1 2024-09-16T00:50:16.872 INFO:tasks.workunit.client.0.smithi053.stdout:9/228: write f4 [1485300,114973] 0 2024-09-16T00:50:16.873 INFO:tasks.workunit.client.0.smithi053.stdout:7/221: rename d1/d35/d14/d27 to d1/d2a/d4f/d52 0 2024-09-16T00:50:16.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/459: mknod dd/d50/d29/d2f/c96 0 2024-09-16T00:50:16.876 INFO:tasks.workunit.client.0.smithi053.stdout:5/161: write d3/f6 [747035,89763] 0 2024-09-16T00:50:16.877 INFO:tasks.workunit.client.0.smithi053.stdout:6/142: mkdir d1/d2f 0 2024-09-16T00:50:16.877 INFO:tasks.workunit.client.0.smithi053.stdout:6/143: creat d1/dc/d1e/f30 x:0 0 0 2024-09-16T00:50:16.877 INFO:tasks.workunit.client.0.smithi053.stdout:8/272: dwrite d10/d21/f42 [0,4194304] 0 2024-09-16T00:50:16.885 INFO:tasks.workunit.client.1.smithi152.stdout:5/795: mkdir d6/d16/d1f/d65/dd2/d123 0 2024-09-16T00:50:16.888 INFO:tasks.workunit.client.0.smithi053.stdout:5/162: write d3/f9 [566739,23484] 0 2024-09-16T00:50:16.888 INFO:tasks.workunit.client.0.smithi053.stdout:0/159: truncate d4/f10 3617058 0 2024-09-16T00:50:16.890 INFO:tasks.workunit.client.1.smithi152.stdout:1/696: mknod d9/d3e/d4b/db7/c104 0 2024-09-16T00:50:16.894 INFO:tasks.workunit.client.1.smithi152.stdout:6/626: creat db/da8/db7/fc3 x:0 0 0 2024-09-16T00:50:16.897 INFO:tasks.workunit.client.1.smithi152.stdout:9/609: mkdir d1/d4e/d48/d26/d30/d4f/dcb 0 2024-09-16T00:50:16.897 INFO:tasks.workunit.client.1.smithi152.stdout:9/610: fsync d1/d7/d77/f33 0 2024-09-16T00:50:16.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/614: link d3/c5 d3/d6/d64/cce 0 2024-09-16T00:50:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.900+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c0104c90 con 0x7f32a806d640 2024-09-16T00:50:16.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/694: rmdir d2/db/d39 39 2024-09-16T00:50:16.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/695: fdatasync d2/d1e/d28/d69/f9c 0 2024-09-16T00:50:16.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/696: stat d2/db/d39/d3c/d7f/d98/c86 0 2024-09-16T00:50:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:8/460: creat dd/f97 x:0 0 0 2024-09-16T00:50:16.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/796: symlink d6/d16/d1f/d8c/db8/l124 0 2024-09-16T00:50:16.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/797: truncate d6/f2d 4338308 0 2024-09-16T00:50:16.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.911+0000 7f32af7fe700 1 -- 172.21.15.53:0/3435640002 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f32c0104c90 con 0x7f32a806d640 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (6m) 2m ago 8m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (8m) 2m ago 8m 7453k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (7m) 3s ago 7m 7327k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (8m) 2m ago 8m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (7m) 3s ago 7m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (6m) 2m ago 7m 84.2M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (2m) 2m ago 2m 17.4M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (2m) 2m ago 2m 16.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:50:16.913 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (2m) 3s ago 2m 14.4M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (2m) 3s ago 2m 13.1M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 308f181966ac 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (37s) 3s ago 7m 484M - 19.1.1-326-g8921c8ef f1455bd0219c 9e697fb152d1 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (9m) 2m ago 9m 44.1M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (7m) 3s ago 7m 39.4M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (8m) 2m ago 8m 15.8M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 3s ago 7m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (6m) 2m ago 6m 50.7M 3948M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (5m) 2m ago 5m 47.4M 3948M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (5m) 2m ago 5m 45.7M 3948M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (5m) 3s ago 5m 202M 4970M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (4m) 3s ago 4m 186M 4970M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:50:16.914 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (4m) 3s ago 4m 210M 4970M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:50:16.915 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (6m) 2m ago 7m 63.0M - 2.43.0 a07b618ecd1d 61cdcd6b91c6 2024-09-16T00:50:16.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/627: rename db/d12/d23/d4a/d43/d48/d6a/f82 to db/d28/db3/fc4 0 2024-09-16T00:50:16.915 INFO:tasks.workunit.client.0.smithi053.stdout:5/163: dwrite d3/f35 [0,4194304] 0 2024-09-16T00:50:16.916 INFO:tasks.workunit.client.0.smithi053.stdout:5/164: stat d3/f4 0 2024-09-16T00:50:16.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 msgr2=0x7f32a806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 0x7f32a806faf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f32c01001a0 tx=0x7f32b0009260 comp rx=0 tx=0).stop 2024-09-16T00:50:16.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 msgr2=0x7f32c0196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:16.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f32b400fa00 tx=0x7f32b400fae0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 shutdown_connections 2024-09-16T00:50:16.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f32a806d640 0x7f32a806faf0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f32c01001a0 tx=0x7f32b0009260 comp rx=0 tx=0).stop 2024-09-16T00:50:16.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32c00ff140 0x7f32c0195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 --2- 172.21.15.53:0/3435640002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c0100340 0x7f32c0196010 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:16.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 >> 172.21.15.53:0/3435640002 conn(0x7f32c00fa6d0 msgr2=0x7f32c0103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:16.918 INFO:tasks.workunit.client.1.smithi152.stdout:0/615: creat d3/d6/d51/dbb/dbf/fcf x:0 0 0 2024-09-16T00:50:16.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 shutdown_connections 2024-09-16T00:50:16.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:16.915+0000 7f32c49fe700 1 -- 172.21.15.53:0/3435640002 wait complete. 2024-09-16T00:50:16.918 INFO:tasks.workunit.client.0.smithi053.stdout:5/165: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:16.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/135: rename d6/d9/d14/c1b to d6/d9/dd/d26/c27 0 2024-09-16T00:50:16.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/136: readlink d6/d9/d14/l21 0 2024-09-16T00:50:16.920 INFO:tasks.workunit.client.1.smithi152.stdout:4/697: truncate d2/db/d39/f93 132388 0 2024-09-16T00:50:16.922 INFO:tasks.workunit.client.0.smithi053.stdout:7/222: getdents d1/d3 0 2024-09-16T00:50:16.922 INFO:tasks.workunit.client.0.smithi053.stdout:7/223: write d1/d2a/d4f/d52/d2c/f4d [2284038,120935] 0 2024-09-16T00:50:16.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/798: getdents d6/d16/d1f/d8c/db8/dbf 0 2024-09-16T00:50:16.932 INFO:tasks.workunit.client.0.smithi053.stdout:7/224: dread d1/d2a/d4f/d52/f37 [0,4194304] 0 2024-09-16T00:50:16.932 INFO:tasks.workunit.client.0.smithi053.stdout:7/225: chown d1/c11 2004882316 1 2024-09-16T00:50:16.935 INFO:tasks.workunit.client.1.smithi152.stdout:1/697: mkdir d9/da/d105 0 2024-09-16T00:50:16.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/616: dwrite d3/d6/d6d/f8e [0,4194304] 0 2024-09-16T00:50:16.939 INFO:tasks.workunit.client.1.smithi152.stdout:0/617: dread d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 [0,4194304] 0 2024-09-16T00:50:16.942 INFO:tasks.workunit.client.1.smithi152.stdout:6/628: mkdir db/d12/d23/d4a/dc5 0 2024-09-16T00:50:16.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/799: mkdir d6/d16/d1f/d6c/d125 0 2024-09-16T00:50:16.949 INFO:tasks.workunit.client.1.smithi152.stdout:1/698: rename d9/d3e/d41/d31/d48/d4a/la4 to d9/d3e/d4b/d6b/d6d/d97/l106 0 2024-09-16T00:50:16.949 INFO:tasks.workunit.client.0.smithi053.stdout:5/166: dwrite d3/f27 [0,4194304] 0 2024-09-16T00:50:16.949 INFO:tasks.workunit.client.0.smithi053.stdout:5/167: write d3/f13 [4793999,82227] 0 2024-09-16T00:50:16.955 INFO:tasks.workunit.client.1.smithi152.stdout:8/461: write dd/f1f [3559688,2335] 0 2024-09-16T00:50:16.956 INFO:tasks.workunit.client.1.smithi152.stdout:6/629: dread db/d12/d20/f3e [4194304,4194304] 0 2024-09-16T00:50:16.956 INFO:tasks.workunit.client.1.smithi152.stdout:4/698: dwrite d2/db/d44/f50 [0,4194304] 0 2024-09-16T00:50:16.958 INFO:tasks.workunit.client.1.smithi152.stdout:5/800: symlink d6/d16/d10d/l126 0 2024-09-16T00:50:16.958 INFO:tasks.workunit.client.1.smithi152.stdout:5/801: fdatasync d6/d16/d1f/f2e 0 2024-09-16T00:50:16.961 INFO:tasks.workunit.client.1.smithi152.stdout:0/618: dwrite d3/d6/d51/f85 [0,4194304] 0 2024-09-16T00:50:16.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/699: dwrite d9/f19 [0,4194304] 0 2024-09-16T00:50:16.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/700: fsync d9/d3e/d4b/db7/dc4/fe2 0 2024-09-16T00:50:16.966 INFO:tasks.workunit.client.1.smithi152.stdout:6/630: creat db/d12/d23/d4a/d33/fc6 x:0 0 0 2024-09-16T00:50:16.967 INFO:tasks.workunit.client.1.smithi152.stdout:5/802: creat d6/d16/d1f/d65/dd2/d123/f127 x:0 0 0 2024-09-16T00:50:16.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/699: dread d2/db/d39/d3c/f48 [0,4194304] 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/144: creat d1/dc/f31 x:0 0 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/145: fdatasync d1/dc/f31 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/146: creat d1/dc/f32 x:0 0 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/147: readlink d1/dc/d11/l1a 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/148: truncate d1/dc/d1e/f2a 864181 0 2024-09-16T00:50:16.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/149: truncate d1/f9 5077844 0 2024-09-16T00:50:16.969 INFO:tasks.workunit.client.0.smithi053.stdout:6/150: write d1/fd [1285111,12200] 0 2024-09-16T00:50:16.970 INFO:tasks.workunit.client.1.smithi152.stdout:8/462: mkdir dd/d98 0 2024-09-16T00:50:16.970 INFO:tasks.workunit.client.1.smithi152.stdout:8/463: fsync dd/d15/f68 0 2024-09-16T00:50:16.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/700: dread d2/d1e/d28/d69/f49 [0,4194304] 0 2024-09-16T00:50:16.981 INFO:tasks.workunit.client.1.smithi152.stdout:0/619: mknod d3/d6/d8/cd0 0 2024-09-16T00:50:16.981 INFO:tasks.workunit.client.1.smithi152.stdout:1/701: rename d9/d3e/d41/d31/d38 to d9/d3e/d7b/df0/d107 0 2024-09-16T00:50:16.982 INFO:tasks.workunit.client.0.smithi053.stdout:0/160: getdents d4 0 2024-09-16T00:50:16.982 INFO:tasks.workunit.client.0.smithi053.stdout:0/161: readlink d4/ld 0 2024-09-16T00:50:16.982 INFO:tasks.workunit.client.0.smithi053.stdout:0/162: fdatasync d4/f17 0 2024-09-16T00:50:16.986 INFO:tasks.workunit.client.1.smithi152.stdout:6/631: link db/d12/d20/f51 db/d12/d20/d86/fc7 0 2024-09-16T00:50:16.986 INFO:tasks.workunit.client.0.smithi053.stdout:4/172: link d0/da/l14 d0/d31/l3b 0 2024-09-16T00:50:16.987 INFO:tasks.workunit.client.0.smithi053.stdout:9/229: getdents d8/d22/d26 0 2024-09-16T00:50:16.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/603: sync 2024-09-16T00:50:16.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/590: sync 2024-09-16T00:50:16.988 INFO:tasks.workunit.client.1.smithi152.stdout:2/586: sync 2024-09-16T00:50:16.988 INFO:tasks.workunit.client.1.smithi152.stdout:7/604: fsync d9/fd 0 2024-09-16T00:50:16.988 INFO:tasks.workunit.client.1.smithi152.stdout:7/605: fsync d9/f23 0 2024-09-16T00:50:16.989 INFO:tasks.workunit.client.0.smithi053.stdout:6/151: dwrite d1/f2b [0,4194304] 0 2024-09-16T00:50:16.990 INFO:tasks.workunit.client.1.smithi152.stdout:8/464: creat dd/d50/f99 x:0 0 0 2024-09-16T00:50:16.994 INFO:tasks.workunit.client.1.smithi152.stdout:0/620: creat d3/d6/d8/d1d/d23/d25/d45/fd1 x:0 0 0 2024-09-16T00:50:16.997 INFO:tasks.workunit.client.0.smithi053.stdout:2/137: mkdir d6/d9/dd/d28 0 2024-09-16T00:50:16.997 INFO:tasks.workunit.client.1.smithi152.stdout:4/701: dwrite d2/d1e/f64 [0,4194304] 0 2024-09-16T00:50:16.997 INFO:tasks.workunit.client.1.smithi152.stdout:4/702: write d2/db/d39/d3c/d76/db8/f34 [2116700,12061] 0 2024-09-16T00:50:17.000 INFO:tasks.workunit.client.0.smithi053.stdout:7/226: chown d1/d2a/d4f/d52/c31 731083945 1 2024-09-16T00:50:17.001 INFO:tasks.workunit.client.1.smithi152.stdout:3/591: dread dc/d10/d17/f37 [0,4194304] 0 2024-09-16T00:50:17.003 INFO:tasks.workunit.client.1.smithi152.stdout:5/803: rename d6/d57/d2b/d50/d66/df1 to d6/d16/d1f/d6c/de7/d128 0 2024-09-16T00:50:17.005 INFO:tasks.workunit.client.0.smithi053.stdout:4/173: dwrite d0/f5 [8388608,4194304] 0 2024-09-16T00:50:17.008 INFO:tasks.workunit.client.0.smithi053.stdout:7/227: write d1/d2a/d4f/d52/d2c/f40 [3779214,102395] 0 2024-09-16T00:50:17.010 INFO:tasks.workunit.client.1.smithi152.stdout:6/632: creat db/d12/d23/d3a/dbc/fc8 x:0 0 0 2024-09-16T00:50:17.014 INFO:tasks.workunit.client.1.smithi152.stdout:5/804: dread d6/d16/d1f/d65/d77/fd8 [0,4194304] 0 2024-09-16T00:50:17.014 INFO:tasks.workunit.client.1.smithi152.stdout:5/805: chown d6/d16/d1f/d6c/f88 11243926 1 2024-09-16T00:50:17.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/587: unlink d4/d44/d7a/d9e/d87/la8 0 2024-09-16T00:50:17.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/588: readlink d4/d44/la2 0 2024-09-16T00:50:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/606: symlink d9/d31/d64/d3c/ld1 0 2024-09-16T00:50:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/607: dread - d9/d31/fcb zero size 2024-09-16T00:50:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/608: fdatasync f4 0 2024-09-16T00:50:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/609: chown d9/c14 652425 1 2024-09-16T00:50:17.024 INFO:tasks.workunit.client.1.smithi152.stdout:6/633: read db/f40 [7252347,18131] 0 2024-09-16T00:50:17.024 INFO:tasks.workunit.client.1.smithi152.stdout:8/465: symlink dd/d25/d77/l9a 0 2024-09-16T00:50:17.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/610: dread d9/d31/d64/f61 [0,4194304] 0 2024-09-16T00:50:17.025 INFO:tasks.workunit.client.1.smithi152.stdout:0/621: getdents d3/d6/d64/d6a/d61 0 2024-09-16T00:50:17.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/589: dread d4/d19/d20/d28/f68 [0,4194304] 0 2024-09-16T00:50:17.026 INFO:tasks.workunit.client.0.smithi053.stdout:4/174: dwrite d0/f5 [0,4194304] 0 2024-09-16T00:50:17.027 INFO:tasks.workunit.client.0.smithi053.stdout:9/230: link d8/d19/d31/d37/c4b d8/d22/d26/c4f 0 2024-09-16T00:50:17.028 INFO:tasks.workunit.client.0.smithi053.stdout:9/231: chown d8/d19/c2e 1 1 2024-09-16T00:50:17.028 INFO:tasks.workunit.client.0.smithi053.stdout:4/175: dread d0/d2/f28 [0,4194304] 0 2024-09-16T00:50:17.029 INFO:tasks.workunit.client.1.smithi152.stdout:3/592: getdents dc/d10/d17 0 2024-09-16T00:50:17.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/702: rename d9/f9b to d9/d3e/d4b/db7/ddd/f108 0 2024-09-16T00:50:17.034 INFO:tasks.workunit.client.0.smithi053.stdout:6/152: creat d1/d2f/f33 x:0 0 0 2024-09-16T00:50:17.034 INFO:tasks.workunit.client.0.smithi053.stdout:6/153: dread - d1/dc/f31 zero size 2024-09-16T00:50:17.036 INFO:tasks.workunit.client.1.smithi152.stdout:5/806: mknod d6/d57/d2b/d50/d64/df5/c129 0 2024-09-16T00:50:17.039 INFO:tasks.workunit.client.0.smithi053.stdout:2/138: rename d6/d9/dd/d26 to d6/d29 0 2024-09-16T00:50:17.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/622: dwrite d3/f19 [0,4194304] 0 2024-09-16T00:50:17.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/623: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fac [461860,93505] 0 2024-09-16T00:50:17.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/624: fsync d3/d6/d8/fca 0 2024-09-16T00:50:17.047 INFO:tasks.workunit.client.0.smithi053.stdout:7/228: creat d1/d2a/d4f/f53 x:0 0 0 2024-09-16T00:50:17.049 INFO:tasks.workunit.client.0.smithi053.stdout:0/163: unlink d4/dc/d25/f32 0 2024-09-16T00:50:17.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/634: symlink db/d12/d23/d4a/d33/dbe/lc9 0 2024-09-16T00:50:17.050 INFO:tasks.workunit.client.0.smithi053.stdout:9/232: rmdir d8 39 2024-09-16T00:50:17.052 INFO:tasks.workunit.client.1.smithi152.stdout:8/466: truncate dd/d15/f18 4026172 0 2024-09-16T00:50:17.054 INFO:tasks.workunit.client.1.smithi152.stdout:7/611: mknod d9/d80/cd2 0 2024-09-16T00:50:17.057 INFO:tasks.workunit.client.0.smithi053.stdout:6/154: rename d1/dc/d1e/f2a to d1/dc/d11/f34 0 2024-09-16T00:50:17.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/590: truncate d4/d44/f48 2155662 0 2024-09-16T00:50:17.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/591: creat d4/d44/fc3 x:0 0 0 2024-09-16T00:50:17.063 INFO:tasks.workunit.client.1.smithi152.stdout:3/593: truncate dc/d10/d17/d5a/d68/f7c 131274 0 2024-09-16T00:50:17.065 INFO:tasks.workunit.client.0.smithi053.stdout:7/229: mknod d1/d35/c54 0 2024-09-16T00:50:17.065 INFO:tasks.workunit.client.1.smithi152.stdout:9/611: sync 2024-09-16T00:50:17.066 INFO:tasks.workunit.client.1.smithi152.stdout:8/467: dwrite dd/d25/f91 [0,4194304] 0 2024-09-16T00:50:17.067 INFO:tasks.workunit.client.0.smithi053.stdout:0/164: creat d4/d13/f38 x:0 0 0 2024-09-16T00:50:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:16 smithi053 ceph-mon[27950]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:16 smithi053 ceph-mon[27950]: mgrmap e25: smithi152.nlmwrx(active, since 11s), standbys: smithi053.cjiiek 2024-09-16T00:50:17.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:16 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:50:17.070 INFO:tasks.workunit.client.0.smithi053.stdout:4/176: mkdir d0/d3c 0 2024-09-16T00:50:17.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/592: dwrite d4/d44/d7a/f7e [0,4194304] 0 2024-09-16T00:50:17.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/593: truncate d4/d44/d7a/d9e/d87/d9c/fae 1623423 0 2024-09-16T00:50:17.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/594: truncate d4/d19/d20/d28/f81 879659 0 2024-09-16T00:50:17.079 INFO:tasks.workunit.client.0.smithi053.stdout:7/230: creat d1/d2a/d4f/d52/d2c/f55 x:0 0 0 2024-09-16T00:50:17.079 INFO:tasks.workunit.client.0.smithi053.stdout:7/231: dread - d1/f3a zero size 2024-09-16T00:50:17.079 INFO:tasks.workunit.client.0.smithi053.stdout:7/232: readlink d1/l1b 0 2024-09-16T00:50:17.080 INFO:tasks.workunit.client.0.smithi053.stdout:0/165: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:17.080 INFO:tasks.workunit.client.1.smithi152.stdout:6/635: creat db/d12/d23/d4a/fca x:0 0 0 2024-09-16T00:50:17.086 INFO:tasks.workunit.client.1.smithi152.stdout:7/612: truncate d9/d10/f9d 1449 0 2024-09-16T00:50:17.088 INFO:tasks.workunit.client.0.smithi053.stdout:6/155: symlink d1/l35 0 2024-09-16T00:50:17.089 INFO:tasks.workunit.client.0.smithi053.stdout:0/166: dread d4/f9 [0,4194304] 0 2024-09-16T00:50:17.091 INFO:tasks.workunit.client.0.smithi053.stdout:6/156: write d1/dc/f18 [154243,107626] 0 2024-09-16T00:50:17.095 INFO:tasks.workunit.client.0.smithi053.stdout:7/233: unlink d1/d2a/d4f/d52/d2c/f4d 0 2024-09-16T00:50:17.097 INFO:tasks.workunit.client.1.smithi152.stdout:2/595: dwrite d4/d44/d7a/f7c [0,4194304] 0 2024-09-16T00:50:17.098 INFO:tasks.workunit.client.1.smithi152.stdout:3/594: mknod dc/d10/d17/d1c/d50/daa/cb8 0 2024-09-16T00:50:17.099 INFO:tasks.workunit.client.1.smithi152.stdout:3/595: dread dc/d10/d17/d5a/d68/f9b [0,4194304] 0 2024-09-16T00:50:17.101 INFO:tasks.workunit.client.0.smithi053.stdout:4/177: rename d0/f15 to d0/da/f3d 0 2024-09-16T00:50:17.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/612: mknod d1/d4e/d48/d2b/d93/ccc 0 2024-09-16T00:50:17.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/613: dread - d1/d7/fc8 zero size 2024-09-16T00:50:17.105 INFO:tasks.workunit.client.1.smithi152.stdout:9/614: write d1/d4e/d34/f62 [4574225,51967] 0 2024-09-16T00:50:17.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/167: link d4/dc/d1e/c20 d4/dc/d1e/d22/c39 0 2024-09-16T00:50:17.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/168: chown c2 8075 1 2024-09-16T00:50:17.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/169: fsync d4/f30 0 2024-09-16T00:50:17.107 INFO:tasks.workunit.client.0.smithi053.stdout:6/157: symlink d1/d2f/l36 0 2024-09-16T00:50:17.107 INFO:tasks.workunit.client.0.smithi053.stdout:6/158: write d1/dc/d11/f2e [1240708,3306] 0 2024-09-16T00:50:17.107 INFO:tasks.workunit.client.0.smithi053.stdout:6/159: fdatasync d1/dc/d11/f25 0 2024-09-16T00:50:17.110 INFO:tasks.workunit.client.0.smithi053.stdout:7/234: rename d1/d35/d14/f16 to d1/d35/d4a/f56 0 2024-09-16T00:50:17.110 INFO:tasks.workunit.client.0.smithi053.stdout:7/235: write d1/d2a/d4f/d52/d2c/f55 [132606,94066] 0 2024-09-16T00:50:17.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/703: rename d2/d1e/f64 to d2/db/d39/d3c/d7f/d8b/fe9 0 2024-09-16T00:50:17.112 INFO:tasks.workunit.client.0.smithi053.stdout:4/178: creat d0/d2/dd/f3e x:0 0 0 2024-09-16T00:50:17.113 INFO:tasks.workunit.client.1.smithi152.stdout:3/596: dwrite dc/d10/d17/d5a/db2/f90 [0,4194304] 0 2024-09-16T00:50:17.113 INFO:tasks.workunit.client.1.smithi152.stdout:3/597: stat dc/d10/d17/d1c/f7e 0 2024-09-16T00:50:17.113 INFO:tasks.workunit.client.1.smithi152.stdout:3/598: write dc/d10/d17/d5a/db2/f5e [1025810,140] 0 2024-09-16T00:50:17.114 INFO:tasks.workunit.client.0.smithi053.stdout:4/179: dread d0/d2/d26/f2b [0,4194304] 0 2024-09-16T00:50:17.114 INFO:tasks.workunit.client.0.smithi053.stdout:4/180: dread d0/d2/d26/f2b [0,4194304] 0 2024-09-16T00:50:17.116 INFO:tasks.workunit.client.1.smithi152.stdout:6/636: symlink db/d12/d20/d86/lcb 0 2024-09-16T00:50:17.118 INFO:tasks.workunit.client.1.smithi152.stdout:7/613: mkdir d9/d31/d64/d3c/db9/dd3 0 2024-09-16T00:50:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 -- 172.21.15.53:0/2536874304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c1003d0 msgr2=0x7f047c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 --2- 172.21.15.53:0/2536874304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c1003d0 0x7f047c100840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0470009910 tx=0x7f0470009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 -- 172.21.15.53:0/2536874304 shutdown_connections 2024-09-16T00:50:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 --2- 172.21.15.53:0/2536874304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c1003d0 0x7f047c100840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 --2- 172.21.15.53:0/2536874304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c0ff130 0x7f047c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 -- 172.21.15.53:0/2536874304 >> 172.21.15.53:0/2536874304 conn(0x7f047c0fa780 msgr2=0x7f047c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 -- 172.21.15.53:0/2536874304 shutdown_connections 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.117+0000 7f0480ec5700 1 -- 172.21.15.53:0/2536874304 wait complete. 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.118+0000 7f0480ec5700 1 Processor -- start 2024-09-16T00:50:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0480ec5700 1 -- start start 2024-09-16T00:50:17.121 INFO:tasks.workunit.client.0.smithi053.stdout:7/236: link d1/c45 d1/d3/c57 0 2024-09-16T00:50:17.121 INFO:tasks.workunit.client.0.smithi053.stdout:7/237: stat d1/d35/d14/d15/f1d 0 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0480ec5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 0x7f047c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0480ec5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0480ec5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c19adb0 con 0x7f047c0ff130 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0480ec5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c19aef0 con 0x7f047c1003d0 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f047a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 0x7f047c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0479d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0479d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:56776/0 (socket says 172.21.15.53:56776) 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0479d9b700 1 -- 172.21.15.53:0/1091224149 learned_addr learned my addr 172.21.15.53:0/1091224149 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0479d9b700 1 -- 172.21.15.53:0/1091224149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 msgr2=0x7f047c0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.119+0000 7f0479d9b700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 0x7f047c0690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f0479d9b700 1 -- 172.21.15.53:0/1091224149 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04700095f0 con 0x7f047c1003d0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f047a59c700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 0x7f047c0690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f0479d9b700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f047000f690 tx=0x7f047000f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047001d070 con 0x7f047c1003d0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c19b170 con 0x7f047c1003d0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0470005640 con 0x7f047c1003d0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0470021410 con 0x7f047c1003d0 2024-09-16T00:50:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.120+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c19b600 con 0x7f047c1003d0 2024-09-16T00:50:17.124 INFO:tasks.workunit.client.1.smithi152.stdout:2/596: readlink d4/d19/d20/d28/d2c/l60 0 2024-09-16T00:50:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.121+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c107c10 con 0x7f047c1003d0 2024-09-16T00:50:17.124 INFO:tasks.workunit.client.0.smithi053.stdout:4/181: link d0/da/l14 d0/d3c/l3f 0 2024-09-16T00:50:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.123+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f047000faa0 con 0x7f047c1003d0 2024-09-16T00:50:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.124+0000 7f046b7fe700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 0x7f046406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.124+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f047008e0c0 con 0x7f047c1003d0 2024-09-16T00:50:17.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.125+0000 7f047a59c700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 0x7f046406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.129 INFO:tasks.workunit.client.0.smithi053.stdout:0/170: symlink d4/dc/d25/d34/d2a/d27/l3a 0 2024-09-16T00:50:17.129 INFO:tasks.workunit.client.0.smithi053.stdout:0/171: write d4/f30 [1449768,80205] 0 2024-09-16T00:50:17.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.128+0000 7f047a59c700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 0x7f046406faf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f046c011490 tx=0x7f046c009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:17.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.128+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f047005b2d0 con 0x7f047c1003d0 2024-09-16T00:50:17.131 INFO:tasks.workunit.client.0.smithi053.stdout:6/160: mkdir d1/d37 0 2024-09-16T00:50:17.133 INFO:tasks.workunit.client.0.smithi053.stdout:7/238: read d1/d35/f1e [4991193,107688] 0 2024-09-16T00:50:17.133 INFO:tasks.workunit.client.1.smithi152.stdout:9/615: truncate d1/d4e/d48/d2b/f70 4603679 0 2024-09-16T00:50:17.133 INFO:tasks.workunit.client.1.smithi152.stdout:9/616: creat d1/fcd x:0 0 0 2024-09-16T00:50:17.137 INFO:tasks.workunit.client.1.smithi152.stdout:1/703: rename d9/d3e/d7b/df0/d107/cd8 to d9/d3e/d4b/d6b/d6d/d97/c109 0 2024-09-16T00:50:17.137 INFO:tasks.workunit.client.1.smithi152.stdout:1/704: chown d9/d3e/d41/f8d 4370 1 2024-09-16T00:50:17.138 INFO:tasks.workunit.client.0.smithi053.stdout:7/239: dread d1/d2a/d4f/d52/d2c/f40 [0,4194304] 0 2024-09-16T00:50:17.139 INFO:tasks.workunit.client.1.smithi152.stdout:4/704: mknod d2/cea 0 2024-09-16T00:50:17.144 INFO:tasks.workunit.client.0.smithi053.stdout:4/182: dwrite d0/d2/d1d/f36 [0,4194304] 0 2024-09-16T00:50:17.144 INFO:tasks.workunit.client.0.smithi053.stdout:4/183: chown d0 0 1 2024-09-16T00:50:17.146 INFO:tasks.workunit.client.1.smithi152.stdout:1/705: write d9/da/df/f30 [1751943,58268] 0 2024-09-16T00:50:17.147 INFO:tasks.workunit.client.1.smithi152.stdout:3/599: mkdir dc/d10/d17/d1c/d1f/d24/db9 0 2024-09-16T00:50:17.149 INFO:tasks.workunit.client.1.smithi152.stdout:6/637: mknod db/d12/d1c/d80/ccc 0 2024-09-16T00:50:17.149 INFO:tasks.workunit.client.1.smithi152.stdout:6/638: write db/d12/d23/d4a/d33/fa3 [879773,83418] 0 2024-09-16T00:50:17.149 INFO:tasks.workunit.client.1.smithi152.stdout:6/639: write db/d12/d23/d4a/d43/d48/d6a/fb6 [387356,78038] 0 2024-09-16T00:50:17.157 INFO:tasks.workunit.client.0.smithi053.stdout:0/172: symlink d4/l3b 0 2024-09-16T00:50:17.158 INFO:tasks.workunit.client.1.smithi152.stdout:7/614: mknod d9/d31/d64/d3c/cd4 0 2024-09-16T00:50:17.161 INFO:tasks.workunit.client.1.smithi152.stdout:2/597: creat d4/d19/d20/d28/d2c/fc4 x:0 0 0 2024-09-16T00:50:17.166 INFO:tasks.workunit.client.1.smithi152.stdout:9/617: creat d1/d7/dca/fce x:0 0 0 2024-09-16T00:50:17.167 INFO:tasks.workunit.client.1.smithi152.stdout:9/618: write d1/d59/f2f [5341030,50469] 0 2024-09-16T00:50:17.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/807: rename d6/d57/d2b/l3f to d6/d16/d1f/l12a 0 2024-09-16T00:50:17.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/808: fdatasync d6/d16/d1f/d8c/db8/dbf/ded/ffb 0 2024-09-16T00:50:17.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/809: creat d6/d16/d10d/d10e/f12b x:0 0 0 2024-09-16T00:50:17.172 INFO:tasks.workunit.client.1.smithi152.stdout:4/705: getdents d2/d1e/d28/d7b 0 2024-09-16T00:50:17.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/706: fsync d2/d1e/fd9 0 2024-09-16T00:50:17.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/707: write d2/d1e/d28/f57 [894578,103344] 0 2024-09-16T00:50:17.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/708: write d2/db/d39/d3c/d76/f82 [622482,18367] 0 2024-09-16T00:50:17.174 INFO:tasks.workunit.client.0.smithi053.stdout:6/161: unlink d1/le 0 2024-09-16T00:50:17.177 INFO:tasks.workunit.client.0.smithi053.stdout:0/173: dwrite d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:17.177 INFO:tasks.workunit.client.0.smithi053.stdout:7/240: rmdir d1/d2a/d4f/d52/d2c 39 2024-09-16T00:50:17.180 INFO:tasks.workunit.client.1.smithi152.stdout:1/706: link d9/d3e/d41/d31/d48/d4a/lfe d9/d3e/d4b/d6b/d6d/d99/l10a 0 2024-09-16T00:50:17.180 INFO:tasks.workunit.client.1.smithi152.stdout:1/707: truncate d9/d3e/d4b/d6b/d6d/d99/fc9 764943 0 2024-09-16T00:50:17.180 INFO:tasks.workunit.client.1.smithi152.stdout:1/708: write d9/d3e/d7b/df0/d107/f5d [1698944,29142] 0 2024-09-16T00:50:17.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/619: dread d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:17.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/620: write d1/d7/d77/d32/da5/da8/fac [4294012,111317] 0 2024-09-16T00:50:17.181 INFO:tasks.workunit.client.1.smithi152.stdout:3/600: mkdir dc/d10/d17/d1c/dba 0 2024-09-16T00:50:17.182 INFO:tasks.workunit.client.0.smithi053.stdout:0/174: creat d4/dc/d1e/d1f/f3c x:0 0 0 2024-09-16T00:50:17.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/640: truncate f2 2819519 0 2024-09-16T00:50:17.186 INFO:tasks.workunit.client.0.smithi053.stdout:6/162: mknod d1/c38 0 2024-09-16T00:50:17.188 INFO:tasks.workunit.client.1.smithi152.stdout:2/598: symlink d4/d19/d20/d28/d8b/da9/db7/lc5 0 2024-09-16T00:50:17.188 INFO:tasks.workunit.client.1.smithi152.stdout:2/599: read - d4/d44/d7a/d9e/d87/d9c/fad zero size 2024-09-16T00:50:17.189 INFO:tasks.workunit.client.0.smithi053.stdout:7/241: getdents d1/d2a 0 2024-09-16T00:50:17.191 INFO:tasks.workunit.client.0.smithi053.stdout:0/175: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:17.193 INFO:tasks.workunit.client.0.smithi053.stdout:7/242: truncate d1/d3/f3c 1015283 0 2024-09-16T00:50:17.195 INFO:tasks.workunit.client.1.smithi152.stdout:5/810: mkdir d6/d57/d54/d12c 0 2024-09-16T00:50:17.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:16 smithi152 ceph-mon[33237]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:17.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:16 smithi152 ceph-mon[33237]: mgrmap e25: smithi152.nlmwrx(active, since 11s), standbys: smithi053.cjiiek 2024-09-16T00:50:17.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:16 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:50:17.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/709: mkdir d2/db/dce/deb 0 2024-09-16T00:50:17.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/176: getdents d4/dc/d25/d34 0 2024-09-16T00:50:17.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/177: write d4/d13/f1c [3300581,47033] 0 2024-09-16T00:50:17.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/178: fdatasync d4/dc/f14 0 2024-09-16T00:50:17.199 INFO:tasks.workunit.client.1.smithi152.stdout:9/621: mknod d1/d4e/d48/ccf 0 2024-09-16T00:50:17.199 INFO:tasks.workunit.client.1.smithi152.stdout:9/622: write d1/f8b [767507,65845] 0 2024-09-16T00:50:17.200 INFO:tasks.workunit.client.0.smithi053.stdout:7/243: mknod d1/d35/d14/d15/c58 0 2024-09-16T00:50:17.202 INFO:tasks.workunit.client.1.smithi152.stdout:2/600: dwrite d4/d44/d7a/d9e/d66/f9a [0,4194304] 0 2024-09-16T00:50:17.203 INFO:tasks.workunit.client.0.smithi053.stdout:6/163: rename d1/dc/d11 to d1/dc/d39 0 2024-09-16T00:50:17.203 INFO:tasks.workunit.client.0.smithi053.stdout:6/164: truncate d1/dc/f31 519659 0 2024-09-16T00:50:17.204 INFO:tasks.workunit.client.1.smithi152.stdout:6/641: stat db/d12/d1c/d80/c8f 0 2024-09-16T00:50:17.204 INFO:tasks.workunit.client.1.smithi152.stdout:6/642: chown db/d12/d1c/d80/d97/f99 44215360 1 2024-09-16T00:50:17.205 INFO:tasks.workunit.client.0.smithi053.stdout:0/179: unlink d4/dc/d1e/d22/c39 0 2024-09-16T00:50:17.207 INFO:tasks.workunit.client.1.smithi152.stdout:7/615: getdents d9/d31/d64/d3c/db9 0 2024-09-16T00:50:17.210 INFO:tasks.workunit.client.0.smithi053.stdout:0/180: write d4/dc/d25/f2f [778033,72429] 0 2024-09-16T00:50:17.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/710: truncate d2/db/d39/d3c/d76/db8/f34 774241 0 2024-09-16T00:50:17.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/711: creat d2/db/dce/fec x:0 0 0 2024-09-16T00:50:17.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/712: write d2/d41/fde [180945,127919] 0 2024-09-16T00:50:17.212 INFO:tasks.workunit.client.1.smithi152.stdout:2/601: write d4/f15 [2087263,77237] 0 2024-09-16T00:50:17.213 INFO:tasks.workunit.client.0.smithi053.stdout:7/244: mknod d1/d2a/d4f/d52/d2c/c59 0 2024-09-16T00:50:17.214 INFO:tasks.workunit.client.0.smithi053.stdout:7/245: creat d1/d35/d14/d15/f5a x:0 0 0 2024-09-16T00:50:17.220 INFO:tasks.workunit.client.0.smithi053.stdout:0/181: read d4/dc/f14 [1130666,92990] 0 2024-09-16T00:50:17.220 INFO:tasks.workunit.client.0.smithi053.stdout:0/182: dread - d4/d13/f38 zero size 2024-09-16T00:50:17.220 INFO:tasks.workunit.client.0.smithi053.stdout:0/183: readlink d4/l3b 0 2024-09-16T00:50:17.223 INFO:tasks.workunit.client.1.smithi152.stdout:7/616: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5 0 2024-09-16T00:50:17.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/602: dread d4/f15 [8388608,4194304] 0 2024-09-16T00:50:17.225 INFO:tasks.workunit.client.0.smithi053.stdout:0/184: unlink d4/dc/d1e/c20 0 2024-09-16T00:50:17.225 INFO:tasks.workunit.client.0.smithi053.stdout:6/165: dwrite d1/d2f/f33 [0,4194304] 0 2024-09-16T00:50:17.226 INFO:tasks.workunit.client.0.smithi053.stdout:0/185: chown d4/dc 481656 1 2024-09-16T00:50:17.226 INFO:tasks.workunit.client.0.smithi053.stdout:0/186: dread - d4/dc/d1e/d1f/f3c zero size 2024-09-16T00:50:17.226 INFO:tasks.workunit.client.0.smithi053.stdout:0/187: dread - d4/dc/d25/d34/d2a/d27/f37 zero size 2024-09-16T00:50:17.226 INFO:tasks.workunit.client.0.smithi053.stdout:6/166: write d1/dc/d39/f13 [3123552,31632] 0 2024-09-16T00:50:17.227 INFO:tasks.workunit.client.1.smithi152.stdout:4/713: truncate d2/d1e/d28/d69/f6d 3682447 0 2024-09-16T00:50:17.228 INFO:tasks.workunit.client.1.smithi152.stdout:4/714: fsync d2/db/d39/f93 0 2024-09-16T00:50:17.228 INFO:tasks.workunit.client.1.smithi152.stdout:4/715: fdatasync d2/db/dce/fec 0 2024-09-16T00:50:17.230 INFO:tasks.workunit.client.0.smithi053.stdout:7/246: dread d1/d3/f1f [0,4194304] 0 2024-09-16T00:50:17.230 INFO:tasks.workunit.client.0.smithi053.stdout:7/247: chown d1/d3/f5 145 1 2024-09-16T00:50:17.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/601: rename dc/d10/d17/d1c/d8d/d8e/d2f/d46/d77 to dc/d10/d17/d5a/db2/d6f/dbb 0 2024-09-16T00:50:17.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/602: chown dc/f35 13611 1 2024-09-16T00:50:17.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/603: chown dc/d10/d17/d5a/db2 22053 1 2024-09-16T00:50:17.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/604: truncate dc/d10/d17/d1c/d8d/d8e/f84 701145 0 2024-09-16T00:50:17.232 INFO:tasks.workunit.client.0.smithi053.stdout:0/188: mknod d4/d13/d2d/c3d 0 2024-09-16T00:50:17.235 INFO:tasks.workunit.client.1.smithi152.stdout:7/617: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/dd6 0 2024-09-16T00:50:17.236 INFO:tasks.workunit.client.0.smithi053.stdout:6/167: rename d1/dc/d1e/c27 to d1/d2f/c3a 0 2024-09-16T00:50:17.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/603: mkdir d4/d19/d20/d28/dc6 0 2024-09-16T00:50:17.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/604: chown d4/d44/d7a/d9e 165200 1 2024-09-16T00:50:17.243 INFO:tasks.workunit.client.1.smithi152.stdout:1/709: dwrite d9/d3e/d41/d31/d48/db2/fe1 [0,4194304] 0 2024-09-16T00:50:17.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/643: rename db/d12/d23/d4a/d33/c52 to db/d12/d23/d3a/ccd 0 2024-09-16T00:50:17.249 INFO:tasks.workunit.client.1.smithi152.stdout:3/605: rename dc/d10/d17/d1c/d8d/d8e/f2e to dc/d10/d17/d1c/d8d/d8e/fbc 0 2024-09-16T00:50:17.251 INFO:tasks.workunit.client.1.smithi152.stdout:7/618: creat d9/d31/dc4/fd7 x:0 0 0 2024-09-16T00:50:17.251 INFO:tasks.workunit.client.1.smithi152.stdout:3/606: read dc/d10/d17/d1c/d1f/f91 [167414,15201] 0 2024-09-16T00:50:17.252 INFO:tasks.workunit.client.1.smithi152.stdout:4/716: dwrite d2/db/dce/fdb [0,4194304] 0 2024-09-16T00:50:17.253 INFO:tasks.workunit.client.1.smithi152.stdout:9/623: getdents d1/d7/dca 0 2024-09-16T00:50:17.255 INFO:tasks.workunit.client.1.smithi152.stdout:6/644: write db/d12/d23/d4a/f5a [1677933,49114] 0 2024-09-16T00:50:17.256 INFO:tasks.workunit.client.1.smithi152.stdout:2/605: mkdir d4/d44/d7a/dc7 0 2024-09-16T00:50:17.259 INFO:tasks.workunit.client.0.smithi053.stdout:7/248: truncate d1/d35/d14/f2f 569843 0 2024-09-16T00:50:17.262 INFO:tasks.workunit.client.1.smithi152.stdout:7/619: write d9/d31/d65/d4b/f66 [3408889,54519] 0 2024-09-16T00:50:17.264 INFO:tasks.workunit.client.0.smithi053.stdout:0/189: rename d4/l12 to d4/d13/d2d/l3e 0 2024-09-16T00:50:17.265 INFO:tasks.workunit.client.1.smithi152.stdout:3/607: dread dc/d10/d17/d1c/d1f/f49 [0,4194304] 0 2024-09-16T00:50:17.268 INFO:tasks.workunit.client.0.smithi053.stdout:6/168: unlink d1/dc/d1e/c28 0 2024-09-16T00:50:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:6/645: dread db/d12/d20/f36 [0,4194304] 0 2024-09-16T00:50:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:6/646: fdatasync db/d12/d20/f51 0 2024-09-16T00:50:17.272 INFO:tasks.workunit.client.0.smithi053.stdout:6/169: unlink d1/dc/d39/l14 0 2024-09-16T00:50:17.272 INFO:tasks.workunit.client.0.smithi053.stdout:6/170: creat d1/dc/f3b x:0 0 0 2024-09-16T00:50:17.273 INFO:tasks.workunit.client.1.smithi152.stdout:6/647: dread db/d12/d23/d4a/d43/d48/f9e [0,4194304] 0 2024-09-16T00:50:17.275 INFO:tasks.workunit.client.0.smithi053.stdout:0/190: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:17.288 INFO:tasks.workunit.client.1.smithi152.stdout:7/620: dwrite d9/d31/d65/d8a/d41/f62 [0,4194304] 0 2024-09-16T00:50:17.289 INFO:tasks.workunit.client.1.smithi152.stdout:7/621: write d9/d31/d64/d3c/f8b [1039680,41245] 0 2024-09-16T00:50:17.289 INFO:tasks.workunit.client.1.smithi152.stdout:7/622: chown d9/d31/c38 1 1 2024-09-16T00:50:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/623: dread d9/d31/d65/d8a/f3b [0,4194304] 0 2024-09-16T00:50:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/624: write d9/d31/d64/f61 [2419290,14874] 0 2024-09-16T00:50:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/625: chown d9/c14 1 1 2024-09-16T00:50:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/626: chown d9/d31/d64/d3c/f44 695 1 2024-09-16T00:50:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:7/627: truncate d9/d31/d64/d3c/f8b 1539374 0 2024-09-16T00:50:17.293 INFO:tasks.workunit.client.0.smithi053.stdout:7/249: dwrite d1/d35/f1e [4194304,4194304] 0 2024-09-16T00:50:17.293 INFO:tasks.workunit.client.1.smithi152.stdout:6/648: dwrite db/d12/d23/fac [0,4194304] 0 2024-09-16T00:50:17.293 INFO:tasks.workunit.client.0.smithi053.stdout:6/171: rmdir d1/d37 0 2024-09-16T00:50:17.298 INFO:tasks.workunit.client.0.smithi053.stdout:7/250: mkdir d1/d35/d5b 0 2024-09-16T00:50:17.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/710: rename d9/d3e/d41/fbd to d9/d3e/f10b 0 2024-09-16T00:50:17.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/711: stat d9/d3e/d4b/d6b/d6d/d97/ffd 0 2024-09-16T00:50:17.309 INFO:tasks.workunit.client.1.smithi152.stdout:4/717: mkdir d2/db/d39/d3c/d7f/ded 0 2024-09-16T00:50:17.309 INFO:tasks.workunit.client.1.smithi152.stdout:4/718: fdatasync d2/d1e/d28/f30 0 2024-09-16T00:50:17.310 INFO:tasks.workunit.client.1.smithi152.stdout:9/624: rmdir d1/d4e/d48/d26 39 2024-09-16T00:50:17.311 INFO:tasks.workunit.client.1.smithi152.stdout:9/625: write d1/d4e/d48/d2b/d7c/fbc [214968,97941] 0 2024-09-16T00:50:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/608: getdents dc/d10/d17/d5a 0 2024-09-16T00:50:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/609: write dc/d10/d17/d1c/f23 [1329719,26331] 0 2024-09-16T00:50:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/610: readlink dc/d10/d17/d5a/d68/da5/la7 0 2024-09-16T00:50:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/611: creat dc/fbd x:0 0 0 2024-09-16T00:50:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/612: stat dc/d10/d17/d1c/d50/d55 0 2024-09-16T00:50:17.317 INFO:tasks.workunit.client.0.smithi053.stdout:7/251: write d1/d3/f5 [4514693,48958] 0 2024-09-16T00:50:17.317 INFO:tasks.workunit.client.0.smithi053.stdout:7/252: fdatasync d1/d35/d4a/f56 0 2024-09-16T00:50:17.317 INFO:tasks.workunit.client.0.smithi053.stdout:7/253: truncate d1/d35/d14/d15/f48 608484 0 2024-09-16T00:50:17.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/628: dwrite f7 [0,4194304] 0 2024-09-16T00:50:17.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/649: dwrite db/d12/d20/d86/d91/fa6 [4194304,4194304] 0 2024-09-16T00:50:17.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/650: write db/d12/d20/d86/fc7 [3034609,51684] 0 2024-09-16T00:50:17.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/651: write db/d12/d1c/fb1 [907452,23320] 0 2024-09-16T00:50:17.327 INFO:tasks.workunit.client.1.smithi152.stdout:6/652: dread f2 [0,4194304] 0 2024-09-16T00:50:17.328 INFO:tasks.workunit.client.0.smithi053.stdout:6/172: rmdir d1/d2f 39 2024-09-16T00:50:17.328 INFO:tasks.workunit.client.0.smithi053.stdout:6/173: fdatasync d1/dc/d39/f13 0 2024-09-16T00:50:17.329 INFO:tasks.workunit.client.1.smithi152.stdout:1/712: getdents d9/d3e/d7b/df0 0 2024-09-16T00:50:17.331 INFO:tasks.workunit.client.0.smithi053.stdout:6/174: mkdir d1/dc/d3c 0 2024-09-16T00:50:17.331 INFO:tasks.workunit.client.0.smithi053.stdout:6/175: write d1/fd [1385894,109068] 0 2024-09-16T00:50:17.332 INFO:tasks.workunit.client.1.smithi152.stdout:9/626: mknod d1/d4e/d48/d26/d58/cd0 0 2024-09-16T00:50:17.332 INFO:tasks.workunit.client.1.smithi152.stdout:9/627: fsync d1/d59/f2f 0 2024-09-16T00:50:17.336 INFO:tasks.workunit.client.0.smithi053.stdout:6/176: mkdir d1/dc/d3d 0 2024-09-16T00:50:17.336 INFO:tasks.workunit.client.0.smithi053.stdout:6/177: fdatasync d1/dc/d39/f25 0 2024-09-16T00:50:17.338 INFO:tasks.workunit.client.1.smithi152.stdout:7/629: mknod d9/d31/d64/d3c/db9/dc2/cd8 0 2024-09-16T00:50:17.340 INFO:tasks.workunit.client.1.smithi152.stdout:3/613: dwrite dc/d10/f7a [0,4194304] 0 2024-09-16T00:50:17.341 INFO:tasks.workunit.client.0.smithi053.stdout:0/191: truncate d4/d13/f1c 1064794 0 2024-09-16T00:50:17.343 INFO:tasks.workunit.client.0.smithi053.stdout:6/178: rename d1/f5 to d1/dc/f3e 0 2024-09-16T00:50:17.349 INFO:tasks.workunit.client.1.smithi152.stdout:1/713: dwrite d9/da/df/f2c [0,4194304] 0 2024-09-16T00:50:17.350 INFO:tasks.workunit.client.1.smithi152.stdout:7/630: dread d9/d31/d65/d8a/d41/f50 [0,4194304] 0 2024-09-16T00:50:17.350 INFO:tasks.workunit.client.1.smithi152.stdout:7/631: stat d9/d31/d64/l84 0 2024-09-16T00:50:17.351 INFO:tasks.workunit.client.1.smithi152.stdout:7/632: truncate d9/d31/d64/d3c/f71 1005727 0 2024-09-16T00:50:17.352 INFO:tasks.workunit.client.1.smithi152.stdout:6/653: rename db/d12/d23/d4a/d43/c88 to db/d12/d1c/cce 0 2024-09-16T00:50:17.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/719: getdents d2/d1e 0 2024-09-16T00:50:17.365 INFO:tasks.workunit.client.1.smithi152.stdout:8/468: sync 2024-09-16T00:50:17.365 INFO:tasks.workunit.client.1.smithi152.stdout:0/625: sync 2024-09-16T00:50:17.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/714: mkdir d9/d3e/d4b/db7/dc4/d10c 0 2024-09-16T00:50:17.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/715: readlink d9/d3e/d4b/d6b/d6d/d97/lb9 0 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/654: dread db/d12/d23/d4a/d43/d48/f4d [0,4194304] 0 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/655: readlink db/d12/d23/d4a/d43/d48/d6a/l7c 0 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/656: fdatasync db/d12/d20/d86/fc7 0 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.0.smithi053.stdout:3/251: sync 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.0.smithi053.stdout:1/190: sync 2024-09-16T00:50:17.369 INFO:tasks.workunit.client.0.smithi053.stdout:3/252: readlink d1/d5/l2e 0 2024-09-16T00:50:17.370 INFO:tasks.workunit.client.1.smithi152.stdout:3/614: rename dc/d10/d17/d5a/db2/f90 to dc/d10/d17/d5a/fbe 0 2024-09-16T00:50:17.372 INFO:tasks.workunit.client.1.smithi152.stdout:9/628: mkdir d1/d4e/d48/d2b/d93/d96/dd1 0 2024-09-16T00:50:17.373 INFO:tasks.workunit.client.0.smithi053.stdout:1/191: mkdir d5/d18/d33/d38 0 2024-09-16T00:50:17.375 INFO:tasks.workunit.client.1.smithi152.stdout:8/469: mkdir dd/d15/d9b 0 2024-09-16T00:50:17.376 INFO:tasks.workunit.client.0.smithi053.stdout:0/192: dwrite d4/f17 [0,4194304] 0 2024-09-16T00:50:17.377 INFO:tasks.workunit.client.1.smithi152.stdout:4/720: dwrite d2/f6 [0,4194304] 0 2024-09-16T00:50:17.378 INFO:tasks.workunit.client.1.smithi152.stdout:0/626: creat d3/d6/d8/d1d/d65/d6e/d82/fd2 x:0 0 0 2024-09-16T00:50:17.380 INFO:tasks.workunit.client.0.smithi053.stdout:1/192: mkdir d5/d7/d39 0 2024-09-16T00:50:17.380 INFO:tasks.workunit.client.0.smithi053.stdout:1/193: creat d5/d7/d10/f3a x:0 0 0 2024-09-16T00:50:17.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/615: write dc/d10/d17/d5a/db2/d6f/dbb/f98 [9394721,118963] 0 2024-09-16T00:50:17.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/616: write dc/d10/d17/d5a/db2/d6f/f83 [889438,76396] 0 2024-09-16T00:50:17.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/627: dread d3/d6/f1e [0,4194304] 0 2024-09-16T00:50:17.382 INFO:tasks.workunit.client.1.smithi152.stdout:1/716: mknod d9/d3e/d41/d31/d48/dc3/c10d 0 2024-09-16T00:50:17.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/193: creat d4/dc/d25/f3f x:0 0 0 2024-09-16T00:50:17.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/194: write d4/dc/f1b [3531773,91882] 0 2024-09-16T00:50:17.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/195: fdatasync d4/dc/d25/d34/d2a/d27/f33 0 2024-09-16T00:50:17.385 INFO:tasks.workunit.client.1.smithi152.stdout:6/657: truncate db/d12/d1c/f5c 2634268 0 2024-09-16T00:50:17.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/658: chown db/d12/d20/d86/d91/fbd 15992304 1 2024-09-16T00:50:17.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/659: stat db/fc 0 2024-09-16T00:50:17.386 INFO:tasks.workunit.client.1.smithi152.stdout:0/628: dread d3/d6/d8/d1d/d23/d25/f4d [0,4194304] 0 2024-09-16T00:50:17.387 INFO:tasks.workunit.client.0.smithi053.stdout:3/253: dwrite d1/d5/d14/f18 [4194304,4194304] 0 2024-09-16T00:50:17.389 INFO:tasks.workunit.client.1.smithi152.stdout:8/470: symlink dd/d25/l9c 0 2024-09-16T00:50:17.390 INFO:tasks.workunit.client.0.smithi053.stdout:1/194: dread d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:17.399 INFO:tasks.workunit.client.1.smithi152.stdout:4/721: symlink d2/db/d39/d3c/d7f/lee 0 2024-09-16T00:50:17.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/254: dwrite d1/d5/d14/f30 [0,4194304] 0 2024-09-16T00:50:17.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/617: rename dc/d10/d17/d1c/d8d/d8e/f92 to dc/d10/d17/d1c/d8d/d8e/fbf 0 2024-09-16T00:50:17.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/618: dread - dc/d10/d17/d4f/fb0 zero size 2024-09-16T00:50:17.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/619: chown dc/d10/d17/d1c/d50/d63/ca9 243642030 1 2024-09-16T00:50:17.405 INFO:tasks.workunit.client.0.smithi053.stdout:3/255: truncate d1/f21 4070341 0 2024-09-16T00:50:17.405 INFO:tasks.workunit.client.0.smithi053.stdout:3/256: write d1/d5/f2f [114552,115933] 0 2024-09-16T00:50:17.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/620: write dc/d10/d17/d1c/d50/d55/f96 [2791041,74492] 0 2024-09-16T00:50:17.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/621: write f5 [1406165,15128] 0 2024-09-16T00:50:17.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/622: chown dc/d10/d17/d1c/d50 581 1 2024-09-16T00:50:17.414 INFO:tasks.workunit.client.1.smithi152.stdout:1/717: dread d9/da/f68 [0,4194304] 0 2024-09-16T00:50:17.414 INFO:tasks.workunit.client.1.smithi152.stdout:1/718: fdatasync d9/da/df/dcb/fc7 0 2024-09-16T00:50:17.414 INFO:tasks.workunit.client.1.smithi152.stdout:1/719: chown d9/da/df/dcb/c8b 767 1 2024-09-16T00:50:17.415 INFO:tasks.workunit.client.0.smithi053.stdout:1/195: dwrite d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:17.415 INFO:tasks.workunit.client.0.smithi053.stdout:1/196: fdatasync d5/d7/d10/f15 0 2024-09-16T00:50:17.479 INFO:tasks.workunit.client.1.smithi152.stdout:6/660: rename db/l55 to db/d12/d23/d4a/d43/d48/lcf 0 2024-09-16T00:50:17.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/629: truncate d3/d6/d6d/f8e 5754941 0 2024-09-16T00:50:17.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/471: symlink dd/d50/d88/l9d 0 2024-09-16T00:50:17.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/472: chown dd/d15/d69/f87 4674 1 2024-09-16T00:50:17.484 INFO:tasks.workunit.client.1.smithi152.stdout:8/473: creat dd/d15/d69/f9e x:0 0 0 2024-09-16T00:50:17.484 INFO:tasks.workunit.client.0.smithi053.stdout:0/196: write d4/dc/d1e/d22/f29 [1575654,37703] 0 2024-09-16T00:50:17.486 INFO:tasks.workunit.client.1.smithi152.stdout:6/661: write db/fc [7638531,117551] 0 2024-09-16T00:50:17.486 INFO:tasks.workunit.client.1.smithi152.stdout:4/722: mkdir d2/db/d39/d3c/d7f/d98/def 0 2024-09-16T00:50:17.488 INFO:tasks.workunit.client.0.smithi053.stdout:3/257: rmdir d1/d5/d16/d47/d4c/d50 39 2024-09-16T00:50:17.491 INFO:tasks.workunit.client.1.smithi152.stdout:3/623: mknod dc/d10/d17/d1c/d50/d55/d6d/cc0 0 2024-09-16T00:50:17.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/474: dread dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:17.500 INFO:tasks.workunit.client.1.smithi152.stdout:0/630: link d3/d6/f17 d3/d6/d2e/fd3 0 2024-09-16T00:50:17.501 INFO:tasks.workunit.client.1.smithi152.stdout:8/475: dread dd/d15/d1a/f3a [0,4194304] 0 2024-09-16T00:50:17.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/197: mkdir d4/dc/d1e/d1f/d40 0 2024-09-16T00:50:17.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/198: truncate d4/dc/d1e/d1f/f3c 303100 0 2024-09-16T00:50:17.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/199: write d4/f10 [3875021,55435] 0 2024-09-16T00:50:17.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/200: chown d4/dc/c36 3939587 1 2024-09-16T00:50:17.505 INFO:tasks.workunit.client.0.smithi053.stdout:0/201: fdatasync d4/f10 0 2024-09-16T00:50:17.507 INFO:tasks.workunit.client.0.smithi053.stdout:0/202: dread d4/dc/d1e/d22/f29 [0,4194304] 0 2024-09-16T00:50:17.508 INFO:tasks.workunit.client.0.smithi053.stdout:3/258: rename d1/d5/d11/l53 to d1/d5/d16/d47/d4c/d50/l57 0 2024-09-16T00:50:17.509 INFO:tasks.workunit.client.0.smithi053.stdout:3/259: dread d1/d5/f2f [0,4194304] 0 2024-09-16T00:50:17.510 INFO:tasks.workunit.client.0.smithi053.stdout:3/260: fdatasync d1/d5/d31/f39 0 2024-09-16T00:50:17.512 INFO:tasks.workunit.client.1.smithi152.stdout:6/662: mkdir db/d12/d23/d4a/dc5/dd0 0 2024-09-16T00:50:17.513 INFO:tasks.workunit.client.0.smithi053.stdout:1/197: rmdir d5/d9 39 2024-09-16T00:50:17.514 INFO:tasks.workunit.client.0.smithi053.stdout:3/261: write d1/d5/f19 [634025,119953] 0 2024-09-16T00:50:17.514 INFO:tasks.workunit.client.0.smithi053.stdout:3/262: truncate d1/d5/d31/f3d 1368918 0 2024-09-16T00:50:17.514 INFO:tasks.workunit.client.0.smithi053.stdout:3/263: chown d1/d5/d16/l43 342176961 1 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/723: rmdir d2/d1e/d28/d7b/db0 39 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/724: truncate d2/db/d39/d3c/d7f/d98/f88 385933 0 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/725: fdatasync d2/d1e/f37 0 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/726: write d2/d1e/d28/d69/f49 [357136,32287] 0 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/811: sync 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:2/606: sync 2024-09-16T00:50:17.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/812: write d6/d57/d2b/d50/d66/f87 [4325142,6883] 0 2024-09-16T00:50:17.517 INFO:tasks.workunit.client.0.smithi053.stdout:1/198: rename d5/d7/f2d to d5/d9/f3b 0 2024-09-16T00:50:17.517 INFO:tasks.workunit.client.0.smithi053.stdout:1/199: fdatasync d5/d9/f1d 0 2024-09-16T00:50:17.518 INFO:tasks.workunit.client.1.smithi152.stdout:3/624: creat dc/d5c/dae/fc1 x:0 0 0 2024-09-16T00:50:17.520 INFO:tasks.workunit.client.0.smithi053.stdout:1/200: rmdir d5/d9 39 2024-09-16T00:50:17.522 INFO:tasks.workunit.client.1.smithi152.stdout:0/631: unlink d3/d6/d8/d1d/d23/f62 0 2024-09-16T00:50:17.524 INFO:tasks.workunit.client.0.smithi053.stdout:1/201: link d5/d7/l8 d5/d18/d33/d30/l3c 0 2024-09-16T00:50:17.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/476: rmdir dd/d50/d88 39 2024-09-16T00:50:17.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/477: write dd/d15/f20 [4272694,107185] 0 2024-09-16T00:50:17.529 INFO:tasks.workunit.client.1.smithi152.stdout:6/663: creat db/d12/d23/d4a/d43/d48/d64/dab/fd1 x:0 0 0 2024-09-16T00:50:17.529 INFO:tasks.workunit.client.1.smithi152.stdout:6/664: creat db/da8/db7/fd2 x:0 0 0 2024-09-16T00:50:17.531 INFO:tasks.workunit.client.0.smithi053.stdout:1/202: creat d5/d18/d1f/f3d x:0 0 0 2024-09-16T00:50:17.532 INFO:tasks.workunit.client.1.smithi152.stdout:4/727: mknod d2/d1e/d28/cf0 0 2024-09-16T00:50:17.534 INFO:tasks.workunit.client.1.smithi152.stdout:2/607: symlink d4/d17/lc8 0 2024-09-16T00:50:17.537 INFO:tasks.workunit.client.1.smithi152.stdout:3/625: creat dc/d10/d17/d1c/d8d/d8e/fc2 x:0 0 0 2024-09-16T00:50:17.538 INFO:tasks.workunit.client.1.smithi152.stdout:0/632: link d3/d6/d8/d1d/d23/d25/laf d3/d6/d8/d9e/ld4 0 2024-09-16T00:50:17.541 INFO:tasks.workunit.client.1.smithi152.stdout:4/728: mkdir d2/d41/df1 0 2024-09-16T00:50:17.548 INFO:tasks.workunit.client.1.smithi152.stdout:2/608: rename d4/d19/d20/d9d to d4/d19/d20/d28/d8b/da9/db7/dc9 0 2024-09-16T00:50:17.553 INFO:tasks.workunit.client.0.smithi053.stdout:0/203: dwrite d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:17.553 INFO:tasks.workunit.client.0.smithi053.stdout:0/204: write d4/dc/d25/f3f [721556,92185] 0 2024-09-16T00:50:17.553 INFO:tasks.workunit.client.0.smithi053.stdout:0/205: readlink d4/ld 0 2024-09-16T00:50:17.554 INFO:tasks.workunit.client.1.smithi152.stdout:4/729: dread d2/d1e/fd9 [0,4194304] 0 2024-09-16T00:50:17.554 INFO:tasks.workunit.client.1.smithi152.stdout:4/730: write d2/d1e/d28/d69/fb5 [72465,37105] 0 2024-09-16T00:50:17.556 INFO:tasks.workunit.client.0.smithi053.stdout:0/206: creat d4/d13/f41 x:0 0 0 2024-09-16T00:50:17.557 INFO:tasks.workunit.client.0.smithi053.stdout:0/207: unlink d4/c15 0 2024-09-16T00:50:17.559 INFO:tasks.workunit.client.0.smithi053.stdout:0/208: creat d4/dc/d1e/d22/f42 x:0 0 0 2024-09-16T00:50:17.559 INFO:tasks.workunit.client.1.smithi152.stdout:2/609: write d4/d44/d7a/d9e/faf [797411,56356] 0 2024-09-16T00:50:17.560 INFO:tasks.workunit.client.1.smithi152.stdout:2/610: readlink d4/d17/l2f 0 2024-09-16T00:50:17.560 INFO:tasks.workunit.client.0.smithi053.stdout:0/209: truncate d4/dc/d25/f2f 147418 0 2024-09-16T00:50:17.563 INFO:tasks.workunit.client.0.smithi053.stdout:0/210: symlink d4/dc/d1e/l43 0 2024-09-16T00:50:17.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/626: getdents dc/d5c/dae 0 2024-09-16T00:50:17.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/627: stat dc/d10/d17/d5a/d68/c73 0 2024-09-16T00:50:17.572 INFO:tasks.workunit.client.1.smithi152.stdout:3/628: rmdir dc/d10/d17/d1c/d1f/d24 39 2024-09-16T00:50:17.580 INFO:tasks.workunit.client.0.smithi053.stdout:0/211: fsync d4/d13/f41 0 2024-09-16T00:50:17.582 INFO:tasks.workunit.client.0.smithi053.stdout:0/212: mkdir d4/dc/d1e/d1f/d40/d44 0 2024-09-16T00:50:17.584 INFO:tasks.workunit.client.0.smithi053.stdout:0/213: mknod d4/dc/d1e/d22/c45 0 2024-09-16T00:50:17.584 INFO:tasks.workunit.client.0.smithi053.stdout:0/214: chown d4/d13/f41 38459 1 2024-09-16T00:50:17.585 INFO:tasks.workunit.client.0.smithi053.stdout:0/215: unlink d4/f10 0 2024-09-16T00:50:17.588 INFO:tasks.workunit.client.1.smithi152.stdout:8/478: dwrite dd/d50/d29/f84 [0,4194304] 0 2024-09-16T00:50:17.588 INFO:tasks.workunit.client.0.smithi053.stdout:0/216: symlink d4/dc/d25/l46 0 2024-09-16T00:50:17.588 INFO:tasks.workunit.client.0.smithi053.stdout:0/217: creat d4/d13/d2d/f47 x:0 0 0 2024-09-16T00:50:17.589 INFO:tasks.workunit.client.0.smithi053.stdout:8/273: sync 2024-09-16T00:50:17.590 INFO:tasks.workunit.client.0.smithi053.stdout:0/218: rmdir d4/dc/d25/d34/d2a 39 2024-09-16T00:50:17.590 INFO:tasks.workunit.client.0.smithi053.stdout:0/219: truncate d4/dc/d25/d34/d2a/d27/f37 24870 0 2024-09-16T00:50:17.592 INFO:tasks.workunit.client.0.smithi053.stdout:0/220: symlink d4/dc/d25/l48 0 2024-09-16T00:50:17.597 INFO:tasks.workunit.client.1.smithi152.stdout:6/665: dwrite db/d12/d20/d86/fc7 [4194304,4194304] 0 2024-09-16T00:50:17.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.597+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f047c107e30 con 0x7f047c1003d0 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.599+0000 7f046b7fe700 1 -- 172.21.15.53:0/1091224149 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f047005ae60 con 0x7f047c1003d0 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:50:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:50:17.602 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:50:17.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/666: dread db/d12/d23/d4a/f5f [0,4194304] 0 2024-09-16T00:50:17.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/667: write db/d12/d20/f3e [3631643,96366] 0 2024-09-16T00:50:17.603 INFO:tasks.workunit.client.1.smithi152.stdout:6/668: chown db/d12 213858279 1 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 msgr2=0x7f046406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 0x7f046406faf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f046c011490 tx=0x7f046c009260 comp rx=0 tx=0).stop 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 msgr2=0x7f047c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f047000f690 tx=0x7f047000f6c0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 shutdown_connections 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f046406d640 0x7f046406faf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047c0ff130 0x7f047c0690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 --2- 172.21.15.53:0/1091224149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f047c1003d0 0x7f047c19a7e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 >> 172.21.15.53:0/1091224149 conn(0x7f047c0fa780 msgr2=0x7f047c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 shutdown_connections 2024-09-16T00:50:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.602+0000 7f0480ec5700 1 -- 172.21.15.53:0/1091224149 wait complete. 2024-09-16T00:50:17.605 INFO:tasks.workunit.client.0.smithi053.stdout:0/221: dread d4/f17 [0,4194304] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:4/731: dwrite d2/db/d39/d3c/d7f/d8b/fe9 [4194304,4194304] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:2/611: dwrite d4/d19/d20/d28/d8b/da9/db7/dc9/fac [0,4194304] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/629: dwrite dc/d10/d17/d1c/d1f/f2a [0,4194304] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/630: chown dc/d10/d17/f52 1335 1 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:0/633: dwrite d3/d6/d8/d1d/d23/d4b/d54/f90 [4194304,4194304] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:0/634: write d3/d6/d6d/db7/fc0 [482508,29848] 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:0/635: fsync d3/d6/d8/ff 0 2024-09-16T00:50:17.607 INFO:tasks.workunit.client.1.smithi152.stdout:0/636: chown d3/d6/d8/d1d/d23/d25/d2a/d5c/lb2 0 1 2024-09-16T00:50:17.608 INFO:tasks.workunit.client.0.smithi053.stdout:8/274: dwrite d10/d1c/d2b/d40/f4d [0,4194304] 0 2024-09-16T00:50:17.608 INFO:tasks.workunit.client.0.smithi053.stdout:0/222: mkdir d4/dc/d1e/d1f/d40/d44/d49 0 2024-09-16T00:50:17.608 INFO:tasks.workunit.client.1.smithi152.stdout:8/479: dwrite dd/f4c [0,4194304] 0 2024-09-16T00:50:17.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/732: creat d2/db/d39/d3c/d76/db8/ff2 x:0 0 0 2024-09-16T00:50:17.618 INFO:tasks.workunit.client.1.smithi152.stdout:8/480: dread dd/d50/d29/f58 [0,4194304] 0 2024-09-16T00:50:17.618 INFO:tasks.workunit.client.1.smithi152.stdout:8/481: fdatasync dd/ff 0 2024-09-16T00:50:17.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/631: unlink dc/d10/d17/d1c/d1f/f49 0 2024-09-16T00:50:17.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/632: stat dc/d10/l82 0 2024-09-16T00:50:17.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/633: stat dc/d10/d17/d1c/d8d 0 2024-09-16T00:50:17.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/634: write dc/f1a [3988847,95826] 0 2024-09-16T00:50:17.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/635: write dc/d10/d17/d5a/d68/f9d [541939,128752] 0 2024-09-16T00:50:17.623 INFO:tasks.workunit.client.1.smithi152.stdout:3/636: dread dc/d10/d17/d5a/db2/f57 [0,4194304] 0 2024-09-16T00:50:17.623 INFO:tasks.workunit.client.1.smithi152.stdout:3/637: chown dc/d10/d17/d1c/d50/d55/d6d/cc0 15963 1 2024-09-16T00:50:17.624 INFO:tasks.workunit.client.0.smithi053.stdout:0/223: mkdir d4/dc/d25/d34/d2a/d27/d4a 0 2024-09-16T00:50:17.624 INFO:tasks.workunit.client.0.smithi053.stdout:0/224: dread - d4/d13/f38 zero size 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.0.smithi053.stdout:0/225: chown d4/dc/d1e/d1f/f3c 510502 1 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.0.smithi053.stdout:0/226: chown d4 1640771 1 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.0.smithi053.stdout:0/227: chown d4/f17 155 1 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.0.smithi053.stdout:0/228: write d4/dc/f1b [3500686,124394] 0 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.0.smithi053.stdout:0/229: dread - d4/dc/d25/d34/d2a/d27/f33 zero size 2024-09-16T00:50:17.625 INFO:tasks.workunit.client.1.smithi152.stdout:6/669: dwrite db/f40 [0,4194304] 0 2024-09-16T00:50:17.626 INFO:tasks.workunit.client.1.smithi152.stdout:6/670: write db/fc [5985363,59226] 0 2024-09-16T00:50:17.626 INFO:tasks.workunit.client.1.smithi152.stdout:0/637: creat d3/d6/d64/d6a/fd5 x:0 0 0 2024-09-16T00:50:17.627 INFO:tasks.workunit.client.1.smithi152.stdout:6/671: fdatasync db/d12/d20/f3e 0 2024-09-16T00:50:17.627 INFO:tasks.workunit.client.1.smithi152.stdout:2/612: dwrite d4/d19/d20/d28/d2c/fc1 [0,4194304] 0 2024-09-16T00:50:17.627 INFO:tasks.workunit.client.1.smithi152.stdout:4/733: symlink d2/d41/df1/lf3 0 2024-09-16T00:50:17.636 INFO:tasks.workunit.client.1.smithi152.stdout:8/482: rmdir dd/d15/d1a/d92 0 2024-09-16T00:50:17.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/638: creat dc/d10/d17/d1c/d50/d63/fc3 x:0 0 0 2024-09-16T00:50:17.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/638: unlink d3/d6/d4e/f55 0 2024-09-16T00:50:17.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/639: fdatasync d3/d6/d64/f6c 0 2024-09-16T00:50:17.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/640: chown d3/d6/d8/d1d/d23/d25/d45/d6f/da7 299 1 2024-09-16T00:50:17.640 INFO:tasks.workunit.client.0.smithi053.stdout:0/230: dwrite d4/dc/d1e/d1f/f3c [0,4194304] 0 2024-09-16T00:50:17.641 INFO:tasks.workunit.client.1.smithi152.stdout:6/672: mkdir db/d12/d20/d86/d91/dd3 0 2024-09-16T00:50:17.643 INFO:tasks.workunit.client.1.smithi152.stdout:2/613: truncate d4/d44/d7a/d9e/d66/f9a 556114 0 2024-09-16T00:50:17.645 INFO:tasks.workunit.client.1.smithi152.stdout:4/734: unlink d2/db/c9b 0 2024-09-16T00:50:17.648 INFO:tasks.workunit.client.0.smithi053.stdout:0/231: link d4/f17 d4/f4b 0 2024-09-16T00:50:17.649 INFO:tasks.workunit.client.1.smithi152.stdout:8/483: mknod dd/d50/d29/c9f 0 2024-09-16T00:50:17.650 INFO:tasks.workunit.client.1.smithi152.stdout:8/484: chown dd/d15/d1a/f3f 14767190 1 2024-09-16T00:50:17.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/639: mkdir dc/d10/d17/d1c/d50/d63/dc4 0 2024-09-16T00:50:17.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/640: readlink dc/d10/laf 0 2024-09-16T00:50:17.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/641: stat dc/f6c 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/641: link d3/d6/d8/d1d/d23/d25/d45/cbc d3/d6/d8/d1d/d23/d25/cd6 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/642: write d3/d6/d8/d1d/d65/db0/db6/fc3 [1315663,114933] 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/643: write d3/d6/d6d/f8e [6755301,49496] 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/644: fsync d3/d6/d8/d1d/f20 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/645: truncate d3/d6/f42 1439442 0 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/646: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fa0 703826979 1 2024-09-16T00:50:17.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/647: creat d3/d6/d64/d6a/fd7 x:0 0 0 2024-09-16T00:50:17.657 INFO:tasks.workunit.client.1.smithi152.stdout:2/614: dwrite d4/d19/d94/fb3 [0,4194304] 0 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:6/673: mknod db/d12/d23/d4a/cd4 0 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:9/629: sync 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:7/633: sync 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:1/720: sync 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:1/721: chown d9/d3e/d41/ca6 227627 1 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:1/722: chown d9/da/df/f30 6638628 1 2024-09-16T00:50:17.659 INFO:tasks.workunit.client.1.smithi152.stdout:1/723: write d9/d3e/d41/ff3 [863311,101845] 0 2024-09-16T00:50:17.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/724: chown d9/d3e/d41/d31/d48/d4a/c6f 381 1 2024-09-16T00:50:17.660 INFO:tasks.workunit.client.0.smithi053.stdout:0/232: rmdir d4/dc/d25 39 2024-09-16T00:50:17.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/725: read d9/d3e/d41/f8d [725676,6115] 0 2024-09-16T00:50:17.661 INFO:tasks.workunit.client.1.smithi152.stdout:1/726: fdatasync d9/d3e/d41/d31/d48/f70 0 2024-09-16T00:50:17.661 INFO:tasks.workunit.client.1.smithi152.stdout:7/634: write d9/d10/f16 [46167,126083] 0 2024-09-16T00:50:17.667 INFO:tasks.workunit.client.0.smithi053.stdout:0/233: link c2 d4/dc/d1e/d1f/d40/d44/d49/c4c 0 2024-09-16T00:50:17.667 INFO:tasks.workunit.client.0.smithi053.stdout:0/234: readlink d4/dc/d1e/l43 0 2024-09-16T00:50:17.667 INFO:tasks.workunit.client.0.smithi053.stdout:0/235: write d4/d13/f41 [202287,13142] 0 2024-09-16T00:50:17.670 INFO:tasks.workunit.client.0.smithi053.stdout:0/236: creat d4/dc/d25/f4d x:0 0 0 2024-09-16T00:50:17.673 INFO:tasks.workunit.client.0.smithi053.stdout:0/237: creat d4/dc/d25/d34/d2a/f4e x:0 0 0 2024-09-16T00:50:17.674 INFO:tasks.workunit.client.1.smithi152.stdout:8/485: dwrite dd/d15/d49/f13 [0,4194304] 0 2024-09-16T00:50:17.674 INFO:tasks.workunit.client.1.smithi152.stdout:8/486: chown dd/f72 17935166 1 2024-09-16T00:50:17.674 INFO:tasks.workunit.client.1.smithi152.stdout:8/487: chown dd/d15/d49/c11 144173 1 2024-09-16T00:50:17.675 INFO:tasks.workunit.client.0.smithi053.stdout:0/238: dread d4/dc/d25/f2f [0,4194304] 0 2024-09-16T00:50:17.675 INFO:tasks.workunit.client.0.smithi053.stdout:0/239: chown d4/d13/d2d/c3d 68406 1 2024-09-16T00:50:17.677 INFO:tasks.workunit.client.1.smithi152.stdout:0/648: mkdir d3/d6/d8/d1d/d65/d6e/d82/da4/dd8 0 2024-09-16T00:50:17.678 INFO:tasks.workunit.client.1.smithi152.stdout:7/635: dwrite f7 [4194304,4194304] 0 2024-09-16T00:50:17.678 INFO:tasks.workunit.client.1.smithi152.stdout:3/642: dwrite dc/d10/d17/d1c/d1f/d24/f85 [0,4194304] 0 2024-09-16T00:50:17.682 INFO:tasks.workunit.client.1.smithi152.stdout:2/615: unlink d4/d44/fc3 0 2024-09-16T00:50:17.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/674: mkdir db/d12/d23/d4a/d43/d59/d67/dc2/dd5 0 2024-09-16T00:50:17.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/813: sync 2024-09-16T00:50:17.685 INFO:tasks.workunit.client.1.smithi152.stdout:9/630: creat d1/d4e/d48/d26/d30/d4f/dcb/fd2 x:0 0 0 2024-09-16T00:50:17.685 INFO:tasks.workunit.client.1.smithi152.stdout:9/631: write d1/d7/dca/fce [378820,17972] 0 2024-09-16T00:50:17.686 INFO:tasks.workunit.client.1.smithi152.stdout:1/727: symlink d9/d3e/d41/d31/da5/l10e 0 2024-09-16T00:50:17.686 INFO:tasks.workunit.client.1.smithi152.stdout:1/728: chown d9/da/df/f2c 62 1 2024-09-16T00:50:17.687 INFO:tasks.workunit.client.1.smithi152.stdout:4/735: rmdir d2/d1e/d28/db7 39 2024-09-16T00:50:17.690 INFO:tasks.workunit.client.1.smithi152.stdout:8/488: creat dd/d15/d49/fa0 x:0 0 0 2024-09-16T00:50:17.691 INFO:tasks.workunit.client.1.smithi152.stdout:0/649: symlink d3/d6/d8/d1d/d23/d4b/ld9 0 2024-09-16T00:50:17.691 INFO:tasks.workunit.client.1.smithi152.stdout:0/650: getdents d3/d6/d8/d9e/dcb 0 2024-09-16T00:50:17.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/736: dread d2/db/d39/d3c/d76/f82 [0,4194304] 0 2024-09-16T00:50:17.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/737: read d2/db/d39/d3c/f7c [1309598,72457] 0 2024-09-16T00:50:17.699 INFO:tasks.workunit.client.1.smithi152.stdout:2/616: rename d4/d19/d20/d28/dc6 to d4/d44/d7a/d9e/da0/dca 0 2024-09-16T00:50:17.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/636: dwrite d9/d31/d65/d4b/f9c [0,4194304] 0 2024-09-16T00:50:17.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/814: mkdir d6/d57/d54/d12c/d12d 0 2024-09-16T00:50:17.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/815: dread - d6/d57/d2b/d50/d64/f6f zero size 2024-09-16T00:50:17.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/816: creat d6/d16/d1f/d6c/f12e x:0 0 0 2024-09-16T00:50:17.704 INFO:tasks.workunit.client.1.smithi152.stdout:5/817: truncate d6/f20 524179 0 2024-09-16T00:50:17.705 INFO:tasks.workunit.client.1.smithi152.stdout:9/632: creat d1/d7/d77/d32/da5/da8/fd3 x:0 0 0 2024-09-16T00:50:17.706 INFO:tasks.workunit.client.1.smithi152.stdout:1/729: read d9/da/fbf [480253,61256] 0 2024-09-16T00:50:17.707 INFO:tasks.workunit.client.0.smithi053.stdout:0/240: dwrite d4/d13/f41 [0,4194304] 0 2024-09-16T00:50:17.707 INFO:tasks.workunit.client.1.smithi152.stdout:8/489: truncate dd/d50/d29/d2f/f95 158139 0 2024-09-16T00:50:17.707 INFO:tasks.workunit.client.1.smithi152.stdout:8/490: creat dd/d15/d49/fa1 x:0 0 0 2024-09-16T00:50:17.708 INFO:tasks.workunit.client.1.smithi152.stdout:8/491: fsync f3 0 2024-09-16T00:50:17.708 INFO:tasks.workunit.client.1.smithi152.stdout:8/492: write dd/d50/d29/d2f/d5f/f7f [487810,109543] 0 2024-09-16T00:50:17.708 INFO:tasks.workunit.client.1.smithi152.stdout:0/651: stat d3/d6/d8/c59 0 2024-09-16T00:50:17.709 INFO:tasks.workunit.client.1.smithi152.stdout:0/652: dread - d3/d6/d8/d1d/f68 zero size 2024-09-16T00:50:17.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/637: dread d9/d31/fb5 [0,4194304] 0 2024-09-16T00:50:17.709 INFO:tasks.workunit.client.1.smithi152.stdout:6/675: dwrite db/d12/d23/d4a/f5f [0,4194304] 0 2024-09-16T00:50:17.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/738: creat d2/db/d39/d3c/dc5/ff4 x:0 0 0 2024-09-16T00:50:17.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/739: getdents d2/d8e/dc9 0 2024-09-16T00:50:17.715 INFO:tasks.workunit.client.1.smithi152.stdout:9/633: dread d1/d7/d13/f73 [0,4194304] 0 2024-09-16T00:50:17.716 INFO:tasks.workunit.client.0.smithi053.stdout:0/241: link d4/f30 d4/d13/f4f 0 2024-09-16T00:50:17.717 INFO:tasks.workunit.client.1.smithi152.stdout:9/634: dread d1/d7/d77/fb3 [0,4194304] 0 2024-09-16T00:50:17.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/818: creat d6/d16/f12f x:0 0 0 2024-09-16T00:50:17.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/819: dread - d6/d57/d2b/d50/d64/fad zero size 2024-09-16T00:50:17.719 INFO:tasks.workunit.client.1.smithi152.stdout:2/617: dwrite d4/d19/d20/d28/f2a [0,4194304] 0 2024-09-16T00:50:17.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/730: mkdir d9/da/df/dcb/df2/d10f 0 2024-09-16T00:50:17.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/731: chown d9/lfb 2634 1 2024-09-16T00:50:17.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/638: dread d9/d31/d65/f69 [0,4194304] 0 2024-09-16T00:50:17.723 INFO:tasks.workunit.client.1.smithi152.stdout:8/493: symlink dd/d50/la2 0 2024-09-16T00:50:17.723 INFO:tasks.workunit.client.1.smithi152.stdout:8/494: chown dd/d23/l75 404619 1 2024-09-16T00:50:17.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/653: dwrite d3/d6/d6d/f8f [4194304,4194304] 0 2024-09-16T00:50:17.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/654: creat d3/d6/d8/d1d/d65/db0/db6/fda x:0 0 0 2024-09-16T00:50:17.726 INFO:tasks.workunit.client.1.smithi152.stdout:6/676: unlink db/d12/d20/f72 0 2024-09-16T00:50:17.726 INFO:tasks.workunit.client.1.smithi152.stdout:6/677: truncate db/d12/d1c/fa5 313799 0 2024-09-16T00:50:17.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/740: unlink d2/c3f 0 2024-09-16T00:50:17.731 INFO:tasks.workunit.client.1.smithi152.stdout:9/635: unlink d1/d4e/d48/d2b/l60 0 2024-09-16T00:50:17.733 INFO:tasks.workunit.client.1.smithi152.stdout:5/820: mkdir d6/d16/d1f/d65/dd2/d123/d130 0 2024-09-16T00:50:17.733 INFO:tasks.workunit.client.1.smithi152.stdout:5/821: dread - d6/f1e zero size 2024-09-16T00:50:17.735 INFO:tasks.workunit.client.1.smithi152.stdout:2/618: mkdir d4/d19/d20/d34/dcb 0 2024-09-16T00:50:17.735 INFO:tasks.workunit.client.1.smithi152.stdout:2/619: readlink d4/d44/d7a/d9e/d66/lb9 0 2024-09-16T00:50:17.738 INFO:tasks.workunit.client.1.smithi152.stdout:1/732: link d9/f36 d9/d3e/d41/d9a/f110 0 2024-09-16T00:50:17.739 INFO:tasks.workunit.client.0.smithi053.stdout:0/242: write d4/d13/f41 [5220731,110281] 0 2024-09-16T00:50:17.739 INFO:tasks.workunit.client.0.smithi053.stdout:0/243: creat d4/d13/d2d/f50 x:0 0 0 2024-09-16T00:50:17.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/655: dread d3/f19 [0,4194304] 0 2024-09-16T00:50:17.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/656: readlink d3/d6/d2e/lc1 0 2024-09-16T00:50:17.740 INFO:tasks.workunit.client.1.smithi152.stdout:8/495: unlink dd/d15/f20 0 2024-09-16T00:50:17.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/657: dread d3/d6/f1f [0,4194304] 0 2024-09-16T00:50:17.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/658: readlink d3/d6/d2e/lb9 0 2024-09-16T00:50:17.741 INFO:tasks.workunit.client.1.smithi152.stdout:7/639: dwrite d9/d31/d64/d3c/db9/dc2/fcd [0,4194304] 0 2024-09-16T00:50:17.746 INFO:tasks.workunit.client.0.smithi053.stdout:0/244: rename d4/d13/l21 to d4/dc/d1e/d1f/d40/l51 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:2/620: dread d4/d19/d20/d28/f50 [0,4194304] 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:2/621: write d4/d19/d20/d28/f50 [4959577,42237] 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:2/622: creat d4/d19/d94/d93/fcc x:0 0 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:2/623: write d4/d44/d7a/d9e/f7f [344881,26199] 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/678: link db/d12/f3d db/d28/fd6 0 2024-09-16T00:50:17.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/679: stat db/d12/d23/d4a/d43/l74 0 2024-09-16T00:50:17.748 INFO:tasks.workunit.client.1.smithi152.stdout:7/640: write d9/d31/d65/d8a/d41/d46/d7d/fb0 [2632716,109725] 0 2024-09-16T00:50:17.749 INFO:tasks.workunit.client.1.smithi152.stdout:2/624: dread d4/d44/d7a/d9e/d66/f97 [0,4194304] 0 2024-09-16T00:50:17.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/741: mknod d2/db/d39/d95/cf5 0 2024-09-16T00:50:17.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/742: chown d2/f92 247347687 1 2024-09-16T00:50:17.750 INFO:tasks.workunit.client.0.smithi053.stdout:0/245: mknod d4/c52 0 2024-09-16T00:50:17.751 INFO:tasks.workunit.client.1.smithi152.stdout:9/636: rmdir d1/d7/d77/d32/da5 39 2024-09-16T00:50:17.751 INFO:tasks.workunit.client.1.smithi152.stdout:9/637: fsync d1/d4e/f67 0 2024-09-16T00:50:17.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/822: rename f0 to d6/d57/d2b/f131 0 2024-09-16T00:50:17.754 INFO:tasks.workunit.client.1.smithi152.stdout:6/680: write db/d12/faf [3647276,39738] 0 2024-09-16T00:50:17.761 INFO:tasks.workunit.client.0.smithi053.stdout:5/168: sync 2024-09-16T00:50:17.761 INFO:tasks.workunit.client.0.smithi053.stdout:5/169: chown d3/f13 0 1 2024-09-16T00:50:17.761 INFO:tasks.workunit.client.0.smithi053.stdout:5/170: stat d3/d7/d12/f38 0 2024-09-16T00:50:17.761 INFO:tasks.workunit.client.0.smithi053.stdout:5/171: fdatasync d3/f4 0 2024-09-16T00:50:17.761 INFO:tasks.workunit.client.0.smithi053.stdout:5/172: truncate d3/f8 8587181 0 2024-09-16T00:50:17.765 INFO:tasks.workunit.client.0.smithi053.stdout:5/173: link d3/d7/d12/f19 d3/d7/d24/d34/f39 0 2024-09-16T00:50:17.765 INFO:tasks.workunit.client.0.smithi053.stdout:5/174: stat d3/d7/d24/d34 0 2024-09-16T00:50:17.766 INFO:tasks.workunit.client.0.smithi053.stdout:0/246: dwrite d4/dc/d25/d34/d2a/d27/f37 [0,4194304] 0 2024-09-16T00:50:17.769 INFO:tasks.workunit.client.0.smithi053.stdout:5/175: creat d3/d7/d2b/f3a x:0 0 0 2024-09-16T00:50:17.769 INFO:tasks.workunit.client.0.smithi053.stdout:5/176: creat d3/d7/f3b x:0 0 0 2024-09-16T00:50:17.769 INFO:tasks.workunit.client.0.smithi053.stdout:0/247: dread d4/d13/f1c [0,4194304] 0 2024-09-16T00:50:17.769 INFO:tasks.workunit.client.0.smithi053.stdout:0/248: chown d4/dc/d25/d34/d2a/d27 277234 1 2024-09-16T00:50:17.769 INFO:tasks.workunit.client.0.smithi053.stdout:0/249: readlink d4/dc/l1a 0 2024-09-16T00:50:17.771 INFO:tasks.workunit.client.1.smithi152.stdout:1/733: unlink d9/c1a 0 2024-09-16T00:50:17.774 INFO:tasks.workunit.client.1.smithi152.stdout:8/496: creat dd/d25/d77/fa3 x:0 0 0 2024-09-16T00:50:17.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/659: mkdir d3/d6/d4e/ddb 0 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 -- 172.21.15.53:0/168523867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 msgr2=0x7faa541030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 --2- 172.21.15.53:0/168523867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa541030b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa50009910 tx=0x7faa50009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 -- 172.21.15.53:0/168523867 shutdown_connections 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 --2- 172.21.15.53:0/168523867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa541059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 --2- 172.21.15.53:0/168523867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa541030b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 -- 172.21.15.53:0/168523867 >> 172.21.15.53:0/168523867 conn(0x7faa540fa6d0 msgr2=0x7faa540fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 -- 172.21.15.53:0/168523867 shutdown_connections 2024-09-16T00:50:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.778+0000 7faa5bde6700 1 -- 172.21.15.53:0/168523867 wait complete. 2024-09-16T00:50:17.781 INFO:tasks.workunit.client.0.smithi053.stdout:5/177: truncate d3/f13 3537861 0 2024-09-16T00:50:17.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 Processor -- start 2024-09-16T00:50:17.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 -- start start 2024-09-16T00:50:17.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa54195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541965b0 con 0x7faa54100cd0 2024-09-16T00:50:17.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.779+0000 7faa5bde6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541966f0 con 0x7faa541035f0 2024-09-16T00:50:17.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48532/0 (socket says 172.21.15.53:48532) 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 -- 172.21.15.53:0/2524474289 learned_addr learned my addr 172.21.15.53:0/2524474289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59381700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa54195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 -- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 msgr2=0x7faa54195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa54195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59b82700 1 -- 172.21.15.53:0/2524474289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500095f0 con 0x7faa54100cd0 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.780+0000 7faa59381700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa54195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.781+0000 7faa59b82700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa500092e0 tx=0x7faa5001e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.781+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5001edf0 con 0x7faa54100cd0 2024-09-16T00:50:17.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.781+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa50005dc0 con 0x7faa54100cd0 2024-09-16T00:50:17.784 INFO:tasks.workunit.client.0.smithi053.stdout:0/250: symlink d4/dc/l53 0 2024-09-16T00:50:17.784 INFO:tasks.workunit.client.0.smithi053.stdout:0/251: fsync d4/d13/f41 0 2024-09-16T00:50:17.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.782+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa5000f790 con 0x7faa54100cd0 2024-09-16T00:50:17.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.782+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540feac0 con 0x7faa54100cd0 2024-09-16T00:50:17.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.782+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540fefb0 con 0x7faa54100cd0 2024-09-16T00:50:17.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.784+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5418fc60 con 0x7faa54100cd0 2024-09-16T00:50:17.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.784+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7faa50003bc0 con 0x7faa54100cd0 2024-09-16T00:50:17.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.785+0000 7faa4affd700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 0x7faa4006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:17.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.785+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7faa50092600 con 0x7faa54100cd0 2024-09-16T00:50:17.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.785+0000 7faa59381700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 0x7faa4006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:17.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.786+0000 7faa59381700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 0x7faa4006faf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44009cb0 tx=0x7faa44009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:17.793 INFO:tasks.workunit.client.0.smithi053.stdout:5/178: creat d3/d7/d24/d34/f3c x:0 0 0 2024-09-16T00:50:17.795 INFO:tasks.workunit.client.1.smithi152.stdout:2/625: creat d4/d19/d20/d28/d8b/da9/db7/fcd x:0 0 0 2024-09-16T00:50:17.796 INFO:tasks.workunit.client.1.smithi152.stdout:7/641: dread d9/d31/d64/d3c/f71 [0,4194304] 0 2024-09-16T00:50:17.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:17.796+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7faa5005f770 con 0x7faa54100cd0 2024-09-16T00:50:17.798 INFO:tasks.workunit.client.1.smithi152.stdout:4/743: truncate d2/db/f47 585553 0 2024-09-16T00:50:17.798 INFO:tasks.workunit.client.1.smithi152.stdout:4/744: chown d2/db/d44 0 1 2024-09-16T00:50:17.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/626: dread d4/d19/d20/d28/d2c/f79 [0,4194304] 0 2024-09-16T00:50:17.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/627: truncate d4/d19/d20/d28/d2c/d77/da7/fb5 140589 0 2024-09-16T00:50:17.805 INFO:tasks.workunit.client.0.smithi053.stdout:0/252: dwrite d4/d13/f41 [4194304,4194304] 0 2024-09-16T00:50:17.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/823: creat d6/d57/d2b/f132 x:0 0 0 2024-09-16T00:50:17.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/824: write d6/d16/f33 [625057,127615] 0 2024-09-16T00:50:17.810 INFO:tasks.workunit.client.1.smithi152.stdout:6/681: read db/d12/d23/d4a/d43/d48/d6a/f87 [391576,102132] 0 2024-09-16T00:50:17.811 INFO:tasks.workunit.client.1.smithi152.stdout:4/745: read d2/d1e/d28/d69/f9c [3638810,76961] 0 2024-09-16T00:50:17.813 INFO:tasks.workunit.client.1.smithi152.stdout:1/734: truncate d9/d3e/d41/f40 387646 0 2024-09-16T00:50:17.813 INFO:tasks.workunit.client.1.smithi152.stdout:5/825: dread d6/d16/d1f/d8c/db8/fa7 [0,4194304] 0 2024-09-16T00:50:17.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/497: unlink dd/d25/d77/f7c 0 2024-09-16T00:50:17.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/498: fsync dd/d25/f70 0 2024-09-16T00:50:17.818 INFO:tasks.workunit.client.1.smithi152.stdout:0/660: getdents d3/d6/d4e 0 2024-09-16T00:50:17.821 INFO:tasks.workunit.client.1.smithi152.stdout:7/642: creat d9/d31/d65/d8a/d41/d46/fd9 x:0 0 0 2024-09-16T00:50:17.821 INFO:tasks.workunit.client.1.smithi152.stdout:7/643: readlink d9/d31/d65/d8a/lcc 0 2024-09-16T00:50:17.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/628: rename d4/d17/l1b to d4/d19/d20/d28/d8b/lce 0 2024-09-16T00:50:17.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/629: readlink d4/d17/l2f 0 2024-09-16T00:50:17.824 INFO:tasks.workunit.client.0.smithi053.stdout:0/253: dwrite d4/dc/d25/d34/d2a/f4e [0,4194304] 0 2024-09-16T00:50:17.824 INFO:tasks.workunit.client.0.smithi053.stdout:0/254: dread - d4/d13/d2d/f50 zero size 2024-09-16T00:50:17.825 INFO:tasks.workunit.client.0.smithi053.stdout:5/179: dwrite d3/d7/d24/f28 [0,4194304] 0 2024-09-16T00:50:17.825 INFO:tasks.workunit.client.0.smithi053.stdout:5/180: stat d3/d7/d2b/d2f 0 2024-09-16T00:50:17.825 INFO:tasks.workunit.client.0.smithi053.stdout:5/181: chown d3/f2c 503 1 2024-09-16T00:50:17.825 INFO:tasks.workunit.client.1.smithi152.stdout:5/826: write d6/d57/d2b/f2f [1201833,130126] 0 2024-09-16T00:50:17.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/638: getdents d1/d7/d77/d68 0 2024-09-16T00:50:17.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/639: chown d1/d7/d13/d5d/d69/c98 7235 1 2024-09-16T00:50:17.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/640: write d1/d7/d13/d5d/f94 [612284,48398] 0 2024-09-16T00:50:17.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/641: chown d1/d4e/d48/c56 15914429 1 2024-09-16T00:50:17.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/642: chown d1/d59/f2f 90783 1 2024-09-16T00:50:17.834 INFO:tasks.workunit.client.0.smithi053.stdout:5/182: write d3/f35 [2185046,121103] 0 2024-09-16T00:50:17.838 INFO:tasks.workunit.client.0.smithi053.stdout:0/255: write d4/dc/f14 [3547096,56956] 0 2024-09-16T00:50:17.841 INFO:tasks.workunit.client.1.smithi152.stdout:9/643: dread d1/fb [0,4194304] 0 2024-09-16T00:50:17.841 INFO:tasks.workunit.client.1.smithi152.stdout:9/644: write d1/fcd [634879,111289] 0 2024-09-16T00:50:17.842 INFO:tasks.workunit.client.1.smithi152.stdout:8/499: dwrite dd/d25/f91 [0,4194304] 0 2024-09-16T00:50:17.842 INFO:tasks.workunit.client.1.smithi152.stdout:4/746: dwrite d2/db/d39/d3c/d76/db8/f23 [0,4194304] 0 2024-09-16T00:50:17.849 INFO:tasks.workunit.client.0.smithi053.stdout:0/256: mkdir d4/dc/d1e/d1f/d40/d44/d54 0 2024-09-16T00:50:17.850 INFO:tasks.workunit.client.0.smithi053.stdout:0/257: chown d4/dc/d25 1791119 1 2024-09-16T00:50:17.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/735: truncate d9/f16 7491480 0 2024-09-16T00:50:17.853 INFO:tasks.workunit.client.1.smithi152.stdout:0/661: mknod d3/d6/d64/cdc 0 2024-09-16T00:50:17.853 INFO:tasks.workunit.client.1.smithi152.stdout:0/662: chown d3/d6/d8/c59 67230 1 2024-09-16T00:50:17.855 INFO:tasks.workunit.client.1.smithi152.stdout:7/644: link d9/f25 d9/d31/d65/d6b/fda 0 2024-09-16T00:50:17.855 INFO:tasks.workunit.client.1.smithi152.stdout:7/645: read d9/d31/d65/d4b/f66 [862255,23483] 0 2024-09-16T00:50:17.855 INFO:tasks.workunit.client.1.smithi152.stdout:9/645: dread d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:17.855 INFO:tasks.workunit.client.1.smithi152.stdout:9/646: truncate d1/d7/dca/fce 1257795 0 2024-09-16T00:50:17.856 INFO:tasks.workunit.client.1.smithi152.stdout:9/647: truncate d1/d4e/d48/d2b/d93/fa7 1556201 0 2024-09-16T00:50:17.856 INFO:tasks.workunit.client.0.smithi053.stdout:0/258: mknod d4/dc/d1e/d1f/c55 0 2024-09-16T00:50:17.858 INFO:tasks.workunit.client.0.smithi053.stdout:2/139: sync 2024-09-16T00:50:17.858 INFO:tasks.workunit.client.0.smithi053.stdout:9/233: sync 2024-09-16T00:50:17.858 INFO:tasks.workunit.client.0.smithi053.stdout:9/234: write d8/d1c/f1b [3014059,64061] 0 2024-09-16T00:50:17.861 INFO:tasks.workunit.client.1.smithi152.stdout:5/827: creat d6/d57/d54/f133 x:0 0 0 2024-09-16T00:50:17.862 INFO:tasks.workunit.client.0.smithi053.stdout:4/184: sync 2024-09-16T00:50:17.862 INFO:tasks.workunit.client.0.smithi053.stdout:1/203: sync 2024-09-16T00:50:17.862 INFO:tasks.workunit.client.0.smithi053.stdout:6/179: sync 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:7/254: sync 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:4/185: creat d0/d2/dd/f40 x:0 0 0 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:4/186: truncate d0/d2/dd/f40 937031 0 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:8/275: sync 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:8/276: readlink d10/d1c/l36 0 2024-09-16T00:50:17.863 INFO:tasks.workunit.client.0.smithi053.stdout:8/277: write d10/d21/f33 [1044970,100341] 0 2024-09-16T00:50:17.864 INFO:tasks.workunit.client.0.smithi053.stdout:3/264: sync 2024-09-16T00:50:17.864 INFO:tasks.workunit.client.0.smithi053.stdout:2/140: creat d6/d29/f2a x:0 0 0 2024-09-16T00:50:17.864 INFO:tasks.workunit.client.0.smithi053.stdout:2/141: chown f0 2243 1 2024-09-16T00:50:17.864 INFO:tasks.workunit.client.0.smithi053.stdout:2/142: fsync d6/d9/f12 0 2024-09-16T00:50:17.864 INFO:tasks.workunit.client.0.smithi053.stdout:2/143: fsync d6/d9/f1e 0 2024-09-16T00:50:17.865 INFO:tasks.workunit.client.1.smithi152.stdout:9/648: dread d1/d7/d77/d32/f49 [0,4194304] 0 2024-09-16T00:50:17.865 INFO:tasks.workunit.client.1.smithi152.stdout:9/649: write d1/d4e/d48/d26/d30/d4f/da2/fb9 [305721,42444] 0 2024-09-16T00:50:17.865 INFO:tasks.workunit.client.1.smithi152.stdout:6/682: getdents db/d12/d20/d4b 0 2024-09-16T00:50:17.867 INFO:tasks.workunit.client.0.smithi053.stdout:1/204: rmdir d5/d18/d33/d38 0 2024-09-16T00:50:17.872 INFO:tasks.workunit.client.0.smithi053.stdout:4/187: rmdir d0/d2/d26 39 2024-09-16T00:50:17.874 INFO:tasks.workunit.client.1.smithi152.stdout:4/747: dwrite d2/db/d39/d3c/d7f/d98/fd5 [0,4194304] 0 2024-09-16T00:50:17.875 INFO:tasks.workunit.client.0.smithi053.stdout:8/278: truncate d10/d1c/f23 2240652 0 2024-09-16T00:50:17.875 INFO:tasks.workunit.client.0.smithi053.stdout:8/279: rename d10/d1c/d2b/d40 to d10/d1c/d2b/d40/d50/d5f 22 2024-09-16T00:50:17.875 INFO:tasks.workunit.client.0.smithi053.stdout:8/280: write d10/d21/f30 [2727349,59688] 0 2024-09-16T00:50:17.877 INFO:tasks.workunit.client.0.smithi053.stdout:3/265: truncate d1/f21 1371758 0 2024-09-16T00:50:17.877 INFO:tasks.workunit.client.0.smithi053.stdout:3/266: truncate d1/d5/d14/f2a 376577 0 2024-09-16T00:50:17.880 INFO:tasks.workunit.client.0.smithi053.stdout:1/205: getdents d5/d9 0 2024-09-16T00:50:17.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/748: dread d2/db/f66 [0,4194304] 0 2024-09-16T00:50:17.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/749: chown d2/d1e/d28/d69/cdd 56301 1 2024-09-16T00:50:17.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/750: fdatasync d2/d1e/d28/f57 0 2024-09-16T00:50:17.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/751: readlink d2/d1e/d28/d7b/db0/lb6 0 2024-09-16T00:50:17.881 INFO:tasks.workunit.client.0.smithi053.stdout:0/259: fdatasync d4/dc/f14 0 2024-09-16T00:50:17.881 INFO:tasks.workunit.client.0.smithi053.stdout:0/260: dread - d4/dc/d25/d34/d2a/d27/f33 zero size 2024-09-16T00:50:17.882 INFO:tasks.workunit.client.0.smithi053.stdout:0/261: fsync d4/dc/f1b 0 2024-09-16T00:50:17.883 INFO:tasks.workunit.client.0.smithi053.stdout:4/188: mkdir d0/d2/dd/d25/d41 0 2024-09-16T00:50:17.889 INFO:tasks.workunit.client.0.smithi053.stdout:0/262: read d4/f4b [1155183,112099] 0 2024-09-16T00:50:17.891 INFO:tasks.workunit.client.0.smithi053.stdout:3/267: dread d1/d5/f19 [0,4194304] 0 2024-09-16T00:50:17.891 INFO:tasks.workunit.client.0.smithi053.stdout:8/281: rename d10/d4a/c59 to d10/d1c/c60 0 2024-09-16T00:50:17.893 INFO:tasks.workunit.client.0.smithi053.stdout:5/183: dwrite d3/f2e [4194304,4194304] 0 2024-09-16T00:50:17.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/500: dwrite dd/f16 [0,4194304] 0 2024-09-16T00:50:17.899 INFO:tasks.workunit.client.0.smithi053.stdout:1/206: link d5/d18/d33/d30/l3c d5/l3e 0 2024-09-16T00:50:17.900 INFO:tasks.workunit.client.0.smithi053.stdout:7/255: dwrite d1/d35/d14/f38 [0,4194304] 0 2024-09-16T00:50:17.902 INFO:tasks.workunit.client.1.smithi152.stdout:0/663: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd 0 2024-09-16T00:50:17.908 INFO:tasks.workunit.client.1.smithi152.stdout:7/646: creat d9/d31/d64/d3c/d5b/fdb x:0 0 0 2024-09-16T00:50:17.908 INFO:tasks.workunit.client.1.smithi152.stdout:7/647: fsync d9/d31/fb5 0 2024-09-16T00:50:17.909 INFO:tasks.workunit.client.0.smithi053.stdout:0/263: creat d4/dc/d25/d34/d2a/d27/d4a/f56 x:0 0 0 2024-09-16T00:50:17.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/630: getdents d4/d19/d94/d93/da4 0 2024-09-16T00:50:17.913 INFO:tasks.workunit.client.0.smithi053.stdout:8/282: mkdir d10/d21/d28/d3c/d61 0 2024-09-16T00:50:17.913 INFO:tasks.workunit.client.0.smithi053.stdout:8/283: dread - d10/d1c/d49/f5a zero size 2024-09-16T00:50:17.915 INFO:tasks.workunit.client.1.smithi152.stdout:3/643: sync 2024-09-16T00:50:17.916 INFO:tasks.workunit.client.0.smithi053.stdout:2/144: dwrite d6/f23 [0,4194304] 0 2024-09-16T00:50:17.916 INFO:tasks.workunit.client.1.smithi152.stdout:5/828: rename d6/d57/d2b/d50/l63 to d6/d16/d8b/l134 0 2024-09-16T00:50:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:5/829: write d6/d57/d54/f60 [391528,104276] 0 2024-09-16T00:50:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:9/650: mknod d1/d7/d77/d32/da5/da8/cd4 0 2024-09-16T00:50:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:6/683: creat db/d12/d23/d4a/d43/d59/d67/dc2/dd5/fd7 x:0 0 0 2024-09-16T00:50:17.920 INFO:tasks.workunit.client.0.smithi053.stdout:1/207: mknod d5/d7/c3f 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:7/256: mknod d1/d35/d4a/c5c 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:4/189: dwrite d0/f38 [0,4194304] 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/235: dwrite d8/d1c/f1b [0,4194304] 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/236: write f6 [4841588,38100] 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/237: fsync d8/d1c/f1b 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/238: write d8/d1c/f33 [156506,64127] 0 2024-09-16T00:50:17.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/239: write d8/fb [4981270,3368] 0 2024-09-16T00:50:17.926 INFO:tasks.workunit.client.0.smithi053.stdout:3/268: dwrite d1/d5/d16/d47/f4b [0,4194304] 0 2024-09-16T00:50:17.927 INFO:tasks.workunit.client.0.smithi053.stdout:8/284: mknod d10/d21/c62 0 2024-09-16T00:50:17.930 INFO:tasks.workunit.client.0.smithi053.stdout:0/264: dread d4/d13/f41 [4194304,4194304] 0 2024-09-16T00:50:17.930 INFO:tasks.workunit.client.0.smithi053.stdout:0/265: readlink d4/dc/d25/d34/d2a/d27/l3a 0 2024-09-16T00:50:17.937 INFO:tasks.workunit.client.1.smithi152.stdout:1/736: mknod d9/d3e/d41/d31/c111 0 2024-09-16T00:50:17.937 INFO:tasks.workunit.client.0.smithi053.stdout:2/145: truncate d6/f7 3617814 0 2024-09-16T00:50:17.939 INFO:tasks.workunit.client.1.smithi152.stdout:7/648: creat d9/d31/d65/d6b/fdc x:0 0 0 2024-09-16T00:50:17.943 INFO:tasks.workunit.client.0.smithi053.stdout:5/184: rename d3/d7/d12/l1a to d3/l3d 0 2024-09-16T00:50:17.943 INFO:tasks.workunit.client.0.smithi053.stdout:5/185: chown d3/d7/d2b 0 1 2024-09-16T00:50:17.943 INFO:tasks.workunit.client.0.smithi053.stdout:5/186: dread - d3/d7/d24/f30 zero size 2024-09-16T00:50:17.943 INFO:tasks.workunit.client.0.smithi053.stdout:4/190: dwrite d0/d2/f23 [0,4194304] 0 2024-09-16T00:50:17.945 INFO:tasks.workunit.client.1.smithi152.stdout:2/631: mkdir d4/d19/d20/d28/d2c/d77/da5/dcf 0 2024-09-16T00:50:17.946 INFO:tasks.workunit.client.0.smithi053.stdout:1/208: link d5/dd/d19/f26 d5/d9/f40 0 2024-09-16T00:50:17.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/644: mkdir dc/d10/d17/d1c/d1f/dc5 0 2024-09-16T00:50:17.952 INFO:tasks.workunit.client.1.smithi152.stdout:4/752: rename d2/d1e/d28/d7b/le1 to d2/db/d39/d3c/d76/db4/lf6 0 2024-09-16T00:50:17.953 INFO:tasks.workunit.client.1.smithi152.stdout:4/753: write d2/db/d39/d3c/d7f/f9f [846080,76742] 0 2024-09-16T00:50:17.953 INFO:tasks.workunit.client.1.smithi152.stdout:4/754: write d2/db/d39/d3c/d76/db8/ff2 [506736,55647] 0 2024-09-16T00:50:17.954 INFO:tasks.workunit.client.1.smithi152.stdout:9/651: mknod d1/d7/d77/d3c/cd5 0 2024-09-16T00:50:17.956 INFO:tasks.workunit.client.0.smithi053.stdout:7/257: truncate d1/d2a/d4f/d52/d2c/f40 4069671 0 2024-09-16T00:50:17.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/684: mkdir db/d28/dd8 0 2024-09-16T00:50:17.964 INFO:tasks.workunit.client.0.smithi053.stdout:9/240: getdents d8/d19 0 2024-09-16T00:50:17.964 INFO:tasks.workunit.client.0.smithi053.stdout:9/241: stat d8/fc 0 2024-09-16T00:50:17.965 INFO:tasks.workunit.client.1.smithi152.stdout:7/649: dwrite d9/d31/d65/fa1 [0,4194304] 0 2024-09-16T00:50:17.966 INFO:tasks.workunit.client.1.smithi152.stdout:8/501: unlink dd/d50/d29/c9f 0 2024-09-16T00:50:17.971 INFO:tasks.workunit.client.0.smithi053.stdout:7/258: dread d1/d35/d14/f38 [0,4194304] 0 2024-09-16T00:50:17.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/632: mkdir d4/d19/d94/d8f/dd0 0 2024-09-16T00:50:17.973 INFO:tasks.workunit.client.1.smithi152.stdout:2/633: write d4/d44/d7a/d9e/d66/f97 [809695,87847] 0 2024-09-16T00:50:17.975 INFO:tasks.workunit.client.0.smithi053.stdout:3/269: rename d1/d5/d16/d47/d4c/l4f to d1/d5/d16/d47/d4c/l58 0 2024-09-16T00:50:17.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/645: rename dc/fe to dc/d10/d17/d5a/d68/da1/fc6 0 2024-09-16T00:50:17.981 INFO:tasks.workunit.client.1.smithi152.stdout:4/755: symlink d2/db/de8/lf7 0 2024-09-16T00:50:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/685: creat db/d12/d23/d4a/dc5/fd9 x:0 0 0 2024-09-16T00:50:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/756: dread d2/d1e/d28/d69/f6d [0,4194304] 0 2024-09-16T00:50:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/757: creat d2/db/dce/ff8 x:0 0 0 2024-09-16T00:50:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/758: chown d2/db/d39/d3c/d7f/lee 279716367 1 2024-09-16T00:50:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/759: chown d2/db/dce/fe0 2953 1 2024-09-16T00:50:17.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/502: dwrite dd/d15/d1a/f3f [0,4194304] 0 2024-09-16T00:50:18.000 INFO:tasks.workunit.client.0.smithi053.stdout:0/266: unlink d4/dc/d1e/d22/c45 0 2024-09-16T00:50:18.000 INFO:tasks.workunit.client.0.smithi053.stdout:0/267: chown d4/dc/d25/d34/d2a/c2e 44 1 2024-09-16T00:50:18.004 INFO:tasks.workunit.client.1.smithi152.stdout:1/737: getdents d9/d3e/d4b/d6b 0 2024-09-16T00:50:18.005 INFO:tasks.workunit.client.1.smithi152.stdout:1/738: write d9/d3e/d41/d31/d48/db2/fe1 [4281475,42861] 0 2024-09-16T00:50:18.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/187: mkdir d3/d7/d24/d34/d3e 0 2024-09-16T00:50:18.007 INFO:tasks.workunit.client.1.smithi152.stdout:8/503: dwrite dd/d15/d49/f51 [0,4194304] 0 2024-09-16T00:50:18.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/634: rmdir d4/d44/d7a/d9e/da0/dca 0 2024-09-16T00:50:18.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/635: chown d4/d19/d20/d28/c84 31991113 1 2024-09-16T00:50:18.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/636: chown d4/d19/d20/d34/l83 12 1 2024-09-16T00:50:18.015 INFO:tasks.workunit.client.0.smithi053.stdout:4/191: mkdir d0/da/d42 0 2024-09-16T00:50:18.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/646: mknod dc/d5c/dae/cc7 0 2024-09-16T00:50:18.017 INFO:tasks.workunit.client.0.smithi053.stdout:9/242: write d8/d22/d26/f32 [694357,88386] 0 2024-09-16T00:50:18.020 INFO:tasks.workunit.client.0.smithi053.stdout:7/259: creat d1/d2a/d4f/d52/d2c/d50/f5d x:0 0 0 2024-09-16T00:50:18.022 INFO:tasks.workunit.client.0.smithi053.stdout:3/270: mkdir d1/d5/d59 0 2024-09-16T00:50:18.022 INFO:tasks.workunit.client.1.smithi152.stdout:1/739: dwrite d9/da/da2/fd4 [0,4194304] 0 2024-09-16T00:50:18.023 INFO:tasks.workunit.client.1.smithi152.stdout:1/740: truncate d9/d3e/d41/d31/d48/d4a/fdc 687232 0 2024-09-16T00:50:18.025 INFO:tasks.workunit.client.0.smithi053.stdout:0/268: rename d4/dc/d25/l46 to d4/dc/d1e/d1f/d40/d44/d54/l57 0 2024-09-16T00:50:18.026 INFO:tasks.workunit.client.0.smithi053.stdout:0/269: write d4/dc/d1e/d22/f29 [297618,82956] 0 2024-09-16T00:50:18.026 INFO:tasks.workunit.client.0.smithi053.stdout:0/270: creat d4/dc/d25/d34/d2a/f58 x:0 0 0 2024-09-16T00:50:18.027 INFO:tasks.workunit.client.0.smithi053.stdout:2/146: rmdir d6/d29 39 2024-09-16T00:50:18.031 INFO:tasks.workunit.client.0.smithi053.stdout:5/188: mkdir d3/d7/d24/d3f 0 2024-09-16T00:50:18.033 INFO:tasks.workunit.client.0.smithi053.stdout:1/209: getdents d5/d18/d1f 0 2024-09-16T00:50:18.034 INFO:tasks.workunit.client.0.smithi053.stdout:4/192: dwrite d0/d2/dd/d25/f24 [0,4194304] 0 2024-09-16T00:50:18.035 INFO:tasks.workunit.client.0.smithi053.stdout:9/243: dwrite f4 [4194304,4194304] 0 2024-09-16T00:50:18.037 INFO:tasks.workunit.client.0.smithi053.stdout:9/244: read d8/d13/f20 [467619,96222] 0 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:3/271: rename d1/d54 to d1/d5/d14/d28/d5a 0 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:3/272: creat d1/d5/d16/d47/f5b x:0 0 0 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:3/273: chown d1/d5/d11/d3a/l48 3473315 1 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:5/189: read d3/d7/f1f [4006512,113387] 0 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:5/190: dread - d3/d7/d12/f38 zero size 2024-09-16T00:50:18.041 INFO:tasks.workunit.client.0.smithi053.stdout:5/191: stat d3/f32 0 2024-09-16T00:50:18.042 INFO:tasks.workunit.client.1.smithi152.stdout:9/652: rmdir d1/d4e/d48 39 2024-09-16T00:50:18.043 INFO:tasks.workunit.client.1.smithi152.stdout:6/686: symlink db/d28/db3/lda 0 2024-09-16T00:50:18.044 INFO:tasks.workunit.client.1.smithi152.stdout:6/687: creat db/da8/db7/fdb x:0 0 0 2024-09-16T00:50:18.046 INFO:tasks.workunit.client.0.smithi053.stdout:0/271: mknod d4/c59 0 2024-09-16T00:50:18.046 INFO:tasks.workunit.client.0.smithi053.stdout:0/272: dread - d4/dc/d25/d34/d2a/f58 zero size 2024-09-16T00:50:18.046 INFO:tasks.workunit.client.1.smithi152.stdout:4/760: mkdir d2/d8e/df9 0 2024-09-16T00:50:18.046 INFO:tasks.workunit.client.1.smithi152.stdout:4/761: truncate d2/db/d39/d3c/d76/db8/f4a 4488945 0 2024-09-16T00:50:18.047 INFO:tasks.workunit.client.0.smithi053.stdout:2/147: truncate d6/d9/dd/f1c 6937381 0 2024-09-16T00:50:18.049 INFO:tasks.workunit.client.0.smithi053.stdout:1/210: link d5/dd/d19/c27 d5/d18/c41 0 2024-09-16T00:50:18.049 INFO:tasks.workunit.client.0.smithi053.stdout:1/211: truncate d5/d7/f20 5156909 0 2024-09-16T00:50:18.054 INFO:tasks.workunit.client.0.smithi053.stdout:4/193: creat d0/d31/f43 x:0 0 0 2024-09-16T00:50:18.059 INFO:tasks.workunit.client.0.smithi053.stdout:9/245: creat d8/d19/d31/f50 x:0 0 0 2024-09-16T00:50:18.061 INFO:tasks.workunit.client.0.smithi053.stdout:7/260: rmdir d1/d35/d4a 39 2024-09-16T00:50:18.063 INFO:tasks.workunit.client.1.smithi152.stdout:7/650: getdents d9/d31 0 2024-09-16T00:50:18.070 INFO:tasks.workunit.client.0.smithi053.stdout:3/274: symlink d1/d5/d14/l5c 0 2024-09-16T00:50:18.070 INFO:tasks.workunit.client.0.smithi053.stdout:3/275: readlink d1/d5/d11/l20 0 2024-09-16T00:50:18.070 INFO:tasks.workunit.client.0.smithi053.stdout:3/276: creat d1/d5/d16/d47/f5d x:0 0 0 2024-09-16T00:50:18.072 INFO:tasks.workunit.client.0.smithi053.stdout:5/192: creat d3/d7/d24/d34/f40 x:0 0 0 2024-09-16T00:50:18.072 INFO:tasks.workunit.client.0.smithi053.stdout:5/193: write d3/f4 [1787654,54907] 0 2024-09-16T00:50:18.073 INFO:tasks.workunit.client.1.smithi152.stdout:8/504: mkdir dd/d25/da4 0 2024-09-16T00:50:18.073 INFO:tasks.workunit.client.1.smithi152.stdout:8/505: chown dd/d15/d49/f7b 3297 1 2024-09-16T00:50:18.075 INFO:tasks.workunit.client.0.smithi053.stdout:0/273: mkdir d4/d5a 0 2024-09-16T00:50:18.075 INFO:tasks.workunit.client.0.smithi053.stdout:0/274: fsync d4/dc/d25/f2f 0 2024-09-16T00:50:18.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/637: creat d4/d19/d20/d28/d2c/d77/fd1 x:0 0 0 2024-09-16T00:50:18.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/638: chown d4/d19/d20/d28/d8b/c92 3 1 2024-09-16T00:50:18.078 INFO:tasks.workunit.client.0.smithi053.stdout:2/148: mkdir d6/d29/d2b 0 2024-09-16T00:50:18.078 INFO:tasks.workunit.client.0.smithi053.stdout:2/149: dread - d6/d9/dd/f1a zero size 2024-09-16T00:50:18.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/647: creat dc/d10/d17/d5a/db2/d6f/d74/db5/fc8 x:0 0 0 2024-09-16T00:50:18.080 INFO:tasks.workunit.client.0.smithi053.stdout:1/212: link d5/d9/c2e d5/d18/c42 0 2024-09-16T00:50:18.080 INFO:tasks.workunit.client.0.smithi053.stdout:1/213: write d5/d9/d21/f2a [938740,40496] 0 2024-09-16T00:50:18.080 INFO:tasks.workunit.client.0.smithi053.stdout:1/214: fsync d5/d9/f40 0 2024-09-16T00:50:18.082 INFO:tasks.workunit.client.0.smithi053.stdout:7/261: dwrite d1/f36 [0,4194304] 0 2024-09-16T00:50:18.082 INFO:tasks.workunit.client.0.smithi053.stdout:7/262: read - d1/d2a/d4f/f53 zero size 2024-09-16T00:50:18.083 INFO:tasks.workunit.client.0.smithi053.stdout:4/194: mknod d0/d2/dd/d25/d39/c44 0 2024-09-16T00:50:18.086 INFO:tasks.workunit.client.0.smithi053.stdout:9/246: rename d8/d19/d31/d37 to d8/d19/d51 0 2024-09-16T00:50:18.086 INFO:tasks.workunit.client.0.smithi053.stdout:9/247: truncate d8/d1c/f33 315204 0 2024-09-16T00:50:18.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/741: creat d9/d3e/d41/d31/f112 x:0 0 0 2024-09-16T00:50:18.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/742: fdatasync d9/da/df/dcb/fd0 0 2024-09-16T00:50:18.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/506: dread dd/d15/d1a/f45 [0,4194304] 0 2024-09-16T00:50:18.091 INFO:tasks.workunit.client.0.smithi053.stdout:3/277: truncate d1/d5/d14/f2d 7900 0 2024-09-16T00:50:18.092 INFO:tasks.workunit.client.0.smithi053.stdout:3/278: readlink d1/d5/d11/l20 0 2024-09-16T00:50:18.092 INFO:tasks.workunit.client.1.smithi152.stdout:8/507: chown dd/d15/d49/f21 2186751 1 2024-09-16T00:50:18.093 INFO:tasks.workunit.client.0.smithi053.stdout:1/215: dread d5/d9/f40 [0,4194304] 0 2024-09-16T00:50:18.094 INFO:tasks.workunit.client.0.smithi053.stdout:1/216: dread - d5/d7/d10/f37 zero size 2024-09-16T00:50:18.096 INFO:tasks.workunit.client.0.smithi053.stdout:5/194: symlink d3/d7/d24/d34/l41 0 2024-09-16T00:50:18.096 INFO:tasks.workunit.client.0.smithi053.stdout:5/195: chown d3/d7/d12/f38 377664 1 2024-09-16T00:50:18.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/688: creat db/d28/dd8/fdc x:0 0 0 2024-09-16T00:50:18.098 INFO:tasks.workunit.client.0.smithi053.stdout:0/275: mkdir d4/dc/d25/d34/d2a/d5b 0 2024-09-16T00:50:18.099 INFO:tasks.workunit.client.0.smithi053.stdout:0/276: chown d4/d13/f41 1086 1 2024-09-16T00:50:18.099 INFO:tasks.workunit.client.0.smithi053.stdout:0/277: write d4/f4b [4815272,71609] 0 2024-09-16T00:50:18.100 INFO:tasks.workunit.client.1.smithi152.stdout:4/762: unlink d2/f4 0 2024-09-16T00:50:18.103 INFO:tasks.workunit.client.1.smithi152.stdout:3/648: dwrite dc/d10/d17/d4f/f60 [0,4194304] 0 2024-09-16T00:50:18.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/651: creat d9/d31/d64/d3c/db9/dc2/fdd x:0 0 0 2024-09-16T00:50:18.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/652: getdents d9/db6 0 2024-09-16T00:50:18.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/653: write d9/d31/d65/d6b/f77 [182232,95891] 0 2024-09-16T00:50:18.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/654: write d9/d31/d65/f59 [3417603,116022] 0 2024-09-16T00:50:18.105 INFO:tasks.workunit.client.1.smithi152.stdout:2/639: dwrite d4/d44/d7a/d9e/d87/d9c/fad [0,4194304] 0 2024-09-16T00:50:18.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/640: creat d4/d44/fd2 x:0 0 0 2024-09-16T00:50:18.106 INFO:tasks.workunit.client.1.smithi152.stdout:1/743: rename d9/d3e/d41/d31/d48/d4a/f5b to d9/d3e/d41/d31/f113 0 2024-09-16T00:50:18.111 INFO:tasks.workunit.client.1.smithi152.stdout:8/508: mkdir dd/d98/da5 0 2024-09-16T00:50:18.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/649: dread dc/d10/d17/d1c/d50/d55/f96 [0,4194304] 0 2024-09-16T00:50:18.112 INFO:tasks.workunit.client.1.smithi152.stdout:2/641: dread d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:18.115 INFO:tasks.workunit.client.0.smithi053.stdout:9/248: dwrite d8/f11 [4194304,4194304] 0 2024-09-16T00:50:18.115 INFO:tasks.workunit.client.1.smithi152.stdout:9/653: link d1/d4e/d48/d66/l78 d1/d4e/d48/d2b/d93/d96/ld6 0 2024-09-16T00:50:18.117 INFO:tasks.workunit.client.0.smithi053.stdout:4/195: symlink d0/d2/dd/d25/l45 0 2024-09-16T00:50:18.117 INFO:tasks.workunit.client.0.smithi053.stdout:3/279: dread d1/d5/d16/f1f [0,4194304] 0 2024-09-16T00:50:18.119 INFO:tasks.workunit.client.0.smithi053.stdout:3/280: dread d1/d5/d31/d3b/f44 [0,4194304] 0 2024-09-16T00:50:18.119 INFO:tasks.workunit.client.0.smithi053.stdout:3/281: write d1/d5/d16/d47/f5d [722106,6909] 0 2024-09-16T00:50:18.119 INFO:tasks.workunit.client.1.smithi152.stdout:6/689: truncate db/d12/d23/d4a/d43/d48/f4d 2629138 0 2024-09-16T00:50:18.119 INFO:tasks.workunit.client.1.smithi152.stdout:6/690: chown db/d12/d23/d4a/d43/d48/d64/dab/fd1 388180 1 2024-09-16T00:50:18.121 INFO:tasks.workunit.client.1.smithi152.stdout:3/650: dread dc/d10/f87 [0,4194304] 0 2024-09-16T00:50:18.122 INFO:tasks.workunit.client.1.smithi152.stdout:4/763: creat d2/db/ffa x:0 0 0 2024-09-16T00:50:18.122 INFO:tasks.workunit.client.1.smithi152.stdout:4/764: chown d2/db/d39/d3c/l5d 226374 1 2024-09-16T00:50:18.123 INFO:tasks.workunit.client.1.smithi152.stdout:4/765: readlink d2/db/d39/d3c/d7f/d98/l4b 0 2024-09-16T00:50:18.123 INFO:tasks.workunit.client.1.smithi152.stdout:4/766: fsync d2/d1e/fd9 0 2024-09-16T00:50:18.127 INFO:tasks.workunit.client.1.smithi152.stdout:2/642: dwrite d4/d19/d20/d28/d8b/da9/db7/dc9/fac [0,4194304] 0 2024-09-16T00:50:18.127 INFO:tasks.workunit.client.1.smithi152.stdout:2/643: read d4/d17/f33 [627255,108556] 0 2024-09-16T00:50:18.128 INFO:tasks.workunit.client.0.smithi053.stdout:7/263: rename d1/d2a/d4f/d52/d2c/f55 to d1/d35/d4a/f5e 0 2024-09-16T00:50:18.132 INFO:tasks.workunit.client.1.smithi152.stdout:7/655: unlink d9/d31/d65/d4b/f81 0 2024-09-16T00:50:18.132 INFO:tasks.workunit.client.1.smithi152.stdout:7/656: read d9/d31/d65/d6b/f77 [55582,7157] 0 2024-09-16T00:50:18.132 INFO:tasks.workunit.client.1.smithi152.stdout:7/657: chown d9/d31/d65/d8a/d41/d46/d7d/d86 101691 1 2024-09-16T00:50:18.133 INFO:tasks.workunit.client.0.smithi053.stdout:5/196: truncate d3/d7/d24/d34/f39 1853167 0 2024-09-16T00:50:18.133 INFO:tasks.workunit.client.1.smithi152.stdout:7/658: dread d9/d31/d65/d8a/f3b [0,4194304] 0 2024-09-16T00:50:18.145 INFO:tasks.workunit.client.0.smithi053.stdout:2/150: getdents d6 0 2024-09-16T00:50:18.147 INFO:tasks.workunit.client.0.smithi053.stdout:7/264: dwrite d1/d2a/d4f/f53 [0,4194304] 0 2024-09-16T00:50:18.152 INFO:tasks.workunit.client.0.smithi053.stdout:2/151: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:18.153 INFO:tasks.workunit.client.0.smithi053.stdout:9/249: creat d8/d1c/d2b/f52 x:0 0 0 2024-09-16T00:50:18.156 INFO:tasks.workunit.client.0.smithi053.stdout:4/196: truncate d0/d2/dd/d25/f35 1596582 0 2024-09-16T00:50:18.156 INFO:tasks.workunit.client.0.smithi053.stdout:4/197: chown d0/d2/dd/d25/d41 306663 1 2024-09-16T00:50:18.160 INFO:tasks.workunit.client.0.smithi053.stdout:4/198: read d0/d2/d26/f2c [263076,112531] 0 2024-09-16T00:50:18.162 INFO:tasks.workunit.client.0.smithi053.stdout:0/278: rename d4/dc/d25/d34/d2a/d27/l3a to d4/dc/d1e/d1f/d40/l5c 0 2024-09-16T00:50:18.163 INFO:tasks.workunit.client.0.smithi053.stdout:0/279: creat d4/d13/d2d/f5d x:0 0 0 2024-09-16T00:50:18.169 INFO:tasks.workunit.client.0.smithi053.stdout:0/280: dread d4/f4b [0,4194304] 0 2024-09-16T00:50:18.169 INFO:tasks.workunit.client.0.smithi053.stdout:0/281: chown d4/dc/d1e/d1f/d40/d44/d49 46515 1 2024-09-16T00:50:18.170 INFO:tasks.workunit.client.1.smithi152.stdout:1/744: unlink d9/da/fd1 0 2024-09-16T00:50:18.170 INFO:tasks.workunit.client.1.smithi152.stdout:1/745: chown d9/da/df/f42 83119954 1 2024-09-16T00:50:18.170 INFO:tasks.workunit.client.1.smithi152.stdout:8/509: truncate dd/d15/d1a/f45 1590918 0 2024-09-16T00:50:18.171 INFO:tasks.workunit.client.1.smithi152.stdout:9/654: symlink d1/d4e/d48/d2b/ld7 0 2024-09-16T00:50:18.174 INFO:tasks.workunit.client.0.smithi053.stdout:1/217: truncate d5/d9/d21/f2a 580197 0 2024-09-16T00:50:18.174 INFO:tasks.workunit.client.0.smithi053.stdout:1/218: creat d5/d7/d10/f43 x:0 0 0 2024-09-16T00:50:18.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/691: creat db/d12/d23/d4a/d43/d59/d67/dc2/fdd x:0 0 0 2024-09-16T00:50:18.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/692: chown db/d12/d20/d86/fc7 8710 1 2024-09-16T00:50:18.176 INFO:tasks.workunit.client.0.smithi053.stdout:9/250: dwrite d8/f46 [0,4194304] 0 2024-09-16T00:50:18.177 INFO:tasks.workunit.client.0.smithi053.stdout:5/197: mkdir d3/d7/d42 0 2024-09-16T00:50:18.179 INFO:tasks.workunit.client.0.smithi053.stdout:4/199: dwrite d0/d2/f28 [0,4194304] 0 2024-09-16T00:50:18.179 INFO:tasks.workunit.client.0.smithi053.stdout:4/200: fsync d0/f38 0 2024-09-16T00:50:18.179 INFO:tasks.workunit.client.1.smithi152.stdout:6/693: dread db/d12/d23/f79 [0,4194304] 0 2024-09-16T00:50:18.179 INFO:tasks.workunit.client.1.smithi152.stdout:3/651: mknod dc/d10/d17/d5a/d68/da1/cc9 0 2024-09-16T00:50:18.180 INFO:tasks.workunit.client.1.smithi152.stdout:3/652: stat dc/d10/d17/d5a/d68/da1/fc6 0 2024-09-16T00:50:18.182 INFO:tasks.workunit.client.1.smithi152.stdout:4/767: mknod d2/db/dce/deb/cfb 0 2024-09-16T00:50:18.186 INFO:tasks.workunit.client.1.smithi152.stdout:2/644: creat d4/d19/d20/fd3 x:0 0 0 2024-09-16T00:50:18.188 INFO:tasks.workunit.client.1.smithi152.stdout:6/694: dread db/d12/d20/f3e [0,4194304] 0 2024-09-16T00:50:18.188 INFO:tasks.workunit.client.1.smithi152.stdout:6/695: fsync db/d12/d23/d4a/d33/fa3 0 2024-09-16T00:50:18.190 INFO:tasks.workunit.client.0.smithi053.stdout:7/265: link d1/d35/d4a/l51 d1/d35/l5f 0 2024-09-16T00:50:18.190 INFO:tasks.workunit.client.0.smithi053.stdout:7/266: chown d1/l8 8 1 2024-09-16T00:50:18.190 INFO:tasks.workunit.client.0.smithi053.stdout:7/267: read d1/d35/d4a/f56 [3183038,17757] 0 2024-09-16T00:50:18.192 INFO:tasks.workunit.client.1.smithi152.stdout:4/768: dread d2/d41/fa0 [0,4194304] 0 2024-09-16T00:50:18.192 INFO:tasks.workunit.client.1.smithi152.stdout:7/659: rename d9/d31/d65/d8a/d41/d46/d7d/d86/dd6 to d9/db6/dde 0 2024-09-16T00:50:18.193 INFO:tasks.workunit.client.0.smithi053.stdout:2/152: truncate f5 3483280 0 2024-09-16T00:50:18.193 INFO:tasks.workunit.client.0.smithi053.stdout:2/153: chown d6/d9/d14/f1f 77772448 1 2024-09-16T00:50:18.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/653: dwrite dc/d10/f7a [4194304,4194304] 0 2024-09-16T00:50:18.195 INFO:tasks.workunit.client.1.smithi152.stdout:8/510: creat dd/d23/fa6 x:0 0 0 2024-09-16T00:50:18.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:17 smithi152 ceph-mon[33237]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:18.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:17 smithi152 ceph-mon[33237]: pgmap v9: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 184 MiB/s rd, 229 MiB/s wr, 364 op/s 2024-09-16T00:50:18.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:17 smithi152 ceph-mon[33237]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:18.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:17 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1091224149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:50:18.198 INFO:tasks.workunit.client.1.smithi152.stdout:1/746: mkdir d9/d3e/d41/d31/d48/d4a/d114 0 2024-09-16T00:50:18.200 INFO:tasks.workunit.client.0.smithi053.stdout:0/282: unlink d4/dc/d1e/d1f/f3c 0 2024-09-16T00:50:18.201 INFO:tasks.workunit.client.1.smithi152.stdout:3/654: dread dc/d10/d17/d1c/d8d/d8e/d2f/f48 [0,4194304] 0 2024-09-16T00:50:18.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/655: creat d1/d4e/d48/d26/d92/fd8 x:0 0 0 2024-09-16T00:50:18.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/656: dread - d1/d4e/d48/fc7 zero size 2024-09-16T00:50:18.203 INFO:tasks.workunit.client.1.smithi152.stdout:2/645: creat d4/d19/d20/d28/d2c/d77/da5/dcf/fd4 x:0 0 0 2024-09-16T00:50:18.205 INFO:tasks.workunit.client.0.smithi053.stdout:1/219: unlink d5/dd/d19/c27 0 2024-09-16T00:50:18.207 INFO:tasks.workunit.client.1.smithi152.stdout:6/696: mkdir db/d12/d20/d86/d91/dde 0 2024-09-16T00:50:18.207 INFO:tasks.workunit.client.1.smithi152.stdout:6/697: chown db/da8/db7 246243929 1 2024-09-16T00:50:18.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/655: dread dc/d10/d17/d1c/d50/d55/f96 [0,4194304] 0 2024-09-16T00:50:18.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/198: creat d3/d7/d2b/d2f/f43 x:0 0 0 2024-09-16T00:50:18.217 INFO:tasks.workunit.client.1.smithi152.stdout:4/769: mkdir d2/db/d39/d3c/d7f/d98/dcf/dfc 0 2024-09-16T00:50:18.218 INFO:tasks.workunit.client.1.smithi152.stdout:7/660: truncate d9/d31/d65/f69 2404742 0 2024-09-16T00:50:18.223 INFO:tasks.workunit.client.0.smithi053.stdout:4/201: rename d0/cf to d0/d2/d1e/c46 0 2024-09-16T00:50:18.223 INFO:tasks.workunit.client.0.smithi053.stdout:4/202: fdatasync d0/d2/d1d/f36 0 2024-09-16T00:50:18.225 INFO:tasks.workunit.client.0.smithi053.stdout:4/203: dread d0/d2/dd/f40 [0,4194304] 0 2024-09-16T00:50:18.227 INFO:tasks.workunit.client.1.smithi152.stdout:8/511: symlink dd/d25/d77/la7 0 2024-09-16T00:50:18.228 INFO:tasks.workunit.client.1.smithi152.stdout:8/512: creat dd/d15/d1a/fa8 x:0 0 0 2024-09-16T00:50:18.228 INFO:tasks.workunit.client.0.smithi053.stdout:7/268: truncate d1/d2a/d4f/d52/f26 463127 0 2024-09-16T00:50:18.230 INFO:tasks.workunit.client.1.smithi152.stdout:1/747: mkdir d9/d3e/d4b/d50/d115 0 2024-09-16T00:50:18.230 INFO:tasks.workunit.client.1.smithi152.stdout:8/513: dread dd/d25/f79 [0,4194304] 0 2024-09-16T00:50:18.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/661: dread d9/d31/d65/d8a/d90/fa4 [0,4194304] 0 2024-09-16T00:50:18.232 INFO:tasks.workunit.client.0.smithi053.stdout:0/283: rmdir d4/dc/d25/d34 39 2024-09-16T00:50:18.233 INFO:tasks.workunit.client.1.smithi152.stdout:9/657: getdents d1/d4e/d48/d26/d30/d8f/dc4 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:9/658: fsync d1/d4e/d48/fc7 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:9/659: truncate d1/d4e/f61 497153 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/770: dwrite d2/db/d39/d3c/d76/db4/fc3 [0,4194304] 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/771: getdents d2/d41/dd8 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:9/660: write d1/d4e/d48/d26/d30/d8f/fbf [663151,96205] 0 2024-09-16T00:50:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:3/656: dwrite dc/d10/d17/d1c/d8d/d8e/d2f/f8c [0,4194304] 0 2024-09-16T00:50:18.235 INFO:tasks.workunit.client.0.smithi053.stdout:1/220: creat d5/d9/f44 x:0 0 0 2024-09-16T00:50:18.235 INFO:tasks.workunit.client.0.smithi053.stdout:1/221: creat d5/dd/f45 x:0 0 0 2024-09-16T00:50:18.237 INFO:tasks.workunit.client.1.smithi152.stdout:2/646: rmdir d4/d19/d94/d8f/dd0 0 2024-09-16T00:50:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.236+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faa5402ce90 con 0x7faa54100cd0 2024-09-16T00:50:18.238 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:17 smithi053 ceph-mon[27950]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:18.238 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:17 smithi053 ceph-mon[27950]: pgmap v9: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 184 MiB/s rd, 229 MiB/s wr, 364 op/s 2024-09-16T00:50:18.238 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:17 smithi053 ceph-mon[27950]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:18.238 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:17 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1091224149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:50:18.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.236+0000 7faa4affd700 1 -- 172.21.15.53:0/2524474289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7faa5005f300 con 0x7faa54100cd0 2024-09-16T00:50:18.239 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:50:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:50:18.241 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:18.243 INFO:tasks.workunit.client.0.smithi053.stdout:9/251: getdents d8/d1c/d2b 0 2024-09-16T00:50:18.243 INFO:tasks.workunit.client.0.smithi053.stdout:9/252: write d8/f27 [252749,106889] 0 2024-09-16T00:50:18.243 INFO:tasks.workunit.client.0.smithi053.stdout:9/253: chown d8/d13/f29 1 1 2024-09-16T00:50:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.240+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 msgr2=0x7faa4006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 0x7faa4006faf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44009cb0 tx=0x7faa44009260 comp rx=0 tx=0).stop 2024-09-16T00:50:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 msgr2=0x7faa54195a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa500092e0 tx=0x7faa5001e740 comp rx=0 tx=0).stop 2024-09-16T00:50:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 shutdown_connections 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7faa4006d640 0x7faa4006faf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100cd0 0x7faa54195a50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 --2- 172.21.15.53:0/2524474289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa541035f0 0x7faa54195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 >> 172.21.15.53:0/2524474289 conn(0x7faa540fa6d0 msgr2=0x7faa540fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 shutdown_connections 2024-09-16T00:50:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.241+0000 7faa5bde6700 1 -- 172.21.15.53:0/2524474289 wait complete. 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/698: creat db/d12/d23/d4a/d43/d59/fdf x:0 0 0 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/699: truncate db/d12/d23/d4a/d43/d59/d67/dc2/fdd 925666 0 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/700: chown db/d12/d23/d4a/d43/d48/d64/f6d 0 1 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/701: stat db/d12/d23/d4a/d43/d48/f4d 0 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/702: write f9 [679635,73778] 0 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/703: stat db/d12/d20/f2d 0 2024-09-16T00:50:18.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/704: truncate db/da8/db7/fd2 311108 0 2024-09-16T00:50:18.246 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:50:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/830: sync 2024-09-16T00:50:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:0/664: sync 2024-09-16T00:50:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/831: fsync d6/d57/d54/ff2 0 2024-09-16T00:50:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/832: readlink d6/d57/d2b/d50/d6e/l8f 0 2024-09-16T00:50:18.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/514: dwrite dd/d15/f7a [0,4194304] 0 2024-09-16T00:50:18.249 INFO:tasks.workunit.client.0.smithi053.stdout:2/154: rename d6/d9/dd/f1c to d6/f2c 0 2024-09-16T00:50:18.249 INFO:tasks.workunit.client.0.smithi053.stdout:2/155: stat d6/d9/d14/l21 0 2024-09-16T00:50:18.253 INFO:tasks.workunit.client.0.smithi053.stdout:7/269: unlink d1/d35/d14/d15/f3e 0 2024-09-16T00:50:18.255 INFO:tasks.workunit.client.0.smithi053.stdout:2/156: dread d6/d9/d14/f15 [0,4194304] 0 2024-09-16T00:50:18.256 INFO:tasks.workunit.client.0.smithi053.stdout:0/284: creat d4/dc/d25/d34/f5e x:0 0 0 2024-09-16T00:50:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/647: dwrite d4/d19/d94/d93/fcc [0,4194304] 0 2024-09-16T00:50:18.259 INFO:tasks.workunit.client.0.smithi053.stdout:2/157: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:18.260 INFO:tasks.workunit.client.1.smithi152.stdout:8/515: write f3 [2515304,40095] 0 2024-09-16T00:50:18.261 INFO:tasks.workunit.client.0.smithi053.stdout:9/254: symlink d8/d13/l53 0 2024-09-16T00:50:18.263 INFO:tasks.workunit.client.1.smithi152.stdout:4/772: symlink d2/d1e/d28/d69/lfd 0 2024-09-16T00:50:18.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/648: dread d4/d19/d20/f47 [0,4194304] 0 2024-09-16T00:50:18.269 INFO:tasks.workunit.client.0.smithi053.stdout:8/285: sync 2024-09-16T00:50:18.269 INFO:tasks.workunit.client.0.smithi053.stdout:6/180: sync 2024-09-16T00:50:18.269 INFO:tasks.workunit.client.0.smithi053.stdout:6/181: truncate d1/dc/f31 1228035 0 2024-09-16T00:50:18.269 INFO:tasks.workunit.client.0.smithi053.stdout:6/182: write d1/fd [513911,89910] 0 2024-09-16T00:50:18.270 INFO:tasks.workunit.client.1.smithi152.stdout:9/661: creat d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/fd9 x:0 0 0 2024-09-16T00:50:18.271 INFO:tasks.workunit.client.0.smithi053.stdout:8/286: read d10/d21/f33 [604473,66143] 0 2024-09-16T00:50:18.274 INFO:tasks.workunit.client.0.smithi053.stdout:5/199: rename d3/d7/d24/f30 to d3/d7/d2b/d37/f44 0 2024-09-16T00:50:18.274 INFO:tasks.workunit.client.0.smithi053.stdout:5/200: dread - d3/d7/d24/d34/f3c zero size 2024-09-16T00:50:18.274 INFO:tasks.workunit.client.0.smithi053.stdout:9/255: write d8/f39 [695905,75173] 0 2024-09-16T00:50:18.277 INFO:tasks.workunit.client.1.smithi152.stdout:3/657: unlink dc/d10/d17/l95 0 2024-09-16T00:50:18.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/649: dread d4/d44/d7a/d9e/d87/d9c/fad [0,4194304] 0 2024-09-16T00:50:18.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/650: write d4/f9 [2464524,21705] 0 2024-09-16T00:50:18.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/651: chown d4/d44/d7a/d9e/d87/d9c/fad 305035630 1 2024-09-16T00:50:18.280 INFO:tasks.workunit.client.1.smithi152.stdout:8/516: dwrite dd/d23/f60 [0,4194304] 0 2024-09-16T00:50:18.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/256: dread d8/d1c/d2b/d2c/f41 [0,4194304] 0 2024-09-16T00:50:18.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/257: write d8/d1c/d2b/f47 [631909,33933] 0 2024-09-16T00:50:18.280 INFO:tasks.workunit.client.0.smithi053.stdout:6/183: dread d1/f15 [0,4194304] 0 2024-09-16T00:50:18.281 INFO:tasks.workunit.client.0.smithi053.stdout:7/270: mkdir d1/d60 0 2024-09-16T00:50:18.281 INFO:tasks.workunit.client.0.smithi053.stdout:7/271: readlink d1/d35/d4a/l51 0 2024-09-16T00:50:18.285 INFO:tasks.workunit.client.0.smithi053.stdout:0/285: creat d4/dc/d25/f5f x:0 0 0 2024-09-16T00:50:18.285 INFO:tasks.workunit.client.0.smithi053.stdout:0/286: chown d4/f4b 13 1 2024-09-16T00:50:18.285 INFO:tasks.workunit.client.0.smithi053.stdout:0/287: creat d4/d13/d2d/f60 x:0 0 0 2024-09-16T00:50:18.287 INFO:tasks.workunit.client.1.smithi152.stdout:9/662: dread d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:18.287 INFO:tasks.workunit.client.1.smithi152.stdout:6/705: mkdir db/d12/d23/d4a/d43/d48/d6a/de0 0 2024-09-16T00:50:18.287 INFO:tasks.workunit.client.1.smithi152.stdout:9/663: dread - d1/d7/d77/d32/da5/da8/fd3 zero size 2024-09-16T00:50:18.287 INFO:tasks.workunit.client.1.smithi152.stdout:6/706: write db/d12/f1a [6620,67245] 0 2024-09-16T00:50:18.290 INFO:tasks.workunit.client.0.smithi053.stdout:8/287: read d10/d21/f42 [513198,8422] 0 2024-09-16T00:50:18.290 INFO:tasks.workunit.client.0.smithi053.stdout:9/258: fsync d8/f39 0 2024-09-16T00:50:18.291 INFO:tasks.workunit.client.0.smithi053.stdout:2/158: link d6/c13 d6/d9/c2d 0 2024-09-16T00:50:18.291 INFO:tasks.workunit.client.0.smithi053.stdout:2/159: fsync d6/d9/dd/f16 0 2024-09-16T00:50:18.292 INFO:tasks.workunit.client.0.smithi053.stdout:7/272: write d1/d2a/d4f/f53 [483820,98850] 0 2024-09-16T00:50:18.293 INFO:tasks.workunit.client.0.smithi053.stdout:7/273: chown d1/d2a/d4f/d52/c31 202588 1 2024-09-16T00:50:18.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/658: dread dc/d10/d47/f4e [0,4194304] 0 2024-09-16T00:50:18.293 INFO:tasks.workunit.client.1.smithi152.stdout:4/773: dwrite d2/d1e/d28/db7/fcc [0,4194304] 0 2024-09-16T00:50:18.294 INFO:tasks.workunit.client.1.smithi152.stdout:0/665: creat d3/d6/d8/d1d/d65/fde x:0 0 0 2024-09-16T00:50:18.297 INFO:tasks.workunit.client.0.smithi053.stdout:9/259: dread d8/d1c/f1b [0,4194304] 0 2024-09-16T00:50:18.298 INFO:tasks.workunit.client.1.smithi152.stdout:3/659: write dc/d10/d17/f80 [7804205,25908] 0 2024-09-16T00:50:18.299 INFO:tasks.workunit.client.1.smithi152.stdout:3/660: fdatasync dc/d10/d17/d1c/d50/d63/fc3 0 2024-09-16T00:50:18.299 INFO:tasks.workunit.client.1.smithi152.stdout:3/661: write dc/f1a [199090,49053] 0 2024-09-16T00:50:18.300 INFO:tasks.workunit.client.0.smithi053.stdout:1/222: rename d5/d7/d10/f43 to d5/dd/d19/f46 0 2024-09-16T00:50:18.300 INFO:tasks.workunit.client.1.smithi152.stdout:2/652: dwrite d4/d19/d20/d28/d2c/d77/da7/db8/fc2 [0,4194304] 0 2024-09-16T00:50:18.302 INFO:tasks.workunit.client.0.smithi053.stdout:5/201: mknod d3/d7/d24/d34/d3e/c45 0 2024-09-16T00:50:18.303 INFO:tasks.workunit.client.1.smithi152.stdout:0/666: dread d3/d6/d8/d1d/d23/f3b [0,4194304] 0 2024-09-16T00:50:18.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/667: dread d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fac [0,4194304] 0 2024-09-16T00:50:18.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/668: fdatasync d3/d6/f1f 0 2024-09-16T00:50:18.306 INFO:tasks.workunit.client.1.smithi152.stdout:0/669: dread d3/d6/d8/d1d/d23/d25/d45/d6f/da7/fb5 [0,4194304] 0 2024-09-16T00:50:18.310 INFO:tasks.workunit.client.1.smithi152.stdout:9/664: dwrite d1/ff [0,4194304] 0 2024-09-16T00:50:18.311 INFO:tasks.workunit.client.1.smithi152.stdout:7/662: rename d9/d31/c38 to d9/d10/cdf 0 2024-09-16T00:50:18.314 INFO:tasks.workunit.client.0.smithi053.stdout:0/288: symlink d4/d5a/l61 0 2024-09-16T00:50:18.314 INFO:tasks.workunit.client.0.smithi053.stdout:0/289: dread - d4/d13/f38 zero size 2024-09-16T00:50:18.314 INFO:tasks.workunit.client.0.smithi053.stdout:0/290: write d4/d13/d2d/f60 [718761,94306] 0 2024-09-16T00:50:18.314 INFO:tasks.workunit.client.0.smithi053.stdout:0/291: chown d4/dc/d1e/d1f/c55 12044 1 2024-09-16T00:50:18.314 INFO:tasks.workunit.client.0.smithi053.stdout:0/292: fdatasync d4/d13/d2d/f5d 0 2024-09-16T00:50:18.317 INFO:tasks.workunit.client.0.smithi053.stdout:8/288: truncate d10/d21/f3e 384980 0 2024-09-16T00:50:18.317 INFO:tasks.workunit.client.0.smithi053.stdout:8/289: dread - d10/d52/f55 zero size 2024-09-16T00:50:18.319 INFO:tasks.workunit.client.0.smithi053.stdout:1/223: dwrite d5/dd/f31 [4194304,4194304] 0 2024-09-16T00:50:18.320 INFO:tasks.workunit.client.0.smithi053.stdout:8/290: write d10/d21/d28/f34 [55788,130865] 0 2024-09-16T00:50:18.320 INFO:tasks.workunit.client.0.smithi053.stdout:8/291: write d10/d21/f30 [644007,26596] 0 2024-09-16T00:50:18.321 INFO:tasks.workunit.client.0.smithi053.stdout:2/160: link d6/d9/c20 d6/d9/dd/c2e 0 2024-09-16T00:50:18.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/663: dread d9/d31/d64/d3c/f78 [0,4194304] 0 2024-09-16T00:50:18.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/664: creat d9/d31/dc4/fe0 x:0 0 0 2024-09-16T00:50:18.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/665: dread - d9/d31/d65/d8a/d41/d46/d7d/fb2 zero size 2024-09-16T00:50:18.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/666: truncate d9/d31/d65/d8a/d41/f50 4343827 0 2024-09-16T00:50:18.326 INFO:tasks.workunit.client.0.smithi053.stdout:7/274: symlink d1/d2a/d4f/l61 0 2024-09-16T00:50:18.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/260: mkdir d8/d22/d54 0 2024-09-16T00:50:18.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/261: write d8/d19/f3a [540873,34667] 0 2024-09-16T00:50:18.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/262: chown d8/l2a 2882498 1 2024-09-16T00:50:18.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/263: chown d8/f30 123 1 2024-09-16T00:50:18.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/264: write d8/f1f [3506095,42576] 0 2024-09-16T00:50:18.333 INFO:tasks.workunit.client.0.smithi053.stdout:6/184: rename d1/c17 to d1/dc/d3d/c3f 0 2024-09-16T00:50:18.336 INFO:tasks.workunit.client.0.smithi053.stdout:5/202: mkdir d3/d7/d2b/d37/d46 0 2024-09-16T00:50:18.342 INFO:tasks.workunit.client.0.smithi053.stdout:1/224: unlink d5/dd/d19/f26 0 2024-09-16T00:50:18.346 INFO:tasks.workunit.client.0.smithi053.stdout:8/292: mkdir d10/d21/d28/d3c/d63 0 2024-09-16T00:50:18.346 INFO:tasks.workunit.client.0.smithi053.stdout:8/293: creat d10/d1c/d49/f64 x:0 0 0 2024-09-16T00:50:18.346 INFO:tasks.workunit.client.1.smithi152.stdout:8/517: dread dd/d50/d29/d2f/f95 [0,4194304] 0 2024-09-16T00:50:18.347 INFO:tasks.workunit.client.0.smithi053.stdout:7/275: mkdir d1/d60/d62 0 2024-09-16T00:50:18.348 INFO:tasks.workunit.client.0.smithi053.stdout:7/276: write d1/d2a/d4f/d52/d2c/f40 [461136,88888] 0 2024-09-16T00:50:18.348 INFO:tasks.workunit.client.0.smithi053.stdout:7/277: chown d1/d35/d4a 2477830 1 2024-09-16T00:50:18.348 INFO:tasks.workunit.client.0.smithi053.stdout:7/278: fsync d1/d35/d14/f43 0 2024-09-16T00:50:18.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/707: mknod db/d12/d23/d4a/d43/d59/d67/dc2/ce1 0 2024-09-16T00:50:18.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/708: chown db/d12/d23/d3a/ccd 20 1 2024-09-16T00:50:18.350 INFO:tasks.workunit.client.0.smithi053.stdout:9/265: symlink d8/d4c/l55 0 2024-09-16T00:50:18.350 INFO:tasks.workunit.client.0.smithi053.stdout:9/266: read d8/f17 [2746392,30943] 0 2024-09-16T00:50:18.350 INFO:tasks.workunit.client.0.smithi053.stdout:9/267: stat d8/d19 0 2024-09-16T00:50:18.352 INFO:tasks.workunit.client.0.smithi053.stdout:0/293: dwrite d4/d13/d2d/f5d [0,4194304] 0 2024-09-16T00:50:18.352 INFO:tasks.workunit.client.0.smithi053.stdout:0/294: fdatasync d4/d13/f1c 0 2024-09-16T00:50:18.353 INFO:tasks.workunit.client.0.smithi053.stdout:5/203: mknod d3/d7/d24/d34/d3e/c47 0 2024-09-16T00:50:18.356 INFO:tasks.workunit.client.1.smithi152.stdout:5/833: rmdir d6/d16/d1f/db5/dd3 39 2024-09-16T00:50:18.358 INFO:tasks.workunit.client.0.smithi053.stdout:2/161: dwrite d6/f23 [0,4194304] 0 2024-09-16T00:50:18.358 INFO:tasks.workunit.client.0.smithi053.stdout:2/162: truncate d6/d9/dd/f1a 1026547 0 2024-09-16T00:50:18.358 INFO:tasks.workunit.client.0.smithi053.stdout:2/163: write d6/d29/f2a [534256,118704] 0 2024-09-16T00:50:18.358 INFO:tasks.workunit.client.0.smithi053.stdout:1/225: mkdir d5/dd/d47 0 2024-09-16T00:50:18.359 INFO:tasks.workunit.client.0.smithi053.stdout:6/185: dwrite d1/dc/d1e/f30 [0,4194304] 0 2024-09-16T00:50:18.361 INFO:tasks.workunit.client.0.smithi053.stdout:8/294: read d10/d21/d28/d3c/f3d [300385,52778] 0 2024-09-16T00:50:18.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/662: creat dc/d10/d17/d1c/d50/d63/dc4/fca x:0 0 0 2024-09-16T00:50:18.371 INFO:tasks.workunit.client.0.smithi053.stdout:7/279: link d1/d35/d4a/c5c d1/d35/d5b/c63 0 2024-09-16T00:50:18.371 INFO:tasks.workunit.client.0.smithi053.stdout:7/280: creat d1/d35/d14/f64 x:0 0 0 2024-09-16T00:50:18.373 INFO:tasks.workunit.client.0.smithi053.stdout:9/268: creat d8/d19/d51/f56 x:0 0 0 2024-09-16T00:50:18.377 INFO:tasks.workunit.client.1.smithi152.stdout:0/670: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fdf x:0 0 0 2024-09-16T00:50:18.380 INFO:tasks.workunit.client.0.smithi053.stdout:0/295: rename d4/d13/d2d/f47 to d4/dc/d1e/d1f/d40/f62 0 2024-09-16T00:50:18.382 INFO:tasks.workunit.client.0.smithi053.stdout:9/269: dread d8/f39 [0,4194304] 0 2024-09-16T00:50:18.383 INFO:tasks.workunit.client.1.smithi152.stdout:9/665: link d1/d4e/d48/d2b/d93/fa7 d1/d4e/d48/d26/d92/fda 0 2024-09-16T00:50:18.383 INFO:tasks.workunit.client.1.smithi152.stdout:9/666: stat d1/d7/d77/d3c/dc9/dc3 0 2024-09-16T00:50:18.383 INFO:tasks.workunit.client.1.smithi152.stdout:9/667: chown d1/d4e/d48/d26/d92 3619 1 2024-09-16T00:50:18.386 INFO:tasks.workunit.client.1.smithi152.stdout:4/774: rename d2/db/d39/d3c/d76/cae to d2/db/d39/d3c/dc5/cfe 0 2024-09-16T00:50:18.386 INFO:tasks.workunit.client.1.smithi152.stdout:4/775: write d2/db/fe6 [863061,110632] 0 2024-09-16T00:50:18.386 INFO:tasks.workunit.client.0.smithi053.stdout:1/226: creat d5/d7/d39/f48 x:0 0 0 2024-09-16T00:50:18.387 INFO:tasks.workunit.client.1.smithi152.stdout:9/668: dread d1/f8b [0,4194304] 0 2024-09-16T00:50:18.387 INFO:tasks.workunit.client.1.smithi152.stdout:9/669: truncate d1/d4e/d34/f5e 5128351 0 2024-09-16T00:50:18.387 INFO:tasks.workunit.client.1.smithi152.stdout:9/670: dread - d1/d4e/d48/fc7 zero size 2024-09-16T00:50:18.391 INFO:tasks.workunit.client.0.smithi053.stdout:6/186: creat d1/dc/d3d/f40 x:0 0 0 2024-09-16T00:50:18.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/709: dwrite db/d12/d1c/d80/f7a [0,4194304] 0 2024-09-16T00:50:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/710: creat db/d12/d23/d3a/fe2 x:0 0 0 2024-09-16T00:50:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/711: truncate db/d12/d23/d4a/d43/d48/d6a/fb6 675850 0 2024-09-16T00:50:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/712: creat db/d12/d20/d86/d91/fe3 x:0 0 0 2024-09-16T00:50:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:5/834: dwrite d6/d57/d2b/f109 [0,4194304] 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:5/204: dwrite d3/f2c [0,4194304] 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:5/205: read d3/f35 [360413,88796] 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:2/164: dwrite d6/d9/d14/f15 [0,4194304] 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:7/281: write d1/f36 [307374,92797] 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:7/282: creat d1/d2a/d4f/d52/d2c/d50/f65 x:0 0 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:7/283: truncate d1/d35/d14/f64 58945 0 2024-09-16T00:50:18.396 INFO:tasks.workunit.client.0.smithi053.stdout:7/284: fsync d1/d2a/d4f/d52/f26 0 2024-09-16T00:50:18.400 INFO:tasks.workunit.client.1.smithi152.stdout:8/518: mknod dd/d25/d77/ca9 0 2024-09-16T00:50:18.400 INFO:tasks.workunit.client.1.smithi152.stdout:8/519: creat dd/d50/faa x:0 0 0 2024-09-16T00:50:18.400 INFO:tasks.workunit.client.1.smithi152.stdout:8/520: dread - dd/d15/d69/f87 zero size 2024-09-16T00:50:18.407 INFO:tasks.workunit.client.1.smithi152.stdout:9/671: dwrite d1/d7/d13/f27 [4194304,4194304] 0 2024-09-16T00:50:18.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/653: link d4/d19/d20/d28/d2c/c36 d4/d19/d20/d28/d2c/d77/da5/dcf/cd5 0 2024-09-16T00:50:18.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/663: rename dc/f2d to dc/d10/d17/d1c/d8d/d8e/fcb 0 2024-09-16T00:50:18.414 INFO:tasks.workunit.client.0.smithi053.stdout:0/296: creat d4/d13/f63 x:0 0 0 2024-09-16T00:50:18.414 INFO:tasks.workunit.client.0.smithi053.stdout:0/297: fsync d4/dc/d25/f5f 0 2024-09-16T00:50:18.414 INFO:tasks.workunit.client.0.smithi053.stdout:0/298: read - d4/d13/f38 zero size 2024-09-16T00:50:18.414 INFO:tasks.workunit.client.0.smithi053.stdout:0/299: truncate d4/dc/d1e/d22/f42 314705 0 2024-09-16T00:50:18.415 INFO:tasks.workunit.client.0.smithi053.stdout:6/187: unlink d1/dc/d39/f25 0 2024-09-16T00:50:18.426 INFO:tasks.workunit.client.0.smithi053.stdout:5/206: link d3/d7/l15 d3/d7/d24/d34/l48 0 2024-09-16T00:50:18.426 INFO:tasks.workunit.client.0.smithi053.stdout:5/207: stat d3/d7 0 2024-09-16T00:50:18.426 INFO:tasks.workunit.client.0.smithi053.stdout:5/208: fdatasync d3/f32 0 2024-09-16T00:50:18.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/664: dread dc/ff [0,4194304] 0 2024-09-16T00:50:18.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/665: readlink dc/d10/d17/d1c/d1f/l45 0 2024-09-16T00:50:18.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/666: fsync dc/d10/d17/d5a/fa3 0 2024-09-16T00:50:18.432 INFO:tasks.workunit.client.0.smithi053.stdout:0/300: read d4/dc/d25/d34/d2a/d27/f37 [2914072,36799] 0 2024-09-16T00:50:18.433 INFO:tasks.workunit.client.1.smithi152.stdout:5/835: mkdir d6/d57/d2b/dee/d135 0 2024-09-16T00:50:18.433 INFO:tasks.workunit.client.1.smithi152.stdout:5/836: chown d6/d16/d10d/d10e 20797 1 2024-09-16T00:50:18.434 INFO:tasks.workunit.client.0.smithi053.stdout:9/270: dwrite d8/d1c/d2b/f47 [0,4194304] 0 2024-09-16T00:50:18.434 INFO:tasks.workunit.client.0.smithi053.stdout:9/271: fsync d8/d1c/f1b 0 2024-09-16T00:50:18.434 INFO:tasks.workunit.client.0.smithi053.stdout:2/165: dwrite d6/f7 [0,4194304] 0 2024-09-16T00:50:18.434 INFO:tasks.workunit.client.0.smithi053.stdout:2/166: getdents d6/d9/dd/d28 0 2024-09-16T00:50:18.438 INFO:tasks.workunit.client.1.smithi152.stdout:8/521: mkdir dd/d15/d69/dab 0 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 -- 172.21.15.53:0/1472560388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 msgr2=0x7f6184100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 --2- 172.21.15.53:0/1472560388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184100840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6178009910 tx=0x7f6178009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 -- 172.21.15.53:0/1472560388 shutdown_connections 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 --2- 172.21.15.53:0/1472560388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184100840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 --2- 172.21.15.53:0/1472560388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 0x7f61840ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 -- 172.21.15.53:0/1472560388 >> 172.21.15.53:0/1472560388 conn(0x7f61840fa780 msgr2=0x7f61840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 -- 172.21.15.53:0/1472560388 shutdown_connections 2024-09-16T00:50:18.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.440+0000 7f618a5c3700 1 -- 172.21.15.53:0/1472560388 wait complete. 2024-09-16T00:50:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.441+0000 7f618a5c3700 1 Processor -- start 2024-09-16T00:50:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f618a5c3700 1 -- start start 2024-09-16T00:50:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f618a5c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 0x7f6184069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f618a5c3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f618a5c3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6184198b70 con 0x7f61841003d0 2024-09-16T00:50:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f618a5c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6184198cb0 con 0x7f61840ff130 2024-09-16T00:50:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.442+0000 7f61837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48550/0 (socket says 172.21.15.53:48550) 2024-09-16T00:50:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 -- 172.21.15.53:0/4112801632 learned_addr learned my addr 172.21.15.53:0/4112801632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f6183fff700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 0x7f6184069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 -- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 msgr2=0x7f6184069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 0x7f6184069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 -- 172.21.15.53:0/4112801632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780095f0 con 0x7f61841003d0 2024-09-16T00:50:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.443+0000 7f61837fe700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6178000c00 tx=0x7f617800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:18.446 INFO:tasks.workunit.client.0.smithi053.stdout:8/295: rename d10/d1c/d2b/c46 to d10/c65 0 2024-09-16T00:50:18.446 INFO:tasks.workunit.client.0.smithi053.stdout:8/296: dread - d10/d1c/d2b/f5d zero size 2024-09-16T00:50:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.444+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617801d070 con 0x7f61841003d0 2024-09-16T00:50:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.444+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6178005dc0 con 0x7f61841003d0 2024-09-16T00:50:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.444+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61780226a0 con 0x7f61841003d0 2024-09-16T00:50:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.444+0000 7f618a5c3700 1 -- 172.21.15.53:0/4112801632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6184198f30 con 0x7f61841003d0 2024-09-16T00:50:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.445+0000 7f618a5c3700 1 -- 172.21.15.53:0/4112801632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184199360 con 0x7f61841003d0 2024-09-16T00:50:18.447 INFO:tasks.workunit.client.0.smithi053.stdout:8/297: dread d10/d21/d28/d3c/f3d [0,4194304] 0 2024-09-16T00:50:18.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.446+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618419a7b0 con 0x7f61841003d0 2024-09-16T00:50:18.450 INFO:tasks.workunit.client.0.smithi053.stdout:6/188: mkdir d1/dc/d1e/d41 0 2024-09-16T00:50:18.450 INFO:tasks.workunit.client.0.smithi053.stdout:5/209: getdents d3/d7/d2b/d37 0 2024-09-16T00:50:18.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.447+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f6178003680 con 0x7f61841003d0 2024-09-16T00:50:18.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.448+0000 7f61817fa700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 0x7f616c06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:18.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.449+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f617808e300 con 0x7f61841003d0 2024-09-16T00:50:18.451 INFO:tasks.workunit.client.1.smithi152.stdout:9/672: creat d1/d4e/d48/d66/d76/fdb x:0 0 0 2024-09-16T00:50:18.451 INFO:tasks.workunit.client.1.smithi152.stdout:9/673: dread - d1/d7/d77/d32/da5/da8/fd3 zero size 2024-09-16T00:50:18.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.449+0000 7f6183fff700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 0x7f616c06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:18.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.451+0000 7f6183fff700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 0x7f616c06fae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6174009bf0 tx=0x7f6174009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:18.453 INFO:tasks.workunit.client.1.smithi152.stdout:2/654: mknod d4/d44/d7a/d9e/cd6 0 2024-09-16T00:50:18.454 INFO:tasks.workunit.client.0.smithi053.stdout:0/301: link d4/cf d4/dc/d1e/d22/c64 0 2024-09-16T00:50:18.454 INFO:tasks.workunit.client.0.smithi053.stdout:0/302: dread - d4/d13/f38 zero size 2024-09-16T00:50:18.456 INFO:tasks.workunit.client.0.smithi053.stdout:8/298: write f8 [349383,109869] 0 2024-09-16T00:50:18.456 INFO:tasks.workunit.client.0.smithi053.stdout:8/299: write d10/d21/d28/f32 [936217,101629] 0 2024-09-16T00:50:18.457 INFO:tasks.workunit.client.1.smithi152.stdout:0/671: rename d3/d6/d51/dbb/lcc to d3/d6/d8/d1d/d65/d6e/d82/da4/le0 0 2024-09-16T00:50:18.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.456+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f617805b4f0 con 0x7f61841003d0 2024-09-16T00:50:18.459 INFO:tasks.workunit.client.1.smithi152.stdout:4/776: mknod d2/db/cff 0 2024-09-16T00:50:18.459 INFO:tasks.workunit.client.1.smithi152.stdout:4/777: dread - d2/db/dce/ff8 zero size 2024-09-16T00:50:18.459 INFO:tasks.workunit.client.1.smithi152.stdout:4/778: chown d2/l11 3979 1 2024-09-16T00:50:18.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/667: creat dc/d10/d17/d5a/d68/da5/fcc x:0 0 0 2024-09-16T00:50:18.462 INFO:tasks.workunit.client.1.smithi152.stdout:8/522: dwrite dd/d15/d49/f51 [0,4194304] 0 2024-09-16T00:50:18.463 INFO:tasks.workunit.client.1.smithi152.stdout:9/674: mkdir d1/d7/d13/d5d/d69/ddc 0 2024-09-16T00:50:18.463 INFO:tasks.workunit.client.1.smithi152.stdout:9/675: write d1/d7/d13/fad [1274697,93016] 0 2024-09-16T00:50:18.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/667: sync 2024-09-16T00:50:18.465 INFO:tasks.workunit.client.1.smithi152.stdout:1/748: sync 2024-09-16T00:50:18.466 INFO:tasks.workunit.client.1.smithi152.stdout:5/837: dwrite d6/d16/d1f/d8c/db8/fdd [0,4194304] 0 2024-09-16T00:50:18.466 INFO:tasks.workunit.client.1.smithi152.stdout:5/838: fsync d6/d16/d10d/f119 0 2024-09-16T00:50:18.467 INFO:tasks.workunit.client.1.smithi152.stdout:5/839: fsync d6/d57/d54/f70 0 2024-09-16T00:50:18.467 INFO:tasks.workunit.client.1.smithi152.stdout:5/840: read d6/d57/d2b/d50/d64/df5/ffc [34229,77404] 0 2024-09-16T00:50:18.468 INFO:tasks.workunit.client.1.smithi152.stdout:6/713: rename db/d12/d20/d4b/l90 to db/d12/le4 0 2024-09-16T00:50:18.468 INFO:tasks.workunit.client.1.smithi152.stdout:6/714: chown db/f1e 91 1 2024-09-16T00:50:18.470 INFO:tasks.workunit.client.0.smithi053.stdout:5/210: dwrite d3/f13 [0,4194304] 0 2024-09-16T00:50:18.471 INFO:tasks.workunit.client.1.smithi152.stdout:4/779: symlink d2/d41/l100 0 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/668: creat dc/d10/d17/d1c/d8d/fcd x:0 0 0 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/669: chown l9 114798 1 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/670: chown dc/d10/d17/d5a/db2/d6f/dbb/f98 16080135 1 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/671: readlink dc/d10/l82 0 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/672: write dc/d10/d17/d1c/d8d/d8e/d2f/f7b [509701,88404] 0 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/673: chown dc/d10/d17/d1c/d50/d63/fc3 1 1 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/674: write dc/f1a [3512527,94947] 0 2024-09-16T00:50:18.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/675: chown dc/d10/d17/d1c/d1f/d9e 39876801 1 2024-09-16T00:50:18.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/272: mknod d8/c57 0 2024-09-16T00:50:18.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/273: stat d8/d22/l44 0 2024-09-16T00:50:18.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/523: mknod dd/d15/d9b/cac 0 2024-09-16T00:50:18.486 INFO:tasks.workunit.client.0.smithi053.stdout:2/167: unlink d6/d9/dd/f10 0 2024-09-16T00:50:18.486 INFO:tasks.workunit.client.0.smithi053.stdout:2/168: truncate d6/d9/f25 396224 0 2024-09-16T00:50:18.487 INFO:tasks.workunit.client.0.smithi053.stdout:2/169: write d6/d9/dd/f1a [359790,98140] 0 2024-09-16T00:50:18.489 INFO:tasks.workunit.client.0.smithi053.stdout:1/227: rename d5/l32 to d5/d7/d39/l49 0 2024-09-16T00:50:18.490 INFO:tasks.workunit.client.1.smithi152.stdout:2/655: rmdir d4/d19/d20/d28/d2c/d77/da5/dcf 39 2024-09-16T00:50:18.492 INFO:tasks.workunit.client.1.smithi152.stdout:1/749: symlink d9/d3e/d4b/d50/l116 0 2024-09-16T00:50:18.493 INFO:tasks.workunit.client.1.smithi152.stdout:5/841: dwrite d6/d57/d2b/d50/d6e/fc1 [0,4194304] 0 2024-09-16T00:50:18.494 INFO:tasks.workunit.client.1.smithi152.stdout:5/842: creat d6/f136 x:0 0 0 2024-09-16T00:50:18.499 INFO:tasks.workunit.client.1.smithi152.stdout:8/524: dread dd/ff [0,4194304] 0 2024-09-16T00:50:18.500 INFO:tasks.workunit.client.0.smithi053.stdout:2/170: dread d6/f23 [0,4194304] 0 2024-09-16T00:50:18.500 INFO:tasks.workunit.client.0.smithi053.stdout:2/171: read d6/d9/f1e [171787,7189] 0 2024-09-16T00:50:18.501 INFO:tasks.workunit.client.1.smithi152.stdout:9/676: write d1/d4e/d48/d2b/d93/d96/fab [5144814,88445] 0 2024-09-16T00:50:18.504 INFO:tasks.workunit.client.1.smithi152.stdout:6/715: dwrite db/d12/d20/f3e [4194304,4194304] 0 2024-09-16T00:50:18.504 INFO:tasks.workunit.client.1.smithi152.stdout:6/716: write db/d12/d23/d4a/d43/d59/d67/dc2/fdd [1083847,57437] 0 2024-09-16T00:50:18.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/717: dread - db/da8/db7/fdb zero size 2024-09-16T00:50:18.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/718: write db/d12/d20/f51 [8905961,41925] 0 2024-09-16T00:50:18.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/780: dwrite d2/db/d39/f3b [0,4194304] 0 2024-09-16T00:50:18.507 INFO:tasks.workunit.client.0.smithi053.stdout:2/172: dread d6/d29/f2a [0,4194304] 0 2024-09-16T00:50:18.507 INFO:tasks.workunit.client.0.smithi053.stdout:6/189: rename d1/c1f to d1/c42 0 2024-09-16T00:50:18.513 INFO:tasks.workunit.client.1.smithi152.stdout:3/676: mkdir dc/d10/d17/d1c/d8d/d8e/d2f/d46/dce 0 2024-09-16T00:50:18.514 INFO:tasks.workunit.client.0.smithi053.stdout:9/274: rmdir d8/d19/d31 39 2024-09-16T00:50:18.517 INFO:tasks.workunit.client.0.smithi053.stdout:8/300: truncate d10/f1d 3019217 0 2024-09-16T00:50:18.519 INFO:tasks.workunit.client.1.smithi152.stdout:9/677: dwrite d1/d4e/d34/f62 [0,4194304] 0 2024-09-16T00:50:18.519 INFO:tasks.workunit.client.1.smithi152.stdout:9/678: write d1/d7/d13/f27 [8724282,98328] 0 2024-09-16T00:50:18.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/750: symlink d9/d3e/d41/d31/d48/d4a/l117 0 2024-09-16T00:50:18.520 INFO:tasks.workunit.client.0.smithi053.stdout:6/190: mkdir d1/dc/d43 0 2024-09-16T00:50:18.524 INFO:tasks.workunit.client.0.smithi053.stdout:8/301: truncate d10/d21/f42 383614 0 2024-09-16T00:50:18.524 INFO:tasks.workunit.client.0.smithi053.stdout:8/302: write d10/d52/f55 [533281,85774] 0 2024-09-16T00:50:18.525 INFO:tasks.workunit.client.1.smithi152.stdout:6/719: dwrite db/d12/d20/f2d [0,4194304] 0 2024-09-16T00:50:18.529 INFO:tasks.workunit.client.0.smithi053.stdout:1/228: rename d5/d9/f1d to d5/d18/d1f/f4a 0 2024-09-16T00:50:18.533 INFO:tasks.workunit.client.0.smithi053.stdout:8/303: mkdir d10/d52/d5b/d66 0 2024-09-16T00:50:18.535 INFO:tasks.workunit.client.1.smithi152.stdout:5/843: getdents d6/d57/d2b/d50/d6e 0 2024-09-16T00:50:18.538 INFO:tasks.workunit.client.0.smithi053.stdout:2/173: rename f3 to d6/d9/dd/d28/f2f 0 2024-09-16T00:50:18.538 INFO:tasks.workunit.client.0.smithi053.stdout:2/174: truncate d6/d9/f12 4857735 0 2024-09-16T00:50:18.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/751: dwrite d9/d3e/d4b/d6b/d6d/d97/fc6 [0,4194304] 0 2024-09-16T00:50:18.541 INFO:tasks.workunit.client.1.smithi152.stdout:1/752: read d9/d3e/d7b/fa9 [581080,81441] 0 2024-09-16T00:50:18.541 INFO:tasks.workunit.client.1.smithi152.stdout:8/525: symlink dd/d15/d1a/lad 0 2024-09-16T00:50:18.542 INFO:tasks.workunit.client.0.smithi053.stdout:1/229: creat d5/d9/f4b x:0 0 0 2024-09-16T00:50:18.545 INFO:tasks.workunit.client.1.smithi152.stdout:8/526: dread dd/d15/f52 [0,4194304] 0 2024-09-16T00:50:18.545 INFO:tasks.workunit.client.1.smithi152.stdout:8/527: creat dd/d25/fae x:0 0 0 2024-09-16T00:50:18.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/781: rename d2/db/d44/f94 to d2/db/dce/f101 0 2024-09-16T00:50:18.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/782: stat d2/db/d39/le5 0 2024-09-16T00:50:18.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/783: dread - d2/d1e/d28/d7b/f99 zero size 2024-09-16T00:50:18.550 INFO:tasks.workunit.client.0.smithi053.stdout:9/275: rename d8/d19/f3a to d8/d1c/d2b/f58 0 2024-09-16T00:50:18.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/844: dread d6/d16/f4d [4194304,4194304] 0 2024-09-16T00:50:18.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/845: fdatasync d6/d57/d2b/d50/d66/fd6 0 2024-09-16T00:50:18.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/846: creat d6/d16/d1f/d8c/db8/dbf/ded/f137 x:0 0 0 2024-09-16T00:50:18.552 INFO:tasks.workunit.client.0.smithi053.stdout:6/191: dwrite d1/f2b [0,4194304] 0 2024-09-16T00:50:18.552 INFO:tasks.workunit.client.0.smithi053.stdout:6/192: fsync d1/dc/f3e 0 2024-09-16T00:50:18.553 INFO:tasks.workunit.client.0.smithi053.stdout:2/175: mkdir d6/d9/dd/d28/d30 0 2024-09-16T00:50:18.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/679: dwrite d1/d4e/d34/f39 [0,4194304] 0 2024-09-16T00:50:18.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/677: rmdir dc/d10/d17/d1c/d1f/dc5 0 2024-09-16T00:50:18.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/678: write dc/d10/d17/d5a/d68/f9b [940175,111894] 0 2024-09-16T00:50:18.555 INFO:tasks.workunit.client.1.smithi152.stdout:2/656: getdents d4/d19/d20/d28 0 2024-09-16T00:50:18.555 INFO:tasks.workunit.client.1.smithi152.stdout:2/657: truncate d4/d19/d94/f69 4482846 0 2024-09-16T00:50:18.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/276: link d8/d1c/c24 d8/d19/d31/c59 0 2024-09-16T00:50:18.557 INFO:tasks.workunit.client.0.smithi053.stdout:9/277: readlink d8/d1c/d2b/d2c/l42 0 2024-09-16T00:50:18.566 INFO:tasks.workunit.client.0.smithi053.stdout:2/176: creat d6/d9/dd/f31 x:0 0 0 2024-09-16T00:50:18.566 INFO:tasks.workunit.client.0.smithi053.stdout:2/177: write d6/d9/f1e [187520,73155] 0 2024-09-16T00:50:18.566 INFO:tasks.workunit.client.0.smithi053.stdout:2/178: chown d6/c24 18192 1 2024-09-16T00:50:18.566 INFO:tasks.workunit.client.0.smithi053.stdout:2/179: truncate f5 3608486 0 2024-09-16T00:50:18.567 INFO:tasks.workunit.client.1.smithi152.stdout:2/658: write d4/d19/d94/d93/f99 [1758472,49832] 0 2024-09-16T00:50:18.572 INFO:tasks.workunit.client.0.smithi053.stdout:9/278: getdents d8/d19 0 2024-09-16T00:50:18.574 INFO:tasks.workunit.client.0.smithi053.stdout:6/193: link d1/l24 d1/l44 0 2024-09-16T00:50:18.577 INFO:tasks.workunit.client.0.smithi053.stdout:2/180: link d6/f23 d6/f32 0 2024-09-16T00:50:18.579 INFO:tasks.workunit.client.0.smithi053.stdout:9/279: mkdir d8/d4c/d5a 0 2024-09-16T00:50:18.579 INFO:tasks.workunit.client.0.smithi053.stdout:9/280: chown d8/d19/d31 1 1 2024-09-16T00:50:18.581 INFO:tasks.workunit.client.0.smithi053.stdout:6/194: mkdir d1/dc/d45 0 2024-09-16T00:50:18.581 INFO:tasks.workunit.client.0.smithi053.stdout:1/230: dwrite d5/d18/d1f/f3d [0,4194304] 0 2024-09-16T00:50:18.582 INFO:tasks.workunit.client.0.smithi053.stdout:2/181: symlink d6/l33 0 2024-09-16T00:50:18.583 INFO:tasks.workunit.client.0.smithi053.stdout:2/182: chown d6/f23 6245 1 2024-09-16T00:50:18.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/753: chown d9/d3e/d41/d9a/cb1 3154 1 2024-09-16T00:50:18.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/754: creat d9/d3e/d4b/d6b/d6d/d99/f118 x:0 0 0 2024-09-16T00:50:18.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/755: read - d9/d3e/d7b/df0/d107/fb5 zero size 2024-09-16T00:50:18.583 INFO:tasks.workunit.client.0.smithi053.stdout:9/281: mkdir d8/d4c/d5b 0 2024-09-16T00:50:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/528: symlink dd/d50/d29/d2f/d5f/laf 0 2024-09-16T00:50:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/529: write dd/d15/d1a/f82 [639063,60449] 0 2024-09-16T00:50:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/530: fdatasync dd/ff 0 2024-09-16T00:50:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/531: truncate dd/d15/d49/fa1 900043 0 2024-09-16T00:50:18.586 INFO:tasks.workunit.client.0.smithi053.stdout:6/195: link d1/dc/d1e/l20 d1/d2f/l46 0 2024-09-16T00:50:18.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/679: link dc/d10/d17/d1c/d50/c62 dc/d10/d17/d1c/d50/ccf 0 2024-09-16T00:50:18.592 INFO:tasks.workunit.client.0.smithi053.stdout:2/183: creat d6/d29/d2b/f34 x:0 0 0 2024-09-16T00:50:18.594 INFO:tasks.workunit.client.0.smithi053.stdout:9/282: mkdir d8/d1c/d2b/d5c 0 2024-09-16T00:50:18.595 INFO:tasks.workunit.client.0.smithi053.stdout:9/283: write d8/f27 [2831540,124150] 0 2024-09-16T00:50:18.595 INFO:tasks.workunit.client.0.smithi053.stdout:9/284: read - d8/d1c/d2b/f52 zero size 2024-09-16T00:50:18.595 INFO:tasks.workunit.client.0.smithi053.stdout:9/285: creat d8/d19/d51/f5d x:0 0 0 2024-09-16T00:50:18.596 INFO:tasks.workunit.client.0.smithi053.stdout:8/304: dwrite d10/d21/f42 [0,4194304] 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:5/847: dwrite d6/d57/d2b/d50/d6e/ffa [0,4194304] 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:5/848: stat d6/d57/ddc/f105 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:5/849: readlink d6/d57/d2b/dee/l103 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:2/659: dwrite d4/d19/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:9/680: dwrite d1/d4e/d34/f39 [0,4194304] 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:9/681: chown d1/d7/c1d 0 1 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:1/756: link d9/d3e/d41/d31/d48/d4a/f100 d9/d3e/f119 0 2024-09-16T00:50:18.597 INFO:tasks.workunit.client.1.smithi152.stdout:1/757: write d9/d3e/f119 [557677,30144] 0 2024-09-16T00:50:18.598 INFO:tasks.workunit.client.0.smithi053.stdout:6/196: mknod d1/dc/d45/c47 0 2024-09-16T00:50:18.600 INFO:tasks.workunit.client.1.smithi152.stdout:8/532: truncate dd/d15/d49/f6d 417978 0 2024-09-16T00:50:18.602 INFO:tasks.workunit.client.0.smithi053.stdout:1/231: mkdir d5/d9/d4c 0 2024-09-16T00:50:18.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/680: getdents dc/d10/d17 0 2024-09-16T00:50:18.605 INFO:tasks.workunit.client.0.smithi053.stdout:6/197: write d1/dc/d39/f13 [548928,103466] 0 2024-09-16T00:50:18.605 INFO:tasks.workunit.client.0.smithi053.stdout:6/198: creat d1/dc/f48 x:0 0 0 2024-09-16T00:50:18.608 INFO:tasks.workunit.client.0.smithi053.stdout:9/286: creat d8/f5e x:0 0 0 2024-09-16T00:50:18.608 INFO:tasks.workunit.client.0.smithi053.stdout:9/287: creat d8/f5f x:0 0 0 2024-09-16T00:50:18.609 INFO:tasks.workunit.client.0.smithi053.stdout:9/288: write d8/d1c/d2b/f58 [111397,26345] 0 2024-09-16T00:50:18.609 INFO:tasks.workunit.client.0.smithi053.stdout:9/289: creat d8/d1c/d2b/d2c/f60 x:0 0 0 2024-09-16T00:50:18.610 INFO:tasks.workunit.client.0.smithi053.stdout:9/290: chown d8/d22/d54 28 1 2024-09-16T00:50:18.610 INFO:tasks.workunit.client.0.smithi053.stdout:2/184: dwrite d6/d9/f1e [0,4194304] 0 2024-09-16T00:50:18.611 INFO:tasks.workunit.client.1.smithi152.stdout:5/850: creat d6/d16/d1f/d65/dd2/d123/d130/f138 x:0 0 0 2024-09-16T00:50:18.613 INFO:tasks.workunit.client.1.smithi152.stdout:2/660: link d4/d19/f5b d4/d44/fd7 0 2024-09-16T00:50:18.615 INFO:tasks.workunit.client.1.smithi152.stdout:9/682: rmdir d1/d4e/d48/d26/d30/d8f 39 2024-09-16T00:50:18.615 INFO:tasks.workunit.client.1.smithi152.stdout:9/683: creat d1/d7/d77/d32/da5/da8/fdd x:0 0 0 2024-09-16T00:50:18.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/758: mknod d9/d3e/d4b/c11a 0 2024-09-16T00:50:18.619 INFO:tasks.workunit.client.1.smithi152.stdout:3/681: rename dc/d10/d17/d1c/d1f/f2a to dc/d10/d17/d1c/d50/fd0 0 2024-09-16T00:50:18.626 INFO:tasks.workunit.client.1.smithi152.stdout:5/851: unlink d6/d16/d1f/d8c/db8/fe0 0 2024-09-16T00:50:18.630 INFO:tasks.workunit.client.1.smithi152.stdout:2/661: mkdir d4/d44/d7a/d9e/d87/dd8 0 2024-09-16T00:50:18.630 INFO:tasks.workunit.client.1.smithi152.stdout:2/662: read d4/d44/d7a/d9e/f75 [3456430,4766] 0 2024-09-16T00:50:18.635 INFO:tasks.workunit.client.0.smithi053.stdout:1/232: symlink d5/dd/d19/l4d 0 2024-09-16T00:50:18.636 INFO:tasks.workunit.client.1.smithi152.stdout:9/684: link d1/d7/d13/f37 d1/d4e/d48/d2b/d93/d96/dd1/fde 0 2024-09-16T00:50:18.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/759: truncate d9/d3e/d7b/df0/d107/f43 2769029 0 2024-09-16T00:50:18.643 INFO:tasks.workunit.client.0.smithi053.stdout:1/233: dread d5/d7/d10/f15 [0,4194304] 0 2024-09-16T00:50:18.644 INFO:tasks.workunit.client.0.smithi053.stdout:1/234: fdatasync d5/dd/f31 0 2024-09-16T00:50:18.644 INFO:tasks.workunit.client.0.smithi053.stdout:1/235: chown d5/lb 14327 1 2024-09-16T00:50:18.644 INFO:tasks.workunit.client.1.smithi152.stdout:3/682: creat dc/d10/d17/d1c/d1f/d24/db9/fd1 x:0 0 0 2024-09-16T00:50:18.646 INFO:tasks.workunit.client.0.smithi053.stdout:6/199: link d1/dc/c26 d1/dc/d1e/d41/c49 0 2024-09-16T00:50:18.653 INFO:tasks.workunit.client.0.smithi053.stdout:9/291: creat d8/d22/d26/f61 x:0 0 0 2024-09-16T00:50:18.654 INFO:tasks.workunit.client.0.smithi053.stdout:9/292: dread d8/d1c/d2b/d2c/f41 [0,4194304] 0 2024-09-16T00:50:18.663 INFO:tasks.workunit.client.1.smithi152.stdout:2/663: mkdir d4/d44/d7a/d9e/d87/d9c/dd9 0 2024-09-16T00:50:18.664 INFO:tasks.workunit.client.0.smithi053.stdout:8/305: unlink d10/l1b 0 2024-09-16T00:50:18.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/683: dwrite dc/d10/d17/d5a/d68/da1/fc6 [0,4194304] 0 2024-09-16T00:50:18.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/684: chown dc/d10/d17/d5a/db2 117621720 1 2024-09-16T00:50:18.667 INFO:tasks.workunit.client.1.smithi152.stdout:9/685: link d1/d4e/d48/d26/d30/l8c d1/d59/ldf 0 2024-09-16T00:50:18.667 INFO:tasks.workunit.client.0.smithi053.stdout:1/236: dwrite d5/d9/f4b [0,4194304] 0 2024-09-16T00:50:18.667 INFO:tasks.workunit.client.0.smithi053.stdout:6/200: mkdir d1/dc/d3c/d4a 0 2024-09-16T00:50:18.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/293: symlink d8/d1c/d2b/d5c/l62 0 2024-09-16T00:50:18.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/294: truncate d8/f5f 471822 0 2024-09-16T00:50:18.669 INFO:tasks.workunit.client.1.smithi152.stdout:2/664: mknod d4/d44/d7a/dc7/cda 0 2024-09-16T00:50:18.671 INFO:tasks.workunit.client.0.smithi053.stdout:2/185: rmdir d6/d29/d2b 39 2024-09-16T00:50:18.675 INFO:tasks.workunit.client.0.smithi053.stdout:8/306: rename d10/d1c/c43 to d10/d1c/d2b/c67 0 2024-09-16T00:50:18.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/685: mkdir dc/d10/d17/d5a/db2/d6f/d74/dd2 0 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:7/668: sync 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:0/672: sync 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/686: symlink d1/d59/le0 0 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/687: stat d1/d4e/d48/d26/d30 0 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:7/669: chown d9/d31/d65/d6b/fda 292977987 1 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:0/673: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe1 x:0 0 0 2024-09-16T00:50:18.679 INFO:tasks.workunit.client.1.smithi152.stdout:0/674: write d3/d6/d64/f80 [5053987,116315] 0 2024-09-16T00:50:18.683 INFO:tasks.workunit.client.1.smithi152.stdout:2/665: creat d4/d19/d20/d28/d2c/d77/da5/dcf/fdb x:0 0 0 2024-09-16T00:50:18.686 INFO:tasks.workunit.client.0.smithi053.stdout:6/201: getdents d1/dc/d1e/d41 0 2024-09-16T00:50:18.689 INFO:tasks.workunit.client.0.smithi053.stdout:9/295: dwrite d8/d1c/d2b/f58 [0,4194304] 0 2024-09-16T00:50:18.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/686: rename dc/d10/d47/c6e to dc/d5c/cd3 0 2024-09-16T00:50:18.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/687: chown dc/d10/d17/d1c/d8d/fcd 35211 1 2024-09-16T00:50:18.691 INFO:tasks.workunit.client.0.smithi053.stdout:2/186: rename d6/d9/d14/c22 to d6/d9/dd/d28/c35 0 2024-09-16T00:50:18.693 INFO:tasks.workunit.client.1.smithi152.stdout:7/670: dread d9/d31/d65/fa1 [0,4194304] 0 2024-09-16T00:50:18.693 INFO:tasks.workunit.client.1.smithi152.stdout:7/671: stat d9/d31/d64/d3c/d5b/f60 0 2024-09-16T00:50:18.694 INFO:tasks.workunit.client.0.smithi053.stdout:8/307: mknod d10/d1c/d2b/d58/c68 0 2024-09-16T00:50:18.694 INFO:tasks.workunit.client.0.smithi053.stdout:8/308: chown d10/d1c/d2b/d40 7105485 1 2024-09-16T00:50:18.694 INFO:tasks.workunit.client.0.smithi053.stdout:8/309: chown d10/f19 3988542 1 2024-09-16T00:50:18.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/675: mknod d3/d6/d6d/db7/ce2 0 2024-09-16T00:50:18.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/676: chown d3/d6/d8/d9e/dcb 2039 1 2024-09-16T00:50:18.698 INFO:tasks.workunit.client.0.smithi053.stdout:1/237: symlink d5/d18/d33/d30/l4e 0 2024-09-16T00:50:18.698 INFO:tasks.workunit.client.0.smithi053.stdout:1/238: write d5/d7/d10/f37 [538200,43637] 0 2024-09-16T00:50:18.700 INFO:tasks.workunit.client.1.smithi152.stdout:1/760: rename d9/d3e/d41/c26 to d9/d3e/d41/c11b 0 2024-09-16T00:50:18.700 INFO:tasks.workunit.client.1.smithi152.stdout:1/761: write d9/d3e/fba [2402177,45533] 0 2024-09-16T00:50:18.701 INFO:tasks.workunit.client.1.smithi152.stdout:1/762: fdatasync d9/d3e/d41/d31/d48/d7d/fbb 0 2024-09-16T00:50:18.702 INFO:tasks.workunit.client.0.smithi053.stdout:6/202: unlink d1/dc/f18 0 2024-09-16T00:50:18.702 INFO:tasks.workunit.client.0.smithi053.stdout:6/203: write d1/f9 [5153509,43055] 0 2024-09-16T00:50:18.704 INFO:tasks.workunit.client.1.smithi152.stdout:9/688: dwrite d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:18.705 INFO:tasks.workunit.client.1.smithi152.stdout:3/688: creat dc/d10/d17/d1c/d1f/d24/fd4 x:0 0 0 2024-09-16T00:50:18.705 INFO:tasks.workunit.client.1.smithi152.stdout:3/689: write f5 [1462575,44972] 0 2024-09-16T00:50:18.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/677: dread d3/d6/d8/d1d/d23/d25/f3f [0,4194304] 0 2024-09-16T00:50:18.708 INFO:tasks.workunit.client.0.smithi053.stdout:9/296: dwrite d8/f39 [4194304,4194304] 0 2024-09-16T00:50:18.708 INFO:tasks.workunit.client.0.smithi053.stdout:9/297: creat d8/d1c/f63 x:0 0 0 2024-09-16T00:50:18.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/672: link d9/d31/f67 d9/d31/d64/d3c/db9/dc2/fe1 0 2024-09-16T00:50:18.710 INFO:tasks.workunit.client.0.smithi053.stdout:2/187: symlink d6/d9/dd/d28/l36 0 2024-09-16T00:50:18.712 INFO:tasks.workunit.client.0.smithi053.stdout:1/239: dread d5/d7/d10/f37 [0,4194304] 0 2024-09-16T00:50:18.712 INFO:tasks.workunit.client.0.smithi053.stdout:3/282: sync 2024-09-16T00:50:18.712 INFO:tasks.workunit.client.0.smithi053.stdout:1/240: write d5/d7/d39/f48 [822347,72919] 0 2024-09-16T00:50:18.713 INFO:tasks.workunit.client.0.smithi053.stdout:1/241: write d5/dd/d19/f46 [400940,99744] 0 2024-09-16T00:50:18.718 INFO:tasks.workunit.client.0.smithi053.stdout:6/204: mkdir d1/dc/d3c/d4b 0 2024-09-16T00:50:18.718 INFO:tasks.workunit.client.0.smithi053.stdout:6/205: write d1/dc/d39/f13 [2706904,16684] 0 2024-09-16T00:50:18.719 INFO:tasks.workunit.client.0.smithi053.stdout:2/188: dread d6/f8 [0,4194304] 0 2024-09-16T00:50:18.725 INFO:tasks.workunit.client.0.smithi053.stdout:9/298: creat d8/d4c/d5b/f64 x:0 0 0 2024-09-16T00:50:18.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/678: link d3/d6/d2e/lb9 d3/d6/d8/d1d/d65/d6e/d82/da4/le3 0 2024-09-16T00:50:18.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/679: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe4 x:0 0 0 2024-09-16T00:50:18.727 INFO:tasks.workunit.client.0.smithi053.stdout:3/283: mkdir d1/d5/d16/d5e 0 2024-09-16T00:50:18.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/673: stat d9/l21 0 2024-09-16T00:50:18.730 INFO:tasks.workunit.client.0.smithi053.stdout:8/310: getdents d10/d1c/d49 0 2024-09-16T00:50:18.731 INFO:tasks.workunit.client.1.smithi152.stdout:1/763: read d9/d3e/d41/f4e [1377538,23188] 0 2024-09-16T00:50:18.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/666: rename d4/d19/d20/d28/d2c/d77/da5/dcf/fdb to d4/d19/d20/d28/d2c/fdc 0 2024-09-16T00:50:18.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/689: dwrite d1/d4e/d48/d26/d58/faa [0,4194304] 0 2024-09-16T00:50:18.735 INFO:tasks.workunit.client.1.smithi152.stdout:7/674: read d9/d31/d65/fa1 [856872,90455] 0 2024-09-16T00:50:18.735 INFO:tasks.workunit.client.0.smithi053.stdout:6/206: mknod d1/dc/d39/c4c 0 2024-09-16T00:50:18.736 INFO:tasks.workunit.client.1.smithi152.stdout:1/764: creat d9/d3e/d4b/d50/d115/f11c x:0 0 0 2024-09-16T00:50:18.736 INFO:tasks.workunit.client.1.smithi152.stdout:1/765: chown d9/d3e/d4b/d6b/d6d/ffc 1 1 2024-09-16T00:50:18.737 INFO:tasks.workunit.client.0.smithi053.stdout:3/284: read d1/d5/d11/f25 [3788126,33520] 0 2024-09-16T00:50:18.737 INFO:tasks.workunit.client.0.smithi053.stdout:3/285: chown d1/d5/d31 6300821 1 2024-09-16T00:50:18.737 INFO:tasks.workunit.client.0.smithi053.stdout:2/189: rmdir d6/d29 39 2024-09-16T00:50:18.738 INFO:tasks.workunit.client.1.smithi152.stdout:3/690: rename dc/d10/d17/d1c/d8d/d8e/f94 to dc/d10/d17/d1c/d50/d63/dc4/fd5 0 2024-09-16T00:50:18.738 INFO:tasks.workunit.client.1.smithi152.stdout:0/680: dread d3/d6/d8/d1d/d65/d6e/d82/f91 [0,4194304] 0 2024-09-16T00:50:18.740 INFO:tasks.workunit.client.0.smithi053.stdout:9/299: mknod d8/d19/d51/c65 0 2024-09-16T00:50:18.744 INFO:tasks.workunit.client.1.smithi152.stdout:2/667: symlink d4/d19/d20/d28/d8b/da9/ldd 0 2024-09-16T00:50:18.745 INFO:tasks.workunit.client.0.smithi053.stdout:1/242: link d5/d9/f44 d5/d7/d39/f4f 0 2024-09-16T00:50:18.748 INFO:tasks.workunit.client.0.smithi053.stdout:8/311: symlink d10/d21/d28/l69 0 2024-09-16T00:50:18.749 INFO:tasks.workunit.client.0.smithi053.stdout:8/312: write d10/d21/d28/f31 [1122717,116837] 0 2024-09-16T00:50:18.751 INFO:tasks.workunit.client.0.smithi053.stdout:6/207: link d1/dc/d39/l19 d1/dc/d1e/d41/l4d 0 2024-09-16T00:50:18.753 INFO:tasks.workunit.client.0.smithi053.stdout:3/286: truncate d1/d5/d31/f38 3494217 0 2024-09-16T00:50:18.756 INFO:tasks.workunit.client.0.smithi053.stdout:9/300: rename d8/f27 to d8/d13/f66 0 2024-09-16T00:50:18.756 INFO:tasks.workunit.client.0.smithi053.stdout:9/301: read - d8/d22/d26/f61 zero size 2024-09-16T00:50:18.757 INFO:tasks.workunit.client.0.smithi053.stdout:1/243: mknod d5/d7/d10/c50 0 2024-09-16T00:50:18.758 INFO:tasks.workunit.client.1.smithi152.stdout:9/690: mkdir d1/d4e/d48/d26/d58/de1 0 2024-09-16T00:50:18.759 INFO:tasks.workunit.client.1.smithi152.stdout:9/691: dread - d1/d7/d77/d32/da5/da8/fdd zero size 2024-09-16T00:50:18.759 INFO:tasks.workunit.client.1.smithi152.stdout:9/692: readlink d1/d59/l8e 0 2024-09-16T00:50:18.759 INFO:tasks.workunit.client.0.smithi053.stdout:8/313: getdents d10/d21 0 2024-09-16T00:50:18.759 INFO:tasks.workunit.client.0.smithi053.stdout:8/314: chown d10/f39 0 1 2024-09-16T00:50:18.759 INFO:tasks.workunit.client.0.smithi053.stdout:8/315: write d10/d21/f2c [429861,100208] 0 2024-09-16T00:50:18.760 INFO:tasks.workunit.client.1.smithi152.stdout:7/675: mkdir d9/d31/d65/d8a/d41/d46/d7d/de2 0 2024-09-16T00:50:18.761 INFO:tasks.workunit.client.1.smithi152.stdout:0/681: mkdir d3/d6/d64/de5 0 2024-09-16T00:50:18.762 INFO:tasks.workunit.client.0.smithi053.stdout:9/302: unlink d8/d13/f34 0 2024-09-16T00:50:18.763 INFO:tasks.workunit.client.1.smithi152.stdout:2/668: mknod d4/d19/d20/d28/d2c/d77/cde 0 2024-09-16T00:50:18.764 INFO:tasks.workunit.client.0.smithi053.stdout:1/244: symlink d5/dd/d19/l51 0 2024-09-16T00:50:18.765 INFO:tasks.workunit.client.1.smithi152.stdout:9/693: mkdir d1/de2 0 2024-09-16T00:50:18.765 INFO:tasks.workunit.client.1.smithi152.stdout:9/694: fdatasync d1/d4e/d48/d66/d76/fdb 0 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/691: dwrite dc/d10/d17/d5a/d68/f7c [0,4194304] 0 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/692: dread - dc/d10/d17/d5a/db2/d6f/dbb/fad zero size 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/693: truncate dc/d10/fa2 800105 0 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/694: stat dc/d10/d17/d1c/d1f/l45 0 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/695: chown dc/d10/d17/d5a/db2/d6f/d74/db5 13 1 2024-09-16T00:50:18.766 INFO:tasks.workunit.client.1.smithi152.stdout:1/766: dwrite d9/d3e/fba [0,4194304] 0 2024-09-16T00:50:18.767 INFO:tasks.workunit.client.0.smithi053.stdout:8/316: mkdir d10/d21/d28/d3c/d63/d6a 0 2024-09-16T00:50:18.767 INFO:tasks.workunit.client.0.smithi053.stdout:8/317: chown d10/d1c/c60 0 1 2024-09-16T00:50:18.767 INFO:tasks.workunit.client.1.smithi152.stdout:7/676: mknod d9/d31/dc4/ce3 0 2024-09-16T00:50:18.767 INFO:tasks.workunit.client.1.smithi152.stdout:7/677: write d9/d31/d65/d8a/d41/d46/d7d/fb2 [758225,33668] 0 2024-09-16T00:50:18.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/682: mknod d3/d6/d64/d6a/d61/ce6 0 2024-09-16T00:50:18.769 INFO:tasks.workunit.client.1.smithi152.stdout:0/683: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe7 x:0 0 0 2024-09-16T00:50:18.769 INFO:tasks.workunit.client.1.smithi152.stdout:0/684: chown d3/d6/d64/d6a/fd7 21425992 1 2024-09-16T00:50:18.769 INFO:tasks.workunit.client.1.smithi152.stdout:0/685: chown d3/d6/d8/d1d/d65/d6e/d82/fd2 33691 1 2024-09-16T00:50:18.771 INFO:tasks.workunit.client.1.smithi152.stdout:9/695: creat d1/d7/d77/d3c/dc9/fe3 x:0 0 0 2024-09-16T00:50:18.771 INFO:tasks.workunit.client.1.smithi152.stdout:9/696: fdatasync d1/d4e/d48/d2b/d93/d96/fab 0 2024-09-16T00:50:18.775 INFO:tasks.workunit.client.0.smithi053.stdout:9/303: mknod d8/d19/d31/c67 0 2024-09-16T00:50:18.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/696: creat dc/d10/d17/d1c/d1f/d9e/fd6 x:0 0 0 2024-09-16T00:50:18.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/697: chown dc/d10/fa2 1851640 1 2024-09-16T00:50:18.778 INFO:tasks.workunit.client.0.smithi053.stdout:3/287: dwrite d1/d5/d14/f2d [0,4194304] 0 2024-09-16T00:50:18.778 INFO:tasks.workunit.client.0.smithi053.stdout:2/190: dwrite d6/d9/dd/f16 [0,4194304] 0 2024-09-16T00:50:18.778 INFO:tasks.workunit.client.0.smithi053.stdout:3/288: write d1/d5/d11/f55 [594476,28710] 0 2024-09-16T00:50:18.778 INFO:tasks.workunit.client.0.smithi053.stdout:2/191: write d6/f7 [4637281,3567] 0 2024-09-16T00:50:18.779 INFO:tasks.workunit.client.1.smithi152.stdout:2/669: dread d4/d44/d7a/f8a [0,4194304] 0 2024-09-16T00:50:18.779 INFO:tasks.workunit.client.0.smithi053.stdout:9/304: creat d8/d22/d26/f68 x:0 0 0 2024-09-16T00:50:18.779 INFO:tasks.workunit.client.0.smithi053.stdout:9/305: dread - d8/d1c/d2b/d2c/f48 zero size 2024-09-16T00:50:18.780 INFO:tasks.workunit.client.0.smithi053.stdout:1/245: dread d5/d7/d39/f48 [0,4194304] 0 2024-09-16T00:50:18.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/678: dread d9/d31/d64/d3c/db9/dc2/fcd [0,4194304] 0 2024-09-16T00:50:18.781 INFO:tasks.workunit.client.1.smithi152.stdout:1/767: write d9/d3e/d41/f87 [3408023,299] 0 2024-09-16T00:50:18.789 INFO:tasks.workunit.client.1.smithi152.stdout:0/686: mknod d3/d6/d2e/ce8 0 2024-09-16T00:50:18.791 INFO:tasks.workunit.client.0.smithi053.stdout:8/318: dwrite d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:18.792 INFO:tasks.workunit.client.1.smithi152.stdout:3/698: creat dc/d10/d17/d5a/fd7 x:0 0 0 2024-09-16T00:50:18.794 INFO:tasks.workunit.client.1.smithi152.stdout:9/697: dwrite d1/f8b [0,4194304] 0 2024-09-16T00:50:18.795 INFO:tasks.workunit.client.1.smithi152.stdout:2/670: creat d4/d44/d7a/dc7/fdf x:0 0 0 2024-09-16T00:50:18.795 INFO:tasks.workunit.client.1.smithi152.stdout:2/671: chown d4/d44/d7a/d9e/d87/d9c/dd9 76 1 2024-09-16T00:50:18.796 INFO:tasks.workunit.client.0.smithi053.stdout:6/208: rmdir d1/dc 39 2024-09-16T00:50:18.796 INFO:tasks.workunit.client.0.smithi053.stdout:6/209: getdents d1/dc/d3c/d4a 0 2024-09-16T00:50:18.799 INFO:tasks.workunit.client.1.smithi152.stdout:7/679: stat d9/d31/d65/d4b/l74 0 2024-09-16T00:50:18.799 INFO:tasks.workunit.client.0.smithi053.stdout:8/319: dread d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:18.802 INFO:tasks.workunit.client.1.smithi152.stdout:0/687: write d3/d6/d64/f80 [155783,24392] 0 2024-09-16T00:50:18.802 INFO:tasks.workunit.client.1.smithi152.stdout:0/688: dread - d3/d6/d8/fca zero size 2024-09-16T00:50:18.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/246: dwrite d5/dd/d19/f34 [0,4194304] 0 2024-09-16T00:50:18.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/247: truncate d5/d7/d10/f3a 396625 0 2024-09-16T00:50:18.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/248: chown d5/lb 1786943901 1 2024-09-16T00:50:18.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/249: creat d5/d7/f52 x:0 0 0 2024-09-16T00:50:18.803 INFO:tasks.workunit.client.1.smithi152.stdout:1/768: mknod d9/d3e/d4b/d6b/d6d/d82/c11d 0 2024-09-16T00:50:18.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/699: rename dc/d10/d17/d5a/db2/d6f/d74/db5/l4c to dc/d10/d17/d1c/d50/ld8 0 2024-09-16T00:50:18.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/700: chown dc/d10/f31 78119 1 2024-09-16T00:50:18.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/701: stat dc/d10/d17/d5a/d68/f9b 0 2024-09-16T00:50:18.812 INFO:tasks.workunit.client.1.smithi152.stdout:9/698: dwrite d1/d7/d77/d32/f35 [0,4194304] 0 2024-09-16T00:50:18.818 INFO:tasks.workunit.client.1.smithi152.stdout:2/672: creat d4/d19/d20/d34/fe0 x:0 0 0 2024-09-16T00:50:18.819 INFO:tasks.workunit.client.0.smithi053.stdout:3/289: mkdir d1/d5/d16/d47/d4c/d5f 0 2024-09-16T00:50:18.819 INFO:tasks.workunit.client.0.smithi053.stdout:3/290: chown d1/d5/d14/l32 241989547 1 2024-09-16T00:50:18.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/680: creat d9/db6/fe4 x:0 0 0 2024-09-16T00:50:18.821 INFO:tasks.workunit.client.1.smithi152.stdout:0/689: dwrite d3/d6/d64/f95 [0,4194304] 0 2024-09-16T00:50:18.822 INFO:tasks.workunit.client.1.smithi152.stdout:1/769: rename d9/d3e/d41/d31/d48/d7d/fae to d9/d3e/d4b/f11e 0 2024-09-16T00:50:18.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/699: truncate d1/d7/d13/f27 1564605 0 2024-09-16T00:50:18.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/700: fdatasync d1/d7/d77/d32/f49 0 2024-09-16T00:50:18.826 INFO:tasks.workunit.client.0.smithi053.stdout:2/192: rmdir d6/d9/dd/d28/d30 0 2024-09-16T00:50:18.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/673: unlink d4/d17/d3e/f89 0 2024-09-16T00:50:18.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/674: write d4/d17/f33 [3882986,66211] 0 2024-09-16T00:50:18.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/675: dread - d4/d17/f62 zero size 2024-09-16T00:50:18.830 INFO:tasks.workunit.client.0.smithi053.stdout:9/306: symlink d8/d1c/d2b/l69 0 2024-09-16T00:50:18.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/681: rename d9/d31/d64/d3c/d5b/l95 to d9/d31/d65/d8a/d41/d46/d7d/d86/d97/le5 0 2024-09-16T00:50:18.833 INFO:tasks.workunit.client.1.smithi152.stdout:3/702: dwrite dc/d10/d17/f37 [4194304,4194304] 0 2024-09-16T00:50:18.834 INFO:tasks.workunit.client.1.smithi152.stdout:3/703: fdatasync dc/fbd 0 2024-09-16T00:50:18.834 INFO:tasks.workunit.client.1.smithi152.stdout:3/704: chown dc/d10/d17/d5a/d68 45683227 1 2024-09-16T00:50:18.835 INFO:tasks.workunit.client.1.smithi152.stdout:0/690: dread d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad [0,4194304] 0 2024-09-16T00:50:18.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/770: unlink d9/d3e/f96 0 2024-09-16T00:50:18.835 INFO:tasks.workunit.client.1.smithi152.stdout:0/691: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe7 [55903,69768] 0 2024-09-16T00:50:18.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/771: creat d9/da/df/dcb/df2/f11f x:0 0 0 2024-09-16T00:50:18.837 INFO:tasks.workunit.client.1.smithi152.stdout:1/772: dread d9/d3e/d41/d31/d48/db2/fda [0,4194304] 0 2024-09-16T00:50:18.838 INFO:tasks.workunit.client.1.smithi152.stdout:9/701: dread d1/d4e/d48/d26/d30/f3f [0,4194304] 0 2024-09-16T00:50:18.838 INFO:tasks.workunit.client.0.smithi053.stdout:6/210: mknod d1/dc/d43/c4e 0 2024-09-16T00:50:18.838 INFO:tasks.workunit.client.0.smithi053.stdout:6/211: chown d1/dc/d39/f13 942418 1 2024-09-16T00:50:18.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/682: unlink d9/d31/d64/d3c/ld1 0 2024-09-16T00:50:18.839 INFO:tasks.workunit.client.0.smithi053.stdout:8/320: mknod d10/d21/d28/d3c/d61/c6b 0 2024-09-16T00:50:18.842 INFO:tasks.workunit.client.1.smithi152.stdout:2/676: dread d4/f16 [0,4194304] 0 2024-09-16T00:50:18.842 INFO:tasks.workunit.client.1.smithi152.stdout:2/677: write d4/d19/d20/d28/d2c/d77/da5/dcf/fd4 [692339,108879] 0 2024-09-16T00:50:18.842 INFO:tasks.workunit.client.1.smithi152.stdout:2/678: read d4/d19/f27 [2020457,115320] 0 2024-09-16T00:50:18.847 INFO:tasks.workunit.client.1.smithi152.stdout:3/705: rename dc/d10/d17/d1c/d8d/c9c to dc/d5c/dae/cd9 0 2024-09-16T00:50:18.848 INFO:tasks.workunit.client.0.smithi053.stdout:6/212: write d1/f2b [4152810,75956] 0 2024-09-16T00:50:18.848 INFO:tasks.workunit.client.0.smithi053.stdout:6/213: dread - d1/dc/d3d/f40 zero size 2024-09-16T00:50:18.850 INFO:tasks.workunit.client.1.smithi152.stdout:0/692: dwrite d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fdf [0,4194304] 0 2024-09-16T00:50:18.852 INFO:tasks.workunit.client.1.smithi152.stdout:9/702: creat d1/d7/dca/fe4 x:0 0 0 2024-09-16T00:50:18.853 INFO:tasks.workunit.client.1.smithi152.stdout:7/683: truncate d9/d31/d65/fa1 2422651 0 2024-09-16T00:50:18.855 INFO:tasks.workunit.client.1.smithi152.stdout:3/706: mknod dc/d10/d17/d1c/cda 0 2024-09-16T00:50:18.856 INFO:tasks.workunit.client.0.smithi053.stdout:7/285: sync 2024-09-16T00:50:18.857 INFO:tasks.workunit.client.0.smithi053.stdout:3/291: mknod d1/d5/d16/d47/c60 0 2024-09-16T00:50:18.857 INFO:tasks.workunit.client.0.smithi053.stdout:3/292: truncate d1/d5/d31/f39 744971 0 2024-09-16T00:50:18.857 INFO:tasks.workunit.client.0.smithi053.stdout:3/293: truncate d1/d5/f2f 872827 0 2024-09-16T00:50:18.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/773: symlink d9/da/df/l120 0 2024-09-16T00:50:18.861 INFO:tasks.workunit.client.0.smithi053.stdout:2/193: creat d6/d9/d14/f37 x:0 0 0 2024-09-16T00:50:18.861 INFO:tasks.workunit.client.0.smithi053.stdout:2/194: rename d6 to d6/d29/d2b/d38 22 2024-09-16T00:50:18.863 INFO:tasks.workunit.client.0.smithi053.stdout:4/204: sync 2024-09-16T00:50:18.864 INFO:tasks.workunit.client.0.smithi053.stdout:9/307: link d8/d19/d31/f50 d8/d4c/d5a/f6a 0 2024-09-16T00:50:18.865 INFO:tasks.workunit.client.0.smithi053.stdout:9/308: read d8/d1c/f33 [32833,38270] 0 2024-09-16T00:50:18.866 INFO:tasks.workunit.client.0.smithi053.stdout:9/309: readlink d8/d13/l53 0 2024-09-16T00:50:18.866 INFO:tasks.workunit.client.0.smithi053.stdout:9/310: write d8/d1c/d2b/d2c/f48 [381174,62939] 0 2024-09-16T00:50:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.865+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f618419a940 con 0x7f616c06d630 2024-09-16T00:50:18.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.866+0000 7f61817fa700 1 -- 172.21.15.53:0/4112801632 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f618419a940 con 0x7f616c06d630 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "1/23 daemons upgraded", 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "", 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:50:18.868 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:50:18.869 INFO:tasks.workunit.client.0.smithi053.stdout:8/321: mknod d10/d4a/c6c 0 2024-09-16T00:50:18.871 INFO:tasks.workunit.client.0.smithi053.stdout:6/214: creat d1/f4f x:0 0 0 2024-09-16T00:50:18.871 INFO:tasks.workunit.client.0.smithi053.stdout:6/215: write d1/dc/d39/f16 [2527344,80029] 0 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 msgr2=0x7f616c06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 0x7f616c06fae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6174009bf0 tx=0x7f6174009260 comp rx=0 tx=0).stop 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 msgr2=0x7f6184198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6178000c00 tx=0x7f617800f740 comp rx=0 tx=0).stop 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 shutdown_connections 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f616c06d630 0x7f616c06fae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840ff130 0x7f6184069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 --2- 172.21.15.53:0/4112801632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61841003d0 0x7f6184198550 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 >> 172.21.15.53:0/4112801632 conn(0x7f61840fa780 msgr2=0x7f6184103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 shutdown_connections 2024-09-16T00:50:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:18.870+0000 7f616affd700 1 -- 172.21.15.53:0/4112801632 wait complete. 2024-09-16T00:50:18.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/693: mkdir d3/d6/d2e/de9 0 2024-09-16T00:50:18.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/694: truncate d3/d6/d8/d1d/d23/d25/f4d 1049833 0 2024-09-16T00:50:18.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/684: dwrite d9/d31/d65/d4b/f66 [4194304,4194304] 0 2024-09-16T00:50:18.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/685: truncate d9/d31/d64/f8e 207588 0 2024-09-16T00:50:18.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/686: fsync d9/d31/d64/d3c/d5b/f7a 0 2024-09-16T00:50:18.875 INFO:tasks.workunit.client.0.smithi053.stdout:1/250: getdents d5 0 2024-09-16T00:50:18.875 INFO:tasks.workunit.client.0.smithi053.stdout:1/251: chown d5/dd/d19/f46 451091292 1 2024-09-16T00:50:18.876 INFO:tasks.workunit.client.0.smithi053.stdout:1/252: dread - d5/d9/f44 zero size 2024-09-16T00:50:18.876 INFO:tasks.workunit.client.0.smithi053.stdout:7/286: rmdir d1/d60 39 2024-09-16T00:50:18.876 INFO:tasks.workunit.client.0.smithi053.stdout:7/287: chown d1/d2a/d4f/f53 0 1 2024-09-16T00:50:18.877 INFO:tasks.workunit.client.0.smithi053.stdout:3/294: mknod d1/d5/d11/c61 0 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:2/195: mkdir d6/d29/d2b/d39 0 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:2/196: chown d6/d9/dd/d28 1 1 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:2/197: stat d6/d9/f1e 0 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:2/198: chown d6/d9/dd/f1a 4 1 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:5/211: sync 2024-09-16T00:50:18.882 INFO:tasks.workunit.client.0.smithi053.stdout:0/303: sync 2024-09-16T00:50:18.883 INFO:tasks.workunit.client.0.smithi053.stdout:0/304: chown d4/d13/d2d 106 1 2024-09-16T00:50:18.883 INFO:tasks.workunit.client.0.smithi053.stdout:9/311: dread f4 [4194304,4194304] 0 2024-09-16T00:50:18.883 INFO:tasks.workunit.client.1.smithi152.stdout:9/703: rmdir d1/d4e/d48/d2b/d7c 39 2024-09-16T00:50:18.883 INFO:tasks.workunit.client.1.smithi152.stdout:9/704: chown d1/d4e/d48/c56 6 1 2024-09-16T00:50:18.884 INFO:tasks.workunit.client.1.smithi152.stdout:9/705: chown d1/d4e/d48/d26/d30/f3f 13798593 1 2024-09-16T00:50:18.885 INFO:tasks.workunit.client.0.smithi053.stdout:4/205: symlink d0/d2/dd/d25/d37/l47 0 2024-09-16T00:50:18.887 INFO:tasks.workunit.client.1.smithi152.stdout:3/707: symlink dc/d10/d17/d5a/ldb 0 2024-09-16T00:50:18.888 INFO:tasks.workunit.client.0.smithi053.stdout:0/305: dread d4/d13/d2d/f60 [0,4194304] 0 2024-09-16T00:50:18.888 INFO:tasks.workunit.client.0.smithi053.stdout:0/306: creat d4/dc/d1e/d22/f65 x:0 0 0 2024-09-16T00:50:18.888 INFO:tasks.workunit.client.0.smithi053.stdout:0/307: dread - d4/dc/d25/f5f zero size 2024-09-16T00:50:18.889 INFO:tasks.workunit.client.1.smithi152.stdout:1/774: mknod d9/d3e/d4b/db7/dc4/d10c/c121 0 2024-09-16T00:50:18.889 INFO:tasks.workunit.client.1.smithi152.stdout:1/775: fdatasync d9/d3e/d41/d31/d48/d7d/fcf 0 2024-09-16T00:50:18.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/216: unlink d1/dc/d39/f16 0 2024-09-16T00:50:18.892 INFO:tasks.workunit.client.0.smithi053.stdout:8/322: dwrite d10/f20 [4194304,4194304] 0 2024-09-16T00:50:18.892 INFO:tasks.workunit.client.0.smithi053.stdout:8/323: getdents d10/d21 0 2024-09-16T00:50:18.893 INFO:tasks.workunit.client.1.smithi152.stdout:7/687: mkdir d9/d31/d64/d3c/db9/dd3/de6 0 2024-09-16T00:50:18.894 INFO:tasks.workunit.client.0.smithi053.stdout:7/288: mknod d1/d2a/d4f/c66 0 2024-09-16T00:50:18.898 INFO:tasks.workunit.client.1.smithi152.stdout:9/706: unlink d1/l3b 0 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/720: sync 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/721: getdents db/d12/d23/d4a/dc5/dd0 0 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/722: truncate db/da8/db7/fd2 421548 0 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:5/852: sync 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/784: sync 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/533: sync 2024-09-16T00:50:18.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/534: readlink dd/d23/l64 0 2024-09-16T00:50:18.901 INFO:tasks.workunit.client.0.smithi053.stdout:2/199: rename d6/d9/dd/f16 to d6/d9/dd/f3a 0 2024-09-16T00:50:18.903 INFO:tasks.workunit.client.0.smithi053.stdout:5/212: truncate d3/d7/d24/f28 922733 0 2024-09-16T00:50:18.904 INFO:tasks.workunit.client.0.smithi053.stdout:3/295: dwrite d1/d5/d11/f46 [0,4194304] 0 2024-09-16T00:50:18.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/708: mknod dc/d10/d17/d1c/d8d/d8e/d2f/d75/cdc 0 2024-09-16T00:50:18.908 INFO:tasks.workunit.client.0.smithi053.stdout:9/312: link d8/d1c/d2b/d2c/f60 d8/d1c/d2b/d49/f6b 0 2024-09-16T00:50:18.908 INFO:tasks.workunit.client.0.smithi053.stdout:9/313: truncate d8/d19/f4a 73287 0 2024-09-16T00:50:18.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/200: dread d6/f2c [0,4194304] 0 2024-09-16T00:50:18.911 INFO:tasks.workunit.client.1.smithi152.stdout:9/707: unlink d1/d4e/d48/d26/d92/fda 0 2024-09-16T00:50:18.911 INFO:tasks.workunit.client.1.smithi152.stdout:9/708: chown d1/d4e/d48/d66/d76/fdb 3 1 2024-09-16T00:50:18.912 INFO:tasks.workunit.client.0.smithi053.stdout:4/206: mkdir d0/d3c/d48 0 2024-09-16T00:50:18.912 INFO:tasks.workunit.client.0.smithi053.stdout:4/207: fdatasync d0/d2/dd/d25/f21 0 2024-09-16T00:50:18.914 INFO:tasks.workunit.client.0.smithi053.stdout:6/217: dwrite d1/dc/d39/f34 [0,4194304] 0 2024-09-16T00:50:18.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/723: truncate db/d12/f44 3755562 0 2024-09-16T00:50:18.916 INFO:tasks.workunit.client.0.smithi053.stdout:9/314: dread d8/d13/f66 [0,4194304] 0 2024-09-16T00:50:18.918 INFO:tasks.workunit.client.1.smithi152.stdout:6/724: dread f9 [0,4194304] 0 2024-09-16T00:50:18.918 INFO:tasks.workunit.client.1.smithi152.stdout:6/725: creat db/d12/fe5 x:0 0 0 2024-09-16T00:50:18.920 INFO:tasks.workunit.client.0.smithi053.stdout:2/201: dread f5 [0,4194304] 0 2024-09-16T00:50:18.921 INFO:tasks.workunit.client.0.smithi053.stdout:2/202: write d6/f8 [3631987,1802] 0 2024-09-16T00:50:18.921 INFO:tasks.workunit.client.0.smithi053.stdout:8/324: dwrite d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:18.921 INFO:tasks.workunit.client.0.smithi053.stdout:8/325: getdents d10/d1c/d49 0 2024-09-16T00:50:18.922 INFO:tasks.workunit.client.1.smithi152.stdout:5/853: rename d6/f44 to d6/d57/d2b/d50/d64/df5/d10a/f139 0 2024-09-16T00:50:18.922 INFO:tasks.workunit.client.0.smithi053.stdout:2/203: read d6/d9/f25 [225968,108424] 0 2024-09-16T00:50:18.923 INFO:tasks.workunit.client.0.smithi053.stdout:8/326: dread d10/d21/f33 [0,4194304] 0 2024-09-16T00:50:18.923 INFO:tasks.workunit.client.0.smithi053.stdout:0/308: link d4/d13/l31 d4/d13/d2d/l66 0 2024-09-16T00:50:18.923 INFO:tasks.workunit.client.0.smithi053.stdout:0/309: creat d4/dc/d25/d34/d2a/f67 x:0 0 0 2024-09-16T00:50:18.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/709: dread d1/d4e/d34/f39 [0,4194304] 0 2024-09-16T00:50:18.925 INFO:tasks.workunit.client.0.smithi053.stdout:2/204: dread d6/d29/f2a [0,4194304] 0 2024-09-16T00:50:18.925 INFO:tasks.workunit.client.0.smithi053.stdout:2/205: chown d6/d9/c20 2442045 1 2024-09-16T00:50:18.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/785: mkdir d2/db/d39/d95/d102 0 2024-09-16T00:50:18.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/786: write d2/db/f1d [3593110,15147] 0 2024-09-16T00:50:18.930 INFO:tasks.workunit.client.0.smithi053.stdout:1/253: link d5/d9/f40 d5/d18/d33/f53 0 2024-09-16T00:50:18.932 INFO:tasks.workunit.client.1.smithi152.stdout:3/709: mknod dc/d10/d17/d1c/d1f/d24/cdd 0 2024-09-16T00:50:18.932 INFO:tasks.workunit.client.1.smithi152.stdout:3/710: truncate dc/d10/d17/d5a/db2/d6f/dbb/f98 13371794 0 2024-09-16T00:50:18.933 INFO:tasks.workunit.client.0.smithi053.stdout:7/289: rename d1/d35/d14/d15/c58 to d1/d35/d4a/c67 0 2024-09-16T00:50:18.936 INFO:tasks.workunit.client.0.smithi053.stdout:8/327: dwrite d10/f39 [0,4194304] 0 2024-09-16T00:50:18.936 INFO:tasks.workunit.client.0.smithi053.stdout:5/213: unlink d3/d7/d24/c36 0 2024-09-16T00:50:18.939 INFO:tasks.workunit.client.0.smithi053.stdout:4/208: symlink d0/d2/dd/d25/d37/l49 0 2024-09-16T00:50:18.948 INFO:tasks.workunit.client.0.smithi053.stdout:6/218: mknod d1/dc/d3d/c50 0 2024-09-16T00:50:18.953 INFO:tasks.workunit.client.0.smithi053.stdout:5/214: dwrite d3/d7/d12/f19 [0,4194304] 0 2024-09-16T00:50:18.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/688: getdents d9/d31/d64/d3c 0 2024-09-16T00:50:18.959 INFO:tasks.workunit.client.0.smithi053.stdout:0/310: mkdir d4/d5a/d68 0 2024-09-16T00:50:18.959 INFO:tasks.workunit.client.0.smithi053.stdout:0/311: fsync d4/dc/d25/f5f 0 2024-09-16T00:50:18.962 INFO:tasks.workunit.client.0.smithi053.stdout:2/206: rename d6/d29/f2a to d6/d29/f3b 0 2024-09-16T00:50:18.962 INFO:tasks.workunit.client.0.smithi053.stdout:2/207: write d6/f18 [25626,14504] 0 2024-09-16T00:50:18.964 INFO:tasks.workunit.client.1.smithi152.stdout:6/726: creat db/d12/d23/d4a/d43/d59/fe6 x:0 0 0 2024-09-16T00:50:18.964 INFO:tasks.workunit.client.1.smithi152.stdout:6/727: truncate f2 2894182 0 2024-09-16T00:50:18.965 INFO:tasks.workunit.client.0.smithi053.stdout:2/208: write d6/f2c [2567288,20378] 0 2024-09-16T00:50:18.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/854: mknod d6/d57/d2b/d50/d64/d92/c13a 0 2024-09-16T00:50:18.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/855: fdatasync d6/d16/d1f/d8c/db8/fdd 0 2024-09-16T00:50:18.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/856: stat d6/d57/d2b/dee/d135 0 2024-09-16T00:50:18.967 INFO:tasks.workunit.client.0.smithi053.stdout:3/296: rename d1/d5/d59 to d1/d5/d31/d42/d62 0 2024-09-16T00:50:18.967 INFO:tasks.workunit.client.0.smithi053.stdout:3/297: readlink d1/d5/d11/d3a/l48 0 2024-09-16T00:50:18.969 INFO:tasks.workunit.client.0.smithi053.stdout:7/290: truncate d1/d35/d14/f38 545185 0 2024-09-16T00:50:18.971 INFO:tasks.workunit.client.1.smithi152.stdout:4/787: creat d2/d41/df1/f103 x:0 0 0 2024-09-16T00:50:18.973 INFO:tasks.workunit.client.1.smithi152.stdout:8/535: rmdir dd/d23 39 2024-09-16T00:50:18.976 INFO:tasks.workunit.client.1.smithi152.stdout:3/711: symlink dc/d10/d17/d1c/d1f/d8a/lde 0 2024-09-16T00:50:18.977 INFO:tasks.workunit.client.0.smithi053.stdout:3/298: read d1/d5/d11/f46 [697099,97355] 0 2024-09-16T00:50:18.977 INFO:tasks.workunit.client.0.smithi053.stdout:8/328: creat d10/d1c/d2b/d40/f6d x:0 0 0 2024-09-16T00:50:18.980 INFO:tasks.workunit.client.1.smithi152.stdout:3/712: dread dc/d10/d17/d5a/db2/f57 [0,4194304] 0 2024-09-16T00:50:18.980 INFO:tasks.workunit.client.0.smithi053.stdout:4/209: creat d0/da/f4a x:0 0 0 2024-09-16T00:50:18.980 INFO:tasks.workunit.client.0.smithi053.stdout:4/210: write d0/d2/dd/d25/f24 [4314582,20483] 0 2024-09-16T00:50:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/788: dread d2/db/d39/d95/f96 [0,4194304] 0 2024-09-16T00:50:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/789: fsync d2/db/d39/d95/f96 0 2024-09-16T00:50:18.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/790: fdatasync d2/db/f66 0 2024-09-16T00:50:18.985 INFO:tasks.workunit.client.1.smithi152.stdout:7/689: getdents d9/d31/d65/d8a/d41 0 2024-09-16T00:50:18.985 INFO:tasks.workunit.client.1.smithi152.stdout:7/690: dread - d9/d31/d64/d3c/d5b/fdb zero size 2024-09-16T00:50:18.985 INFO:tasks.workunit.client.1.smithi152.stdout:7/691: stat d9/d31/d65/d8a/d41/d46/d7d/d86/d97 0 2024-09-16T00:50:18.987 INFO:tasks.workunit.client.0.smithi053.stdout:4/211: write d0/d2/f1b [2249983,45071] 0 2024-09-16T00:50:18.989 INFO:tasks.workunit.client.1.smithi152.stdout:5/857: mkdir d6/d16/d1f/d6c/d125/d13b 0 2024-09-16T00:50:18.990 INFO:tasks.workunit.client.0.smithi053.stdout:6/219: dread d1/f15 [0,4194304] 0 2024-09-16T00:50:18.992 INFO:tasks.workunit.client.1.smithi152.stdout:4/791: dread d2/db/f1d [0,4194304] 0 2024-09-16T00:50:18.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/710: rename d1/d4e/d48/d2b/d93/d96/fb5 to d1/de2/fe5 0 2024-09-16T00:50:18.994 INFO:tasks.workunit.client.0.smithi053.stdout:9/315: rmdir d8/d22 39 2024-09-16T00:50:19.004 INFO:tasks.workunit.client.0.smithi053.stdout:5/215: symlink d3/d7/d2b/d37/l49 0 2024-09-16T00:50:19.004 INFO:tasks.workunit.client.0.smithi053.stdout:5/216: readlink d3/d7/d24/l31 0 2024-09-16T00:50:19.004 INFO:tasks.workunit.client.0.smithi053.stdout:5/217: write d3/d7/d12/f14 [784674,129965] 0 2024-09-16T00:50:19.006 INFO:tasks.workunit.client.0.smithi053.stdout:0/312: creat d4/f69 x:0 0 0 2024-09-16T00:50:19.006 INFO:tasks.workunit.client.0.smithi053.stdout:0/313: fsync d4/f17 0 2024-09-16T00:50:19.006 INFO:tasks.workunit.client.0.smithi053.stdout:0/314: chown d4/dc/d1e/d1f/d40/f62 75879 1 2024-09-16T00:50:19.007 INFO:tasks.workunit.client.0.smithi053.stdout:0/315: write d4/dc/d25/f3f [231459,80164] 0 2024-09-16T00:50:19.009 INFO:tasks.workunit.client.0.smithi053.stdout:1/254: rmdir d5/d9/d21 39 2024-09-16T00:50:19.011 INFO:tasks.workunit.client.0.smithi053.stdout:2/209: truncate d6/f23 1387593 0 2024-09-16T00:50:19.011 INFO:tasks.workunit.client.0.smithi053.stdout:2/210: write d6/d9/dd/f31 [453504,112385] 0 2024-09-16T00:50:19.011 INFO:tasks.workunit.client.0.smithi053.stdout:2/211: write d6/d9/f1e [4484786,104906] 0 2024-09-16T00:50:19.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/536: link c4 dd/d98/cb0 0 2024-09-16T00:50:19.017 INFO:tasks.workunit.client.0.smithi053.stdout:7/291: creat d1/d35/d4a/f68 x:0 0 0 2024-09-16T00:50:19.017 INFO:tasks.workunit.client.1.smithi152.stdout:5/858: dwrite d6/d57/d54/fde [0,4194304] 0 2024-09-16T00:50:19.017 INFO:tasks.workunit.client.1.smithi152.stdout:5/859: chown d6/d16/d10d/f119 0 1 2024-09-16T00:50:19.020 INFO:tasks.workunit.client.1.smithi152.stdout:3/713: symlink dc/d5c/dae/ldf 0 2024-09-16T00:50:19.023 INFO:tasks.workunit.client.0.smithi053.stdout:3/299: rename d1/d5/d14/f3c to d1/d5/d16/d5e/f63 0 2024-09-16T00:50:19.023 INFO:tasks.workunit.client.0.smithi053.stdout:3/300: readlink d1/d5/la 0 2024-09-16T00:50:19.023 INFO:tasks.workunit.client.0.smithi053.stdout:4/212: dwrite d0/d2/d26/f2c [0,4194304] 0 2024-09-16T00:50:19.023 INFO:tasks.workunit.client.0.smithi053.stdout:4/213: write d0/d2/d26/f2b [510306,72227] 0 2024-09-16T00:50:19.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/692: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/de7 0 2024-09-16T00:50:19.028 INFO:tasks.workunit.client.0.smithi053.stdout:8/329: creat d10/d21/d28/d3c/d63/f6e x:0 0 0 2024-09-16T00:50:19.034 INFO:tasks.workunit.client.1.smithi152.stdout:4/792: mknod d2/d41/df1/c104 0 2024-09-16T00:50:19.034 INFO:tasks.workunit.client.1.smithi152.stdout:5/860: dread d6/f32 [0,4194304] 0 2024-09-16T00:50:19.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/728: rename db/d12/d20/d4b to db/d12/d23/d4a/d43/d48/d64/dab/de7 0 2024-09-16T00:50:19.036 INFO:tasks.workunit.client.1.smithi152.stdout:0/695: sync 2024-09-16T00:50:19.036 INFO:tasks.workunit.client.1.smithi152.stdout:2/679: sync 2024-09-16T00:50:19.036 INFO:tasks.workunit.client.1.smithi152.stdout:1/776: sync 2024-09-16T00:50:19.037 INFO:tasks.workunit.client.0.smithi053.stdout:5/218: mknod d3/d7/c4a 0 2024-09-16T00:50:19.038 INFO:tasks.workunit.client.1.smithi152.stdout:9/711: creat d1/d4e/d34/fe6 x:0 0 0 2024-09-16T00:50:19.039 INFO:tasks.workunit.client.0.smithi053.stdout:2/212: dwrite d6/d9/dd/f1a [0,4194304] 0 2024-09-16T00:50:19.040 INFO:tasks.workunit.client.0.smithi053.stdout:0/316: mknod d4/dc/d1e/c6a 0 2024-09-16T00:50:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/714: symlink dc/d10/d17/d1c/d1f/d9e/le0 0 2024-09-16T00:50:19.041 INFO:tasks.workunit.client.0.smithi053.stdout:1/255: symlink d5/d7/d10/l54 0 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:1/256: creat d5/d7/d39/f55 x:0 0 0 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:1/257: chown d5/d18/d1f/l36 16947772 1 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:1/258: chown d5/d18/d33/d30 394 1 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:1/259: chown d5/d7/d10/l1c 13609 1 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:2/213: dread d6/d9/f12 [4194304,4194304] 0 2024-09-16T00:50:19.042 INFO:tasks.workunit.client.0.smithi053.stdout:2/214: fsync d6/d9/dd/f1a 0 2024-09-16T00:50:19.047 INFO:tasks.workunit.client.1.smithi152.stdout:7/693: unlink d9/d31/d65/f7b 0 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 -- 172.21.15.53:0/822041109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900fe8c0 msgr2=0x7f64900fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 --2- 172.21.15.53:0/822041109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900fe8c0 0x7f64900fecd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f648000aa20 tx=0x7f648000ad30 comp rx=0 tx=0).stop 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 -- 172.21.15.53:0/822041109 shutdown_connections 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 --2- 172.21.15.53:0/822041109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900ffb60 0x7f64900fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 --2- 172.21.15.53:0/822041109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900fe8c0 0x7f64900fecd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 -- 172.21.15.53:0/822041109 >> 172.21.15.53:0/822041109 conn(0x7f64900f9f10 msgr2=0x7f64900fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:19.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/793: rmdir d2/db/d39/d3c/d7f/d8b 39 2024-09-16T00:50:19.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/794: fdatasync d2/db/d39/d3c/d76/db4/fc3 0 2024-09-16T00:50:19.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 -- 172.21.15.53:0/822041109 shutdown_connections 2024-09-16T00:50:19.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.047+0000 7f6495ff5700 1 -- 172.21.15.53:0/822041109 wait complete. 2024-09-16T00:50:19.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 Processor -- start 2024-09-16T00:50:19.052 INFO:tasks.workunit.client.0.smithi053.stdout:4/214: dwrite d0/d2/f34 [0,4194304] 0 2024-09-16T00:50:19.052 INFO:tasks.workunit.client.0.smithi053.stdout:4/215: fdatasync d0/d2/f1b 0 2024-09-16T00:50:19.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 -- start start 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 0x7f6490108710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 0x7f6490108c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490105200 con 0x7f64900ffb60 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.049+0000 7f6495ff5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490105370 con 0x7f64900fe8c0 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.050+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 0x7f6490108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.050+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 0x7f6490108710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:56834/0 (socket says 172.21.15.53:56834) 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.050+0000 7f648f7fe700 1 -- 172.21.15.53:0/318683652 learned_addr learned my addr 172.21.15.53:0/318683652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.050+0000 7f648effd700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 0x7f6490108c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:19.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/715: dread dc/d10/d17/d1c/d50/d55/f96 [0,4194304] 0 2024-09-16T00:50:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/716: write f2 [4764007,51739] 0 2024-09-16T00:50:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/717: readlink l1 0 2024-09-16T00:50:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/861: creat d6/d57/d2b/d50/d64/df5/f13c x:0 0 0 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.051+0000 7f648effd700 1 -- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 msgr2=0x7f6490108710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.051+0000 7f648effd700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 0x7f6490108710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.051+0000 7f648effd700 1 -- 172.21.15.53:0/318683652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648000a700 con 0x7f64900ffb60 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.052+0000 7f648effd700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 0x7f6490108c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f647800b3d0 tx=0x7f647800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.052+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6478011800 con 0x7f64900ffb60 2024-09-16T00:50:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.052+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490105650 con 0x7f64900ffb60 2024-09-16T00:50:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.053+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490105ba0 con 0x7f64900ffb60 2024-09-16T00:50:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.053+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f647800be90 con 0x7f64900ffb60 2024-09-16T00:50:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.053+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6478010e70 con 0x7f64900ffb60 2024-09-16T00:50:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.055+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470005320 con 0x7f64900ffb60 2024-09-16T00:50:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.055+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f6478011960 con 0x7f64900ffb60 2024-09-16T00:50:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.056+0000 7f648cff9700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 0x7f647c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.056+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f647808e030 con 0x7f64900ffb60 2024-09-16T00:50:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.056+0000 7f648f7fe700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 0x7f647c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.057+0000 7f648f7fe700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 0x7f647c06fab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648000d010 tx=0x7f6480005dc0 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:19.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/537: rename dd/l57 to dd/d25/lb1 0 2024-09-16T00:50:19.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/538: creat dd/d50/fb2 x:0 0 0 2024-09-16T00:50:19.059 INFO:tasks.workunit.client.0.smithi053.stdout:7/292: rmdir d1/d3 39 2024-09-16T00:50:19.064 INFO:tasks.workunit.client.1.smithi152.stdout:1/777: symlink d9/d3e/d4b/db7/dc4/l122 0 2024-09-16T00:50:19.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.065+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f64780599c0 con 0x7f64900ffb60 2024-09-16T00:50:19.067 INFO:tasks.workunit.client.1.smithi152.stdout:9/712: creat d1/d7/d13/d5d/d69/fe7 x:0 0 0 2024-09-16T00:50:19.068 INFO:tasks.workunit.client.1.smithi152.stdout:7/694: rmdir d9/d10 39 2024-09-16T00:50:19.069 INFO:tasks.workunit.client.0.smithi053.stdout:3/301: getdents d1/d5/d31/d3b 0 2024-09-16T00:50:19.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/539: dread dd/d15/f7a [0,4194304] 0 2024-09-16T00:50:19.072 INFO:tasks.workunit.client.1.smithi152.stdout:6/729: dwrite db/d12/d23/d4a/fca [0,4194304] 0 2024-09-16T00:50:19.072 INFO:tasks.workunit.client.1.smithi152.stdout:3/718: rename dc/d10/d17/d1c/d50/d55/d6d/c8f to dc/d10/d17/d5a/db2/d6f/dbb/ce1 0 2024-09-16T00:50:19.077 INFO:tasks.workunit.client.1.smithi152.stdout:1/778: getdents d9/da/da2 0 2024-09-16T00:50:19.077 INFO:tasks.workunit.client.1.smithi152.stdout:1/779: chown d9/d3e/d4b/d6b/d6d/d99/l10a 2106148 1 2024-09-16T00:50:19.078 INFO:tasks.workunit.client.1.smithi152.stdout:7/695: mknod d9/d31/d65/d8a/ce8 0 2024-09-16T00:50:19.079 INFO:tasks.workunit.client.0.smithi053.stdout:8/330: mkdir d10/d21/d28/d6f 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:8/540: creat dd/d50/d88/fb3 x:0 0 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:8/541: read dd/d50/d29/d2f/f3d [2084878,68668] 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:8/542: stat dd/d50/d88/fb3 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:9/713: dread d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:1/780: dread d9/da/fe8 [0,4194304] 0 2024-09-16T00:50:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:1/781: read - d9/d3e/d4b/db7/dc4/df1/ff9 zero size 2024-09-16T00:50:19.082 INFO:tasks.workunit.client.1.smithi152.stdout:1/782: chown d9/d3e/d41/d31/l33 31354593 1 2024-09-16T00:50:19.082 INFO:tasks.workunit.client.0.smithi053.stdout:6/220: creat d1/dc/f51 x:0 0 0 2024-09-16T00:50:19.082 INFO:tasks.workunit.client.0.smithi053.stdout:5/219: rmdir d3/d7/d24/d34/d3e 39 2024-09-16T00:50:19.083 INFO:tasks.workunit.client.1.smithi152.stdout:6/730: mkdir db/d12/d23/d4a/d43/d48/d6a/de8 0 2024-09-16T00:50:19.085 INFO:tasks.workunit.client.1.smithi152.stdout:7/696: creat d9/d31/d65/d8a/d41/d46/d7d/dac/fe9 x:0 0 0 2024-09-16T00:50:19.087 INFO:tasks.workunit.client.0.smithi053.stdout:2/215: rename d6/d9/dd/c2e to d6/d9/dd/c3c 0 2024-09-16T00:50:19.087 INFO:tasks.workunit.client.1.smithi152.stdout:9/714: getdents d1/d7/d77/d3c 0 2024-09-16T00:50:19.089 INFO:tasks.workunit.client.1.smithi152.stdout:1/783: symlink d9/d3e/d4b/d50/l123 0 2024-09-16T00:50:19.093 INFO:tasks.workunit.client.0.smithi053.stdout:7/293: creat d1/d60/d62/f69 x:0 0 0 2024-09-16T00:50:19.094 INFO:tasks.workunit.client.1.smithi152.stdout:6/731: mknod db/d12/d23/d4a/d43/d48/ce9 0 2024-09-16T00:50:19.094 INFO:tasks.workunit.client.1.smithi152.stdout:9/715: dread d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:19.095 INFO:tasks.workunit.client.0.smithi053.stdout:8/331: mknod d10/d21/d28/d3c/d63/c70 0 2024-09-16T00:50:19.095 INFO:tasks.workunit.client.1.smithi152.stdout:8/543: symlink dd/lb4 0 2024-09-16T00:50:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/696: dwrite d3/d6/d8/d1d/d23/d25/d45/fd1 [0,4194304] 0 2024-09-16T00:50:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/697: creat d3/d6/d8/d1d/d65/fea x:0 0 0 2024-09-16T00:50:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/698: dread - d3/d6/d8/f84 zero size 2024-09-16T00:50:19.099 INFO:tasks.workunit.client.0.smithi053.stdout:0/317: dwrite d4/d13/f1c [0,4194304] 0 2024-09-16T00:50:19.099 INFO:tasks.workunit.client.0.smithi053.stdout:6/221: symlink d1/dc/d45/l52 0 2024-09-16T00:50:19.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/680: dwrite d4/d44/fd7 [0,4194304] 0 2024-09-16T00:50:19.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/784: readlink d9/da/l9d 0 2024-09-16T00:50:19.100 INFO:tasks.workunit.client.1.smithi152.stdout:1/785: chown d9/d3e/d41/d31/d48/db2/cf6 524338 1 2024-09-16T00:50:19.101 INFO:tasks.workunit.client.1.smithi152.stdout:9/716: creat d1/d7/d13/d80/fe8 x:0 0 0 2024-09-16T00:50:19.101 INFO:tasks.workunit.client.1.smithi152.stdout:9/717: write d1/d4e/d48/d26/d30/d4f/da2/fb9 [1048400,117871] 0 2024-09-16T00:50:19.102 INFO:tasks.workunit.client.0.smithi053.stdout:5/220: write d3/d7/d24/d34/f39 [3917146,29379] 0 2024-09-16T00:50:19.103 INFO:tasks.workunit.client.1.smithi152.stdout:8/544: mknod dd/d50/d88/cb5 0 2024-09-16T00:50:19.103 INFO:tasks.workunit.client.1.smithi152.stdout:8/545: chown dd/d50/d29/d2f/d5f 10597290 1 2024-09-16T00:50:19.104 INFO:tasks.workunit.client.0.smithi053.stdout:7/294: creat d1/d2a/d4f/d52/d2c/f6a x:0 0 0 2024-09-16T00:50:19.104 INFO:tasks.workunit.client.0.smithi053.stdout:7/295: truncate d1/d35/d4a/f5e 893064 0 2024-09-16T00:50:19.107 INFO:tasks.workunit.client.0.smithi053.stdout:8/332: symlink d10/d21/d28/l71 0 2024-09-16T00:50:19.115 INFO:tasks.workunit.client.0.smithi053.stdout:0/318: dread d4/d13/f41 [4194304,4194304] 0 2024-09-16T00:50:19.116 INFO:tasks.workunit.client.0.smithi053.stdout:0/319: write d4/dc/d25/d34/d2a/d27/d4a/f56 [563547,93996] 0 2024-09-16T00:50:19.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/699: link d3/d6/d8/d1d/d23/d25/d45/fd1 d3/d6/d8/d9e/feb 0 2024-09-16T00:50:19.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/700: fsync d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 0 2024-09-16T00:50:19.118 INFO:tasks.workunit.client.1.smithi152.stdout:1/786: rename d9/d3e/d41/d9a/cb1 to d9/d3e/d41/d31/d48/d4a/d114/c124 0 2024-09-16T00:50:19.119 INFO:tasks.workunit.client.1.smithi152.stdout:1/787: chown d9/da/f68 16071813 1 2024-09-16T00:50:19.119 INFO:tasks.workunit.client.1.smithi152.stdout:1/788: truncate d9/d3e/d41/d31/f112 897180 0 2024-09-16T00:50:19.119 INFO:tasks.workunit.client.1.smithi152.stdout:1/789: fsync d9/da/df/f86 0 2024-09-16T00:50:19.119 INFO:tasks.workunit.client.0.smithi053.stdout:5/221: mkdir d3/d7/d2b/d4b 0 2024-09-16T00:50:19.121 INFO:tasks.workunit.client.1.smithi152.stdout:5/862: dwrite d6/d57/d54/f91 [0,4194304] 0 2024-09-16T00:50:19.122 INFO:tasks.workunit.client.0.smithi053.stdout:1/260: dwrite d5/d18/d1f/f3d [0,4194304] 0 2024-09-16T00:50:19.122 INFO:tasks.workunit.client.0.smithi053.stdout:1/261: chown d5/d7/d39/l49 7353649 1 2024-09-16T00:50:19.122 INFO:tasks.workunit.client.0.smithi053.stdout:3/302: dwrite d1/d5/d31/f3d [0,4194304] 0 2024-09-16T00:50:19.122 INFO:tasks.workunit.client.0.smithi053.stdout:4/216: rename d0/d2/d1d to d0/d2/d1e/d4b 0 2024-09-16T00:50:19.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/697: dwrite d9/d10/f36 [0,4194304] 0 2024-09-16T00:50:19.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/732: dwrite db/d12/d20/f7e [0,4194304] 0 2024-09-16T00:50:19.124 INFO:tasks.workunit.client.1.smithi152.stdout:9/718: unlink d1/d4e/d48/c36 0 2024-09-16T00:50:19.125 INFO:tasks.workunit.client.0.smithi053.stdout:3/303: dread d1/d5/d31/d3b/f44 [0,4194304] 0 2024-09-16T00:50:19.125 INFO:tasks.workunit.client.0.smithi053.stdout:8/333: dread fb [0,4194304] 0 2024-09-16T00:50:19.128 INFO:tasks.workunit.client.0.smithi053.stdout:7/296: link d1/d2a/d4f/d52/f26 d1/d35/f6b 0 2024-09-16T00:50:19.128 INFO:tasks.workunit.client.0.smithi053.stdout:7/297: dread - d1/f3f zero size 2024-09-16T00:50:19.129 INFO:tasks.workunit.client.0.smithi053.stdout:7/298: stat d1/d35/c12 0 2024-09-16T00:50:19.131 INFO:tasks.workunit.client.1.smithi152.stdout:2/681: dwrite d4/d19/d20/d28/d2c/f79 [0,4194304] 0 2024-09-16T00:50:19.131 INFO:tasks.workunit.client.1.smithi152.stdout:2/682: write d4/d19/d20/d28/d8b/da9/db7/fcd [968056,86546] 0 2024-09-16T00:50:19.134 INFO:tasks.workunit.client.0.smithi053.stdout:0/320: mknod d4/dc/d1e/d22/c6b 0 2024-09-16T00:50:19.136 INFO:tasks.workunit.client.0.smithi053.stdout:3/304: write d1/d5/d14/f30 [633251,63880] 0 2024-09-16T00:50:19.142 INFO:tasks.workunit.client.1.smithi152.stdout:0/701: symlink d3/d6/d8/d1d/d23/d25/d2a/lec 0 2024-09-16T00:50:19.142 INFO:tasks.workunit.client.0.smithi053.stdout:6/222: dwrite d1/f4f [0,4194304] 0 2024-09-16T00:50:19.145 INFO:tasks.workunit.client.0.smithi053.stdout:5/222: rmdir d3/d7/d24/d34 39 2024-09-16T00:50:19.145 INFO:tasks.workunit.client.0.smithi053.stdout:5/223: readlink d3/l18 0 2024-09-16T00:50:19.145 INFO:tasks.workunit.client.0.smithi053.stdout:5/224: creat d3/d7/d12/f4c x:0 0 0 2024-09-16T00:50:19.145 INFO:tasks.workunit.client.0.smithi053.stdout:5/225: dread - d3/d7/f3b zero size 2024-09-16T00:50:19.152 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:18 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2524474289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:50:19.154 INFO:tasks.workunit.client.0.smithi053.stdout:4/217: creat d0/d3c/d48/f4c x:0 0 0 2024-09-16T00:50:19.154 INFO:tasks.workunit.client.0.smithi053.stdout:4/218: chown d0/d2/dd/d25/l1a 18 1 2024-09-16T00:50:19.155 INFO:tasks.workunit.client.1.smithi152.stdout:5/863: rename d6/d16/d1f/l51 to d6/d16/d1f/db5/dcb/l13d 0 2024-09-16T00:50:19.156 INFO:tasks.workunit.client.1.smithi152.stdout:8/546: dwrite dd/d25/f30 [0,4194304] 0 2024-09-16T00:50:19.157 INFO:tasks.workunit.client.0.smithi053.stdout:2/216: rename d6/d9/la to d6/d9/d14/l3d 0 2024-09-16T00:50:19.157 INFO:tasks.workunit.client.0.smithi053.stdout:2/217: chown d6/d9/d14/f1f 13208004 1 2024-09-16T00:50:19.160 INFO:tasks.workunit.client.1.smithi152.stdout:7/698: mknod d9/db6/dde/cea 0 2024-09-16T00:50:19.160 INFO:tasks.workunit.client.1.smithi152.stdout:7/699: truncate d9/d31/fcb 925543 0 2024-09-16T00:50:19.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/226: dread d3/f35 [4194304,4194304] 0 2024-09-16T00:50:19.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/227: write d3/d7/d12/f4c [1034651,48957] 0 2024-09-16T00:50:19.162 INFO:tasks.workunit.client.0.smithi053.stdout:8/334: rename d10/d1c/d2b/f5e to d10/d1c/d2b/f72 0 2024-09-16T00:50:19.167 INFO:tasks.workunit.client.1.smithi152.stdout:8/547: dread dd/d15/f62 [0,4194304] 0 2024-09-16T00:50:19.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/305: mkdir d1/d5/d16/d47/d64 0 2024-09-16T00:50:19.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/306: write d1/d5/d11/f46 [670011,83248] 0 2024-09-16T00:50:19.168 INFO:tasks.workunit.client.0.smithi053.stdout:3/307: truncate d1/d5/d11/f46 4693445 0 2024-09-16T00:50:19.169 INFO:tasks.workunit.client.1.smithi152.stdout:3/719: dwrite dc/d10/f87 [0,4194304] 0 2024-09-16T00:50:19.177 INFO:tasks.workunit.client.0.smithi053.stdout:6/223: creat d1/dc/d3c/d4a/f53 x:0 0 0 2024-09-16T00:50:19.181 INFO:tasks.workunit.client.0.smithi053.stdout:4/219: mkdir d0/d3c/d48/d4d 0 2024-09-16T00:50:19.182 INFO:tasks.workunit.client.0.smithi053.stdout:1/262: dwrite d5/dd/d19/f46 [0,4194304] 0 2024-09-16T00:50:19.182 INFO:tasks.workunit.client.0.smithi053.stdout:1/263: readlink d5/d7/d10/l54 0 2024-09-16T00:50:19.183 INFO:tasks.workunit.client.0.smithi053.stdout:0/321: dwrite d4/d13/f63 [0,4194304] 0 2024-09-16T00:50:19.183 INFO:tasks.workunit.client.0.smithi053.stdout:0/322: fsync d4/d13/f4f 0 2024-09-16T00:50:19.183 INFO:tasks.workunit.client.0.smithi053.stdout:0/323: chown d4/d13/d2d/f5d 10 1 2024-09-16T00:50:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:9/719: dwrite d1/d7/d13/f2c [0,4194304] 0 2024-09-16T00:50:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:7/700: dwrite d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:7/701: chown d9/c14 1462 1 2024-09-16T00:50:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/733: rmdir db/d12/d20/d86/d91/dd3 0 2024-09-16T00:50:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/734: write db/d28/db3/fc4 [1994012,5057] 0 2024-09-16T00:50:19.185 INFO:tasks.workunit.client.0.smithi053.stdout:2/218: dwrite d6/d9/d14/f37 [0,4194304] 0 2024-09-16T00:50:19.185 INFO:tasks.workunit.client.0.smithi053.stdout:2/219: chown d6/d9/d14 218312 1 2024-09-16T00:50:19.191 INFO:tasks.workunit.client.0.smithi053.stdout:5/228: rename d3/d7/d24/d34/d3e/c47 to d3/d7/d24/d34/d3e/c4d 0 2024-09-16T00:50:19.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/335: creat d10/d1c/f73 x:0 0 0 2024-09-16T00:50:19.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/336: dread - d10/d21/f4b zero size 2024-09-16T00:50:19.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/337: creat d10/d21/d28/d3c/d63/f74 x:0 0 0 2024-09-16T00:50:19.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/683: symlink d4/d44/d7a/dc7/le1 0 2024-09-16T00:50:19.197 INFO:tasks.workunit.client.1.smithi152.stdout:0/702: mknod d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/ced 0 2024-09-16T00:50:19.199 INFO:tasks.workunit.client.0.smithi053.stdout:3/308: mkdir d1/d5/d16/d47/d65 0 2024-09-16T00:50:19.201 INFO:tasks.workunit.client.0.smithi053.stdout:0/324: dwrite d4/dc/d25/f5f [0,4194304] 0 2024-09-16T00:50:19.206 INFO:tasks.workunit.client.1.smithi152.stdout:1/790: rmdir d9/d3e/d41/d31/d48 39 2024-09-16T00:50:19.208 INFO:tasks.workunit.client.0.smithi053.stdout:6/224: mkdir d1/dc/d54 0 2024-09-16T00:50:19.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/864: creat d6/d57/d54/d12c/f13e x:0 0 0 2024-09-16T00:50:19.212 INFO:tasks.workunit.client.0.smithi053.stdout:2/220: dwrite d6/d9/dd/f31 [0,4194304] 0 2024-09-16T00:50:19.213 INFO:tasks.workunit.client.0.smithi053.stdout:4/220: rename d0/da/l14 to d0/d2/l4e 0 2024-09-16T00:50:19.213 INFO:tasks.workunit.client.0.smithi053.stdout:4/221: stat d0/d2/dd/d25/d37/l47 0 2024-09-16T00:50:19.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/735: dwrite db/d12/d23/f81 [0,4194304] 0 2024-09-16T00:50:19.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/736: chown db/d12/c50 4 1 2024-09-16T00:50:19.222 INFO:tasks.workunit.client.0.smithi053.stdout:2/221: dread d6/d9/dd/f31 [0,4194304] 0 2024-09-16T00:50:19.222 INFO:tasks.workunit.client.1.smithi152.stdout:8/548: rename dd/d15/d69/dab to dd/d50/d29/d2f/db6 0 2024-09-16T00:50:19.224 INFO:tasks.workunit.client.0.smithi053.stdout:1/264: truncate d5/d7/f20 4959527 0 2024-09-16T00:50:19.225 INFO:tasks.workunit.client.0.smithi053.stdout:0/325: dwrite d4/dc/d1e/d1f/d40/f62 [0,4194304] 0 2024-09-16T00:50:19.225 INFO:tasks.workunit.client.0.smithi053.stdout:0/326: fsync d4/dc/d25/f5f 0 2024-09-16T00:50:19.225 INFO:tasks.workunit.client.0.smithi053.stdout:0/327: chown d4/dc/d1e/d1f/d40 3 1 2024-09-16T00:50:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:9/720: getdents d1/d7/d13/d5d 0 2024-09-16T00:50:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:5/865: dwrite d6/d57/d54/f70 [0,4194304] 0 2024-09-16T00:50:19.245 INFO:tasks.workunit.client.1.smithi152.stdout:2/684: creat d4/d44/d7a/d9e/d87/dd8/fe2 x:0 0 0 2024-09-16T00:50:19.248 INFO:tasks.workunit.client.1.smithi152.stdout:0/703: truncate d3/d6/d51/f57 373989 0 2024-09-16T00:50:19.248 INFO:tasks.workunit.client.1.smithi152.stdout:0/704: stat d3/d6/d8/d1d/d23/d25/d45/f5f 0 2024-09-16T00:50:19.258 INFO:tasks.workunit.client.1.smithi152.stdout:6/737: unlink db/d28/c71 0 2024-09-16T00:50:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:0/705: write d3/d6/d8/d1d/f26 [7141287,26714] 0 2024-09-16T00:50:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:0/706: dread - d3/d6/d64/d6a/fd5 zero size 2024-09-16T00:50:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:0/707: chown d3/d6/d8/d1d/d65/d6e/d82/f91 11167 1 2024-09-16T00:50:19.259 INFO:tasks.workunit.client.0.smithi053.stdout:5/229: getdents d3/d7/d24/d34/d3e 0 2024-09-16T00:50:19.259 INFO:tasks.workunit.client.0.smithi053.stdout:5/230: creat d3/d7/d12/f4e x:0 0 0 2024-09-16T00:50:19.263 INFO:tasks.workunit.client.1.smithi152.stdout:1/791: rename c3 to d9/da/d105/c125 0 2024-09-16T00:50:19.264 INFO:tasks.workunit.client.0.smithi053.stdout:8/338: symlink d10/d21/d28/d3c/d61/l75 0 2024-09-16T00:50:19.270 INFO:tasks.workunit.client.1.smithi152.stdout:3/720: rmdir dc/d10/d17/d5a/d68 39 2024-09-16T00:50:19.270 INFO:tasks.workunit.client.1.smithi152.stdout:3/721: truncate dc/d10/d17/d1c/d50/d55/d6d/f8b 158762 0 2024-09-16T00:50:19.270 INFO:tasks.workunit.client.1.smithi152.stdout:3/722: write dc/d10/d17/d1c/d8d/d8e/d2f/d46/fa8 [272184,18590] 0 2024-09-16T00:50:19.272 INFO:tasks.workunit.client.1.smithi152.stdout:0/708: dwrite d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe4 [0,4194304] 0 2024-09-16T00:50:19.272 INFO:tasks.workunit.client.1.smithi152.stdout:0/709: chown d3/c60 45 1 2024-09-16T00:50:19.273 INFO:tasks.workunit.client.0.smithi053.stdout:6/225: creat d1/dc/d3d/f55 x:0 0 0 2024-09-16T00:50:19.274 INFO:tasks.workunit.client.1.smithi152.stdout:9/721: mkdir d1/d59/de9 0 2024-09-16T00:50:19.278 INFO:tasks.workunit.client.0.smithi053.stdout:3/309: rename d1/d5/d31/d42/d62 to d1/d5/d16/d47/d65/d66 0 2024-09-16T00:50:19.281 INFO:tasks.workunit.client.0.smithi053.stdout:4/222: rmdir d0/d2/dd/d25/d37 39 2024-09-16T00:50:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:5/866: creat d6/d16/d1f/d6c/de2/d10f/f13f x:0 0 0 2024-09-16T00:50:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:5/867: write d6/d16/d1f/d8c/db8/dbf/ded/f137 [410658,42701] 0 2024-09-16T00:50:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:5/868: stat d6/d16/d1f/d6c/de7 0 2024-09-16T00:50:19.284 INFO:tasks.workunit.client.1.smithi152.stdout:5/869: chown d6/d57/c48 551704629 1 2024-09-16T00:50:19.284 INFO:tasks.workunit.client.0.smithi053.stdout:2/222: truncate f5 56263 0 2024-09-16T00:50:19.285 INFO:tasks.workunit.client.1.smithi152.stdout:7/702: mknod d9/d10/ceb 0 2024-09-16T00:50:19.288 INFO:tasks.workunit.client.1.smithi152.stdout:2/685: unlink d4/d19/f25 0 2024-09-16T00:50:19.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/738: mknod db/da8/db7/cea 0 2024-09-16T00:50:19.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/739: creat db/d12/d23/d4a/d43/d48/d64/dab/feb x:0 0 0 2024-09-16T00:50:19.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/740: fsync db/d12/d20/f51 0 2024-09-16T00:50:19.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/723: dwrite dc/d5c/dae/fc1 [0,4194304] 0 2024-09-16T00:50:19.294 INFO:tasks.workunit.client.0.smithi053.stdout:0/328: symlink d4/dc/d1e/d1f/l6c 0 2024-09-16T00:50:19.294 INFO:tasks.workunit.client.0.smithi053.stdout:0/329: chown d4/dc/d1e/l43 44383 1 2024-09-16T00:50:19.296 INFO:tasks.workunit.client.0.smithi053.stdout:6/226: dwrite d1/dc/d39/f13 [0,4194304] 0 2024-09-16T00:50:19.296 INFO:tasks.workunit.client.1.smithi152.stdout:1/792: getdents d9/d3e/d41/d31/d48/d4a 0 2024-09-16T00:50:19.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/870: dread d6/fc [0,4194304] 0 2024-09-16T00:50:19.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/871: truncate d6/d57/d2b/f132 4190 0 2024-09-16T00:50:19.299 INFO:tasks.workunit.client.1.smithi152.stdout:8/549: mknod dd/cb7 0 2024-09-16T00:50:19.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/339: mkdir d10/d1c/d2b/d40/d76 0 2024-09-16T00:50:19.308 INFO:tasks.workunit.client.1.smithi152.stdout:0/710: creat d3/d6/d8/d1d/d23/d25/fee x:0 0 0 2024-09-16T00:50:19.309 INFO:tasks.workunit.client.0.smithi053.stdout:3/310: rmdir d1/d5/d16/d47/d4c/d50 39 2024-09-16T00:50:19.309 INFO:tasks.workunit.client.0.smithi053.stdout:3/311: write d1/d5/f19 [1966653,22714] 0 2024-09-16T00:50:19.309 INFO:tasks.workunit.client.0.smithi053.stdout:3/312: read d1/d5/d16/f3f [200983,43799] 0 2024-09-16T00:50:19.309 INFO:tasks.workunit.client.0.smithi053.stdout:3/313: read d1/d5/d16/d5e/f63 [265193,130089] 0 2024-09-16T00:50:19.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/722: mknod d1/d7/d77/d68/cea 0 2024-09-16T00:50:19.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/723: truncate d1/d7/d77/f43 5137268 0 2024-09-16T00:50:19.316 INFO:tasks.workunit.client.0.smithi053.stdout:4/223: mknod d0/d2/c4f 0 2024-09-16T00:50:19.317 INFO:tasks.workunit.client.1.smithi152.stdout:7/703: mknod d9/d31/d65/d8a/d41/d46/d7d/dac/cec 0 2024-09-16T00:50:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:18 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2524474289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:50:19.319 INFO:tasks.workunit.client.0.smithi053.stdout:1/265: link d5/d9/f4b d5/d9/f56 0 2024-09-16T00:50:19.323 INFO:tasks.workunit.client.0.smithi053.stdout:0/330: link d4/dc/d1e/d1f/l6c d4/l6d 0 2024-09-16T00:50:19.325 INFO:tasks.workunit.client.0.smithi053.stdout:8/340: dwrite d10/d21/d28/d3c/f45 [0,4194304] 0 2024-09-16T00:50:19.325 INFO:tasks.workunit.client.0.smithi053.stdout:8/341: chown d10/f20 44117823 1 2024-09-16T00:50:19.327 INFO:tasks.workunit.client.0.smithi053.stdout:3/314: dwrite d1/d5/d16/d47/f5b [0,4194304] 0 2024-09-16T00:50:19.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/741: truncate db/d12/f3d 1436320 0 2024-09-16T00:50:19.338 INFO:tasks.workunit.client.0.smithi053.stdout:6/227: creat d1/dc/d39/f56 x:0 0 0 2024-09-16T00:50:19.339 INFO:tasks.workunit.client.1.smithi152.stdout:1/793: creat d9/da/d105/f126 x:0 0 0 2024-09-16T00:50:19.344 INFO:tasks.workunit.client.0.smithi053.stdout:5/231: rmdir d3/d7/d24 39 2024-09-16T00:50:19.344 INFO:tasks.workunit.client.0.smithi053.stdout:5/232: stat d3/d7/d24/d34/d3e/c4d 0 2024-09-16T00:50:19.344 INFO:tasks.workunit.client.0.smithi053.stdout:5/233: readlink d3/l3d 0 2024-09-16T00:50:19.344 INFO:tasks.workunit.client.0.smithi053.stdout:6/228: write d1/f15 [2195420,113643] 0 2024-09-16T00:50:19.345 INFO:tasks.workunit.client.1.smithi152.stdout:5/872: mknod d6/d16/d1f/d65/dd2/c140 0 2024-09-16T00:50:19.345 INFO:tasks.workunit.client.1.smithi152.stdout:8/550: mkdir dd/d98/db8 0 2024-09-16T00:50:19.346 INFO:tasks.workunit.client.1.smithi152.stdout:8/551: write dd/d50/d29/d2f/f31 [3246918,115812] 0 2024-09-16T00:50:19.351 INFO:tasks.workunit.client.0.smithi053.stdout:4/224: dwrite d0/d2/dd/f3e [0,4194304] 0 2024-09-16T00:50:19.351 INFO:tasks.workunit.client.0.smithi053.stdout:0/331: dwrite d4/d13/f1c [4194304,4194304] 0 2024-09-16T00:50:19.352 INFO:tasks.workunit.client.0.smithi053.stdout:1/266: mkdir d5/d7/d39/d57 0 2024-09-16T00:50:19.352 INFO:tasks.workunit.client.0.smithi053.stdout:2/223: dread f5 [0,4194304] 0 2024-09-16T00:50:19.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/711: creat d3/d6/d64/d6a/d61/fef x:0 0 0 2024-09-16T00:50:19.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/712: dread - d3/d6/d64/d6a/d61/fef zero size 2024-09-16T00:50:19.353 INFO:tasks.workunit.client.1.smithi152.stdout:6/742: dwrite db/d12/d23/d4a/d33/f38 [0,4194304] 0 2024-09-16T00:50:19.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/724: link d1/c9c d1/d7/d13/d5d/ceb 0 2024-09-16T00:50:19.358 INFO:tasks.workunit.client.0.smithi053.stdout:8/342: getdents d10/d52/d5b 0 2024-09-16T00:50:19.362 INFO:tasks.workunit.client.1.smithi152.stdout:7/704: rename d9/d31/d65/d8a/f55 to d9/d31/d64/d3c/db9/fed 0 2024-09-16T00:50:19.362 INFO:tasks.workunit.client.1.smithi152.stdout:7/705: write d9/d31/d65/d6b/fdc [734687,85731] 0 2024-09-16T00:50:19.368 INFO:tasks.workunit.client.1.smithi152.stdout:5/873: dwrite d6/d57/d54/d12c/f13e [0,4194304] 0 2024-09-16T00:50:19.368 INFO:tasks.workunit.client.0.smithi053.stdout:5/234: dwrite d3/d7/f2a [0,4194304] 0 2024-09-16T00:50:19.368 INFO:tasks.workunit.client.0.smithi053.stdout:5/235: chown d3/f2e 826472 1 2024-09-16T00:50:19.369 INFO:tasks.workunit.client.0.smithi053.stdout:3/315: truncate d1/d5/d31/d3b/f44 284822 0 2024-09-16T00:50:19.375 INFO:tasks.workunit.client.0.smithi053.stdout:6/229: creat d1/f57 x:0 0 0 2024-09-16T00:50:19.375 INFO:tasks.workunit.client.0.smithi053.stdout:6/230: chown d1 3 1 2024-09-16T00:50:19.376 INFO:tasks.workunit.client.0.smithi053.stdout:6/231: chown d1/dc/d3c/d4b 13238 1 2024-09-16T00:50:19.376 INFO:tasks.workunit.client.0.smithi053.stdout:6/232: stat d1/dc/d54 0 2024-09-16T00:50:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:3/724: getdents dc/d10/d17/d1c/d1f/d24/db9 0 2024-09-16T00:50:19.380 INFO:tasks.workunit.client.0.smithi053.stdout:3/316: dread d1/d5/d31/f38 [0,4194304] 0 2024-09-16T00:50:19.380 INFO:tasks.workunit.client.0.smithi053.stdout:9/316: sync 2024-09-16T00:50:19.382 INFO:tasks.workunit.client.0.smithi053.stdout:7/299: sync 2024-09-16T00:50:19.382 INFO:tasks.workunit.client.1.smithi152.stdout:9/725: dwrite d1/de2/fe5 [4194304,4194304] 0 2024-09-16T00:50:19.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/794: mknod d9/d3e/d4b/db7/dc4/d10c/c127 0 2024-09-16T00:50:19.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/795: sync 2024-09-16T00:50:19.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/796: creat d2/d1e/d28/d69/f105 x:0 0 0 2024-09-16T00:50:19.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/343: dwrite d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:19.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/344: chown d10/d21/d28/d3c/d63/f6e 1418 1 2024-09-16T00:50:19.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/345: fdatasync d10/f20 0 2024-09-16T00:50:19.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/346: dread - d10/d1c/d2b/f4e zero size 2024-09-16T00:50:19.389 INFO:tasks.workunit.client.0.smithi053.stdout:9/317: dread d8/d19/d31/f43 [0,4194304] 0 2024-09-16T00:50:19.390 INFO:tasks.workunit.client.1.smithi152.stdout:4/797: write d2/db/d44/f68 [1113857,104065] 0 2024-09-16T00:50:19.391 INFO:tasks.workunit.client.0.smithi053.stdout:4/225: creat d0/d2/d26/f50 x:0 0 0 2024-09-16T00:50:19.394 INFO:tasks.workunit.client.1.smithi152.stdout:0/713: unlink d3/d6/d8/d1d/d23/d25/d45/lc5 0 2024-09-16T00:50:19.394 INFO:tasks.workunit.client.1.smithi152.stdout:0/714: chown d3/d6/d8/d1d/d23/d4b/l7c 89 1 2024-09-16T00:50:19.397 INFO:tasks.workunit.client.0.smithi053.stdout:0/332: symlink d4/dc/d1e/d1f/d40/d44/d49/l6e 0 2024-09-16T00:50:19.398 INFO:tasks.workunit.client.1.smithi152.stdout:6/743: mknod db/d12/d23/d3a/cec 0 2024-09-16T00:50:19.399 INFO:tasks.workunit.client.1.smithi152.stdout:3/725: dwrite dc/d10/d17/d5a/db2/d6f/f83 [0,4194304] 0 2024-09-16T00:50:19.399 INFO:tasks.workunit.client.0.smithi053.stdout:3/317: dwrite d1/d5/d16/f4d [0,4194304] 0 2024-09-16T00:50:19.400 INFO:tasks.workunit.client.0.smithi053.stdout:3/318: readlink d1/l49 0 2024-09-16T00:50:19.400 INFO:tasks.workunit.client.0.smithi053.stdout:1/267: rename d5/d9/d21 to d5/dd/d47/d58 0 2024-09-16T00:50:19.400 INFO:tasks.workunit.client.0.smithi053.stdout:1/268: creat d5/dd/f59 x:0 0 0 2024-09-16T00:50:19.402 INFO:tasks.workunit.client.1.smithi152.stdout:7/706: mknod d9/d31/d64/d3c/db9/cee 0 2024-09-16T00:50:19.402 INFO:tasks.workunit.client.0.smithi053.stdout:1/269: dread d5/dd/d47/d58/f2a [0,4194304] 0 2024-09-16T00:50:19.403 INFO:tasks.workunit.client.0.smithi053.stdout:2/224: mkdir d6/d9/dd/d3e 0 2024-09-16T00:50:19.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/744: dread db/d12/d23/d4a/d43/d48/f7f [0,4194304] 0 2024-09-16T00:50:19.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/745: chown db/d12/d23/d4a/d43/d48/d6a/fb6 4 1 2024-09-16T00:50:19.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/746: dread - db/da8/db7/fdb zero size 2024-09-16T00:50:19.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/747: creat db/d12/fed x:0 0 0 2024-09-16T00:50:19.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/707: dread d9/d31/d65/fa1 [0,4194304] 0 2024-09-16T00:50:19.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/708: chown d9/d31/d65/d8a/d41/f62 3162 1 2024-09-16T00:50:19.408 INFO:tasks.workunit.client.0.smithi053.stdout:3/319: write d1/d5/d14/f2d [2774380,20122] 0 2024-09-16T00:50:19.412 INFO:tasks.workunit.client.0.smithi053.stdout:5/236: truncate d3/f2c 2938711 0 2024-09-16T00:50:19.412 INFO:tasks.workunit.client.0.smithi053.stdout:5/237: readlink d3/d7/d2b/d37/l49 0 2024-09-16T00:50:19.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/726: dwrite d1/d4e/d48/d26/d30/d4f/da2/fb9 [0,4194304] 0 2024-09-16T00:50:19.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/874: truncate d6/f40 115980 0 2024-09-16T00:50:19.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/875: chown d6/d16/d1f/d6c/de2/d106/f120 25631 1 2024-09-16T00:50:19.415 INFO:tasks.workunit.client.0.smithi053.stdout:2/225: dread d6/d9/d14/f37 [0,4194304] 0 2024-09-16T00:50:19.416 INFO:tasks.workunit.client.0.smithi053.stdout:6/233: mkdir d1/dc/d3c/d4b/d58 0 2024-09-16T00:50:19.416 INFO:tasks.workunit.client.0.smithi053.stdout:6/234: fsync d1/dc/f3e 0 2024-09-16T00:50:19.417 INFO:tasks.workunit.client.0.smithi053.stdout:7/300: symlink d1/d35/d5b/l6c 0 2024-09-16T00:50:19.417 INFO:tasks.workunit.client.0.smithi053.stdout:7/301: fsync d1/d2a/d4f/d52/f26 0 2024-09-16T00:50:19.418 INFO:tasks.workunit.client.1.smithi152.stdout:6/748: dread db/d12/d20/f7e [0,4194304] 0 2024-09-16T00:50:19.422 INFO:tasks.workunit.client.0.smithi053.stdout:8/347: unlink d10/d21/d28/f31 0 2024-09-16T00:50:19.422 INFO:tasks.workunit.client.0.smithi053.stdout:8/348: fsync d10/f1d 0 2024-09-16T00:50:19.423 INFO:tasks.workunit.client.1.smithi152.stdout:5/876: dread d6/f2d [0,4194304] 0 2024-09-16T00:50:19.424 INFO:tasks.workunit.client.1.smithi152.stdout:1/795: unlink d9/da/df/f69 0 2024-09-16T00:50:19.425 INFO:tasks.workunit.client.0.smithi053.stdout:9/318: symlink d8/d4c/l6c 0 2024-09-16T00:50:19.426 INFO:tasks.workunit.client.0.smithi053.stdout:9/319: write d8/d4c/d5a/f6a [1020804,107311] 0 2024-09-16T00:50:19.428 INFO:tasks.workunit.client.0.smithi053.stdout:8/349: dread d10/f20 [0,4194304] 0 2024-09-16T00:50:19.428 INFO:tasks.workunit.client.0.smithi053.stdout:8/350: fdatasync d10/d21/d28/f32 0 2024-09-16T00:50:19.428 INFO:tasks.workunit.client.0.smithi053.stdout:8/351: write d10/d1c/d2b/d40/f4d [4539512,31376] 0 2024-09-16T00:50:19.429 INFO:tasks.workunit.client.0.smithi053.stdout:7/302: dread d1/d35/d14/f43 [0,4194304] 0 2024-09-16T00:50:19.429 INFO:tasks.workunit.client.0.smithi053.stdout:7/303: chown d1/d35/l29 168076698 1 2024-09-16T00:50:19.429 INFO:tasks.workunit.client.0.smithi053.stdout:4/226: link d0/d2/d1e/d4b/f36 d0/da/d42/f51 0 2024-09-16T00:50:19.429 INFO:tasks.workunit.client.0.smithi053.stdout:4/227: creat d0/d3c/d48/f52 x:0 0 0 2024-09-16T00:50:19.430 INFO:tasks.workunit.client.0.smithi053.stdout:4/228: dread d0/d2/dd/f40 [0,4194304] 0 2024-09-16T00:50:19.432 INFO:tasks.workunit.client.1.smithi152.stdout:8/552: mkdir dd/db9 0 2024-09-16T00:50:19.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/235: dread d1/dc/d39/f1c [0,4194304] 0 2024-09-16T00:50:19.435 INFO:tasks.workunit.client.0.smithi053.stdout:0/333: unlink d4/dc/d1e/c2b 0 2024-09-16T00:50:19.436 INFO:tasks.workunit.client.1.smithi152.stdout:4/798: creat d2/db/d39/d3c/d76/f106 x:0 0 0 2024-09-16T00:50:19.441 INFO:tasks.workunit.client.1.smithi152.stdout:0/715: truncate d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 519278 0 2024-09-16T00:50:19.441 INFO:tasks.workunit.client.1.smithi152.stdout:0/716: chown d3/d6/d64/d6a 569238315 1 2024-09-16T00:50:19.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/726: mkdir dc/d10/d17/d5a/db2/d6f/d74/db5/de2 0 2024-09-16T00:50:19.448 INFO:tasks.workunit.client.0.smithi053.stdout:1/270: mkdir d5/d5a 0 2024-09-16T00:50:19.451 INFO:tasks.workunit.client.0.smithi053.stdout:3/320: creat d1/d5/d11/d3a/f67 x:0 0 0 2024-09-16T00:50:19.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/238: mkdir d3/d7/d2b/d4b/d4f 0 2024-09-16T00:50:19.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/239: write d3/d7/d12/f19 [3715981,24831] 0 2024-09-16T00:50:19.457 INFO:tasks.workunit.client.0.smithi053.stdout:9/320: dwrite d8/f11 [4194304,4194304] 0 2024-09-16T00:50:19.458 INFO:tasks.workunit.client.1.smithi152.stdout:2/686: dwrite d4/d19/d20/d28/d2c/f31 [0,4194304] 0 2024-09-16T00:50:19.459 INFO:tasks.workunit.client.1.smithi152.stdout:7/709: rename d9/d31/d65/d4b to d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def 0 2024-09-16T00:50:19.461 INFO:tasks.workunit.client.0.smithi053.stdout:2/226: creat d6/d9/dd/d28/f3f x:0 0 0 2024-09-16T00:50:19.462 INFO:tasks.workunit.client.0.smithi053.stdout:3/321: dwrite d1/d5/d11/d3a/f67 [0,4194304] 0 2024-09-16T00:50:19.469 INFO:tasks.workunit.client.0.smithi053.stdout:8/352: rename d10/d4a/c6c to d10/d52/d5b/c77 0 2024-09-16T00:50:19.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/749: unlink db/d12/d23/d4a/d43/d48/d6a/fb6 0 2024-09-16T00:50:19.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/750: dread - db/d12/d23/d4a/d43/d48/d64/dab/fd1 zero size 2024-09-16T00:50:19.474 INFO:tasks.workunit.client.0.smithi053.stdout:4/229: mkdir d0/d3c/d48/d53 0 2024-09-16T00:50:19.481 INFO:tasks.workunit.client.0.smithi053.stdout:6/236: creat d1/dc/d45/f59 x:0 0 0 2024-09-16T00:50:19.481 INFO:tasks.workunit.client.0.smithi053.stdout:6/237: fsync d1/dc/d39/f1c 0 2024-09-16T00:50:19.488 INFO:tasks.workunit.client.1.smithi152.stdout:5/877: link d6/d16/l38 d6/d57/ddc/l141 0 2024-09-16T00:50:19.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/553: write dd/d50/d29/f7e [5334613,6465] 0 2024-09-16T00:50:19.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/554: truncate dd/d15/d49/f51 5083213 0 2024-09-16T00:50:19.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/555: write dd/d15/d69/f89 [652401,98006] 0 2024-09-16T00:50:19.494 INFO:tasks.workunit.client.1.smithi152.stdout:4/799: stat d2/d41/cba 0 2024-09-16T00:50:19.496 INFO:tasks.workunit.client.0.smithi053.stdout:9/321: getdents d8/d1c/d2b 0 2024-09-16T00:50:19.497 INFO:tasks.workunit.client.1.smithi152.stdout:1/796: read d9/da/f58 [4014318,122833] 0 2024-09-16T00:50:19.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/800: dread d2/f16 [0,4194304] 0 2024-09-16T00:50:19.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/801: stat d2/db/d44/c52 0 2024-09-16T00:50:19.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/802: fsync d2/d1e/d28/d69/f9c 0 2024-09-16T00:50:19.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/717: getdents d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4 0 2024-09-16T00:50:19.500 INFO:tasks.workunit.client.0.smithi053.stdout:2/227: rmdir d6/d29/d2b 39 2024-09-16T00:50:19.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/727: mknod dc/d10/d17/d1c/d50/d63/dc4/ce3 0 2024-09-16T00:50:19.508 INFO:tasks.workunit.client.0.smithi053.stdout:3/322: unlink d1/d5/d14/l32 0 2024-09-16T00:50:19.511 INFO:tasks.workunit.client.0.smithi053.stdout:0/334: rename d4/dc/d1e/d22/c6b to d4/dc/d25/d34/c6f 0 2024-09-16T00:50:19.514 INFO:tasks.workunit.client.0.smithi053.stdout:8/353: symlink d10/d1c/d2b/d40/d50/l78 0 2024-09-16T00:50:19.514 INFO:tasks.workunit.client.0.smithi053.stdout:8/354: read d10/d1c/f26 [49391,98222] 0 2024-09-16T00:50:19.514 INFO:tasks.workunit.client.0.smithi053.stdout:8/355: stat d10/d1c/d2b/f4e 0 2024-09-16T00:50:19.518 INFO:tasks.workunit.client.0.smithi053.stdout:4/230: symlink d0/d2/dd/d25/d41/l54 0 2024-09-16T00:50:19.518 INFO:tasks.workunit.client.0.smithi053.stdout:4/231: fsync d0/d2/f34 0 2024-09-16T00:50:19.519 INFO:tasks.workunit.client.0.smithi053.stdout:3/323: dread d1/d5/d14/f18 [4194304,4194304] 0 2024-09-16T00:50:19.519 INFO:tasks.workunit.client.0.smithi053.stdout:3/324: creat d1/d5/f68 x:0 0 0 2024-09-16T00:50:19.519 INFO:tasks.workunit.client.0.smithi053.stdout:8/356: dread d10/f1d [0,4194304] 0 2024-09-16T00:50:19.520 INFO:tasks.workunit.client.0.smithi053.stdout:8/357: fsync d10/f19 0 2024-09-16T00:50:19.521 INFO:tasks.workunit.client.1.smithi152.stdout:7/710: mkdir d9/d31/d65/d8a/d41/d46/d7d/de2/df0 0 2024-09-16T00:50:19.523 INFO:tasks.workunit.client.0.smithi053.stdout:1/271: mkdir d5/d18/d5b 0 2024-09-16T00:50:19.526 INFO:tasks.workunit.client.0.smithi053.stdout:0/335: write d4/dc/d25/d34/d2a/f4e [823507,35666] 0 2024-09-16T00:50:19.529 INFO:tasks.workunit.client.0.smithi053.stdout:9/322: dwrite f6 [0,4194304] 0 2024-09-16T00:50:19.529 INFO:tasks.workunit.client.0.smithi053.stdout:2/228: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:19.532 INFO:tasks.workunit.client.0.smithi053.stdout:5/240: rename d3/l3d to d3/d7/d2b/l50 0 2024-09-16T00:50:19.532 INFO:tasks.workunit.client.0.smithi053.stdout:4/232: mknod d0/d3c/d48/c55 0 2024-09-16T00:50:19.534 INFO:tasks.workunit.client.0.smithi053.stdout:0/336: dread d4/d13/f63 [0,4194304] 0 2024-09-16T00:50:19.535 INFO:tasks.workunit.client.1.smithi152.stdout:5/878: mkdir d6/d57/d2b/dee/d135/d142 0 2024-09-16T00:50:19.542 INFO:tasks.workunit.client.1.smithi152.stdout:8/556: rename dd/d15/d69/l8f to dd/d50/lba 0 2024-09-16T00:50:19.544 INFO:tasks.workunit.client.0.smithi053.stdout:6/238: truncate d1/d2f/f33 1007498 0 2024-09-16T00:50:19.549 INFO:tasks.workunit.client.1.smithi152.stdout:1/797: creat d9/d3e/d41/d31/d48/dc3/f128 x:0 0 0 2024-09-16T00:50:19.552 INFO:tasks.workunit.client.0.smithi053.stdout:2/229: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:19.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/803: mknod d2/c107 0 2024-09-16T00:50:19.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/804: write d2/db/dce/fe0 [4806382,24994] 0 2024-09-16T00:50:19.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/805: creat d2/db/d39/d3c/d76/f108 x:0 0 0 2024-09-16T00:50:19.555 INFO:tasks.workunit.client.0.smithi053.stdout:9/323: mkdir d8/d19/d51/d6d 0 2024-09-16T00:50:19.555 INFO:tasks.workunit.client.0.smithi053.stdout:9/324: fsync d8/f17 0 2024-09-16T00:50:19.555 INFO:tasks.workunit.client.0.smithi053.stdout:9/325: chown d8/d1c/d2b/d2c 7327 1 2024-09-16T00:50:19.556 INFO:tasks.workunit.client.1.smithi152.stdout:0/718: mkdir d3/d6/d8/d1d/d65/db0/df0 0 2024-09-16T00:50:19.556 INFO:tasks.workunit.client.1.smithi152.stdout:0/719: chown d3/d6/d51/f57 3820 1 2024-09-16T00:50:19.557 INFO:tasks.workunit.client.1.smithi152.stdout:7/711: dwrite d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:19.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/728: creat dc/d10/d17/d1c/d8d/d8e/d2f/fe4 x:0 0 0 2024-09-16T00:50:19.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/729: truncate dc/d10/d17/d5a/d68/da5/fcc 23718 0 2024-09-16T00:50:19.561 INFO:tasks.workunit.client.0.smithi053.stdout:1/272: dwrite d5/d7/d39/f55 [0,4194304] 0 2024-09-16T00:50:19.561 INFO:tasks.workunit.client.0.smithi053.stdout:1/273: creat d5/d7/d10/f5c x:0 0 0 2024-09-16T00:50:19.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/337: rmdir d4/dc/d1e/d1f/d40/d44/d54 39 2024-09-16T00:50:19.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/338: chown d4/dc/d1e/l43 1540 1 2024-09-16T00:50:19.563 INFO:tasks.workunit.client.0.smithi053.stdout:0/339: read - d4/f69 zero size 2024-09-16T00:50:19.565 INFO:tasks.workunit.client.1.smithi152.stdout:2/687: mknod d4/d17/d3e/ce3 0 2024-09-16T00:50:19.566 INFO:tasks.workunit.client.0.smithi053.stdout:2/230: creat d6/d29/d2b/d39/f40 x:0 0 0 2024-09-16T00:50:19.566 INFO:tasks.workunit.client.1.smithi152.stdout:5/879: symlink d6/d57/ddc/d11a/d11f/l143 0 2024-09-16T00:50:19.567 INFO:tasks.workunit.client.0.smithi053.stdout:9/326: mknod d8/d13/c6e 0 2024-09-16T00:50:19.568 INFO:tasks.workunit.client.0.smithi053.stdout:9/327: chown d8/d1c/d2b/d5c 625027 1 2024-09-16T00:50:19.568 INFO:tasks.workunit.client.0.smithi053.stdout:9/328: write d8/d19/d31/f43 [850414,9126] 0 2024-09-16T00:50:19.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/798: mkdir d9/da/d105/d129 0 2024-09-16T00:50:19.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/799: chown c6 4850343 1 2024-09-16T00:50:19.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/800: write d9/d3e/d4b/d6b/d6d/d97/feb [3224268,118821] 0 2024-09-16T00:50:19.571 INFO:tasks.workunit.client.1.smithi152.stdout:3/730: dread dc/d10/d47/f4e [0,4194304] 0 2024-09-16T00:50:19.572 INFO:tasks.workunit.client.1.smithi152.stdout:8/557: dwrite dd/d25/f79 [0,4194304] 0 2024-09-16T00:50:19.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/720: creat d3/d6/d8/d1d/d65/db0/df0/ff1 x:0 0 0 2024-09-16T00:50:19.575 INFO:tasks.workunit.client.1.smithi152.stdout:6/751: write db/d12/f44 [1037909,65044] 0 2024-09-16T00:50:19.576 INFO:tasks.workunit.client.0.smithi053.stdout:1/274: dread d5/dd/f31 [4194304,4194304] 0 2024-09-16T00:50:19.578 INFO:tasks.workunit.client.0.smithi053.stdout:0/340: link d4/d13/d2d/f50 d4/dc/d1e/d1f/d40/d44/d49/f70 0 2024-09-16T00:50:19.579 INFO:tasks.workunit.client.0.smithi053.stdout:9/329: chown d8/d22/d26/f45 64379 1 2024-09-16T00:50:19.579 INFO:tasks.workunit.client.0.smithi053.stdout:9/330: fsync d8/fc 0 2024-09-16T00:50:19.582 INFO:tasks.workunit.client.0.smithi053.stdout:3/325: dwrite d1/d5/d14/f2d [0,4194304] 0 2024-09-16T00:50:19.583 INFO:tasks.workunit.client.0.smithi053.stdout:9/331: creat d8/d22/d26/f6f x:0 0 0 2024-09-16T00:50:19.586 INFO:tasks.workunit.client.0.smithi053.stdout:1/275: getdents d5/d7 0 2024-09-16T00:50:19.589 INFO:tasks.workunit.client.1.smithi152.stdout:7/712: rename d9/fbc to d9/d31/d65/ff1 0 2024-09-16T00:50:19.589 INFO:tasks.workunit.client.0.smithi053.stdout:3/326: dread d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:19.590 INFO:tasks.workunit.client.1.smithi152.stdout:2/688: chown d4/d19/d20/d28/d2c/f7b 5125750 1 2024-09-16T00:50:19.592 INFO:tasks.workunit.client.1.smithi152.stdout:5/880: creat d6/d57/d2b/d50/d64/df5/d10a/f144 x:0 0 0 2024-09-16T00:50:19.594 INFO:tasks.workunit.client.1.smithi152.stdout:1/801: creat d9/d3e/d41/d31/d48/d4a/dc1/f12a x:0 0 0 2024-09-16T00:50:19.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/327: mkdir d1/d5/d16/d5e/d69 0 2024-09-16T00:50:19.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/328: readlink d1/d5/d11/d3a/l48 0 2024-09-16T00:50:19.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/329: dread - d1/d5/f68 zero size 2024-09-16T00:50:19.595 INFO:tasks.workunit.client.1.smithi152.stdout:2/689: dread d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:19.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/558: mkdir dd/d98/da5/dbb 0 2024-09-16T00:50:19.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/559: creat dd/d50/d88/fbc x:0 0 0 2024-09-16T00:50:19.598 INFO:tasks.workunit.client.1.smithi152.stdout:0/721: stat d3/d6/d6d/l9a 0 2024-09-16T00:50:19.599 INFO:tasks.workunit.client.0.smithi053.stdout:4/233: dwrite d0/d2/d26/f50 [0,4194304] 0 2024-09-16T00:50:19.600 INFO:tasks.workunit.client.0.smithi053.stdout:8/358: dwrite d10/f1e [0,4194304] 0 2024-09-16T00:50:19.600 INFO:tasks.workunit.client.0.smithi053.stdout:8/359: stat d10/f19 0 2024-09-16T00:50:19.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/881: dread d6/f2d [0,4194304] 0 2024-09-16T00:50:19.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/882: read d6/ff [572800,18178] 0 2024-09-16T00:50:19.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/883: chown d6/d16/d1f/db5/dd3 63216 1 2024-09-16T00:50:19.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/752: link db/da8/db7/cbb db/dba/cee 0 2024-09-16T00:50:19.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/753: stat db/d12/d23/d4a/d43/d48/ce9 0 2024-09-16T00:50:19.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/754: stat db/d12/d1c/fa5 0 2024-09-16T00:50:19.603 INFO:tasks.workunit.client.0.smithi053.stdout:8/360: dread d10/d21/d28/f32 [0,4194304] 0 2024-09-16T00:50:19.603 INFO:tasks.workunit.client.1.smithi152.stdout:7/713: rename d9/d31/d64/d3c/d5b/l6c to d9/d31/d64/d3c/lf2 0 2024-09-16T00:50:19.605 INFO:tasks.workunit.client.1.smithi152.stdout:0/722: dread d3/d6/f42 [0,4194304] 0 2024-09-16T00:50:19.611 INFO:tasks.workunit.client.0.smithi053.stdout:8/361: creat d10/d1c/d2b/d58/f79 x:0 0 0 2024-09-16T00:50:19.613 INFO:tasks.workunit.client.0.smithi053.stdout:5/241: dwrite d3/f4 [0,4194304] 0 2024-09-16T00:50:19.613 INFO:tasks.workunit.client.1.smithi152.stdout:8/560: creat dd/d25/da4/fbd x:0 0 0 2024-09-16T00:50:19.613 INFO:tasks.workunit.client.1.smithi152.stdout:8/561: truncate dd/d25/d77/fa3 627387 0 2024-09-16T00:50:19.613 INFO:tasks.workunit.client.1.smithi152.stdout:3/731: dwrite dc/d10/d17/d1c/d1f/d9e/fd6 [0,4194304] 0 2024-09-16T00:50:19.614 INFO:tasks.workunit.client.0.smithi053.stdout:8/362: creat d10/d52/d5b/d66/f7a x:0 0 0 2024-09-16T00:50:19.614 INFO:tasks.workunit.client.0.smithi053.stdout:8/363: creat d10/d1c/f7b x:0 0 0 2024-09-16T00:50:19.614 INFO:tasks.workunit.client.0.smithi053.stdout:8/364: creat d10/d21/d28/d3c/f7c x:0 0 0 2024-09-16T00:50:19.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/806: dwrite d2/db/d39/d3c/d7f/d98/f74 [0,4194304] 0 2024-09-16T00:50:19.615 INFO:tasks.workunit.client.0.smithi053.stdout:6/239: dwrite d1/dc/d39/f2c [0,4194304] 0 2024-09-16T00:50:19.615 INFO:tasks.workunit.client.0.smithi053.stdout:2/231: dwrite d6/d9/f1e [0,4194304] 0 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:6/240: fdatasync d1/dc/d39/f13 0 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:2/232: fsync d6/d9/f1d 0 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:2/233: fdatasync d6/f7 0 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:2/234: chown d6/d9/d14/l21 3108962 1 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:2/235: fdatasync d6/d9/f25 0 2024-09-16T00:50:19.616 INFO:tasks.workunit.client.0.smithi053.stdout:2/236: write d6/d9/d14/f1f [1120064,52943] 0 2024-09-16T00:50:19.617 INFO:tasks.workunit.client.0.smithi053.stdout:0/341: dwrite d4/d13/f1c [4194304,4194304] 0 2024-09-16T00:50:19.617 INFO:tasks.workunit.client.0.smithi053.stdout:9/332: dwrite d8/f17 [0,4194304] 0 2024-09-16T00:50:19.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.628+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6470005190 con 0x7f64900ffb60 2024-09-16T00:50:19.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.628+0000 7f648cff9700 1 -- 172.21.15.53:0/318683652 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6478015090 con 0x7f64900ffb60 2024-09-16T00:50:19.630 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:50:19.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 msgr2=0x7f647c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:19.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 0x7f647c06fab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f648000d010 tx=0x7f6480005dc0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 msgr2=0x7f6490108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:19.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 0x7f6490108c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f647800b3d0 tx=0x7f647800b6e0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 shutdown_connections 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f647c06d600 0x7f647c06fab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64900fe8c0 0x7f6490108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.631+0000 7f6495ff5700 1 --2- 172.21.15.53:0/318683652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64900ffb60 0x7f6490108c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.632+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 >> 172.21.15.53:0/318683652 conn(0x7f64900f9f10 msgr2=0x7f6490102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.632+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 shutdown_connections 2024-09-16T00:50:19.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:19.632+0000 7f6495ff5700 1 -- 172.21.15.53:0/318683652 wait complete. 2024-09-16T00:50:19.634 INFO:tasks.workunit.client.0.smithi053.stdout:0/342: read d4/dc/d1e/d1f/d40/f62 [3538022,92179] 0 2024-09-16T00:50:19.634 INFO:tasks.workunit.client.0.smithi053.stdout:0/343: stat d4/dc 0 2024-09-16T00:50:19.640 INFO:tasks.workunit.client.0.smithi053.stdout:3/330: dwrite d1/d5/d16/f1f [0,4194304] 0 2024-09-16T00:50:19.655 INFO:tasks.workunit.client.0.smithi053.stdout:3/331: dread d1/d5/d16/d47/f4b [0,4194304] 0 2024-09-16T00:50:19.659 INFO:tasks.workunit.client.1.smithi152.stdout:7/714: dwrite d9/db6/fe4 [0,4194304] 0 2024-09-16T00:50:19.660 INFO:tasks.workunit.client.0.smithi053.stdout:4/234: dwrite d0/d3c/d48/f52 [0,4194304] 0 2024-09-16T00:50:19.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/802: dwrite d9/d3e/d41/f3b [0,4194304] 0 2024-09-16T00:50:19.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/803: chown d9/d3e/d41/d31/d48/f65 14 1 2024-09-16T00:50:19.661 INFO:tasks.workunit.client.0.smithi053.stdout:0/344: dwrite d4/d13/f38 [0,4194304] 0 2024-09-16T00:50:19.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/237: dwrite d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:19.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/238: dread - d6/d29/d2b/f34 zero size 2024-09-16T00:50:19.661 INFO:tasks.workunit.client.1.smithi152.stdout:4/807: dwrite d2/d1e/d28/d7b/fe2 [0,4194304] 0 2024-09-16T00:50:19.662 INFO:tasks.workunit.client.1.smithi152.stdout:4/808: chown d2/d1e/c43 64797 1 2024-09-16T00:50:19.671 INFO:tasks.workunit.client.1.smithi152.stdout:7/715: dread d9/d31/d65/d8a/d41/f62 [0,4194304] 0 2024-09-16T00:50:19.683 INFO:tasks.workunit.client.0.smithi053.stdout:4/235: dwrite d0/d3c/d48/f4c [0,4194304] 0 2024-09-16T00:50:19.683 INFO:tasks.workunit.client.0.smithi053.stdout:2/239: dwrite d6/d9/dd/f31 [0,4194304] 0 2024-09-16T00:50:19.689 INFO:tasks.workunit.client.0.smithi053.stdout:2/240: dread d6/d9/dd/f3a [0,4194304] 0 2024-09-16T00:50:19.689 INFO:tasks.workunit.client.0.smithi053.stdout:2/241: write d6/f8 [904293,86889] 0 2024-09-16T00:50:19.690 INFO:tasks.workunit.client.0.smithi053.stdout:2/242: readlink d6/d9/d14/l19 0 2024-09-16T00:50:19.690 INFO:tasks.workunit.client.0.smithi053.stdout:2/243: write d6/d9/dd/f3a [4503262,63002] 0 2024-09-16T00:50:19.690 INFO:tasks.workunit.client.0.smithi053.stdout:2/244: dread - d6/d29/d2b/f34 zero size 2024-09-16T00:50:19.711 INFO:tasks.workunit.client.0.smithi053.stdout:2/245: dwrite d6/d9/f12 [4194304,4194304] 0 2024-09-16T00:50:19.711 INFO:tasks.workunit.client.0.smithi053.stdout:2/246: fsync d6/d9/d14/f15 0 2024-09-16T00:50:19.712 INFO:tasks.workunit.client.1.smithi152.stdout:0/723: creat d3/d6/d2e/d58/ff2 x:0 0 0 2024-09-16T00:50:19.713 INFO:tasks.workunit.client.0.smithi053.stdout:5/242: mkdir d3/d7/d2b/d4b/d51 0 2024-09-16T00:50:19.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/562: creat dd/d98/fbe x:0 0 0 2024-09-16T00:50:19.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/563: creat dd/d50/d88/fbf x:0 0 0 2024-09-16T00:50:19.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/564: chown dd/d25/l3b 215497 1 2024-09-16T00:50:19.719 INFO:tasks.workunit.client.0.smithi053.stdout:8/365: creat d10/d52/d5b/f7d x:0 0 0 2024-09-16T00:50:19.728 INFO:tasks.workunit.client.0.smithi053.stdout:6/241: mknod d1/dc/d1e/d41/c5a 0 2024-09-16T00:50:19.728 INFO:tasks.workunit.client.0.smithi053.stdout:6/242: chown d1/dc/d39/l1a 42590 1 2024-09-16T00:50:19.728 INFO:tasks.workunit.client.0.smithi053.stdout:6/243: dread - d1/dc/d39/f56 zero size 2024-09-16T00:50:19.728 INFO:tasks.workunit.client.0.smithi053.stdout:6/244: fdatasync d1/dc/f48 0 2024-09-16T00:50:19.728 INFO:tasks.workunit.client.0.smithi053.stdout:6/245: truncate d1/dc/d39/f2e 1688890 0 2024-09-16T00:50:19.731 INFO:tasks.workunit.client.1.smithi152.stdout:9/727: sync 2024-09-16T00:50:19.732 INFO:tasks.workunit.client.1.smithi152.stdout:9/728: write d1/d4e/d34/fe6 [541895,71288] 0 2024-09-16T00:50:19.735 INFO:tasks.workunit.client.0.smithi053.stdout:9/333: rename f2 to d8/d1c/d2b/d5c/f70 0 2024-09-16T00:50:19.735 INFO:tasks.workunit.client.0.smithi053.stdout:9/334: fsync d8/d1c/d2b/d2c/f41 0 2024-09-16T00:50:19.741 INFO:tasks.workunit.client.0.smithi053.stdout:3/332: creat d1/d5/d31/d42/f6a x:0 0 0 2024-09-16T00:50:19.751 INFO:tasks.workunit.client.0.smithi053.stdout:0/345: truncate d4/d13/f63 3889899 0 2024-09-16T00:50:19.756 INFO:tasks.workunit.client.1.smithi152.stdout:6/755: rmdir db/d12 39 2024-09-16T00:50:19.759 INFO:tasks.workunit.client.0.smithi053.stdout:4/236: truncate d0/d2/dd/f3e 2238637 0 2024-09-16T00:50:19.761 INFO:tasks.workunit.client.0.smithi053.stdout:2/247: creat d6/f41 x:0 0 0 2024-09-16T00:50:19.763 INFO:tasks.workunit.client.0.smithi053.stdout:5/243: truncate d3/f6 3093309 0 2024-09-16T00:50:19.763 INFO:tasks.workunit.client.0.smithi053.stdout:5/244: dread - d3/d7/d2b/f3a zero size 2024-09-16T00:50:19.765 INFO:tasks.workunit.client.0.smithi053.stdout:3/333: dwrite d1/d5/d11/f25 [0,4194304] 0 2024-09-16T00:50:19.765 INFO:tasks.workunit.client.0.smithi053.stdout:3/334: chown d1/d5/d16/d47/d4c/d50/l57 963887 1 2024-09-16T00:50:19.766 INFO:tasks.workunit.client.0.smithi053.stdout:8/366: creat d10/d1c/d2b/d40/d50/f7e x:0 0 0 2024-09-16T00:50:19.766 INFO:tasks.workunit.client.0.smithi053.stdout:8/367: readlink d10/d21/d28/l29 0 2024-09-16T00:50:19.768 INFO:tasks.workunit.client.0.smithi053.stdout:2/248: dread d6/f23 [0,4194304] 0 2024-09-16T00:50:19.769 INFO:tasks.workunit.client.0.smithi053.stdout:5/245: dread d3/f20 [0,4194304] 0 2024-09-16T00:50:19.776 INFO:tasks.workunit.client.0.smithi053.stdout:2/249: write d6/d9/f1e [1107973,16345] 0 2024-09-16T00:50:19.780 INFO:tasks.workunit.client.0.smithi053.stdout:6/246: mknod d1/dc/d3c/d4a/c5b 0 2024-09-16T00:50:19.782 INFO:tasks.workunit.client.0.smithi053.stdout:9/335: creat d8/d19/d31/f71 x:0 0 0 2024-09-16T00:50:19.784 INFO:tasks.workunit.client.0.smithi053.stdout:0/346: truncate d4/d13/f41 1869013 0 2024-09-16T00:50:19.784 INFO:tasks.workunit.client.0.smithi053.stdout:0/347: dread - d4/dc/d1e/d22/f65 zero size 2024-09-16T00:50:19.786 INFO:tasks.workunit.client.0.smithi053.stdout:4/237: link d0/d31/l3b d0/d2/dd/d25/l56 0 2024-09-16T00:50:19.788 INFO:tasks.workunit.client.0.smithi053.stdout:3/335: creat d1/d4e/f6b x:0 0 0 2024-09-16T00:50:19.792 INFO:tasks.workunit.client.0.smithi053.stdout:8/368: rename d10/d21/d28/d3c/f45 to d10/d21/f7f 0 2024-09-16T00:50:19.792 INFO:tasks.workunit.client.0.smithi053.stdout:2/250: dwrite d6/d29/d2b/f34 [0,4194304] 0 2024-09-16T00:50:19.793 INFO:tasks.workunit.client.0.smithi053.stdout:6/247: read d1/f4f [131390,17822] 0 2024-09-16T00:50:19.793 INFO:tasks.workunit.client.0.smithi053.stdout:6/248: dread - d1/dc/d45/f59 zero size 2024-09-16T00:50:19.795 INFO:tasks.workunit.client.0.smithi053.stdout:5/246: symlink d3/d7/l52 0 2024-09-16T00:50:19.799 INFO:tasks.workunit.client.0.smithi053.stdout:9/336: creat d8/d22/f72 x:0 0 0 2024-09-16T00:50:19.802 INFO:tasks.workunit.client.0.smithi053.stdout:0/348: mkdir d4/dc/d25/d34/d71 0 2024-09-16T00:50:19.805 INFO:tasks.workunit.client.0.smithi053.stdout:4/238: rmdir d0/d2/d1e 39 2024-09-16T00:50:19.805 INFO:tasks.workunit.client.0.smithi053.stdout:4/239: dread - d0/da/f4a zero size 2024-09-16T00:50:19.806 INFO:tasks.workunit.client.1.smithi152.stdout:7/716: creat d9/db6/dde/ff3 x:0 0 0 2024-09-16T00:50:19.807 INFO:tasks.workunit.client.0.smithi053.stdout:3/336: mkdir d1/d5/d16/d47/d6c 0 2024-09-16T00:50:19.807 INFO:tasks.workunit.client.0.smithi053.stdout:3/337: read - d1/d4e/f6b zero size 2024-09-16T00:50:19.808 INFO:tasks.workunit.client.0.smithi053.stdout:5/247: dwrite d3/d7/d12/f4e [0,4194304] 0 2024-09-16T00:50:19.808 INFO:tasks.workunit.client.0.smithi053.stdout:5/248: write d3/d7/d2b/d37/f44 [1035923,31305] 0 2024-09-16T00:50:19.808 INFO:tasks.workunit.client.1.smithi152.stdout:0/724: mkdir d3/d6/d8/d1d/d23/d4b/d54/df3 0 2024-09-16T00:50:19.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/565: getdents dd/d98/da5 0 2024-09-16T00:50:19.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/566: fsync dd/d23/f55 0 2024-09-16T00:50:19.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/567: write dd/d15/d1a/f45 [1682732,129805] 0 2024-09-16T00:50:19.814 INFO:tasks.workunit.client.0.smithi053.stdout:2/251: creat d6/d9/dd/d3e/f42 x:0 0 0 2024-09-16T00:50:19.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/732: rmdir dc/d10/d17/d1c/d1f/d24 39 2024-09-16T00:50:19.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/733: creat dc/d10/d17/d1c/d50/d63/fe5 x:0 0 0 2024-09-16T00:50:19.818 INFO:tasks.workunit.client.0.smithi053.stdout:6/249: unlink d1/dc/f51 0 2024-09-16T00:50:19.818 INFO:tasks.workunit.client.0.smithi053.stdout:6/250: fsync d1/dc/d45/f59 0 2024-09-16T00:50:19.819 INFO:tasks.workunit.client.1.smithi152.stdout:9/729: mknod d1/d7/d77/d32/da5/cec 0 2024-09-16T00:50:19.821 INFO:tasks.workunit.client.1.smithi152.stdout:8/568: dread dd/d15/d49/f13 [0,4194304] 0 2024-09-16T00:50:19.821 INFO:tasks.workunit.client.0.smithi053.stdout:9/337: link d8/d1c/d2b/d49/l4e d8/d19/l73 0 2024-09-16T00:50:19.821 INFO:tasks.workunit.client.0.smithi053.stdout:9/338: stat d8/l10 0 2024-09-16T00:50:19.823 INFO:tasks.workunit.client.1.smithi152.stdout:3/734: read dc/d10/f7a [5847519,128923] 0 2024-09-16T00:50:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:3/735: write dc/d10/d47/f4e [4835904,91426] 0 2024-09-16T00:50:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:9/730: dread d1/d7/d13/d80/f91 [0,4194304] 0 2024-09-16T00:50:19.825 INFO:tasks.workunit.client.0.smithi053.stdout:0/349: mkdir d4/dc/d1e/d1f/d72 0 2024-09-16T00:50:19.825 INFO:tasks.workunit.client.0.smithi053.stdout:0/350: stat d4/d13/f63 0 2024-09-16T00:50:19.825 INFO:tasks.workunit.client.0.smithi053.stdout:0/351: write d4/f4b [2653346,110056] 0 2024-09-16T00:50:19.825 INFO:tasks.workunit.client.0.smithi053.stdout:0/352: write d4/dc/d25/d34/d2a/f67 [211570,30647] 0 2024-09-16T00:50:19.825 INFO:tasks.workunit.client.0.smithi053.stdout:0/353: truncate d4/f30 1930358 0 2024-09-16T00:50:19.826 INFO:tasks.workunit.client.0.smithi053.stdout:4/240: getdents d0/d2/dd/d25/d37 0 2024-09-16T00:50:19.827 INFO:tasks.workunit.client.0.smithi053.stdout:2/252: dwrite d6/d9/f1d [4194304,4194304] 0 2024-09-16T00:50:19.827 INFO:tasks.workunit.client.0.smithi053.stdout:2/253: write d6/d29/f3b [808981,90876] 0 2024-09-16T00:50:19.831 INFO:tasks.workunit.client.0.smithi053.stdout:0/354: dread d4/dc/d25/d34/d2a/f4e [0,4194304] 0 2024-09-16T00:50:19.832 INFO:tasks.workunit.client.0.smithi053.stdout:3/338: unlink d1/le 0 2024-09-16T00:50:19.832 INFO:tasks.workunit.client.0.smithi053.stdout:3/339: fsync d1/d5/d16/f1f 0 2024-09-16T00:50:19.836 INFO:tasks.workunit.client.1.smithi152.stdout:2/690: rename d4/d19 to d4/d44/d7a/dc7/de4 0 2024-09-16T00:50:19.838 INFO:tasks.workunit.client.1.smithi152.stdout:1/804: getdents d9/d3e 0 2024-09-16T00:50:19.838 INFO:tasks.workunit.client.1.smithi152.stdout:1/805: write d9/d3e/d4b/d6b/d6d/d82/f8e [813968,7929] 0 2024-09-16T00:50:19.839 INFO:tasks.workunit.client.0.smithi053.stdout:5/249: mkdir d3/d7/d2b/d4b/d51/d53 0 2024-09-16T00:50:19.839 INFO:tasks.workunit.client.0.smithi053.stdout:9/339: dwrite d8/f5e [0,4194304] 0 2024-09-16T00:50:19.840 INFO:tasks.workunit.client.0.smithi053.stdout:9/340: rename d8/d1c/d2b to d8/d1c/d2b/d49/d74 22 2024-09-16T00:50:19.840 INFO:tasks.workunit.client.1.smithi152.stdout:9/731: dread d1/de2/fe5 [0,4194304] 0 2024-09-16T00:50:19.841 INFO:tasks.workunit.client.1.smithi152.stdout:7/717: symlink d9/d31/d64/d3c/db9/lf4 0 2024-09-16T00:50:19.843 INFO:tasks.workunit.client.0.smithi053.stdout:6/251: mknod d1/dc/d3c/d4a/c5c 0 2024-09-16T00:50:19.850 INFO:tasks.workunit.client.1.smithi152.stdout:0/725: creat d3/d6/d2e/ff4 x:0 0 0 2024-09-16T00:50:19.850 INFO:tasks.workunit.client.1.smithi152.stdout:9/732: dread d1/d4e/d34/fe6 [0,4194304] 0 2024-09-16T00:50:19.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/726: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/la6 231 1 2024-09-16T00:50:19.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/727: write d3/d6/d8/d1d/d23/d4b/d54/f90 [3703060,19789] 0 2024-09-16T00:50:19.860 INFO:tasks.workunit.client.0.smithi053.stdout:2/254: symlink d6/d29/d2b/l43 0 2024-09-16T00:50:19.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/736: creat dc/d10/d17/d1c/d1f/fe6 x:0 0 0 2024-09-16T00:50:19.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/737: write dc/d10/d17/d1c/d50/d63/fc3 [937329,11152] 0 2024-09-16T00:50:19.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/738: chown dc/c32 254 1 2024-09-16T00:50:19.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/739: write dc/d10/d17/d1c/d1f/d24/f39 [1103370,25539] 0 2024-09-16T00:50:19.865 INFO:tasks.workunit.client.1.smithi152.stdout:5/884: rename d6/d57/d54/f91 to d6/d57/d2b/dee/d135/d142/f145 0 2024-09-16T00:50:19.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/885: chown d6/d16/d1f/cc2 2127 1 2024-09-16T00:50:19.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/806: symlink d9/d3e/d7b/df0/d107/l12b 0 2024-09-16T00:50:19.868 INFO:tasks.workunit.client.0.smithi053.stdout:9/341: symlink d8/d22/l75 0 2024-09-16T00:50:19.868 INFO:tasks.workunit.client.0.smithi053.stdout:9/342: write d8/f39 [1046684,102104] 0 2024-09-16T00:50:19.869 INFO:tasks.workunit.client.0.smithi053.stdout:9/343: write d8/d1c/d2b/d49/f6b [484902,87491] 0 2024-09-16T00:50:19.869 INFO:tasks.workunit.client.0.smithi053.stdout:9/344: fdatasync d8/f35 0 2024-09-16T00:50:19.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/718: creat d9/d31/ff5 x:0 0 0 2024-09-16T00:50:19.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/719: truncate d9/fa6 358370 0 2024-09-16T00:50:19.870 INFO:tasks.workunit.client.0.smithi053.stdout:6/252: getdents d1/dc/d3c 0 2024-09-16T00:50:19.870 INFO:tasks.workunit.client.0.smithi053.stdout:6/253: chown d1/dc/d45/f59 501051 1 2024-09-16T00:50:19.872 INFO:tasks.workunit.client.1.smithi152.stdout:9/733: dread d1/fb [0,4194304] 0 2024-09-16T00:50:19.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/728: link d3/d6/d8/d9e/fc8 d3/d6/d2e/d58/ff5 0 2024-09-16T00:50:19.874 INFO:tasks.workunit.client.0.smithi053.stdout:4/241: link d0/d2/d26/f50 d0/d2/d1e/d4b/f57 0 2024-09-16T00:50:19.880 INFO:tasks.workunit.client.1.smithi152.stdout:8/569: rename dd/ff to dd/d50/d29/d2f/d53/fc0 0 2024-09-16T00:50:19.881 INFO:tasks.workunit.client.0.smithi053.stdout:0/355: dwrite d4/f69 [0,4194304] 0 2024-09-16T00:50:19.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/729: dread d3/d6/d8/d1d/d65/db0/fc9 [0,4194304] 0 2024-09-16T00:50:19.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/730: chown d3/d6/d8/d1d/d23/c28 791958 1 2024-09-16T00:50:19.883 INFO:tasks.workunit.client.0.smithi053.stdout:9/345: rename d8/d22/d26/f45 to d8/d1c/d2b/f76 0 2024-09-16T00:50:19.883 INFO:tasks.workunit.client.0.smithi053.stdout:9/346: creat d8/d1c/d2b/d2c/f77 x:0 0 0 2024-09-16T00:50:19.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/720: mknod d9/d31/d64/d3c/cf6 0 2024-09-16T00:50:19.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/721: chown d9/d31/d65/d8a/d41 108524862 1 2024-09-16T00:50:19.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/722: chown d9/fa6 6 1 2024-09-16T00:50:19.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/723: dread - d9/d31/d65/d8a/d90/fbb zero size 2024-09-16T00:50:19.886 INFO:tasks.workunit.client.0.smithi053.stdout:6/254: dread d1/f9 [4194304,4194304] 0 2024-09-16T00:50:19.886 INFO:tasks.workunit.client.0.smithi053.stdout:6/255: fdatasync d1/f9 0 2024-09-16T00:50:19.887 INFO:tasks.workunit.client.1.smithi152.stdout:5/886: rename d6/d16/c9c to d6/d16/d1f/d8c/db8/c146 0 2024-09-16T00:50:19.887 INFO:tasks.workunit.client.0.smithi053.stdout:4/242: mkdir d0/d3c/d48/d58 0 2024-09-16T00:50:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:8/570: symlink dd/d98/da5/lc1 0 2024-09-16T00:50:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:8/571: creat dd/d25/da4/fc2 x:0 0 0 2024-09-16T00:50:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:8/572: write dd/d50/d29/d2f/d53/f73 [528432,41035] 0 2024-09-16T00:50:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:8/573: creat dd/d25/da4/fc3 x:0 0 0 2024-09-16T00:50:19.891 INFO:tasks.workunit.client.1.smithi152.stdout:0/731: mkdir d3/d6/d2e/de9/df6 0 2024-09-16T00:50:19.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/724: creat d9/d31/d65/ff7 x:0 0 0 2024-09-16T00:50:19.893 INFO:tasks.workunit.client.0.smithi053.stdout:0/356: rename d4/dc/d1e/d1f/d72 to d4/dc/d1e/d1f/d40/d73 0 2024-09-16T00:50:19.893 INFO:tasks.workunit.client.0.smithi053.stdout:0/357: creat d4/dc/d25/d34/f74 x:0 0 0 2024-09-16T00:50:19.894 INFO:tasks.workunit.client.1.smithi152.stdout:1/807: rename d9/d3e/d41/d31/d48/dd9 to d9/d3e/d41/d31/da5/d12c 0 2024-09-16T00:50:19.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/887: creat d6/d16/d1f/d6c/de2/f147 x:0 0 0 2024-09-16T00:50:19.895 INFO:tasks.workunit.client.0.smithi053.stdout:9/347: truncate d8/fb 4596144 0 2024-09-16T00:50:19.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/574: creat dd/db9/fc4 x:0 0 0 2024-09-16T00:50:19.902 INFO:tasks.workunit.client.1.smithi152.stdout:1/808: creat d9/d3e/d7b/df0/f12d x:0 0 0 2024-09-16T00:50:19.905 INFO:tasks.workunit.client.0.smithi053.stdout:6/256: dread d1/f2b [0,4194304] 0 2024-09-16T00:50:19.905 INFO:tasks.workunit.client.0.smithi053.stdout:6/257: stat d1/dc/d3d/f55 0 2024-09-16T00:50:19.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/575: write dd/d23/f3e [1363772,117503] 0 2024-09-16T00:50:19.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/576: chown dd/d50/d29/d2f/d53/f73 7 1 2024-09-16T00:50:19.906 INFO:tasks.workunit.client.1.smithi152.stdout:5/888: link d6/c5b d6/d16/d1f/db5/dcb/c148 0 2024-09-16T00:50:19.907 INFO:tasks.workunit.client.0.smithi053.stdout:6/258: read d1/dc/d39/f2e [184675,71103] 0 2024-09-16T00:50:19.909 INFO:tasks.workunit.client.1.smithi152.stdout:8/577: mknod dd/d15/cc5 0 2024-09-16T00:50:19.910 INFO:tasks.workunit.client.0.smithi053.stdout:5/250: dwrite d3/f8 [4194304,4194304] 0 2024-09-16T00:50:19.910 INFO:tasks.workunit.client.0.smithi053.stdout:3/340: dwrite d1/d5/f40 [0,4194304] 0 2024-09-16T00:50:19.910 INFO:tasks.workunit.client.0.smithi053.stdout:5/251: readlink d3/d7/d24/d34/l48 0 2024-09-16T00:50:19.911 INFO:tasks.workunit.client.0.smithi053.stdout:3/341: write d1/d5/f2f [594982,81220] 0 2024-09-16T00:50:19.912 INFO:tasks.workunit.client.1.smithi152.stdout:2/691: dwrite d4/d44/d7a/dc7/de4/d20/d28/f68 [0,4194304] 0 2024-09-16T00:50:19.913 INFO:tasks.workunit.client.0.smithi053.stdout:5/252: creat d3/d7/d2b/d4b/d4f/f54 x:0 0 0 2024-09-16T00:50:19.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/578: mkdir dd/d50/d29/dc6 0 2024-09-16T00:50:19.914 INFO:tasks.workunit.client.0.smithi053.stdout:3/342: fdatasync d1/d5/d11/f55 0 2024-09-16T00:50:19.917 INFO:tasks.workunit.client.0.smithi053.stdout:3/343: truncate d1/d5/d11/f12 3276018 0 2024-09-16T00:50:19.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/725: write d9/d31/d64/f4f [561558,79798] 0 2024-09-16T00:50:19.919 INFO:tasks.workunit.client.1.smithi152.stdout:2/692: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/ce5 0 2024-09-16T00:50:19.920 INFO:tasks.workunit.client.1.smithi152.stdout:4/809: sync 2024-09-16T00:50:19.920 INFO:tasks.workunit.client.1.smithi152.stdout:4/810: readlink d2/l11 0 2024-09-16T00:50:19.922 INFO:tasks.workunit.client.0.smithi053.stdout:3/344: creat d1/f6d x:0 0 0 2024-09-16T00:50:19.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/726: mknod d9/d31/d64/d3c/d5b/dd0/cf8 0 2024-09-16T00:50:19.927 INFO:tasks.workunit.client.1.smithi152.stdout:4/811: symlink d2/d41/df1/l109 0 2024-09-16T00:50:19.929 INFO:tasks.workunit.client.1.smithi152.stdout:6/756: dwrite db/d28/fd6 [0,4194304] 0 2024-09-16T00:50:19.929 INFO:tasks.workunit.client.1.smithi152.stdout:6/757: fdatasync db/d12/d23/d4a/d43/d48/f7f 0 2024-09-16T00:50:19.929 INFO:tasks.workunit.client.1.smithi152.stdout:3/740: dwrite dc/d10/d17/d5a/d68/f7c [0,4194304] 0 2024-09-16T00:50:19.929 INFO:tasks.workunit.client.1.smithi152.stdout:3/741: write dc/d10/d17/d5a/db2/d6f/dbb/fad [743298,80425] 0 2024-09-16T00:50:19.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/727: mknod d9/d31/d65/d8a/d90/cf9 0 2024-09-16T00:50:19.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/728: read - d9/d31/d65/d8a/d41/d46/d7d/dac/fe9 zero size 2024-09-16T00:50:19.934 INFO:tasks.workunit.client.1.smithi152.stdout:2/693: mkdir d4/d44/d7a/dc7/de4/d20/d28/d2c/de6 0 2024-09-16T00:50:19.935 INFO:tasks.workunit.client.1.smithi152.stdout:4/812: link d2/d1e/d28/d7b/db0/ld2 d2/db/d39/d3c/d76/db4/l10a 0 2024-09-16T00:50:19.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/742: symlink dc/d10/d17/d5a/db2/d6f/dbb/le7 0 2024-09-16T00:50:19.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/743: chown dc/d10/d17/d1c/d50/d55/lb4 2797 1 2024-09-16T00:50:19.942 INFO:tasks.workunit.client.1.smithi152.stdout:3/744: fsync f6 0 2024-09-16T00:50:19.942 INFO:tasks.workunit.client.1.smithi152.stdout:7/729: creat d9/d80/d82/ffa x:0 0 0 2024-09-16T00:50:19.942 INFO:tasks.workunit.client.1.smithi152.stdout:7/730: creat d9/d31/dc4/ffb x:0 0 0 2024-09-16T00:50:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/731: write d9/d10/dc0/fce [425783,112976] 0 2024-09-16T00:50:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/732: write d9/d31/d65/ff7 [1045798,107250] 0 2024-09-16T00:50:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/733: chown d9/d10/dc0/fce 10519 1 2024-09-16T00:50:19.945 INFO:tasks.workunit.client.0.smithi053.stdout:3/345: dwrite d1/d5/d31/f38 [4194304,4194304] 0 2024-09-16T00:50:19.952 INFO:tasks.workunit.client.0.smithi053.stdout:3/346: write d1/d5/f68 [488395,71381] 0 2024-09-16T00:50:19.954 INFO:tasks.workunit.client.1.smithi152.stdout:2/694: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8/fe7 x:0 0 0 2024-09-16T00:50:19.955 INFO:tasks.workunit.client.1.smithi152.stdout:3/745: mkdir dc/d10/d17/d1c/d1f/d24/db9/de8 0 2024-09-16T00:50:19.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/695: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/ce8 0 2024-09-16T00:50:19.958 INFO:tasks.workunit.client.1.smithi152.stdout:2/696: symlink d4/d44/d7a/dc7/de4/d94/d93/le9 0 2024-09-16T00:50:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:3/347: write d1/d5/d11/f25 [2098199,21046] 0 2024-09-16T00:50:19.962 INFO:tasks.workunit.client.0.smithi053.stdout:3/348: rename d1/d5/f2f to d1/d5/d11/d3a/f6e 0 2024-09-16T00:50:19.964 INFO:tasks.workunit.client.0.smithi053.stdout:3/349: dread d1/d5/d14/f2a [0,4194304] 0 2024-09-16T00:50:19.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/813: dread d2/db/d39/d3c/d76/db4/fc3 [0,4194304] 0 2024-09-16T00:50:19.969 INFO:tasks.workunit.client.1.smithi152.stdout:4/814: symlink d2/db/d39/d3c/d7f/l10b 0 2024-09-16T00:50:19.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/697: write d4/d44/d7a/dc7/de4/d20/d28/f52 [739684,75341] 0 2024-09-16T00:50:19.975 INFO:tasks.workunit.client.1.smithi152.stdout:0/732: dwrite d3/d6/d8/f84 [0,4194304] 0 2024-09-16T00:50:19.975 INFO:tasks.workunit.client.1.smithi152.stdout:0/733: fdatasync d3/d6/d8/d1d/f20 0 2024-09-16T00:50:19.975 INFO:tasks.workunit.client.1.smithi152.stdout:0/734: fsync d3/d6/d2e/d58/ff2 0 2024-09-16T00:50:19.975 INFO:tasks.workunit.client.0.smithi053.stdout:4/243: dwrite d0/d2/d26/f50 [0,4194304] 0 2024-09-16T00:50:19.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/255: dwrite d6/d9/dd/d3e/f42 [0,4194304] 0 2024-09-16T00:50:19.980 INFO:tasks.workunit.client.1.smithi152.stdout:0/735: creat d3/d6/d8/d9e/ff7 x:0 0 0 2024-09-16T00:50:19.981 INFO:tasks.workunit.client.1.smithi152.stdout:0/736: fdatasync d3/d6/d8/d1d/d23/d25/d45/f5f 0 2024-09-16T00:50:19.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/734: write d9/d31/d65/d8a/d41/f58 [3682575,7420] 0 2024-09-16T00:50:19.982 INFO:tasks.workunit.client.1.smithi152.stdout:7/735: read d9/d31/d65/d8a/d41/d46/d7d/fb2 [754885,83900] 0 2024-09-16T00:50:19.983 INFO:tasks.workunit.client.0.smithi053.stdout:4/244: symlink d0/d3c/d48/l59 0 2024-09-16T00:50:19.985 INFO:tasks.workunit.client.1.smithi152.stdout:0/737: creat d3/d6/d8/d1d/d23/d4b/d54/ff8 x:0 0 0 2024-09-16T00:50:19.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/738: write d3/d6/d8/d1d/d65/fea [928669,41564] 0 2024-09-16T00:50:19.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/739: write d3/d6/d8/fca [417298,23684] 0 2024-09-16T00:50:19.988 INFO:tasks.workunit.client.1.smithi152.stdout:2/698: write d4/d44/d7a/dc7/de4/f72 [3295209,26180] 0 2024-09-16T00:50:19.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/736: unlink d9/d31/d64/f61 0 2024-09-16T00:50:19.991 INFO:tasks.workunit.client.1.smithi152.stdout:0/740: mknod d3/d6/d64/de5/cf9 0 2024-09-16T00:50:19.993 INFO:tasks.workunit.client.1.smithi152.stdout:2/699: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/fea x:0 0 0 2024-09-16T00:50:19.996 INFO:tasks.workunit.client.1.smithi152.stdout:3/746: dwrite dc/d10/d17/d5a/d68/f9b [0,4194304] 0 2024-09-16T00:50:19.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/809: dwrite d9/d3e/d7b/df0/d107/f39 [0,4194304] 0 2024-09-16T00:50:19.997 INFO:tasks.workunit.client.0.smithi053.stdout:9/348: dwrite d8/f1f [0,4194304] 0 2024-09-16T00:50:19.997 INFO:tasks.workunit.client.0.smithi053.stdout:5/253: dwrite d3/f32 [0,4194304] 0 2024-09-16T00:50:19.997 INFO:tasks.workunit.client.0.smithi053.stdout:0/358: fsync d4/dc/d25/d34/f74 0 2024-09-16T00:50:19.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/758: dwrite db/d12/d23/d4a/d43/f57 [4194304,4194304] 0 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:6/759: chown db/f31 222441124 1 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:6/760: chown db/d12/d20/d86/d91/fe3 376255885 1 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:6/761: truncate db/d12/d1c/fb1 1373247 0 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:6/762: readlink db/d12/d23/d3a/l7b 0 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:5/889: dwrite d6/d57/d2b/fe8 [0,4194304] 0 2024-09-16T00:50:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:5/890: dread - d6/f136 zero size 2024-09-16T00:50:20.000 INFO:tasks.workunit.client.1.smithi152.stdout:5/891: chown d6/d16/f4d 12 1 2024-09-16T00:50:20.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/815: dwrite d2/d41/fe7 [0,4194304] 0 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/816: fsync d2/db/d39/d3c/f48 0 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/817: fsync d2/fb2 0 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/818: chown d2/db/de8/lf7 235525648 1 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.0.smithi053.stdout:6/259: dwrite d1/dc/d39/f34 [0,4194304] 0 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.0.smithi053.stdout:6/260: stat d1/dc/d45 0 2024-09-16T00:50:20.002 INFO:tasks.workunit.client.0.smithi053.stdout:6/261: fdatasync d1/dc/f3e 0 2024-09-16T00:50:20.003 INFO:tasks.workunit.client.0.smithi053.stdout:6/262: fsync d1/dc/f3e 0 2024-09-16T00:50:20.003 INFO:tasks.workunit.client.0.smithi053.stdout:6/263: readlink d1/dc/l22 0 2024-09-16T00:50:20.004 INFO:tasks.workunit.client.1.smithi152.stdout:7/737: dread d9/d31/d65/d8a/d41/d46/fa2 [0,4194304] 0 2024-09-16T00:50:20.004 INFO:tasks.workunit.client.1.smithi152.stdout:7/738: chown d9/d31/d64/d3c/db9/dc2/fcd 2 1 2024-09-16T00:50:20.004 INFO:tasks.workunit.client.1.smithi152.stdout:7/739: chown d9 1335 1 2024-09-16T00:50:20.005 INFO:tasks.workunit.client.0.smithi053.stdout:5/254: dread d3/d7/d24/d34/f39 [0,4194304] 0 2024-09-16T00:50:20.007 INFO:tasks.workunit.client.1.smithi152.stdout:6/763: dread db/fe [0,4194304] 0 2024-09-16T00:50:20.013 INFO:tasks.workunit.client.1.smithi152.stdout:3/747: rename l1 to dc/d10/d17/d1c/d50/daa/le9 0 2024-09-16T00:50:20.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/700: dread d4/d44/d7a/f7c [0,4194304] 0 2024-09-16T00:50:20.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/701: chown d4/c5d 181456064 1 2024-09-16T00:50:20.018 INFO:tasks.workunit.client.1.smithi152.stdout:4/819: dread d2/db/d39/d3c/d76/db8/f34 [0,4194304] 0 2024-09-16T00:50:20.018 INFO:tasks.workunit.client.1.smithi152.stdout:0/741: dwrite d3/d6/d2e/d58/f78 [0,4194304] 0 2024-09-16T00:50:20.025 INFO:tasks.workunit.client.0.smithi053.stdout:2/256: mknod d6/d9/dd/d28/c44 0 2024-09-16T00:50:20.025 INFO:tasks.workunit.client.0.smithi053.stdout:2/257: readlink d6/d29/d2b/l43 0 2024-09-16T00:50:20.030 INFO:tasks.workunit.client.1.smithi152.stdout:2/702: write d4/d44/d7a/dc7/de4/d20/d28/d2c/f7b [187418,99515] 0 2024-09-16T00:50:20.034 INFO:tasks.workunit.client.0.smithi053.stdout:0/359: rmdir d4/d5a 39 2024-09-16T00:50:20.034 INFO:tasks.workunit.client.0.smithi053.stdout:0/360: readlink d4/dc/l53 0 2024-09-16T00:50:20.043 INFO:tasks.workunit.client.0.smithi053.stdout:3/350: dwrite d1/d5/d11/f46 [0,4194304] 0 2024-09-16T00:50:20.043 INFO:tasks.workunit.client.1.smithi152.stdout:6/764: dwrite db/d28/db3/fc4 [0,4194304] 0 2024-09-16T00:50:20.044 INFO:tasks.workunit.client.1.smithi152.stdout:1/810: dwrite d9/da/df/f42 [0,4194304] 0 2024-09-16T00:50:20.045 INFO:tasks.workunit.client.1.smithi152.stdout:4/820: dwrite d2/d1e/d28/d69/f9c [0,4194304] 0 2024-09-16T00:50:20.054 INFO:tasks.workunit.client.1.smithi152.stdout:2/703: dwrite d4/d44/d7a/dc7/de4/d20/d28/f50 [4194304,4194304] 0 2024-09-16T00:50:20.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/704: write d4/d44/d7a/dc7/fdf [330854,46036] 0 2024-09-16T00:50:20.058 INFO:tasks.workunit.client.1.smithi152.stdout:1/811: dread d9/d3e/d41/d9a/f110 [0,4194304] 0 2024-09-16T00:50:20.065 INFO:tasks.workunit.client.1.smithi152.stdout:1/812: dread d9/da/df/f2c [0,4194304] 0 2024-09-16T00:50:20.084 INFO:tasks.workunit.client.1.smithi152.stdout:5/892: mkdir d6/d16/d1f/d65/dd2/d123/d130/d149 0 2024-09-16T00:50:20.084 INFO:tasks.workunit.client.1.smithi152.stdout:5/893: write d6/d16/d1f/d6c/de2/f147 [873709,59657] 0 2024-09-16T00:50:20.089 INFO:tasks.workunit.client.0.smithi053.stdout:6/264: dread d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:20.092 INFO:tasks.workunit.client.1.smithi152.stdout:7/740: mkdir d9/d31/dfc 0 2024-09-16T00:50:20.096 INFO:tasks.workunit.client.1.smithi152.stdout:0/742: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/dfa 0 2024-09-16T00:50:20.100 INFO:tasks.workunit.client.0.smithi053.stdout:9/349: getdents d8/d1c/d2b/d2c 0 2024-09-16T00:50:20.108 INFO:tasks.workunit.client.0.smithi053.stdout:0/361: creat d4/d5a/d68/f75 x:0 0 0 2024-09-16T00:50:20.111 INFO:tasks.workunit.client.1.smithi152.stdout:6/765: mknod db/d12/d23/d4a/d43/d48/d64/dab/cef 0 2024-09-16T00:50:20.111 INFO:tasks.workunit.client.0.smithi053.stdout:3/351: readlink d1/d5/la 0 2024-09-16T00:50:20.118 INFO:tasks.workunit.client.0.smithi053.stdout:9/350: dwrite d8/d1c/d2b/f52 [0,4194304] 0 2024-09-16T00:50:20.130 INFO:tasks.workunit.client.1.smithi152.stdout:4/821: rmdir d2/db/d39/d95/d102 0 2024-09-16T00:50:20.145 INFO:tasks.workunit.client.0.smithi053.stdout:1/276: sync 2024-09-16T00:50:20.145 INFO:tasks.workunit.client.0.smithi053.stdout:7/304: sync 2024-09-16T00:50:20.146 INFO:tasks.workunit.client.0.smithi053.stdout:7/305: truncate d1/d2a/d4f/f53 4230375 0 2024-09-16T00:50:20.146 INFO:tasks.workunit.client.0.smithi053.stdout:7/306: fsync d1/d35/d4a/f4c 0 2024-09-16T00:50:20.146 INFO:tasks.workunit.client.0.smithi053.stdout:7/307: chown d1/d35/d14/c34 2874437 1 2024-09-16T00:50:20.146 INFO:tasks.workunit.client.0.smithi053.stdout:7/308: fdatasync d1/d3/f1f 0 2024-09-16T00:50:20.146 INFO:tasks.workunit.client.0.smithi053.stdout:7/309: chown d1/d2a/d4f/d52/d2c/d50 748 1 2024-09-16T00:50:20.155 INFO:tasks.workunit.client.0.smithi053.stdout:7/310: dread d1/d3/f5 [0,4194304] 0 2024-09-16T00:50:20.155 INFO:tasks.workunit.client.0.smithi053.stdout:7/311: write d1/d3/f5 [4911758,76158] 0 2024-09-16T00:50:20.162 INFO:tasks.workunit.client.0.smithi053.stdout:7/312: dread d1/d35/d4a/f56 [0,4194304] 0 2024-09-16T00:50:20.162 INFO:tasks.workunit.client.0.smithi053.stdout:7/313: creat d1/d2a/d4f/f6d x:0 0 0 2024-09-16T00:50:20.187 INFO:tasks.workunit.client.0.smithi053.stdout:5/255: getdents d3/d7/d2b/d4b/d4f 0 2024-09-16T00:50:20.190 INFO:tasks.workunit.client.0.smithi053.stdout:7/314: dwrite d1/d2a/d4f/f6d [0,4194304] 0 2024-09-16T00:50:20.191 INFO:tasks.workunit.client.0.smithi053.stdout:6/265: creat d1/dc/d1e/f5d x:0 0 0 2024-09-16T00:50:20.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:19 smithi152 ceph-mon[33237]: pgmap v10: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 168 MiB/s rd, 209 MiB/s wr, 333 op/s 2024-09-16T00:50:20.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:19 smithi152 ceph-mon[33237]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:20.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:19 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/318683652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:50:20.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/258: getdents d6/d29/d2b/d39 0 2024-09-16T00:50:20.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/259: read d6/d9/d14/f15 [4493958,66459] 0 2024-09-16T00:50:20.205 INFO:tasks.workunit.client.0.smithi053.stdout:0/362: creat d4/dc/d1e/d1f/d40/d44/f76 x:0 0 0 2024-09-16T00:50:20.205 INFO:tasks.workunit.client.0.smithi053.stdout:0/363: chown d4/dc/d1e/d1f/d40/d73 2883 1 2024-09-16T00:50:20.205 INFO:tasks.workunit.client.0.smithi053.stdout:3/352: write d1/d5/f3e [1319244,125111] 0 2024-09-16T00:50:20.218 INFO:tasks.workunit.client.0.smithi053.stdout:1/277: mknod d5/d18/d5b/c5d 0 2024-09-16T00:50:20.219 INFO:tasks.workunit.client.0.smithi053.stdout:2/260: dwrite d6/d9/dd/d28/f2f [4194304,4194304] 0 2024-09-16T00:50:20.224 INFO:tasks.workunit.client.0.smithi053.stdout:5/256: creat d3/d7/d2b/d4b/d51/d53/f55 x:0 0 0 2024-09-16T00:50:20.236 INFO:tasks.workunit.client.1.smithi152.stdout:1/813: creat d9/da/df/dcb/df2/d10f/f12e x:0 0 0 2024-09-16T00:50:20.236 INFO:tasks.workunit.client.0.smithi053.stdout:6/266: symlink d1/dc/d3d/l5e 0 2024-09-16T00:50:20.241 INFO:tasks.workunit.client.0.smithi053.stdout:6/267: dread d1/dc/f31 [0,4194304] 0 2024-09-16T00:50:20.242 INFO:tasks.workunit.client.0.smithi053.stdout:6/268: read d1/f2b [1359250,4992] 0 2024-09-16T00:50:20.242 INFO:tasks.workunit.client.0.smithi053.stdout:0/364: truncate d4/f4b 3200025 0 2024-09-16T00:50:20.245 INFO:tasks.workunit.client.0.smithi053.stdout:3/353: unlink d1/c13 0 2024-09-16T00:50:20.251 INFO:tasks.workunit.client.0.smithi053.stdout:6/269: dread d1/f9 [0,4194304] 0 2024-09-16T00:50:20.251 INFO:tasks.workunit.client.0.smithi053.stdout:6/270: creat d1/dc/d1e/f5f x:0 0 0 2024-09-16T00:50:20.252 INFO:tasks.workunit.client.0.smithi053.stdout:2/261: symlink d6/d29/l45 0 2024-09-16T00:50:20.260 INFO:tasks.workunit.client.0.smithi053.stdout:7/315: link d1/d2a/d4f/d52/l44 d1/d2a/d4f/l6e 0 2024-09-16T00:50:20.260 INFO:tasks.workunit.client.0.smithi053.stdout:7/316: read - d1/d35/d4a/f68 zero size 2024-09-16T00:50:20.260 INFO:tasks.workunit.client.0.smithi053.stdout:7/317: creat d1/d60/d62/f6f x:0 0 0 2024-09-16T00:50:20.261 INFO:tasks.workunit.client.0.smithi053.stdout:7/318: readlink d1/d35/d14/d15/l28 0 2024-09-16T00:50:20.261 INFO:tasks.workunit.client.0.smithi053.stdout:0/365: dwrite d4/dc/f1b [0,4194304] 0 2024-09-16T00:50:20.263 INFO:tasks.workunit.client.0.smithi053.stdout:0/366: dread d4/d13/d2d/f60 [0,4194304] 0 2024-09-16T00:50:20.263 INFO:tasks.workunit.client.0.smithi053.stdout:0/367: fdatasync d4/f4b 0 2024-09-16T00:50:20.264 INFO:tasks.workunit.client.0.smithi053.stdout:0/368: write d4/dc/d25/f3f [1238221,13115] 0 2024-09-16T00:50:20.268 INFO:tasks.workunit.client.0.smithi053.stdout:7/319: mkdir d1/d60/d70 0 2024-09-16T00:50:20.269 INFO:tasks.workunit.client.0.smithi053.stdout:6/271: dwrite d1/dc/d45/f59 [0,4194304] 0 2024-09-16T00:50:20.273 INFO:tasks.workunit.client.0.smithi053.stdout:6/272: write d1/dc/d3d/f55 [852827,101399] 0 2024-09-16T00:50:20.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/320: dwrite d1/d2a/d4f/d52/d2c/d50/f5d [0,4194304] 0 2024-09-16T00:50:20.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/894: truncate d6/d16/d1f/d8c/db8/fdd 3474528 0 2024-09-16T00:50:20.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/741: mknod d9/d31/d65/d8a/d41/d46/d7d/d86/de7/cfd 0 2024-09-16T00:50:20.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/743: rename d3/d6/d2e/d58/c7b to d3/d6/d8/d1d/d23/d4b/d54/cfb 0 2024-09-16T00:50:20.305 INFO:tasks.workunit.client.0.smithi053.stdout:7/321: dwrite d1/d35/f6b [0,4194304] 0 2024-09-16T00:50:20.308 INFO:tasks.workunit.client.1.smithi152.stdout:4/822: symlink d2/db/d39/d3c/l10c 0 2024-09-16T00:50:20.308 INFO:tasks.workunit.client.0.smithi053.stdout:7/322: rmdir d1/d35/d5b 39 2024-09-16T00:50:20.311 INFO:tasks.workunit.client.1.smithi152.stdout:4/823: dread d2/d1e/d28/d69/f5b [0,4194304] 0 2024-09-16T00:50:20.311 INFO:tasks.workunit.client.1.smithi152.stdout:7/742: link d9/d10/da5/ca7 d9/d31/d65/d8a/d90/cfe 0 2024-09-16T00:50:20.311 INFO:tasks.workunit.client.1.smithi152.stdout:0/744: unlink d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fdf 0 2024-09-16T00:50:20.312 INFO:tasks.workunit.client.1.smithi152.stdout:0/745: fdatasync d3/d6/d8/d1d/d23/d4b/d54/ff8 0 2024-09-16T00:50:20.313 INFO:tasks.workunit.client.1.smithi152.stdout:4/824: rename d2/db/d39/d3c/c97 to d2/db/dce/c10d 0 2024-09-16T00:50:20.313 INFO:tasks.workunit.client.1.smithi152.stdout:7/743: write d9/d31/d65/f59 [3532143,120089] 0 2024-09-16T00:50:20.313 INFO:tasks.workunit.client.1.smithi152.stdout:7/744: fsync d9/d31/d65/ff1 0 2024-09-16T00:50:20.313 INFO:tasks.workunit.client.1.smithi152.stdout:7/745: truncate d9/d80/f9a 1754922 0 2024-09-16T00:50:20.314 INFO:tasks.workunit.client.0.smithi053.stdout:7/323: dread d1/d2a/d4f/d52/f26 [0,4194304] 0 2024-09-16T00:50:20.316 INFO:tasks.workunit.client.1.smithi152.stdout:4/825: creat d2/db/d39/d3c/d7f/f10e x:0 0 0 2024-09-16T00:50:20.318 INFO:tasks.workunit.client.1.smithi152.stdout:7/746: mknod d9/d31/cff 0 2024-09-16T00:50:20.318 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:19 smithi053 ceph-mon[27950]: pgmap v10: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 168 MiB/s rd, 209 MiB/s wr, 333 op/s 2024-09-16T00:50:20.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:19 smithi053 ceph-mon[27950]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:20.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:19 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/318683652' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:50:20.319 INFO:tasks.workunit.client.1.smithi152.stdout:4/826: dread d2/d41/f72 [0,4194304] 0 2024-09-16T00:50:20.331 INFO:tasks.workunit.client.0.smithi053.stdout:7/324: dwrite d1/d2a/d4f/d52/f37 [0,4194304] 0 2024-09-16T00:50:20.332 INFO:tasks.workunit.client.0.smithi053.stdout:7/325: symlink d1/d2a/d4f/l71 0 2024-09-16T00:50:20.337 INFO:tasks.workunit.client.1.smithi152.stdout:4/827: dwrite d2/d1e/d28/d7b/fa7 [0,4194304] 0 2024-09-16T00:50:20.338 INFO:tasks.workunit.client.1.smithi152.stdout:4/828: fdatasync d2/d1e/d28/d7b/fc7 0 2024-09-16T00:50:20.341 INFO:tasks.workunit.client.0.smithi053.stdout:1/278: unlink d5/dd/f45 0 2024-09-16T00:50:20.345 INFO:tasks.workunit.client.0.smithi053.stdout:1/279: mknod d5/dd/c5e 0 2024-09-16T00:50:20.345 INFO:tasks.workunit.client.0.smithi053.stdout:1/280: fsync d5/d7/f52 0 2024-09-16T00:50:20.347 INFO:tasks.workunit.client.0.smithi053.stdout:1/281: mkdir d5/d7/d10/d5f 0 2024-09-16T00:50:20.348 INFO:tasks.workunit.client.0.smithi053.stdout:1/282: creat d5/d7/d10/d5f/f60 x:0 0 0 2024-09-16T00:50:20.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/829: dwrite d2/db/d39/d3c/f58 [0,4194304] 0 2024-09-16T00:50:20.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/830: getdents d2/d1e 0 2024-09-16T00:50:20.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/831: chown d2/db/d44 1684 1 2024-09-16T00:50:20.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/832: write d2/db/d39/fd1 [782529,130429] 0 2024-09-16T00:50:20.359 INFO:tasks.workunit.client.0.smithi053.stdout:1/283: write d5/d9/f4b [3578725,49935] 0 2024-09-16T00:50:20.359 INFO:tasks.workunit.client.0.smithi053.stdout:1/284: stat d5/dd/f1a 0 2024-09-16T00:50:20.363 INFO:tasks.workunit.client.1.smithi152.stdout:4/833: dread d2/d41/fa0 [0,4194304] 0 2024-09-16T00:50:20.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/834: rmdir d2/db/d39/d3c 39 2024-09-16T00:50:20.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/835: write d2/d41/fa0 [4969455,10736] 0 2024-09-16T00:50:20.371 INFO:tasks.workunit.client.1.smithi152.stdout:4/836: mkdir d2/db/d39/d3c/d7f/d98/def/d10f 0 2024-09-16T00:50:20.374 INFO:tasks.workunit.client.1.smithi152.stdout:4/837: unlink d2/db/d39/d3c/d7f/d98/f88 0 2024-09-16T00:50:20.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/838: chown d2/db/ffa 17743 1 2024-09-16T00:50:20.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/839: creat d2/d1e/d28/d7b/f110 x:0 0 0 2024-09-16T00:50:20.377 INFO:tasks.workunit.client.1.smithi152.stdout:4/840: creat d2/d1e/d28/d7b/db0/f111 x:0 0 0 2024-09-16T00:50:20.380 INFO:tasks.workunit.client.1.smithi152.stdout:6/766: rmdir db/d12/d23 39 2024-09-16T00:50:20.380 INFO:tasks.workunit.client.1.smithi152.stdout:6/767: fdatasync db/d12/d20/d86/d91/fe3 0 2024-09-16T00:50:20.380 INFO:tasks.workunit.client.1.smithi152.stdout:6/768: fsync db/d12/d1c/fae 0 2024-09-16T00:50:20.381 INFO:tasks.workunit.client.1.smithi152.stdout:1/814: mkdir d9/d3e/d4b/d6b/d6d/d12f 0 2024-09-16T00:50:20.382 INFO:tasks.workunit.client.1.smithi152.stdout:6/769: mkdir db/d12/d1c/d80/d97/df0 0 2024-09-16T00:50:20.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/815: creat d9/d3e/d41/d31/da5/f130 x:0 0 0 2024-09-16T00:50:20.384 INFO:tasks.workunit.client.1.smithi152.stdout:6/770: getdents db/d12/d23/d4a/dc5 0 2024-09-16T00:50:20.385 INFO:tasks.workunit.client.1.smithi152.stdout:6/771: mknod db/d12/d23/d4a/d43/d59/d67/dc2/cf1 0 2024-09-16T00:50:20.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/816: dread d9/d3e/f49 [0,4194304] 0 2024-09-16T00:50:20.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/772: creat db/d12/d23/d4a/dc5/ff2 x:0 0 0 2024-09-16T00:50:20.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/773: creat db/da8/db7/ff3 x:0 0 0 2024-09-16T00:50:20.387 INFO:tasks.workunit.client.1.smithi152.stdout:6/774: dread db/da8/db7/fd2 [0,4194304] 0 2024-09-16T00:50:20.396 INFO:tasks.workunit.client.1.smithi152.stdout:6/775: dread db/d12/f3d [0,4194304] 0 2024-09-16T00:50:20.396 INFO:tasks.workunit.client.1.smithi152.stdout:6/776: chown db/d12/d23/d4a/d43/d48/d64/dab/de7/fb0 30 1 2024-09-16T00:50:20.398 INFO:tasks.workunit.client.1.smithi152.stdout:6/777: mkdir db/d12/d20/df4 0 2024-09-16T00:50:20.400 INFO:tasks.workunit.client.1.smithi152.stdout:6/778: dread db/d12/d23/d4a/d43/d48/f7f [0,4194304] 0 2024-09-16T00:50:20.401 INFO:tasks.workunit.client.1.smithi152.stdout:6/779: fsync db/d12/d23/d4a/d43/d59/d67/dc2/fdd 0 2024-09-16T00:50:20.401 INFO:tasks.workunit.client.1.smithi152.stdout:6/780: write db/d12/d23/d4a/d43/d48/d64/dab/feb [943041,92482] 0 2024-09-16T00:50:20.409 INFO:tasks.workunit.client.1.smithi152.stdout:6/781: write db/d12/d23/d4a/f5f [451536,125606] 0 2024-09-16T00:50:20.410 INFO:tasks.workunit.client.1.smithi152.stdout:5/895: symlink d6/d16/d1f/db5/l14a 0 2024-09-16T00:50:20.412 INFO:tasks.workunit.client.1.smithi152.stdout:6/782: symlink db/d12/lf5 0 2024-09-16T00:50:20.412 INFO:tasks.workunit.client.1.smithi152.stdout:6/783: write db/d12/d23/d3a/fe2 [760568,130617] 0 2024-09-16T00:50:20.414 INFO:tasks.workunit.client.1.smithi152.stdout:6/784: fsync db/d12/d23/d4a/d43/d48/d64/dab/feb 0 2024-09-16T00:50:20.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/896: link d6/d16/d1f/f22 d6/d57/ddc/f14b 0 2024-09-16T00:50:20.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/785: link db/d12/d23/d4a/d43/d48/d64/c69 db/d12/d23/d4a/d43/d59/d67/dc2/cf6 0 2024-09-16T00:50:20.426 INFO:tasks.workunit.client.1.smithi152.stdout:2/705: unlink d4/d44/d7a/dc7/de4/d94/c9f 0 2024-09-16T00:50:20.428 INFO:tasks.workunit.client.1.smithi152.stdout:6/786: dread db/d12/f14 [4194304,4194304] 0 2024-09-16T00:50:20.434 INFO:tasks.workunit.client.0.smithi053.stdout:7/326: write d1/d35/f6b [4972327,128687] 0 2024-09-16T00:50:20.435 INFO:tasks.workunit.client.0.smithi053.stdout:7/327: read - d1/d2a/d4f/d52/d2c/d50/f65 zero size 2024-09-16T00:50:20.436 INFO:tasks.workunit.client.0.smithi053.stdout:7/328: creat d1/d35/d5b/f72 x:0 0 0 2024-09-16T00:50:20.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/329: link d1/d2a/d4f/l61 d1/d2a/l73 0 2024-09-16T00:50:20.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/330: readlink d1/d2a/d4f/l6e 0 2024-09-16T00:50:20.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/331: stat d1/d2a/d4f/l71 0 2024-09-16T00:50:20.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/332: chown d1/d2a/f3b 84735500 1 2024-09-16T00:50:20.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/333: chown d1/l8 465461 1 2024-09-16T00:50:20.440 INFO:tasks.workunit.client.0.smithi053.stdout:7/334: mkdir d1/d35/d4a/d74 0 2024-09-16T00:50:20.443 INFO:tasks.workunit.client.1.smithi152.stdout:3/748: rmdir dc/d10/d17/d1c/d50/d55 39 2024-09-16T00:50:20.448 INFO:tasks.workunit.client.0.smithi053.stdout:2/262: unlink d6/f41 0 2024-09-16T00:50:20.449 INFO:tasks.workunit.client.0.smithi053.stdout:9/351: rename d8/d1c/d2b/d2c/l42 to d8/d1c/l78 0 2024-09-16T00:50:20.453 INFO:tasks.workunit.client.0.smithi053.stdout:5/257: rename d3/d7/d24/d34/d3e/c4d to d3/d7/d24/d3f/c56 0 2024-09-16T00:50:20.457 INFO:tasks.workunit.client.1.smithi152.stdout:8/579: sync 2024-09-16T00:50:20.457 INFO:tasks.workunit.client.1.smithi152.stdout:9/734: sync 2024-09-16T00:50:20.457 INFO:tasks.workunit.client.1.smithi152.stdout:9/735: truncate d1/d7/d77/d68/f82 618189 0 2024-09-16T00:50:20.457 INFO:tasks.workunit.client.1.smithi152.stdout:4/841: write d2/db/d39/d3c/f58 [5176142,125432] 0 2024-09-16T00:50:20.458 INFO:tasks.workunit.client.0.smithi053.stdout:5/258: mkdir d3/d7/d42/d57 0 2024-09-16T00:50:20.458 INFO:tasks.workunit.client.0.smithi053.stdout:5/259: chown d3/d7/lc 2 1 2024-09-16T00:50:20.458 INFO:tasks.workunit.client.0.smithi053.stdout:2/263: dread d6/f2c [0,4194304] 0 2024-09-16T00:50:20.460 INFO:tasks.workunit.client.0.smithi053.stdout:3/354: rename d1/d5/f6 to d1/f6f 0 2024-09-16T00:50:20.461 INFO:tasks.workunit.client.0.smithi053.stdout:6/273: rmdir d1/dc/d3c 39 2024-09-16T00:50:20.468 INFO:tasks.workunit.client.0.smithi053.stdout:9/352: dwrite d8/d4c/d5b/f64 [0,4194304] 0 2024-09-16T00:50:20.473 INFO:tasks.workunit.client.0.smithi053.stdout:3/355: rename d1/d5/f3e to d1/d5/f70 0 2024-09-16T00:50:20.478 INFO:tasks.workunit.client.0.smithi053.stdout:9/353: creat d8/d19/d51/d6d/f79 x:0 0 0 2024-09-16T00:50:20.479 INFO:tasks.workunit.client.0.smithi053.stdout:1/285: rename d5/d7/d10 to d5/d9/d4c/d61 0 2024-09-16T00:50:20.479 INFO:tasks.workunit.client.0.smithi053.stdout:1/286: readlink d5/d7/l2f 0 2024-09-16T00:50:20.479 INFO:tasks.workunit.client.1.smithi152.stdout:9/736: dread d1/ff [0,4194304] 0 2024-09-16T00:50:20.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/737: dread - d1/d4e/d48/d26/d92/fd8 zero size 2024-09-16T00:50:20.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/738: chown d1/d4e/d48/d66/d76 703 1 2024-09-16T00:50:20.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/354: mkdir d8/d19/d51/d6d/d7a 0 2024-09-16T00:50:20.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/355: fdatasync d8/d1c/d2b/d2c/f60 0 2024-09-16T00:50:20.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/356: creat d8/d19/d51/d6d/f7b x:0 0 0 2024-09-16T00:50:20.482 INFO:tasks.workunit.client.0.smithi053.stdout:9/357: dread d8/f5f [0,4194304] 0 2024-09-16T00:50:20.482 INFO:tasks.workunit.client.0.smithi053.stdout:9/358: truncate d8/d1c/d2b/d2c/f77 855905 0 2024-09-16T00:50:20.483 INFO:tasks.workunit.client.1.smithi152.stdout:9/739: unlink d1/d4e/d48/d2b/f4d 0 2024-09-16T00:50:20.486 INFO:tasks.workunit.client.0.smithi053.stdout:7/335: rename d1/d2a/f3b to d1/d2a/d4f/d52/d2c/d50/f75 0 2024-09-16T00:50:20.486 INFO:tasks.workunit.client.0.smithi053.stdout:7/336: truncate d1/d2a/d4f/d52/d2c/f6a 739302 0 2024-09-16T00:50:20.486 INFO:tasks.workunit.client.0.smithi053.stdout:1/287: rmdir d5/d9/d4c 39 2024-09-16T00:50:20.489 INFO:tasks.workunit.client.0.smithi053.stdout:3/356: rmdir d1/d5/d16/d47/d65 39 2024-09-16T00:50:20.490 INFO:tasks.workunit.client.0.smithi053.stdout:2/264: dwrite d6/f18 [0,4194304] 0 2024-09-16T00:50:20.490 INFO:tasks.workunit.client.0.smithi053.stdout:2/265: readlink d6/d9/d14/l3d 0 2024-09-16T00:50:20.492 INFO:tasks.workunit.client.0.smithi053.stdout:9/359: symlink d8/d19/d31/l7c 0 2024-09-16T00:50:20.495 INFO:tasks.workunit.client.0.smithi053.stdout:7/337: mknod d1/d2a/d4f/c76 0 2024-09-16T00:50:20.498 INFO:tasks.workunit.client.0.smithi053.stdout:1/288: symlink d5/d7/l62 0 2024-09-16T00:50:20.501 INFO:tasks.workunit.client.0.smithi053.stdout:9/360: rmdir d8/d1c 39 2024-09-16T00:50:20.503 INFO:tasks.workunit.client.0.smithi053.stdout:2/266: dread d6/d9/f1d [4194304,4194304] 0 2024-09-16T00:50:20.503 INFO:tasks.workunit.client.0.smithi053.stdout:2/267: fsync d6/f7 0 2024-09-16T00:50:20.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/746: rename d3/d6/d8/d1d/d65/c70 to d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/cfc 0 2024-09-16T00:50:20.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/842: dwrite d2/db/d39/d3c/f58 [0,4194304] 0 2024-09-16T00:50:20.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/580: dwrite dd/d50/d29/d2f/f95 [0,4194304] 0 2024-09-16T00:50:20.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/843: write d2/db/d39/d3c/d76/db8/f79 [2345709,24064] 0 2024-09-16T00:50:20.510 INFO:tasks.workunit.client.1.smithi152.stdout:9/740: dwrite d1/d7/d13/f37 [4194304,4194304] 0 2024-09-16T00:50:20.510 INFO:tasks.workunit.client.1.smithi152.stdout:9/741: dread - d1/d4e/d48/fc7 zero size 2024-09-16T00:50:20.512 INFO:tasks.workunit.client.0.smithi053.stdout:3/357: dwrite d1/f6d [0,4194304] 0 2024-09-16T00:50:20.512 INFO:tasks.workunit.client.0.smithi053.stdout:3/358: fdatasync d1/d5/d16/d47/f5b 0 2024-09-16T00:50:20.514 INFO:tasks.workunit.client.0.smithi053.stdout:9/361: creat d8/d19/f7d x:0 0 0 2024-09-16T00:50:20.514 INFO:tasks.workunit.client.0.smithi053.stdout:9/362: write d8/d22/d26/f61 [1001735,108507] 0 2024-09-16T00:50:20.518 INFO:tasks.workunit.client.0.smithi053.stdout:2/268: link d6/f8 d6/d29/d2b/f46 0 2024-09-16T00:50:20.521 INFO:tasks.workunit.client.0.smithi053.stdout:5/260: rename d3/d7/d12 to d3/d7/d2b/d37/d58 0 2024-09-16T00:50:20.521 INFO:tasks.workunit.client.0.smithi053.stdout:2/269: dread d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:20.522 INFO:tasks.workunit.client.1.smithi152.stdout:4/844: dread d2/db/d39/d3c/d76/db8/f23 [0,4194304] 0 2024-09-16T00:50:20.522 INFO:tasks.workunit.client.1.smithi152.stdout:4/845: creat d2/d41/df1/f112 x:0 0 0 2024-09-16T00:50:20.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/581: symlink dd/d15/d69/lc7 0 2024-09-16T00:50:20.523 INFO:tasks.workunit.client.1.smithi152.stdout:8/582: fdatasync dd/d15/d49/f22 0 2024-09-16T00:50:20.525 INFO:tasks.workunit.client.1.smithi152.stdout:1/817: unlink d9/da/df/f86 0 2024-09-16T00:50:20.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/742: mkdir d1/d7/ded 0 2024-09-16T00:50:20.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/743: dread - d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/fd9 zero size 2024-09-16T00:50:20.526 INFO:tasks.workunit.client.0.smithi053.stdout:1/289: dwrite d5/d18/f1b [0,4194304] 0 2024-09-16T00:50:20.528 INFO:tasks.workunit.client.1.smithi152.stdout:7/747: rename d9/d80 to d9/d31/d64/d3c/db9/dd3/d100 0 2024-09-16T00:50:20.530 INFO:tasks.workunit.client.1.smithi152.stdout:6/787: write db/d12/d23/d4a/d43/d48/d6a/f87 [100899,5329] 0 2024-09-16T00:50:20.536 INFO:tasks.workunit.client.0.smithi053.stdout:3/359: link d1/d5/d16/f3f d1/d5/d14/f71 0 2024-09-16T00:50:20.540 INFO:tasks.workunit.client.0.smithi053.stdout:9/363: mkdir d8/d4c/d5b/d7e 0 2024-09-16T00:50:20.543 INFO:tasks.workunit.client.0.smithi053.stdout:6/274: rename d1/dc/d3c/d4a/c5b to d1/dc/d3c/c60 0 2024-09-16T00:50:20.543 INFO:tasks.workunit.client.0.smithi053.stdout:6/275: creat d1/dc/d3d/f61 x:0 0 0 2024-09-16T00:50:20.543 INFO:tasks.workunit.client.0.smithi053.stdout:6/276: write d1/dc/d3c/d4a/f53 [854695,121149] 0 2024-09-16T00:50:20.545 INFO:tasks.workunit.client.0.smithi053.stdout:1/290: creat d5/d18/d33/f63 x:0 0 0 2024-09-16T00:50:20.547 INFO:tasks.workunit.client.0.smithi053.stdout:3/360: getdents d1/d5/d16/d47/d4c/d50 0 2024-09-16T00:50:20.551 INFO:tasks.workunit.client.0.smithi053.stdout:6/277: creat d1/f62 x:0 0 0 2024-09-16T00:50:20.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/846: creat d2/db/d39/d3c/d76/f113 x:0 0 0 2024-09-16T00:50:20.555 INFO:tasks.workunit.client.0.smithi053.stdout:1/291: link d5/d9/d4c/d61/l54 d5/dd/l64 0 2024-09-16T00:50:20.555 INFO:tasks.workunit.client.0.smithi053.stdout:1/292: write d5/d18/d1f/f4a [4204205,60765] 0 2024-09-16T00:50:20.555 INFO:tasks.workunit.client.0.smithi053.stdout:1/293: chown d5/lb 1 1 2024-09-16T00:50:20.559 INFO:tasks.workunit.client.1.smithi152.stdout:9/744: creat d1/d4e/d48/d2b/d93/d96/fee x:0 0 0 2024-09-16T00:50:20.559 INFO:tasks.workunit.client.1.smithi152.stdout:9/745: chown d1/d7/l5b 18507129 1 2024-09-16T00:50:20.560 INFO:tasks.workunit.client.0.smithi053.stdout:4/245: sync 2024-09-16T00:50:20.560 INFO:tasks.workunit.client.0.smithi053.stdout:8/369: sync 2024-09-16T00:50:20.564 INFO:tasks.workunit.client.0.smithi053.stdout:9/364: dread d8/f1f [0,4194304] 0 2024-09-16T00:50:20.564 INFO:tasks.workunit.client.0.smithi053.stdout:9/365: write d8/d19/f3f [440370,75506] 0 2024-09-16T00:50:20.564 INFO:tasks.workunit.client.0.smithi053.stdout:9/366: fsync d8/d1c/d2b/d49/f6b 0 2024-09-16T00:50:20.567 INFO:tasks.workunit.client.1.smithi152.stdout:5/897: rename d6/d16/d10d/d10e/f12b to d6/d16/d1f/d8c/db8/dbf/f14c 0 2024-09-16T00:50:20.567 INFO:tasks.workunit.client.1.smithi152.stdout:1/818: dwrite d9/f29 [0,4194304] 0 2024-09-16T00:50:20.569 INFO:tasks.workunit.client.0.smithi053.stdout:2/270: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:20.569 INFO:tasks.workunit.client.0.smithi053.stdout:5/261: dwrite d3/f35 [4194304,4194304] 0 2024-09-16T00:50:20.570 INFO:tasks.workunit.client.1.smithi152.stdout:6/788: symlink db/d12/d23/d4a/d43/d48/d64/dab/de7/lf7 0 2024-09-16T00:50:20.570 INFO:tasks.workunit.client.0.smithi053.stdout:1/294: chown d5/d18/c41 0 1 2024-09-16T00:50:20.573 INFO:tasks.workunit.client.1.smithi152.stdout:8/583: rmdir dd/d25/d77 39 2024-09-16T00:50:20.573 INFO:tasks.workunit.client.1.smithi152.stdout:8/584: dread - dd/d25/da4/fbd zero size 2024-09-16T00:50:20.574 INFO:tasks.workunit.client.0.smithi053.stdout:3/361: symlink d1/d5/l72 0 2024-09-16T00:50:20.574 INFO:tasks.workunit.client.0.smithi053.stdout:3/362: chown d1/d5/d31/f41 157 1 2024-09-16T00:50:20.575 INFO:tasks.workunit.client.1.smithi152.stdout:5/898: rmdir d6/d16/d1f/d6c/de7 39 2024-09-16T00:50:20.576 INFO:tasks.workunit.client.0.smithi053.stdout:4/246: dread d0/d2/d1e/d4b/f36 [0,4194304] 0 2024-09-16T00:50:20.576 INFO:tasks.workunit.client.1.smithi152.stdout:4/847: dwrite d2/db/d39/d3c/d7f/d8b/fdf [0,4194304] 0 2024-09-16T00:50:20.576 INFO:tasks.workunit.client.1.smithi152.stdout:4/848: fdatasync d2/db/d39/d3c/fb3 0 2024-09-16T00:50:20.578 INFO:tasks.workunit.client.0.smithi053.stdout:9/367: creat d8/d22/d54/f7f x:0 0 0 2024-09-16T00:50:20.578 INFO:tasks.workunit.client.0.smithi053.stdout:9/368: fdatasync d8/d19/d31/f71 0 2024-09-16T00:50:20.578 INFO:tasks.workunit.client.1.smithi152.stdout:4/849: read d2/db/d39/d3c/d76/db8/f79 [1561383,30999] 0 2024-09-16T00:50:20.578 INFO:tasks.workunit.client.1.smithi152.stdout:4/850: fdatasync d2/db/dce/ff8 0 2024-09-16T00:50:20.579 INFO:tasks.workunit.client.1.smithi152.stdout:4/851: write d2/db/d39/d95/f96 [4734083,4211] 0 2024-09-16T00:50:20.579 INFO:tasks.workunit.client.1.smithi152.stdout:4/852: chown d2/db/d39/d3c/d7f/d98/lca 1 1 2024-09-16T00:50:20.580 INFO:tasks.workunit.client.0.smithi053.stdout:2/271: write d6/f32 [553544,58530] 0 2024-09-16T00:50:20.580 INFO:tasks.workunit.client.1.smithi152.stdout:2/706: rename d4/c5d to d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/ceb 0 2024-09-16T00:50:20.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/819: truncate d9/d3e/d4b/f11e 45325 0 2024-09-16T00:50:20.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/820: read - d9/d3e/d4b/db7/dc4/fe7 zero size 2024-09-16T00:50:20.583 INFO:tasks.workunit.client.0.smithi053.stdout:2/272: dread d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:20.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/821: dread d9/d3e/d4b/d6b/d6d/d99/fc9 [0,4194304] 0 2024-09-16T00:50:20.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/822: write d9/d3e/d41/d31/d48/d7d/fcf [271887,105740] 0 2024-09-16T00:50:20.584 INFO:tasks.workunit.client.0.smithi053.stdout:9/369: dread d8/d1c/d2b/d2c/f77 [0,4194304] 0 2024-09-16T00:50:20.585 INFO:tasks.workunit.client.1.smithi152.stdout:6/789: rmdir db/d12/d23/d4a 39 2024-09-16T00:50:20.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/585: unlink dd/d25/fae 0 2024-09-16T00:50:20.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/586: write dd/d50/d88/fb3 [720919,9703] 0 2024-09-16T00:50:20.590 INFO:tasks.workunit.client.1.smithi152.stdout:5/899: link d6/d16/c34 d6/d16/d1f/d6c/de2/c14d 0 2024-09-16T00:50:20.596 INFO:tasks.workunit.client.1.smithi152.stdout:1/823: dread d9/d3e/d41/d31/d48/f6e [0,4194304] 0 2024-09-16T00:50:20.597 INFO:tasks.workunit.client.1.smithi152.stdout:4/853: getdents d2/d1e/d28/db7 0 2024-09-16T00:50:20.601 INFO:tasks.workunit.client.0.smithi053.stdout:8/370: dwrite d10/d52/d5b/f7d [0,4194304] 0 2024-09-16T00:50:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/749: rename dc/d10/d17/d5a/db2/d6f/d74/dd2 to dc/d10/d17/d1c/d50/d55/d6d/dea 0 2024-09-16T00:50:20.606 INFO:tasks.workunit.client.0.smithi053.stdout:2/273: read d6/d9/dd/f1a [924786,26516] 0 2024-09-16T00:50:20.608 INFO:tasks.workunit.client.1.smithi152.stdout:8/587: creat dd/d15/fc8 x:0 0 0 2024-09-16T00:50:20.608 INFO:tasks.workunit.client.0.smithi053.stdout:1/295: mknod d5/d18/d33/d30/c65 0 2024-09-16T00:50:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:5/900: rmdir d6/d57/ddc/d11a 39 2024-09-16T00:50:20.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/824: creat d9/d3e/d4b/db7/f131 x:0 0 0 2024-09-16T00:50:20.613 INFO:tasks.workunit.client.0.smithi053.stdout:9/370: creat d8/d13/f80 x:0 0 0 2024-09-16T00:50:20.613 INFO:tasks.workunit.client.0.smithi053.stdout:9/371: readlink d8/d4c/l55 0 2024-09-16T00:50:20.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/854: write d2/db/d39/d3c/d7f/d8b/fe9 [5758116,22270] 0 2024-09-16T00:50:20.615 INFO:tasks.workunit.client.1.smithi152.stdout:7/748: rename d9/d31/d65/d8a/d41/f50 to d9/d31/d65/d8a/d41/d46/d7d/dac/f101 0 2024-09-16T00:50:20.615 INFO:tasks.workunit.client.1.smithi152.stdout:7/749: truncate d9/d31/d64/d3c/db9/dd3/d100/d82/ffa 402562 0 2024-09-16T00:50:20.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/750: write d9/d31/d64/d3c/d5b/fdb [110770,49156] 0 2024-09-16T00:50:20.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/751: write d9/d10/f9d [986862,24243] 0 2024-09-16T00:50:20.617 INFO:tasks.workunit.client.1.smithi152.stdout:5/901: truncate d6/d57/ddc/fea 1463361 0 2024-09-16T00:50:20.618 INFO:tasks.workunit.client.1.smithi152.stdout:5/902: dread - d6/d16/d1f/d8c/f94 zero size 2024-09-16T00:50:20.618 INFO:tasks.workunit.client.1.smithi152.stdout:5/903: write d6/d57/d2b/d50/d64/d92/f9a [1029289,10369] 0 2024-09-16T00:50:20.621 INFO:tasks.workunit.client.1.smithi152.stdout:6/790: dwrite db/d12/d20/f36 [0,4194304] 0 2024-09-16T00:50:20.623 INFO:tasks.workunit.client.1.smithi152.stdout:1/825: rename d9/d3e/d4b/fd3 to d9/d3e/d41/d31/d48/db2/f132 0 2024-09-16T00:50:20.623 INFO:tasks.workunit.client.1.smithi152.stdout:1/826: chown d9/d3e/fba 1 1 2024-09-16T00:50:20.624 INFO:tasks.workunit.client.0.smithi053.stdout:3/363: dwrite d1/d5/d16/d47/f4b [0,4194304] 0 2024-09-16T00:50:20.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/746: dwrite d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/fd9 [0,4194304] 0 2024-09-16T00:50:20.626 INFO:tasks.workunit.client.1.smithi152.stdout:8/588: dwrite dd/d50/f28 [0,4194304] 0 2024-09-16T00:50:20.626 INFO:tasks.workunit.client.0.smithi053.stdout:2/274: creat d6/d29/d2b/f47 x:0 0 0 2024-09-16T00:50:20.629 INFO:tasks.workunit.client.0.smithi053.stdout:1/296: creat d5/d7/f66 x:0 0 0 2024-09-16T00:50:20.632 INFO:tasks.workunit.client.0.smithi053.stdout:9/372: unlink d8/d4c/l6c 0 2024-09-16T00:50:20.633 INFO:tasks.workunit.client.1.smithi152.stdout:4/855: dwrite d2/db/d39/d3c/d7f/f10e [0,4194304] 0 2024-09-16T00:50:20.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/791: symlink db/d12/d23/lf8 0 2024-09-16T00:50:20.642 INFO:tasks.workunit.client.0.smithi053.stdout:8/371: rmdir d10/d1c/d2b 39 2024-09-16T00:50:20.644 INFO:tasks.workunit.client.1.smithi152.stdout:7/752: rename d9/d10/da5/lca to d9/d31/d64/d3c/db9/dd3/de6/l102 0 2024-09-16T00:50:20.647 INFO:tasks.workunit.client.0.smithi053.stdout:9/373: dwrite d8/d13/f80 [0,4194304] 0 2024-09-16T00:50:20.647 INFO:tasks.workunit.client.0.smithi053.stdout:9/374: truncate d8/f35 75690 0 2024-09-16T00:50:20.648 INFO:tasks.workunit.client.0.smithi053.stdout:2/275: dwrite f0 [0,4194304] 0 2024-09-16T00:50:20.648 INFO:tasks.workunit.client.0.smithi053.stdout:3/364: symlink d1/d5/d14/l73 0 2024-09-16T00:50:20.648 INFO:tasks.workunit.client.0.smithi053.stdout:3/365: chown d1/d5/d11/f55 295 1 2024-09-16T00:50:20.649 INFO:tasks.workunit.client.0.smithi053.stdout:2/276: write f5 [463196,80780] 0 2024-09-16T00:50:20.649 INFO:tasks.workunit.client.0.smithi053.stdout:2/277: read d6/d9/dd/f1a [3048317,21435] 0 2024-09-16T00:50:20.649 INFO:tasks.workunit.client.0.smithi053.stdout:3/366: dread d1/d5/d31/f39 [0,4194304] 0 2024-09-16T00:50:20.650 INFO:tasks.workunit.client.0.smithi053.stdout:1/297: mknod d5/dd/d47/c67 0 2024-09-16T00:50:20.652 INFO:tasks.workunit.client.0.smithi053.stdout:8/372: mknod d10/d1c/d2b/d40/c80 0 2024-09-16T00:50:20.658 INFO:tasks.workunit.client.0.smithi053.stdout:9/375: creat d8/d1c/d2b/d5c/f81 x:0 0 0 2024-09-16T00:50:20.663 INFO:tasks.workunit.client.0.smithi053.stdout:1/298: truncate d5/d18/d33/f53 1007607 0 2024-09-16T00:50:20.663 INFO:tasks.workunit.client.0.smithi053.stdout:1/299: write d5/d9/f4b [135030,126043] 0 2024-09-16T00:50:20.664 INFO:tasks.workunit.client.0.smithi053.stdout:1/300: write d5/d9/f44 [655428,78094] 0 2024-09-16T00:50:20.664 INFO:tasks.workunit.client.0.smithi053.stdout:1/301: chown d5/d18/d1f/f3d 1 1 2024-09-16T00:50:20.670 INFO:tasks.workunit.client.0.smithi053.stdout:8/373: symlink d10/d1c/d2b/d40/d76/l81 0 2024-09-16T00:50:20.670 INFO:tasks.workunit.client.0.smithi053.stdout:2/278: rmdir d6/d9/dd/d3e 39 2024-09-16T00:50:20.670 INFO:tasks.workunit.client.0.smithi053.stdout:2/279: readlink d6/d9/d14/l3d 0 2024-09-16T00:50:20.670 INFO:tasks.workunit.client.1.smithi152.stdout:1/827: write d9/d3e/d4b/f11e [633356,83304] 0 2024-09-16T00:50:20.671 INFO:tasks.workunit.client.0.smithi053.stdout:3/367: truncate d1/d5/f40 316144 0 2024-09-16T00:50:20.672 INFO:tasks.workunit.client.1.smithi152.stdout:6/792: creat db/d12/d23/d4a/d43/d48/d64/ff9 x:0 0 0 2024-09-16T00:50:20.675 INFO:tasks.workunit.client.0.smithi053.stdout:8/374: unlink la 0 2024-09-16T00:50:20.675 INFO:tasks.workunit.client.0.smithi053.stdout:8/375: chown d10/d1c/d2b/d40/d50/c56 2 1 2024-09-16T00:50:20.677 INFO:tasks.workunit.client.1.smithi152.stdout:9/747: rename d1/d7/d77/d68/f82 to d1/d4e/d48/d26/d30/d4f/d50/fef 0 2024-09-16T00:50:20.678 INFO:tasks.workunit.client.0.smithi053.stdout:2/280: truncate d6/d29/d2b/f34 185257 0 2024-09-16T00:50:20.680 INFO:tasks.workunit.client.1.smithi152.stdout:7/753: symlink d9/d31/d65/d8a/d41/l103 0 2024-09-16T00:50:20.683 INFO:tasks.workunit.client.1.smithi152.stdout:8/589: symlink dd/d50/d29/lc9 0 2024-09-16T00:50:20.684 INFO:tasks.workunit.client.0.smithi053.stdout:1/302: getdents d5/d7/d39 0 2024-09-16T00:50:20.685 INFO:tasks.workunit.client.0.smithi053.stdout:2/281: rename c2 to d6/d9/dd/d3e/c48 0 2024-09-16T00:50:20.686 INFO:tasks.workunit.client.1.smithi152.stdout:1/828: truncate d9/faf 2175810 0 2024-09-16T00:50:20.687 INFO:tasks.workunit.client.0.smithi053.stdout:3/368: getdents d1/d5/d16/d47 0 2024-09-16T00:50:20.690 INFO:tasks.workunit.client.0.smithi053.stdout:1/303: symlink d5/d5a/l68 0 2024-09-16T00:50:20.690 INFO:tasks.workunit.client.0.smithi053.stdout:1/304: chown d5/d18/d1f/f4a 95869 1 2024-09-16T00:50:20.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/856: rename d2/d1e/d28/d69/l87 to d2/db/d39/d3c/d76/db4/l114 0 2024-09-16T00:50:20.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/376: dwrite d10/d21/f7f [0,4194304] 0 2024-09-16T00:50:20.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/377: truncate d10/d1c/f7b 24354 0 2024-09-16T00:50:20.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/748: stat d1/d7/d13/d5d/l75 0 2024-09-16T00:50:20.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/369: write d1/d5/d11/f25 [1751271,87647] 0 2024-09-16T00:50:20.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/754: truncate d9/d31/d64/d3c/d5b/f7a 11471089 0 2024-09-16T00:50:20.700 INFO:tasks.workunit.client.0.smithi053.stdout:3/370: dread d1/d5/f22 [0,4194304] 0 2024-09-16T00:50:20.700 INFO:tasks.workunit.client.0.smithi053.stdout:8/378: dread d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:20.701 INFO:tasks.workunit.client.0.smithi053.stdout:8/379: write fb [2283593,22401] 0 2024-09-16T00:50:20.703 INFO:tasks.workunit.client.0.smithi053.stdout:3/371: dread d1/d5/f70 [0,4194304] 0 2024-09-16T00:50:20.704 INFO:tasks.workunit.client.1.smithi152.stdout:4/857: dread d2/d1e/d28/d69/f49 [0,4194304] 0 2024-09-16T00:50:20.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/755: dread d9/d31/f5f [0,4194304] 0 2024-09-16T00:50:20.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/756: fdatasync d9/d31/d65/d6b/fdc 0 2024-09-16T00:50:20.709 INFO:tasks.workunit.client.1.smithi152.stdout:8/590: truncate dd/f4c 496761 0 2024-09-16T00:50:20.709 INFO:tasks.workunit.client.0.smithi053.stdout:1/305: dread d5/d18/d33/f53 [0,4194304] 0 2024-09-16T00:50:20.717 INFO:tasks.workunit.client.1.smithi152.stdout:1/829: link d9/d3e/d7b/df0/d107/c4c d9/d3e/d41/d31/d48/db2/c133 0 2024-09-16T00:50:20.718 INFO:tasks.workunit.client.1.smithi152.stdout:1/830: creat d9/d3e/d7b/df0/f134 x:0 0 0 2024-09-16T00:50:20.718 INFO:tasks.workunit.client.0.smithi053.stdout:1/306: write d5/d18/f1b [3978528,106047] 0 2024-09-16T00:50:20.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/749: link d1/d4e/d48/d26/d30/l8c d1/d4e/d48/d26/d30/d4f/d50/lf0 0 2024-09-16T00:50:20.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/750: readlink d1/d4e/d48/d26/d30/d8f/dc4/lc1 0 2024-09-16T00:50:20.722 INFO:tasks.workunit.client.1.smithi152.stdout:4/858: mkdir d2/db/d39/d3c/d7f/d98/dcf/dfc/d115 0 2024-09-16T00:50:20.723 INFO:tasks.workunit.client.0.smithi053.stdout:1/307: symlink d5/d9/d4c/l69 0 2024-09-16T00:50:20.724 INFO:tasks.workunit.client.0.smithi053.stdout:1/308: fsync d5/dd/d47/d58/f2a 0 2024-09-16T00:50:20.726 INFO:tasks.workunit.client.1.smithi152.stdout:7/757: link d9/f23 d9/d31/d64/d3c/db9/dd3/d100/f104 0 2024-09-16T00:50:20.727 INFO:tasks.workunit.client.1.smithi152.stdout:8/591: mkdir dd/d15/d69/dca 0 2024-09-16T00:50:20.728 INFO:tasks.workunit.client.0.smithi053.stdout:1/309: truncate d5/dd/d19/f46 3190173 0 2024-09-16T00:50:20.728 INFO:tasks.workunit.client.0.smithi053.stdout:1/310: write d5/d7/f22 [511437,82830] 0 2024-09-16T00:50:20.730 INFO:tasks.workunit.client.1.smithi152.stdout:1/831: unlink d9/fef 0 2024-09-16T00:50:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:1/832: write d9/d3e/d4b/d6b/d6d/ffc [423852,5329] 0 2024-09-16T00:50:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:1/833: chown d9/d3e/d4b/d50/d115 34762 1 2024-09-16T00:50:20.733 INFO:tasks.workunit.client.0.smithi053.stdout:1/311: creat d5/d18/d5b/f6a x:0 0 0 2024-09-16T00:50:20.733 INFO:tasks.workunit.client.0.smithi053.stdout:8/380: dwrite d10/d1c/d2b/d40/d50/f7e [0,4194304] 0 2024-09-16T00:50:20.733 INFO:tasks.workunit.client.0.smithi053.stdout:3/372: dwrite d1/d5/d14/f18 [4194304,4194304] 0 2024-09-16T00:50:20.734 INFO:tasks.workunit.client.0.smithi053.stdout:2/282: dwrite d6/d29/d2b/f34 [0,4194304] 0 2024-09-16T00:50:20.734 INFO:tasks.workunit.client.0.smithi053.stdout:2/283: creat d6/d9/f49 x:0 0 0 2024-09-16T00:50:20.734 INFO:tasks.workunit.client.0.smithi053.stdout:2/284: readlink d6/d9/d14/l19 0 2024-09-16T00:50:20.734 INFO:tasks.workunit.client.0.smithi053.stdout:3/373: dread d1/d5/d11/d3a/f6e [0,4194304] 0 2024-09-16T00:50:20.734 INFO:tasks.workunit.client.0.smithi053.stdout:3/374: stat d1/d5/d16/f1f 0 2024-09-16T00:50:20.735 INFO:tasks.workunit.client.1.smithi152.stdout:9/751: mkdir d1/d7/d77/d32/da5/df1 0 2024-09-16T00:50:20.736 INFO:tasks.workunit.client.0.smithi053.stdout:1/312: mknod d5/dd/d19/c6b 0 2024-09-16T00:50:20.737 INFO:tasks.workunit.client.1.smithi152.stdout:4/859: symlink d2/d8e/df9/l116 0 2024-09-16T00:50:20.741 INFO:tasks.workunit.client.1.smithi152.stdout:7/758: creat d9/d31/d64/d3c/db9/dd3/f105 x:0 0 0 2024-09-16T00:50:20.741 INFO:tasks.workunit.client.1.smithi152.stdout:8/592: symlink dd/d98/da5/dbb/lcb 0 2024-09-16T00:50:20.744 INFO:tasks.workunit.client.1.smithi152.stdout:1/834: creat d9/d3e/d41/d31/d48/f135 x:0 0 0 2024-09-16T00:50:20.745 INFO:tasks.workunit.client.0.smithi053.stdout:8/381: dread d10/d21/f33 [0,4194304] 0 2024-09-16T00:50:20.745 INFO:tasks.workunit.client.0.smithi053.stdout:8/382: write d10/d1c/d2b/f4e [77312,79046] 0 2024-09-16T00:50:20.745 INFO:tasks.workunit.client.0.smithi053.stdout:8/383: chown d10/d1c/f7b 6 1 2024-09-16T00:50:20.747 INFO:tasks.workunit.client.1.smithi152.stdout:9/752: rename d1/d7/d13/d5d/d69/c98 to d1/d7/cf2 0 2024-09-16T00:50:20.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/759: symlink d9/d31/d64/d3c/l106 0 2024-09-16T00:50:20.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/760: truncate d9/d31/fc5 249242 0 2024-09-16T00:50:20.753 INFO:tasks.workunit.client.1.smithi152.stdout:8/593: truncate dd/d15/d1a/f45 961913 0 2024-09-16T00:50:20.755 INFO:tasks.workunit.client.0.smithi053.stdout:3/375: mknod d1/d4e/c74 0 2024-09-16T00:50:20.757 INFO:tasks.workunit.client.1.smithi152.stdout:1/835: link d9/d3e/d41/d31/d48/db2/cc8 d9/d3e/d4b/d6b/d6d/d99/c136 0 2024-09-16T00:50:20.759 INFO:tasks.workunit.client.0.smithi053.stdout:1/313: unlink d5/d18/d5b/f6a 0 2024-09-16T00:50:20.759 INFO:tasks.workunit.client.0.smithi053.stdout:1/314: write d5/d7/f66 [11254,64376] 0 2024-09-16T00:50:20.759 INFO:tasks.workunit.client.0.smithi053.stdout:1/315: chown d5/d18/d33/f53 5520799 1 2024-09-16T00:50:20.761 INFO:tasks.workunit.client.0.smithi053.stdout:8/384: symlink d10/d52/d5b/l82 0 2024-09-16T00:50:20.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/753: creat d1/d4e/d48/d66/ff3 x:0 0 0 2024-09-16T00:50:20.764 INFO:tasks.workunit.client.0.smithi053.stdout:3/376: dread d1/f6d [0,4194304] 0 2024-09-16T00:50:20.765 INFO:tasks.workunit.client.1.smithi152.stdout:7/761: creat d9/d31/d65/d8a/d41/d46/d7d/de2/f107 x:0 0 0 2024-09-16T00:50:20.765 INFO:tasks.workunit.client.1.smithi152.stdout:7/762: chown d9/d31/d64/d3c/db9/dd3/d100/d82 0 1 2024-09-16T00:50:20.766 INFO:tasks.workunit.client.0.smithi053.stdout:3/377: write d1/d5/f40 [81372,93671] 0 2024-09-16T00:50:20.766 INFO:tasks.workunit.client.0.smithi053.stdout:1/316: creat d5/d7/d39/f6c x:0 0 0 2024-09-16T00:50:20.767 INFO:tasks.workunit.client.0.smithi053.stdout:8/385: truncate d10/f1d 1044539 0 2024-09-16T00:50:20.773 INFO:tasks.workunit.client.1.smithi152.stdout:1/836: unlink d9/da/df/dcb/fc7 0 2024-09-16T00:50:20.774 INFO:tasks.workunit.client.0.smithi053.stdout:3/378: write d1/d5/f19 [2075630,17482] 0 2024-09-16T00:50:20.776 INFO:tasks.workunit.client.0.smithi053.stdout:8/386: dread d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:20.776 INFO:tasks.workunit.client.1.smithi152.stdout:4/860: rename d2/db/c1b to d2/db/d39/d3c/d7f/d98/def/d10f/c117 0 2024-09-16T00:50:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:4/861: chown d2/db/d39/d3c/f7c 24 1 2024-09-16T00:50:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:4/862: truncate d2/db/d39/d3c/d76/db8/ff2 1370147 0 2024-09-16T00:50:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:4/863: chown d2/db/d39/d3c/d76/f106 17 1 2024-09-16T00:50:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:9/754: dwrite d1/d7/d13/f37 [4194304,4194304] 0 2024-09-16T00:50:20.777 INFO:tasks.workunit.client.0.smithi053.stdout:1/317: symlink d5/d18/d33/d30/l6d 0 2024-09-16T00:50:20.778 INFO:tasks.workunit.client.1.smithi152.stdout:9/755: write d1/d4e/d48/d26/d30/d4f/d50/fef [404169,21007] 0 2024-09-16T00:50:20.778 INFO:tasks.workunit.client.1.smithi152.stdout:9/756: fdatasync d1/fb 0 2024-09-16T00:50:20.778 INFO:tasks.workunit.client.0.smithi053.stdout:1/318: dread d5/d7/d39/f48 [0,4194304] 0 2024-09-16T00:50:20.779 INFO:tasks.workunit.client.1.smithi152.stdout:7/763: symlink d9/d31/dfc/l108 0 2024-09-16T00:50:20.781 INFO:tasks.workunit.client.0.smithi053.stdout:3/379: truncate d1/d5/d16/d47/f5b 172279 0 2024-09-16T00:50:20.783 INFO:tasks.workunit.client.1.smithi152.stdout:1/837: rename d9/d3e/d41/d31/d48/d4a/f54 to d9/d3e/d41/d31/d48/d4a/f137 0 2024-09-16T00:50:20.784 INFO:tasks.workunit.client.1.smithi152.stdout:1/838: dread d9/d3e/d41/d31/f112 [0,4194304] 0 2024-09-16T00:50:20.784 INFO:tasks.workunit.client.1.smithi152.stdout:1/839: chown d9/d3e/d4b/d6b/d6d/f81 475140354 1 2024-09-16T00:50:20.785 INFO:tasks.workunit.client.1.smithi152.stdout:1/840: fdatasync d9/da/f58 0 2024-09-16T00:50:20.785 INFO:tasks.workunit.client.0.smithi053.stdout:8/387: unlink d10/d21/f30 0 2024-09-16T00:50:20.785 INFO:tasks.workunit.client.0.smithi053.stdout:8/388: chown d10/d21/f2c 44906722 1 2024-09-16T00:50:20.786 INFO:tasks.workunit.client.0.smithi053.stdout:8/389: readlink d10/d21/d28/l71 0 2024-09-16T00:50:20.788 INFO:tasks.workunit.client.0.smithi053.stdout:1/319: creat d5/d9/d4c/d61/f6e x:0 0 0 2024-09-16T00:50:20.789 INFO:tasks.workunit.client.0.smithi053.stdout:3/380: symlink d1/d5/d16/d47/d6c/l75 0 2024-09-16T00:50:20.789 INFO:tasks.workunit.client.0.smithi053.stdout:3/381: stat d1/l49 0 2024-09-16T00:50:20.792 INFO:tasks.workunit.client.1.smithi152.stdout:9/757: creat d1/d7/d13/d5d/d69/ddc/ff4 x:0 0 0 2024-09-16T00:50:20.792 INFO:tasks.workunit.client.1.smithi152.stdout:4/864: dwrite d2/db/d39/f9d [0,4194304] 0 2024-09-16T00:50:20.792 INFO:tasks.workunit.client.1.smithi152.stdout:4/865: truncate d2/db/d39/d3c/f48 4542967 0 2024-09-16T00:50:20.792 INFO:tasks.workunit.client.1.smithi152.stdout:4/866: truncate d2/db/d39/d3c/fb3 484097 0 2024-09-16T00:50:20.793 INFO:tasks.workunit.client.0.smithi053.stdout:1/320: creat d5/dd/f6f x:0 0 0 2024-09-16T00:50:20.793 INFO:tasks.workunit.client.0.smithi053.stdout:1/321: write d5/d9/f56 [4611095,3437] 0 2024-09-16T00:50:20.795 INFO:tasks.workunit.client.0.smithi053.stdout:3/382: mknod d1/d5/d16/d47/d65/d66/c76 0 2024-09-16T00:50:20.796 INFO:tasks.workunit.client.0.smithi053.stdout:2/285: truncate f0 2104341 0 2024-09-16T00:50:20.799 INFO:tasks.workunit.client.1.smithi152.stdout:1/841: mkdir d9/d138 0 2024-09-16T00:50:20.799 INFO:tasks.workunit.client.1.smithi152.stdout:1/842: chown d9/d3e/d7b/la8 47 1 2024-09-16T00:50:20.800 INFO:tasks.workunit.client.1.smithi152.stdout:1/843: creat d9/d3e/d7b/df0/f139 x:0 0 0 2024-09-16T00:50:20.802 INFO:tasks.workunit.client.0.smithi053.stdout:3/383: mknod d1/d5/d11/d3a/c77 0 2024-09-16T00:50:20.805 INFO:tasks.workunit.client.0.smithi053.stdout:3/384: mknod d1/d5/d16/d47/d4c/d50/c78 0 2024-09-16T00:50:20.806 INFO:tasks.workunit.client.0.smithi053.stdout:3/385: dread d1/d5/d11/d3a/f6e [0,4194304] 0 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/758: mkdir d1/d7/d77/d32/da5/da8/dc5/df5 0 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/759: chown d1/d4e/d48/d26/d30/d8f/dc4 2844084 1 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/760: rename d1 to d1/d4e/d48/d26/df6 22 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/761: fdatasync d1/d4e/d34/fe6 0 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/762: creat d1/d7/d77/d32/da5/da8/ff7 x:0 0 0 2024-09-16T00:50:20.809 INFO:tasks.workunit.client.0.smithi053.stdout:3/386: mkdir d1/d5/d16/d5e/d79 0 2024-09-16T00:50:20.810 INFO:tasks.workunit.client.0.smithi053.stdout:8/390: dwrite d10/f3a [0,4194304] 0 2024-09-16T00:50:20.810 INFO:tasks.workunit.client.0.smithi053.stdout:3/387: read d1/d5/d16/f3f [5733,122604] 0 2024-09-16T00:50:20.811 INFO:tasks.workunit.client.0.smithi053.stdout:1/322: dwrite d5/d18/d33/f63 [0,4194304] 0 2024-09-16T00:50:20.811 INFO:tasks.workunit.client.1.smithi152.stdout:4/867: mknod d2/d1e/d28/c118 0 2024-09-16T00:50:20.812 INFO:tasks.workunit.client.0.smithi053.stdout:1/323: dread d5/d9/d4c/d61/f37 [0,4194304] 0 2024-09-16T00:50:20.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/844: fsync d9/d3e/d41/f40 0 2024-09-16T00:50:20.817 INFO:tasks.workunit.client.0.smithi053.stdout:1/324: write d5/dd/f31 [5838099,28114] 0 2024-09-16T00:50:20.820 INFO:tasks.workunit.client.0.smithi053.stdout:8/391: truncate d10/d21/f42 540347 0 2024-09-16T00:50:20.822 INFO:tasks.workunit.client.1.smithi152.stdout:9/763: rename d1/d4e/d48/d66/l78 to d1/d7/d13/d5d/lf8 0 2024-09-16T00:50:20.824 INFO:tasks.workunit.client.1.smithi152.stdout:4/868: creat d2/db/d39/d3c/f119 x:0 0 0 2024-09-16T00:50:20.826 INFO:tasks.workunit.client.1.smithi152.stdout:1/845: creat d9/d3e/d41/d31/d48/d7d/f13a x:0 0 0 2024-09-16T00:50:20.828 INFO:tasks.workunit.client.1.smithi152.stdout:4/869: creat d2/d1e/f11a x:0 0 0 2024-09-16T00:50:20.828 INFO:tasks.workunit.client.1.smithi152.stdout:4/870: write d2/db/d39/d3c/f119 [611942,9921] 0 2024-09-16T00:50:20.828 INFO:tasks.workunit.client.1.smithi152.stdout:4/871: stat d2/db/d39/d3c/fa3 0 2024-09-16T00:50:20.828 INFO:tasks.workunit.client.1.smithi152.stdout:4/872: write d2/db/d39/d3c/d76/f108 [1014297,98248] 0 2024-09-16T00:50:20.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/846: symlink d9/d3e/d41/d31/l13b 0 2024-09-16T00:50:20.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/847: readlink d9/da/df/l3f 0 2024-09-16T00:50:20.835 INFO:tasks.workunit.client.1.smithi152.stdout:4/873: mknod d2/db/d39/d3c/d7f/d98/dcf/dfc/d115/c11b 0 2024-09-16T00:50:20.835 INFO:tasks.workunit.client.1.smithi152.stdout:4/874: chown d2/db/d39/d3c/d7f/d98/c33 0 1 2024-09-16T00:50:20.835 INFO:tasks.workunit.client.1.smithi152.stdout:4/875: write d2/d1e/d28/d7b/db0/f111 [958931,118473] 0 2024-09-16T00:50:20.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/848: dread d9/d3e/d4b/db7/fc0 [0,4194304] 0 2024-09-16T00:50:20.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/849: write d9/d3e/d7b/df0/d107/f43 [2653347,113350] 0 2024-09-16T00:50:20.836 INFO:tasks.workunit.client.1.smithi152.stdout:0/747: sync 2024-09-16T00:50:20.836 INFO:tasks.workunit.client.1.smithi152.stdout:0/748: creat d3/d6/d8/d1d/d23/d4b/d54/ffd x:0 0 0 2024-09-16T00:50:20.838 INFO:tasks.workunit.client.0.smithi053.stdout:3/388: mkdir d1/d5/d31/d7a 0 2024-09-16T00:50:20.846 INFO:tasks.workunit.client.0.smithi053.stdout:1/325: rmdir d5/dd/d47 39 2024-09-16T00:50:20.846 INFO:tasks.workunit.client.0.smithi053.stdout:1/326: readlink d5/d18/d33/d30/l6d 0 2024-09-16T00:50:20.848 INFO:tasks.workunit.client.0.smithi053.stdout:8/392: rename d10/d1c/d2b/d40/d50/c56 to d10/d21/d28/d6f/c83 0 2024-09-16T00:50:20.850 INFO:tasks.workunit.client.0.smithi053.stdout:3/389: creat d1/d5/d14/d28/f7b x:0 0 0 2024-09-16T00:50:20.854 INFO:tasks.workunit.client.0.smithi053.stdout:3/390: mkdir d1/d5/d31/d7c 0 2024-09-16T00:50:20.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/876: dwrite d2/db/d39/d3c/d76/db8/f79 [0,4194304] 0 2024-09-16T00:50:20.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/877: readlink d2/d1e/d28/d7b/lad 0 2024-09-16T00:50:20.855 INFO:tasks.workunit.client.1.smithi152.stdout:4/878: symlink d2/db/d39/d3c/d7f/ded/l11c 0 2024-09-16T00:50:20.856 INFO:tasks.workunit.client.1.smithi152.stdout:4/879: symlink d2/db/d39/d3c/d7f/l11d 0 2024-09-16T00:50:20.857 INFO:tasks.workunit.client.0.smithi053.stdout:1/327: dread d5/dd/d19/f46 [0,4194304] 0 2024-09-16T00:50:20.858 INFO:tasks.workunit.client.0.smithi053.stdout:1/328: mknod d5/d9/d4c/d61/d5f/c70 0 2024-09-16T00:50:20.859 INFO:tasks.workunit.client.0.smithi053.stdout:1/329: read d5/d18/f1b [2894325,97784] 0 2024-09-16T00:50:20.859 INFO:tasks.workunit.client.0.smithi053.stdout:3/391: dread d1/d5/d14/d28/f35 [0,4194304] 0 2024-09-16T00:50:20.859 INFO:tasks.workunit.client.0.smithi053.stdout:3/392: chown d1/d5/d16/c45 134 1 2024-09-16T00:50:20.859 INFO:tasks.workunit.client.0.smithi053.stdout:1/330: creat d5/dd/d47/d58/f71 x:0 0 0 2024-09-16T00:50:20.860 INFO:tasks.workunit.client.0.smithi053.stdout:1/331: readlink d5/d9/d4c/d61/l23 0 2024-09-16T00:50:20.860 INFO:tasks.workunit.client.0.smithi053.stdout:1/332: fsync d5/d9/d4c/d61/f37 0 2024-09-16T00:50:20.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/880: dread d2/d41/fe7 [0,4194304] 0 2024-09-16T00:50:20.865 INFO:tasks.workunit.client.1.smithi152.stdout:4/881: symlink d2/l11e 0 2024-09-16T00:50:20.868 INFO:tasks.workunit.client.1.smithi152.stdout:4/882: dread d2/d1e/d28/d69/f49 [0,4194304] 0 2024-09-16T00:50:20.868 INFO:tasks.workunit.client.1.smithi152.stdout:9/764: dwrite d1/d4e/d34/f39 [4194304,4194304] 0 2024-09-16T00:50:20.870 INFO:tasks.workunit.client.1.smithi152.stdout:9/765: mknod d1/d7/d77/d32/da5/da8/dc5/cf9 0 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/883: write d2/db/d39/d3c/d76/db8/f5c [353309,116259] 0 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/884: chown d2/db/dce/fd4 2450781 1 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/885: readlink d2/l17 0 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/886: mkdir d2/db/d39/d3c/d11f 0 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/887: symlink d2/db/d39/d3c/d7f/d98/def/d10f/l120 0 2024-09-16T00:50:20.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/888: truncate d2/d1e/f37 236540 0 2024-09-16T00:50:20.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/889: unlink d2/db/d39/d3c/ca8 0 2024-09-16T00:50:20.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/890: truncate d2/db/d39/d3c/d76/f82 1460809 0 2024-09-16T00:50:20.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/891: truncate d2/d1e/d28/d69/f105 273274 0 2024-09-16T00:50:20.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/892: symlink d2/db/de8/l121 0 2024-09-16T00:50:20.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/766: dread d1/d4e/d34/f39 [4194304,4194304] 0 2024-09-16T00:50:20.882 INFO:tasks.workunit.client.1.smithi152.stdout:4/893: rmdir d2/d1e/d28/d7b 39 2024-09-16T00:50:20.883 INFO:tasks.workunit.client.1.smithi152.stdout:9/767: truncate d1/d4e/d48/d26/d92/fbb 2927142 0 2024-09-16T00:50:20.884 INFO:tasks.workunit.client.1.smithi152.stdout:4/894: symlink d2/db/d44/l122 0 2024-09-16T00:50:20.886 INFO:tasks.workunit.client.1.smithi152.stdout:9/768: dread d1/d4e/d48/d2b/d93/fa7 [0,4194304] 0 2024-09-16T00:50:20.887 INFO:tasks.workunit.client.1.smithi152.stdout:9/769: rename d1/d4e/d48/c56 to d1/d4e/d48/cfa 0 2024-09-16T00:50:20.893 INFO:tasks.workunit.client.1.smithi152.stdout:4/895: write d2/db/d39/f9d [369164,39756] 0 2024-09-16T00:50:20.897 INFO:tasks.workunit.client.1.smithi152.stdout:4/896: truncate d2/db/f66 42470 0 2024-09-16T00:50:20.898 INFO:tasks.workunit.client.1.smithi152.stdout:4/897: chown d2/db/d39/d3c/dc5/cfe 89674691 1 2024-09-16T00:50:20.898 INFO:tasks.workunit.client.0.smithi053.stdout:8/393: dread d10/d21/f3e [0,4194304] 0 2024-09-16T00:50:20.899 INFO:tasks.workunit.client.0.smithi053.stdout:8/394: mkdir d10/d21/d28/d3c/d84 0 2024-09-16T00:50:20.899 INFO:tasks.workunit.client.0.smithi053.stdout:3/393: dwrite d1/f6f [4194304,4194304] 0 2024-09-16T00:50:20.899 INFO:tasks.workunit.client.0.smithi053.stdout:8/395: mknod d10/d21/d28/c85 0 2024-09-16T00:50:20.901 INFO:tasks.workunit.client.0.smithi053.stdout:3/394: unlink d1/d5/d16/c45 0 2024-09-16T00:50:20.903 INFO:tasks.workunit.client.0.smithi053.stdout:8/396: mknod d10/d1c/c86 0 2024-09-16T00:50:20.903 INFO:tasks.workunit.client.0.smithi053.stdout:8/397: write d10/d1c/d49/f5a [728642,98264] 0 2024-09-16T00:50:20.903 INFO:tasks.workunit.client.0.smithi053.stdout:8/398: chown d10/d52/f55 7061428 1 2024-09-16T00:50:20.904 INFO:tasks.workunit.client.0.smithi053.stdout:8/399: symlink d10/d52/d5b/l87 0 2024-09-16T00:50:20.906 INFO:tasks.workunit.client.0.smithi053.stdout:8/400: mkdir d10/d21/d28/d3c/d63/d6a/d88 0 2024-09-16T00:50:20.910 INFO:tasks.workunit.client.0.smithi053.stdout:8/401: creat d10/d1c/d49/f89 x:0 0 0 2024-09-16T00:50:20.911 INFO:tasks.workunit.client.0.smithi053.stdout:8/402: dread - d10/d21/d28/d3c/f7c zero size 2024-09-16T00:50:20.911 INFO:tasks.workunit.client.0.smithi053.stdout:8/403: chown d10/d1c/d2b/d40/d76 145838067 1 2024-09-16T00:50:20.911 INFO:tasks.workunit.client.0.smithi053.stdout:1/333: dwrite d5/d9/d4c/d61/f6e [0,4194304] 0 2024-09-16T00:50:20.918 INFO:tasks.workunit.client.1.smithi152.stdout:4/898: dwrite d2/d1e/d28/d69/f9c [4194304,4194304] 0 2024-09-16T00:50:20.920 INFO:tasks.workunit.client.1.smithi152.stdout:4/899: mknod d2/db/d39/d3c/d7f/d8b/c123 0 2024-09-16T00:50:20.921 INFO:tasks.workunit.client.0.smithi053.stdout:8/404: write d10/f20 [506071,92414] 0 2024-09-16T00:50:20.921 INFO:tasks.workunit.client.0.smithi053.stdout:3/395: dwrite d1/d4e/f6b [0,4194304] 0 2024-09-16T00:50:20.921 INFO:tasks.workunit.client.0.smithi053.stdout:3/396: write d1/d5/d11/f12 [3272970,85758] 0 2024-09-16T00:50:20.921 INFO:tasks.workunit.client.0.smithi053.stdout:3/397: truncate d1/d4e/f6b 5217361 0 2024-09-16T00:50:20.922 INFO:tasks.workunit.client.0.smithi053.stdout:8/405: creat d10/d1c/d2b/d40/f8a x:0 0 0 2024-09-16T00:50:20.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/707: sync 2024-09-16T00:50:20.923 INFO:tasks.workunit.client.1.smithi152.stdout:6/793: sync 2024-09-16T00:50:20.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/750: sync 2024-09-16T00:50:20.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/904: sync 2024-09-16T00:50:20.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/905: chown d6/d57/d2b/d50/d6e/ldf 1076872970 1 2024-09-16T00:50:20.924 INFO:tasks.workunit.client.1.smithi152.stdout:3/751: fdatasync dc/d10/d17/d5a/db2/d6f/dbb/fad 0 2024-09-16T00:50:20.924 INFO:tasks.workunit.client.1.smithi152.stdout:3/752: write dc/d10/d17/d5a/db2/f5e [1267588,60387] 0 2024-09-16T00:50:20.925 INFO:tasks.workunit.client.0.smithi053.stdout:1/334: dwrite d5/d7/d39/f48 [0,4194304] 0 2024-09-16T00:50:20.925 INFO:tasks.workunit.client.0.smithi053.stdout:1/335: creat d5/d9/d4c/d61/f72 x:0 0 0 2024-09-16T00:50:20.927 INFO:tasks.workunit.client.1.smithi152.stdout:2/708: unlink d4/d44/d7a/d9e/d66/f97 0 2024-09-16T00:50:20.930 INFO:tasks.workunit.client.0.smithi053.stdout:3/398: rename d1/lc to d1/d5/d14/d28/l7d 0 2024-09-16T00:50:20.930 INFO:tasks.workunit.client.0.smithi053.stdout:3/399: write d1/d5/d16/d5e/f63 [1636280,105099] 0 2024-09-16T00:50:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:6/794: rename db/d12/f44 to db/ffa 0 2024-09-16T00:50:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:6/795: read db/d12/d1c/fb1 [1162332,125082] 0 2024-09-16T00:50:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:6/796: write db/d12/d23/d4a/dc5/fd9 [941955,31250] 0 2024-09-16T00:50:20.934 INFO:tasks.workunit.client.0.smithi053.stdout:8/406: mknod d10/d1c/d2b/d40/c8b 0 2024-09-16T00:50:20.938 INFO:tasks.workunit.client.1.smithi152.stdout:5/906: dwrite d6/d57/d2b/f131 [4194304,4194304] 0 2024-09-16T00:50:20.938 INFO:tasks.workunit.client.1.smithi152.stdout:3/753: symlink dc/d10/d17/d5a/leb 0 2024-09-16T00:50:20.938 INFO:tasks.workunit.client.1.smithi152.stdout:3/754: read - dc/d10/d17/d1c/d1f/fe6 zero size 2024-09-16T00:50:20.939 INFO:tasks.workunit.client.0.smithi053.stdout:8/407: dread d10/d1c/d49/f5a [0,4194304] 0 2024-09-16T00:50:20.940 INFO:tasks.workunit.client.0.smithi053.stdout:8/408: truncate d10/f14 705100 0 2024-09-16T00:50:20.940 INFO:tasks.workunit.client.1.smithi152.stdout:2/709: mkdir d4/d44/d7a/d9e/d66/dec 0 2024-09-16T00:50:20.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/907: unlink d6/d16/d1f/d8c/db8/dbf/f14c 0 2024-09-16T00:50:20.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/908: write d6/f1a [1929842,65853] 0 2024-09-16T00:50:20.954 INFO:tasks.workunit.client.1.smithi152.stdout:3/755: mknod dc/d10/d17/d5a/db2/d6f/d74/db5/de2/cec 0 2024-09-16T00:50:20.955 INFO:tasks.workunit.client.1.smithi152.stdout:3/756: chown dc/d10/d17/d5a/d68/da5 28 1 2024-09-16T00:50:20.958 INFO:tasks.workunit.client.1.smithi152.stdout:6/797: getdents db/d12/d23/d4a/dc5 0 2024-09-16T00:50:20.962 INFO:tasks.workunit.client.1.smithi152.stdout:5/909: link d6/d57/ddc/d11a/d11f/l143 d6/d16/d1f/d65/l14e 0 2024-09-16T00:50:20.963 INFO:tasks.workunit.client.1.smithi152.stdout:2/710: getdents d4/d44/d7a/dc7/de4/d94 0 2024-09-16T00:50:20.965 INFO:tasks.workunit.client.0.smithi053.stdout:3/400: mknod d1/d5/d16/c7e 0 2024-09-16T00:50:20.968 INFO:tasks.workunit.client.0.smithi053.stdout:8/409: mknod d10/d4a/d54/c8c 0 2024-09-16T00:50:20.970 INFO:tasks.workunit.client.0.smithi053.stdout:8/410: dread d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:20.970 INFO:tasks.workunit.client.0.smithi053.stdout:8/411: creat d10/d1c/d2b/d40/f8d x:0 0 0 2024-09-16T00:50:20.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/401: mkdir d1/d5/d16/d5e/d79/d7f 0 2024-09-16T00:50:20.971 INFO:tasks.workunit.client.0.smithi053.stdout:3/402: readlink d1/d5/d11/l23 0 2024-09-16T00:50:20.973 INFO:tasks.workunit.client.1.smithi152.stdout:5/910: dread d6/fc [0,4194304] 0 2024-09-16T00:50:20.973 INFO:tasks.workunit.client.1.smithi152.stdout:5/911: chown d6/d57/c111 541262533 1 2024-09-16T00:50:20.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/798: getdents db/d12/d1c 0 2024-09-16T00:50:20.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/799: fsync db/da8/db7/fd2 0 2024-09-16T00:50:20.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/711: symlink d4/d44/d7a/dc7/de4/led 0 2024-09-16T00:50:20.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/712: fsync d4/d44/d7a/dc7/de4/f49 0 2024-09-16T00:50:20.976 INFO:tasks.workunit.client.0.smithi053.stdout:3/403: link d1/d5/d16/l1a d1/d5/d16/d47/l80 0 2024-09-16T00:50:20.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/594: sync 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/764: sync 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/765: truncate d9/d31/d65/f7c 645784 0 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/766: write d9/d31/d64/d3c/f8b [2195280,104775] 0 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/767: stat d9/d31/d65/d8a/d90/cba 0 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/768: truncate d9/d10/f9d 1631086 0 2024-09-16T00:50:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/769: chown d9/d31/dc4 1665 1 2024-09-16T00:50:20.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/800: mkdir db/d12/d20/d86/d91/dde/dfb 0 2024-09-16T00:50:20.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/801: read - db/d12/d23/d4a/d43/d48/d64/dab/de7/fb0 zero size 2024-09-16T00:50:20.980 INFO:tasks.workunit.client.0.smithi053.stdout:3/404: symlink d1/d5/d16/d47/d64/l81 0 2024-09-16T00:50:20.981 INFO:tasks.workunit.client.0.smithi053.stdout:3/405: dread d1/d5/d31/f39 [0,4194304] 0 2024-09-16T00:50:20.982 INFO:tasks.workunit.client.1.smithi152.stdout:2/713: rename d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/fac to d4/d44/d7a/dc7/de4/d94/d8f/fee 0 2024-09-16T00:50:20.983 INFO:tasks.workunit.client.1.smithi152.stdout:5/912: rmdir d6/d16/d1f/d6c/de2/d10f 39 2024-09-16T00:50:20.983 INFO:tasks.workunit.client.1.smithi152.stdout:2/714: write d4/f16 [4607711,55327] 0 2024-09-16T00:50:20.985 INFO:tasks.workunit.client.0.smithi053.stdout:3/406: link d1/d5/d11/f25 d1/d4e/f82 0 2024-09-16T00:50:20.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/595: dread dd/d25/f91 [0,4194304] 0 2024-09-16T00:50:20.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/596: chown dd/d15/d69/c81 1224531 1 2024-09-16T00:50:20.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/597: dread - dd/d98/fbe zero size 2024-09-16T00:50:20.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/770: creat d9/d10/dc0/f109 x:0 0 0 2024-09-16T00:50:20.989 INFO:tasks.workunit.client.1.smithi152.stdout:6/802: rename db/d12/lf5 to db/d12/d23/d3a/lfc 0 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/913: symlink d6/d57/ddc/d11a/d11f/l14f 0 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/914: dread - d6/d16/d1f/d8c/db8/feb zero size 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/915: fdatasync d6/f32 0 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/916: chown d6/d57/d2b/d50/d66/l7e 0 1 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/917: chown d6/f1a 166 1 2024-09-16T00:50:20.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/918: write d6/d57/d2b/d50/d64/df5/d10a/f139 [4003027,12092] 0 2024-09-16T00:50:20.991 INFO:tasks.workunit.client.1.smithi152.stdout:2/715: mknod d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/cef 0 2024-09-16T00:50:20.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/598: creat dd/d15/d9b/fcc x:0 0 0 2024-09-16T00:50:20.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/599: creat dd/d25/da4/fcd x:0 0 0 2024-09-16T00:50:20.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/771: mkdir d9/d31/d65/d8a/d41/d46/d7d/de2/df0/d10a 0 2024-09-16T00:50:20.995 INFO:tasks.workunit.client.1.smithi152.stdout:8/600: dread dd/d25/d77/fa3 [0,4194304] 0 2024-09-16T00:50:20.995 INFO:tasks.workunit.client.1.smithi152.stdout:8/601: truncate dd/d15/d1a/fa8 1039761 0 2024-09-16T00:50:20.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/772: creat d9/d31/d64/d3c/db9/dd3/f10b x:0 0 0 2024-09-16T00:50:20.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/919: mknod d6/d57/d2b/dee/c150 0 2024-09-16T00:50:20.998 INFO:tasks.workunit.client.1.smithi152.stdout:8/602: dread dd/d15/d69/f89 [0,4194304] 0 2024-09-16T00:50:20.999 INFO:tasks.workunit.client.1.smithi152.stdout:8/603: fdatasync dd/f42 0 2024-09-16T00:50:20.999 INFO:tasks.workunit.client.1.smithi152.stdout:8/604: creat dd/d50/d88/fce x:0 0 0 2024-09-16T00:50:21.002 INFO:tasks.workunit.client.1.smithi152.stdout:7/773: symlink d9/d31/d65/d8a/d41/d46/l10c 0 2024-09-16T00:50:21.004 INFO:tasks.workunit.client.1.smithi152.stdout:5/920: unlink d6/d16/d1f/f56 0 2024-09-16T00:50:21.009 INFO:tasks.workunit.client.1.smithi152.stdout:7/774: creat d9/d31/d65/d8a/d41/f10d x:0 0 0 2024-09-16T00:50:21.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/407: dwrite d1/d5/d14/f71 [0,4194304] 0 2024-09-16T00:50:21.012 INFO:tasks.workunit.client.1.smithi152.stdout:7/775: truncate d9/d31/d65/f98 1049840 0 2024-09-16T00:50:21.015 INFO:tasks.workunit.client.1.smithi152.stdout:6/803: dwrite f9 [0,4194304] 0 2024-09-16T00:50:21.020 INFO:tasks.workunit.client.1.smithi152.stdout:2/716: dwrite d4/d44/d7a/dc7/de4/d94/d93/da4/fbd [0,4194304] 0 2024-09-16T00:50:21.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/717: chown d4/d44/d7a/dc7/de4/d20/lbc 30713024 1 2024-09-16T00:50:21.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/776: dread d9/d31/fb5 [0,4194304] 0 2024-09-16T00:50:21.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/777: dread - d9/d10/dc0/f109 zero size 2024-09-16T00:50:21.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/778: write d9/d31/d65/d8a/d41/f58 [510813,1159] 0 2024-09-16T00:50:21.025 INFO:tasks.workunit.client.1.smithi152.stdout:5/921: dwrite d6/d16/d1f/db5/dd3/fd4 [0,4194304] 0 2024-09-16T00:50:21.027 INFO:tasks.workunit.client.1.smithi152.stdout:6/804: write f9 [3256768,73864] 0 2024-09-16T00:50:21.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/805: rename db/d12/d1c/d80 to db/d12/d1c/d80/d97/dfd 22 2024-09-16T00:50:21.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/806: fdatasync db/d28/f32 0 2024-09-16T00:50:21.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/807: fsync db/d12/d23/fac 0 2024-09-16T00:50:21.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/779: symlink d9/d31/d64/d3c/l10e 0 2024-09-16T00:50:21.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/780: chown d9/d10 30 1 2024-09-16T00:50:21.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/781: stat d9/d31/d64/d3c/f78 0 2024-09-16T00:50:21.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/782: fdatasync d9/f93 0 2024-09-16T00:50:21.030 INFO:tasks.workunit.client.1.smithi152.stdout:7/783: stat d9/d31/dc4/fe0 0 2024-09-16T00:50:21.033 INFO:tasks.workunit.client.1.smithi152.stdout:6/808: rename db/d12/d1c/l41 to db/d12/d23/d4a/d43/lfe 0 2024-09-16T00:50:21.034 INFO:tasks.workunit.client.1.smithi152.stdout:7/784: rename d9/d31/d64/d3c/d5b/fdb to d9/d31/d65/f10f 0 2024-09-16T00:50:21.035 INFO:tasks.workunit.client.1.smithi152.stdout:5/922: dread d6/ff [0,4194304] 0 2024-09-16T00:50:21.035 INFO:tasks.workunit.client.1.smithi152.stdout:8/605: dwrite dd/d50/d29/f58 [0,4194304] 0 2024-09-16T00:50:21.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/809: creat db/d12/d23/d4a/d43/d48/d6a/de0/fff x:0 0 0 2024-09-16T00:50:21.037 INFO:tasks.workunit.client.1.smithi152.stdout:5/923: creat d6/d16/d1f/d6c/d125/f151 x:0 0 0 2024-09-16T00:50:21.037 INFO:tasks.workunit.client.1.smithi152.stdout:5/924: write d6/d16/d1f/d6c/de2/d106/f120 [500552,111966] 0 2024-09-16T00:50:21.041 INFO:tasks.workunit.client.1.smithi152.stdout:8/606: rmdir dd/d23 39 2024-09-16T00:50:21.043 INFO:tasks.workunit.client.1.smithi152.stdout:6/810: mkdir db/d28/db3/d100 0 2024-09-16T00:50:21.044 INFO:tasks.workunit.client.1.smithi152.stdout:5/925: symlink d6/d57/ddc/d11a/l152 0 2024-09-16T00:50:21.050 INFO:tasks.workunit.client.1.smithi152.stdout:8/607: dread dd/f1f [0,4194304] 0 2024-09-16T00:50:21.052 INFO:tasks.workunit.client.1.smithi152.stdout:7/785: dwrite d9/d31/d65/d6b/fc9 [0,4194304] 0 2024-09-16T00:50:21.052 INFO:tasks.workunit.client.1.smithi152.stdout:7/786: chown d9/d31/d64/d3c/db9/dd3/de6/l102 300422 1 2024-09-16T00:50:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/811: dread db/d12/d23/d4a/fca [0,4194304] 0 2024-09-16T00:50:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/812: fsync db/d12/d23/d4a/d43/d59/fdf 0 2024-09-16T00:50:21.057 INFO:tasks.workunit.client.1.smithi152.stdout:8/608: rename dd/d50 to dd/d98/db8/dcf 0 2024-09-16T00:50:21.057 INFO:tasks.workunit.client.1.smithi152.stdout:8/609: write dd/d98/db8/dcf/d88/fbc [54657,45124] 0 2024-09-16T00:50:21.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/813: truncate db/d12/d23/d4a/f5f 3607033 0 2024-09-16T00:50:21.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/814: chown db/d12/d23/d4a/d33/dbe 4146 1 2024-09-16T00:50:21.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/815: chown db/d12/d23/d4a/d43/d48/d64/dab/de7/c9a 2141 1 2024-09-16T00:50:21.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/610: dread dd/d15/f52 [0,4194304] 0 2024-09-16T00:50:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:1/850: sync 2024-09-16T00:50:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:0/749: sync 2024-09-16T00:50:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/611: symlink dd/d98/db8/dcf/d29/ld0 0 2024-09-16T00:50:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/612: fdatasync dd/d25/d77/fa3 0 2024-09-16T00:50:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/613: chown dd/d15/d1a/f3f 163214328 1 2024-09-16T00:50:21.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/926: dwrite d6/d16/d10d/d10e/f117 [0,4194304] 0 2024-09-16T00:50:21.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/927: write d6/d16/d8b/fe3 [1021971,4808] 0 2024-09-16T00:50:21.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/928: creat d6/d16/d1f/d65/d77/f153 x:0 0 0 2024-09-16T00:50:21.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/929: dread - d6/d16/d1f/d8c/f94 zero size 2024-09-16T00:50:21.067 INFO:tasks.workunit.client.1.smithi152.stdout:0/750: rename d3/d6/d8/d1d/d65/fea to d3/d6/d4e/ddb/ffe 0 2024-09-16T00:50:21.067 INFO:tasks.workunit.client.1.smithi152.stdout:7/787: write d9/d10/f36 [3503343,116931] 0 2024-09-16T00:50:21.067 INFO:tasks.workunit.client.1.smithi152.stdout:0/751: write d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 [918780,56484] 0 2024-09-16T00:50:21.067 INFO:tasks.workunit.client.1.smithi152.stdout:7/788: write d9/d31/d65/d8a/f4a [4829190,75927] 0 2024-09-16T00:50:21.069 INFO:tasks.workunit.client.1.smithi152.stdout:8/614: symlink dd/d98/ld1 0 2024-09-16T00:50:21.072 INFO:tasks.workunit.client.1.smithi152.stdout:8/615: dread dd/d98/db8/dcf/d29/d2f/d53/f73 [0,4194304] 0 2024-09-16T00:50:21.075 INFO:tasks.workunit.client.1.smithi152.stdout:5/930: creat d6/d57/d2b/dee/f154 x:0 0 0 2024-09-16T00:50:21.076 INFO:tasks.workunit.client.1.smithi152.stdout:7/789: truncate d9/d31/d64/f8e 92098 0 2024-09-16T00:50:21.076 INFO:tasks.workunit.client.1.smithi152.stdout:7/790: readlink d9/l2c 0 2024-09-16T00:50:21.077 INFO:tasks.workunit.client.1.smithi152.stdout:5/931: truncate d6/d16/f4d 1240498 0 2024-09-16T00:50:21.077 INFO:tasks.workunit.client.1.smithi152.stdout:5/932: chown d6/d57/d2b/d50/d64/f6f 2126779229 1 2024-09-16T00:50:21.078 INFO:tasks.workunit.client.1.smithi152.stdout:7/791: symlink d9/d31/d64/d3c/db9/dc2/l110 0 2024-09-16T00:50:21.079 INFO:tasks.workunit.client.1.smithi152.stdout:7/792: getdents d9/d31/d64/d3c/db9/dd3/d100/d82 0 2024-09-16T00:50:21.080 INFO:tasks.workunit.client.1.smithi152.stdout:5/933: rmdir d6/d16/d1f/d65/dd2/d123/d130 39 2024-09-16T00:50:21.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/752: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae [2408812,27167] 0 2024-09-16T00:50:21.081 INFO:tasks.workunit.client.1.smithi152.stdout:7/793: creat d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5/f111 x:0 0 0 2024-09-16T00:50:21.083 INFO:tasks.workunit.client.1.smithi152.stdout:5/934: unlink d6/d16/d1f/d6c/f12e 0 2024-09-16T00:50:21.084 INFO:tasks.workunit.client.1.smithi152.stdout:0/753: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:21.087 INFO:tasks.workunit.client.0.smithi053.stdout:0/369: sync 2024-09-16T00:50:21.087 INFO:tasks.workunit.client.1.smithi152.stdout:0/754: dread d3/d6/f42 [0,4194304] 0 2024-09-16T00:50:21.087 INFO:tasks.workunit.client.1.smithi152.stdout:5/935: creat d6/d16/d1f/d6c/f155 x:0 0 0 2024-09-16T00:50:21.089 INFO:tasks.workunit.client.0.smithi053.stdout:0/370: rename d4/dc/d25/d34/d2a/c2e to d4/dc/d25/d34/c77 0 2024-09-16T00:50:21.090 INFO:tasks.workunit.client.1.smithi152.stdout:6/816: dwrite db/fc [0,4194304] 0 2024-09-16T00:50:21.091 INFO:tasks.workunit.client.1.smithi152.stdout:0/755: mkdir d3/d6/d2e/de9/dff 0 2024-09-16T00:50:21.092 INFO:tasks.workunit.client.1.smithi152.stdout:1/851: dwrite d9/da/df/f27 [4194304,4194304] 0 2024-09-16T00:50:21.093 INFO:tasks.workunit.client.1.smithi152.stdout:8/616: dwrite dd/f72 [0,4194304] 0 2024-09-16T00:50:21.093 INFO:tasks.workunit.client.1.smithi152.stdout:8/617: chown dd/d98/db8/dcf/d88/cb5 1 1 2024-09-16T00:50:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/817: link db/d12/d23/d4a/dc5/ff2 db/d12/d23/d4a/d43/f101 0 2024-09-16T00:50:21.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/756: creat d3/d6/d8/d1d/d65/d6e/f100 x:0 0 0 2024-09-16T00:50:21.099 INFO:tasks.workunit.client.1.smithi152.stdout:5/936: dread d6/d16/f27 [0,4194304] 0 2024-09-16T00:50:21.115 INFO:tasks.workunit.client.1.smithi152.stdout:1/852: dread d9/f29 [0,4194304] 0 2024-09-16T00:50:21.115 INFO:tasks.workunit.client.1.smithi152.stdout:5/937: dread d6/d57/d2b/d50/d6e/ffd [0,4194304] 0 2024-09-16T00:50:21.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/818: dwrite db/d12/d23/d4a/d43/d59/fe6 [0,4194304] 0 2024-09-16T00:50:21.121 INFO:tasks.workunit.client.0.smithi053.stdout:0/371: dwrite d4/dc/d1e/d22/f29 [0,4194304] 0 2024-09-16T00:50:21.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/794: rmdir d9/d31/d65 39 2024-09-16T00:50:21.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/795: creat d9/db6/f112 x:0 0 0 2024-09-16T00:50:21.133 INFO:tasks.workunit.client.1.smithi152.stdout:1/853: dwrite d9/d3e/d4b/d6b/d6d/d97/ffd [0,4194304] 0 2024-09-16T00:50:21.133 INFO:tasks.workunit.client.1.smithi152.stdout:1/854: chown d9/d3e/d4b/db7/lf8 39637 1 2024-09-16T00:50:21.133 INFO:tasks.workunit.client.0.smithi053.stdout:0/372: rmdir d4/dc/d25/d34 39 2024-09-16T00:50:21.134 INFO:tasks.workunit.client.1.smithi152.stdout:6/819: write db/f31 [1967001,35792] 0 2024-09-16T00:50:21.134 INFO:tasks.workunit.client.1.smithi152.stdout:6/820: fdatasync db/d12/d23/fac 0 2024-09-16T00:50:21.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/757: unlink d3/d6/d8/d1d/d23/d4b/d54/f90 0 2024-09-16T00:50:21.136 INFO:tasks.workunit.client.0.smithi053.stdout:0/373: creat d4/dc/d25/d34/d2a/d5b/f78 x:0 0 0 2024-09-16T00:50:21.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/938: mknod d6/d16/d1f/d8c/db8/dbf/ded/c156 0 2024-09-16T00:50:21.138 INFO:tasks.workunit.client.0.smithi053.stdout:0/374: symlink d4/dc/d25/d34/l79 0 2024-09-16T00:50:21.142 INFO:tasks.workunit.client.1.smithi152.stdout:7/796: stat d9/d31/d65/l32 0 2024-09-16T00:50:21.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/821: creat db/d12/d23/d4a/d43/d48/d6a/f102 x:0 0 0 2024-09-16T00:50:21.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/822: rename db to db/d12/d20/df4/d103 22 2024-09-16T00:50:21.149 INFO:tasks.workunit.client.1.smithi152.stdout:0/758: creat d3/d6/d8/d1d/d65/d6e/d82/da4/f101 x:0 0 0 2024-09-16T00:50:21.149 INFO:tasks.workunit.client.1.smithi152.stdout:4/900: sync 2024-09-16T00:50:21.149 INFO:tasks.workunit.client.1.smithi152.stdout:9/770: sync 2024-09-16T00:50:21.150 INFO:tasks.workunit.client.1.smithi152.stdout:1/855: dwrite d9/d3e/d41/d31/d48/d7d/fcf [0,4194304] 0 2024-09-16T00:50:21.151 INFO:tasks.workunit.client.1.smithi152.stdout:5/939: symlink d6/d57/d2b/d50/d64/d92/l157 0 2024-09-16T00:50:21.152 INFO:tasks.workunit.client.1.smithi152.stdout:7/797: creat d9/d31/d65/d8a/d41/d46/d7d/d86/d97/f113 x:0 0 0 2024-09-16T00:50:21.153 INFO:tasks.workunit.client.0.smithi053.stdout:0/375: dread d4/f69 [0,4194304] 0 2024-09-16T00:50:21.153 INFO:tasks.workunit.client.0.smithi053.stdout:0/376: dread - d4/d13/d2d/f50 zero size 2024-09-16T00:50:21.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/823: creat db/d12/d23/d4a/d33/dbe/f104 x:0 0 0 2024-09-16T00:50:21.156 INFO:tasks.workunit.client.0.smithi053.stdout:0/377: symlink d4/dc/d25/d34/d2a/d27/l7a 0 2024-09-16T00:50:21.157 INFO:tasks.workunit.client.1.smithi152.stdout:3/757: sync 2024-09-16T00:50:21.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/718: sync 2024-09-16T00:50:21.159 INFO:tasks.workunit.client.0.smithi053.stdout:0/378: read d4/d13/f4f [1344623,104537] 0 2024-09-16T00:50:21.160 INFO:tasks.workunit.client.1.smithi152.stdout:4/901: creat d2/db/d39/d3c/d76/db8/f124 x:0 0 0 2024-09-16T00:50:21.165 INFO:tasks.workunit.client.1.smithi152.stdout:5/940: unlink d6/fe 0 2024-09-16T00:50:21.166 INFO:tasks.workunit.client.1.smithi152.stdout:7/798: rename d9/d31/d65/d8a/d41/f58 to d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f114 0 2024-09-16T00:50:21.169 INFO:tasks.workunit.client.1.smithi152.stdout:0/759: rmdir d3/d6/d51/dbb/dbf 39 2024-09-16T00:50:21.171 INFO:tasks.workunit.client.1.smithi152.stdout:3/758: link dc/d10/d17/f26 dc/d10/d17/d1c/fed 0 2024-09-16T00:50:21.172 INFO:tasks.workunit.client.1.smithi152.stdout:1/856: dwrite d9/d3e/d41/d31/d48/db2/f132 [0,4194304] 0 2024-09-16T00:50:21.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/902: mkdir d2/db/dce/deb/d125 0 2024-09-16T00:50:21.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/903: write d2/db/d39/d3c/d76/db8/f5c [4783149,31861] 0 2024-09-16T00:50:21.177 INFO:tasks.workunit.client.1.smithi152.stdout:1/857: dread d9/d3e/d7b/f7f [0,4194304] 0 2024-09-16T00:50:21.177 INFO:tasks.workunit.client.1.smithi152.stdout:4/904: dread d2/d1e/d28/d69/f105 [0,4194304] 0 2024-09-16T00:50:21.177 INFO:tasks.workunit.client.1.smithi152.stdout:6/824: rename db/d12/d23/d4a/d43/d48/d64/dab/de7/f4e to db/d12/d23/f105 0 2024-09-16T00:50:21.178 INFO:tasks.workunit.client.1.smithi152.stdout:7/799: creat d9/d10/f115 x:0 0 0 2024-09-16T00:50:21.179 INFO:tasks.workunit.client.1.smithi152.stdout:7/800: chown d9/d31/d65/d8a/d90/fbb 20798792 1 2024-09-16T00:50:21.180 INFO:tasks.workunit.client.1.smithi152.stdout:0/760: dread d3/d6/d8/d1d/d23/d25/d2a/d5c/fa9 [0,4194304] 0 2024-09-16T00:50:21.180 INFO:tasks.workunit.client.1.smithi152.stdout:0/761: write d3/d6/d8/d1d/d23/d25/fee [326544,74005] 0 2024-09-16T00:50:21.186 INFO:tasks.workunit.client.1.smithi152.stdout:1/858: chown d9/da/l5a 1 1 2024-09-16T00:50:21.186 INFO:tasks.workunit.client.1.smithi152.stdout:1/859: fsync d9/da/df/f2c 0 2024-09-16T00:50:21.187 INFO:tasks.workunit.client.1.smithi152.stdout:4/905: truncate d2/fbf 473818 0 2024-09-16T00:50:21.190 INFO:tasks.workunit.client.1.smithi152.stdout:7/801: dread d9/f1b [4194304,4194304] 0 2024-09-16T00:50:21.190 INFO:tasks.workunit.client.1.smithi152.stdout:7/802: write d9/d31/dc4/ffb [795792,41411] 0 2024-09-16T00:50:21.190 INFO:tasks.workunit.client.1.smithi152.stdout:2/719: rename d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/lb4 to d4/d44/d7a/d9e/da0/lf0 0 2024-09-16T00:50:21.191 INFO:tasks.workunit.client.1.smithi152.stdout:9/771: dwrite d1/d4e/f7e [0,4194304] 0 2024-09-16T00:50:21.191 INFO:tasks.workunit.client.1.smithi152.stdout:9/772: chown d1/d4e/d48/d26/d30/d4f/l7d 3683 1 2024-09-16T00:50:21.191 INFO:tasks.workunit.client.1.smithi152.stdout:1/860: mkdir d9/da/d105/d13c 0 2024-09-16T00:50:21.195 INFO:tasks.workunit.client.1.smithi152.stdout:7/803: creat d9/d31/d65/d8a/d41/d46/d7d/d86/f116 x:0 0 0 2024-09-16T00:50:21.196 INFO:tasks.workunit.client.1.smithi152.stdout:2/720: truncate d4/d44/d7a/d9e/f75 182895 0 2024-09-16T00:50:21.198 INFO:tasks.workunit.client.1.smithi152.stdout:6/825: dread db/d12/d23/d4a/d43/d48/d64/f6d [0,4194304] 0 2024-09-16T00:50:21.200 INFO:tasks.workunit.client.0.smithi053.stdout:0/379: dwrite d4/f4b [0,4194304] 0 2024-09-16T00:50:21.200 INFO:tasks.workunit.client.1.smithi152.stdout:9/773: mknod d1/d4e/d48/d26/d30/d8f/cfb 0 2024-09-16T00:50:21.203 INFO:tasks.workunit.client.0.smithi053.stdout:0/380: creat d4/dc/d1e/d1f/d40/f7b x:0 0 0 2024-09-16T00:50:21.206 INFO:tasks.workunit.client.1.smithi152.stdout:7/804: write d9/d31/d65/d8a/d90/fa4 [806034,75707] 0 2024-09-16T00:50:21.211 INFO:tasks.workunit.client.1.smithi152.stdout:1/861: unlink d9/d3e/d41/d31/da5/f130 0 2024-09-16T00:50:21.211 INFO:tasks.workunit.client.1.smithi152.stdout:2/721: mkdir d4/d44/d7a/d9e/da0/df1 0 2024-09-16T00:50:21.212 INFO:tasks.workunit.client.1.smithi152.stdout:2/722: fsync d4/f15 0 2024-09-16T00:50:21.213 INFO:tasks.workunit.client.1.smithi152.stdout:6/826: mknod db/d12/d23/d4a/d43/d48/d6a/c106 0 2024-09-16T00:50:21.213 INFO:tasks.workunit.client.1.smithi152.stdout:4/906: dwrite d2/db/dce/f101 [0,4194304] 0 2024-09-16T00:50:21.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/762: dwrite d3/f16 [0,4194304] 0 2024-09-16T00:50:21.214 INFO:tasks.workunit.client.1.smithi152.stdout:0/763: chown d3/d6/ld 104170 1 2024-09-16T00:50:21.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/774: mkdir d1/d7/d77/dfc 0 2024-09-16T00:50:21.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/775: stat d1/d4e/d48/d2b/d93/ccc 0 2024-09-16T00:50:21.219 INFO:tasks.workunit.client.1.smithi152.stdout:1/862: creat d9/da/da2/f13d x:0 0 0 2024-09-16T00:50:21.219 INFO:tasks.workunit.client.0.smithi053.stdout:0/381: dwrite d4/dc/d25/d34/d2a/f4e [4194304,4194304] 0 2024-09-16T00:50:21.219 INFO:tasks.workunit.client.0.smithi053.stdout:0/382: dread - d4/dc/d25/f4d zero size 2024-09-16T00:50:21.220 INFO:tasks.workunit.client.0.smithi053.stdout:0/383: write d4/dc/d1e/d1f/d40/f7b [1035714,73825] 0 2024-09-16T00:50:21.220 INFO:tasks.workunit.client.1.smithi152.stdout:2/723: symlink d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/lf2 0 2024-09-16T00:50:21.220 INFO:tasks.workunit.client.1.smithi152.stdout:2/724: write d4/d44/d7a/dc7/de4/d20/d28/d2c/f7b [4082926,19817] 0 2024-09-16T00:50:21.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/827: mknod db/d28/dd8/c107 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/384: creat d4/dc/d1e/d1f/d40/d44/d49/f7c x:0 0 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/385: write d4/dc/d25/d34/d2a/f58 [509107,96873] 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/386: truncate d4/dc/d25/d34/d2a/d27/f33 487913 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/387: fsync d4/dc/d25/d34/d2a/f67 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/388: readlink d4/dc/d25/d34/d2a/d27/l7a 0 2024-09-16T00:50:21.224 INFO:tasks.workunit.client.0.smithi053.stdout:0/389: truncate d4/dc/d25/f2f 296327 0 2024-09-16T00:50:21.225 INFO:tasks.workunit.client.0.smithi053.stdout:0/390: dread - d4/d13/d2d/f50 zero size 2024-09-16T00:50:21.225 INFO:tasks.workunit.client.1.smithi152.stdout:7/805: dwrite d9/d31/d65/f10f [0,4194304] 0 2024-09-16T00:50:21.227 INFO:tasks.workunit.client.1.smithi152.stdout:4/907: unlink d2/db/d39/d3c/d7f/d98/f74 0 2024-09-16T00:50:21.228 INFO:tasks.workunit.client.1.smithi152.stdout:0/764: dread d3/d6/d6d/f8e [0,4194304] 0 2024-09-16T00:50:21.228 INFO:tasks.workunit.client.1.smithi152.stdout:9/776: unlink d1/d4e/d48/ccf 0 2024-09-16T00:50:21.228 INFO:tasks.workunit.client.1.smithi152.stdout:9/777: fdatasync d1/d4e/d48/d26/d92/fd8 0 2024-09-16T00:50:21.229 INFO:tasks.workunit.client.1.smithi152.stdout:9/778: readlink d1/d7/l5b 0 2024-09-16T00:50:21.229 INFO:tasks.workunit.client.1.smithi152.stdout:9/779: chown d1/d4e/d48/d26/d30/l8c 834744 1 2024-09-16T00:50:21.230 INFO:tasks.workunit.client.1.smithi152.stdout:1/863: write d9/d3e/d41/ff3 [84421,7788] 0 2024-09-16T00:50:21.232 INFO:tasks.workunit.client.1.smithi152.stdout:2/725: mknod d4/d44/d7a/dc7/de4/d20/d34/cf3 0 2024-09-16T00:50:21.232 INFO:tasks.workunit.client.1.smithi152.stdout:2/726: dread - d4/d44/d7a/dc7/de4/d20/d28/fb1 zero size 2024-09-16T00:50:21.232 INFO:tasks.workunit.client.0.smithi053.stdout:0/391: write d4/d13/f63 [1248125,110391] 0 2024-09-16T00:50:21.233 INFO:tasks.workunit.client.1.smithi152.stdout:6/828: mkdir db/d12/d23/d4a/d43/d48/d64/d108 0 2024-09-16T00:50:21.237 INFO:tasks.workunit.client.0.smithi053.stdout:0/392: symlink d4/d5a/d68/l7d 0 2024-09-16T00:50:21.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/806: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d117 0 2024-09-16T00:50:21.241 INFO:tasks.workunit.client.1.smithi152.stdout:9/780: write d1/d7/f99 [3052392,47706] 0 2024-09-16T00:50:21.242 INFO:tasks.workunit.client.0.smithi053.stdout:0/393: creat d4/d5a/f7e x:0 0 0 2024-09-16T00:50:21.242 INFO:tasks.workunit.client.0.smithi053.stdout:0/394: chown d4/f4b 480 1 2024-09-16T00:50:21.243 INFO:tasks.workunit.client.1.smithi152.stdout:4/908: rmdir d2/db/dce/deb/d125 0 2024-09-16T00:50:21.244 INFO:tasks.workunit.client.1.smithi152.stdout:4/909: chown d2/d1e/d28/c83 0 1 2024-09-16T00:50:21.246 INFO:tasks.workunit.client.1.smithi152.stdout:1/864: unlink d9/d3e/d4b/d6b/d6d/d97/lb9 0 2024-09-16T00:50:21.246 INFO:tasks.workunit.client.1.smithi152.stdout:1/865: write d9/d3e/d41/d9a/fca [857979,102055] 0 2024-09-16T00:50:21.247 INFO:tasks.workunit.client.0.smithi053.stdout:0/395: creat d4/dc/d25/d34/f7f x:0 0 0 2024-09-16T00:50:21.247 INFO:tasks.workunit.client.1.smithi152.stdout:7/807: dread d9/d31/d65/fa1 [0,4194304] 0 2024-09-16T00:50:21.247 INFO:tasks.workunit.client.1.smithi152.stdout:7/808: truncate d9/d31/d65/d8a/d41/d46/fa2 4418860 0 2024-09-16T00:50:21.247 INFO:tasks.workunit.client.1.smithi152.stdout:7/809: chown d9/d31/d64/d3c/db9/dd3/d100/cd2 105 1 2024-09-16T00:50:21.248 INFO:tasks.workunit.client.1.smithi152.stdout:2/727: creat d4/d44/d7a/dc7/de4/d94/d93/da4/ff4 x:0 0 0 2024-09-16T00:50:21.251 INFO:tasks.workunit.client.1.smithi152.stdout:9/781: creat d1/d4e/d48/ffd x:0 0 0 2024-09-16T00:50:21.252 INFO:tasks.workunit.client.1.smithi152.stdout:6/829: dwrite f2 [0,4194304] 0 2024-09-16T00:50:21.252 INFO:tasks.workunit.client.1.smithi152.stdout:4/910: creat d2/db/dce/deb/f126 x:0 0 0 2024-09-16T00:50:21.252 INFO:tasks.workunit.client.1.smithi152.stdout:4/911: write d2/f56 [722320,77934] 0 2024-09-16T00:50:21.252 INFO:tasks.workunit.client.1.smithi152.stdout:5/941: write d6/f8 [5481453,80147] 0 2024-09-16T00:50:21.255 INFO:tasks.workunit.client.1.smithi152.stdout:0/765: dwrite d3/d6/d8/d1d/d23/d25/d2a/f66 [0,4194304] 0 2024-09-16T00:50:21.255 INFO:tasks.workunit.client.1.smithi152.stdout:0/766: chown d3/d6/d8/d9e/dcb 10 1 2024-09-16T00:50:21.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/866: symlink d9/da/df/dcb/df2/l13e 0 2024-09-16T00:50:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/728: rmdir d4/d17 39 2024-09-16T00:50:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/729: truncate d4/d44/d7a/dc7/fdf 631566 0 2024-09-16T00:50:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/730: readlink d4/d44/d7a/dc7/de4/d20/d28/d8b/lce 0 2024-09-16T00:50:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/731: readlink d4/d44/l63 0 2024-09-16T00:50:21.261 INFO:tasks.workunit.client.1.smithi152.stdout:9/782: write d1/d4e/d48/d26/d30/d4f/da2/fb9 [1705013,97241] 0 2024-09-16T00:50:21.261 INFO:tasks.workunit.client.1.smithi152.stdout:6/830: getdents db/d12/d20/d86/d91/dde 0 2024-09-16T00:50:21.264 INFO:tasks.workunit.client.1.smithi152.stdout:4/912: mkdir d2/d8e/df9/d127 0 2024-09-16T00:50:21.275 INFO:tasks.workunit.client.1.smithi152.stdout:0/767: unlink d3/d6/d8/d1d/d23/d25/c4f 0 2024-09-16T00:50:21.279 INFO:tasks.workunit.client.1.smithi152.stdout:6/831: unlink db/d12/d20/d86/c93 0 2024-09-16T00:50:21.279 INFO:tasks.workunit.client.1.smithi152.stdout:4/913: getdents d2/db/d39/d3c/d7f/d8b 0 2024-09-16T00:50:21.282 INFO:tasks.workunit.client.1.smithi152.stdout:0/768: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/d102 0 2024-09-16T00:50:21.289 INFO:tasks.workunit.client.1.smithi152.stdout:1/867: link d9/d3e/d41/f8d d9/d3e/d41/d31/da5/f13f 0 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:1/868: readlink d9/da/l9d 0 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:1/869: chown d9/d3e/d41/d31/d48/db2/fda 205363 1 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:4/914: symlink d2/d1e/d28/d7b/l128 0 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:0/769: getdents d3/d6/d6d 0 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:0/770: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/f103 x:0 0 0 2024-09-16T00:50:21.290 INFO:tasks.workunit.client.1.smithi152.stdout:0/771: fdatasync d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae 0 2024-09-16T00:50:21.291 INFO:tasks.workunit.client.1.smithi152.stdout:0/772: symlink d3/d6/d8/d1d/d23/d25/d45/l104 0 2024-09-16T00:50:21.295 INFO:tasks.workunit.client.1.smithi152.stdout:0/773: mkdir d3/d6/d8/d1d/d65/d6e/d105 0 2024-09-16T00:50:21.295 INFO:tasks.workunit.client.1.smithi152.stdout:0/774: unlink d3/c5 0 2024-09-16T00:50:21.295 INFO:tasks.workunit.client.1.smithi152.stdout:6/832: dwrite db/d12/f7d [0,4194304] 0 2024-09-16T00:50:21.295 INFO:tasks.workunit.client.1.smithi152.stdout:6/833: creat db/da8/db7/f109 x:0 0 0 2024-09-16T00:50:21.303 INFO:tasks.workunit.client.1.smithi152.stdout:0/775: write d3/d6/d64/d6a/fb3 [313155,36679] 0 2024-09-16T00:50:21.303 INFO:tasks.workunit.client.1.smithi152.stdout:0/776: creat d3/d6/d8/d1d/d65/db0/db6/f106 x:0 0 0 2024-09-16T00:50:21.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:20 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:21.342 INFO:tasks.workunit.client.1.smithi152.stdout:2/732: dread d4/d44/d7a/dc7/de4/d94/d93/f99 [0,4194304] 0 2024-09-16T00:50:21.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/733: creat d4/d44/d7a/dc7/de4/d20/d34/daa/ff5 x:0 0 0 2024-09-16T00:50:21.343 INFO:tasks.workunit.client.1.smithi152.stdout:2/734: fdatasync d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8/fe7 0 2024-09-16T00:50:21.346 INFO:tasks.workunit.client.1.smithi152.stdout:2/735: unlink d4/d44/d7a/dc7/de4/d20/d28/d2c/f31 0 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:0/777: dwrite d3/d6/d8/d1d/f20 [4194304,4194304] 0 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:0/778: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae [4816131,96566] 0 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:9/783: dwrite d1/d4e/f61 [0,4194304] 0 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:9/784: read - d1/d7/d77/d32/da5/da8/ff7 zero size 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:1/870: dwrite d9/d3e/f52 [0,4194304] 0 2024-09-16T00:50:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:1/871: chown d9/d3e/d41/ff3 266 1 2024-09-16T00:50:21.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/872: dread - d9/d3e/d4b/db7/dc4/fe7 zero size 2024-09-16T00:50:21.367 INFO:tasks.workunit.client.1.smithi152.stdout:6/834: dwrite db/d12/d23/d3a/fe2 [0,4194304] 0 2024-09-16T00:50:21.367 INFO:tasks.workunit.client.1.smithi152.stdout:6/835: read db/ffa [2910482,23908] 0 2024-09-16T00:50:21.368 INFO:tasks.workunit.client.1.smithi152.stdout:0/779: symlink d3/d6/d8/d1d/d65/db0/dc6/l107 0 2024-09-16T00:50:21.368 INFO:tasks.workunit.client.1.smithi152.stdout:0/780: write d3/d6/f8a [2314762,68454] 0 2024-09-16T00:50:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:1/873: symlink d9/d3e/d4b/l140 0 2024-09-16T00:50:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:1/874: fsync d9/d3e/d41/f87 0 2024-09-16T00:50:21.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/836: unlink db/d12/fed 0 2024-09-16T00:50:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:4/915: dwrite d2/db/f38 [0,4194304] 0 2024-09-16T00:50:21.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/875: unlink d9/d3e/d7b/la8 0 2024-09-16T00:50:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:6/837: rmdir db/d12/d20/d86/d91/dde/dfb 0 2024-09-16T00:50:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:9/785: write d1/d7/d13/d80/f86 [538993,95768] 0 2024-09-16T00:50:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:6/838: chown db/d28/db3/lda 14430 1 2024-09-16T00:50:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:2/736: dwrite d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/fb5 [0,4194304] 0 2024-09-16T00:50:21.377 INFO:tasks.workunit.client.1.smithi152.stdout:9/786: chown d1/d4e/d48/d2b/d93/d96/ld6 911658607 1 2024-09-16T00:50:21.378 INFO:tasks.workunit.client.1.smithi152.stdout:0/781: dread d3/f16 [0,4194304] 0 2024-09-16T00:50:21.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/876: read d9/d3e/d41/f60 [1091382,42053] 0 2024-09-16T00:50:21.386 INFO:tasks.workunit.client.1.smithi152.stdout:0/782: read d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fac [64813,16273] 0 2024-09-16T00:50:21.386 INFO:tasks.workunit.client.1.smithi152.stdout:0/783: fdatasync d3/d6/d8/d1d/d65/d6e/d82/f91 0 2024-09-16T00:50:21.387 INFO:tasks.workunit.client.1.smithi152.stdout:6/839: rename db/d12/d23/d4a/d43/d59/d67/dc2/dd5/fd7 to db/d12/d23/d4a/f10a 0 2024-09-16T00:50:21.392 INFO:tasks.workunit.client.1.smithi152.stdout:1/877: unlink d9/d3e/d4b/d6b/d6d/fd2 0 2024-09-16T00:50:21.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/787: dread d1/d7/d13/f37 [0,4194304] 0 2024-09-16T00:50:21.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/788: read d1/d4e/d48/d26/d30/d4f/d50/fef [392339,66773] 0 2024-09-16T00:50:21.393 INFO:tasks.workunit.client.1.smithi152.stdout:0/784: mkdir d3/d6/d8/d1d/d23/d25/d45/d108 0 2024-09-16T00:50:21.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/840: symlink db/da8/l10b 0 2024-09-16T00:50:21.395 INFO:tasks.workunit.client.0.smithi053.stdout:0/396: truncate d4/dc/d1e/d1f/d40/f7b 143505 0 2024-09-16T00:50:21.395 INFO:tasks.workunit.client.0.smithi053.stdout:0/397: chown d4/dc/d25/d34/d2a/d27/d4a 2083361129 1 2024-09-16T00:50:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:20 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:21.401 INFO:tasks.workunit.client.0.smithi053.stdout:0/398: unlink d4/d13/f38 0 2024-09-16T00:50:21.402 INFO:tasks.workunit.client.1.smithi152.stdout:4/916: dwrite d2/d1e/f11a [0,4194304] 0 2024-09-16T00:50:21.402 INFO:tasks.workunit.client.1.smithi152.stdout:4/917: creat d2/db/dce/deb/f129 x:0 0 0 2024-09-16T00:50:21.403 INFO:tasks.workunit.client.1.smithi152.stdout:7/810: write d9/d31/d65/f98 [958811,39256] 0 2024-09-16T00:50:21.404 INFO:tasks.workunit.client.1.smithi152.stdout:1/878: creat d9/d3e/d7b/df0/d107/f141 x:0 0 0 2024-09-16T00:50:21.404 INFO:tasks.workunit.client.1.smithi152.stdout:1/879: chown d9/d3e/d41/d31/da5 129676 1 2024-09-16T00:50:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/789: write d1/d4e/d48/d26/d58/faa [3948393,92147] 0 2024-09-16T00:50:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/790: dread - d1/d7/d77/d3c/dc9/fe3 zero size 2024-09-16T00:50:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/791: write d1/d7/d13/d80/fe8 [455833,40117] 0 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.0.smithi053.stdout:0/399: symlink d4/dc/d25/d34/d2a/l80 0 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.0.smithi053.stdout:0/400: chown d4/dc/l1a 19723223 1 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/841: creat db/f10c x:0 0 0 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/737: dwrite d4/d44/d7a/dc7/de4/d94/fb3 [4194304,4194304] 0 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/842: chown db/d12/d23/d4a/d43/d48/f5d 2 1 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/738: stat d4/d44/d7a/dc7/de4/d20/d28/d2c/de6 0 2024-09-16T00:50:21.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/843: readlink db/d12/d23/d4a/d43/lfe 0 2024-09-16T00:50:21.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/844: read - db/d12/d23/d4a/f10a zero size 2024-09-16T00:50:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/759: sync 2024-09-16T00:50:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/618: sync 2024-09-16T00:50:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/619: chown dd/d98/cb0 0 1 2024-09-16T00:50:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/620: write dd/d15/f52 [450184,106132] 0 2024-09-16T00:50:21.410 INFO:tasks.workunit.client.0.smithi053.stdout:0/401: symlink d4/dc/d1e/d1f/l81 0 2024-09-16T00:50:21.415 INFO:tasks.workunit.client.1.smithi152.stdout:4/918: write d2/db/d39/d3c/f48 [980343,49686] 0 2024-09-16T00:50:21.416 INFO:tasks.workunit.client.1.smithi152.stdout:4/919: chown d2/d1e/c55 460704682 1 2024-09-16T00:50:21.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/880: write d9/d3e/d41/d31/d48/d7d/fe9 [1996735,63127] 0 2024-09-16T00:50:21.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/881: creat d9/da/d105/f142 x:0 0 0 2024-09-16T00:50:21.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/792: unlink d1/d4e/d48/d26/d30/d4f/d50/fef 0 2024-09-16T00:50:21.422 INFO:tasks.workunit.client.1.smithi152.stdout:9/793: dread d1/d7/d13/d80/f91 [0,4194304] 0 2024-09-16T00:50:21.422 INFO:tasks.workunit.client.1.smithi152.stdout:9/794: fdatasync d1/d4e/d48/d66/d76/fa4 0 2024-09-16T00:50:21.424 INFO:tasks.workunit.client.1.smithi152.stdout:6/845: creat db/d12/d23/d4a/d43/f10d x:0 0 0 2024-09-16T00:50:21.426 INFO:tasks.workunit.client.1.smithi152.stdout:3/760: mkdir dc/d10/d17/d1c/d50/daa/dee 0 2024-09-16T00:50:21.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/920: mkdir d2/db/d39/d3c/d76/db4/d12a 0 2024-09-16T00:50:21.429 INFO:tasks.workunit.client.1.smithi152.stdout:4/921: write d2/db/d39/d3c/d76/f82 [663358,110974] 0 2024-09-16T00:50:21.430 INFO:tasks.workunit.client.1.smithi152.stdout:2/739: rename d4/d17 to d4/d44/df6 0 2024-09-16T00:50:21.431 INFO:tasks.workunit.client.1.smithi152.stdout:0/785: dwrite d3/f16 [0,4194304] 0 2024-09-16T00:50:21.431 INFO:tasks.workunit.client.1.smithi152.stdout:0/786: creat d3/d6/d8/d9e/f109 x:0 0 0 2024-09-16T00:50:21.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/795: rename d1/d4e/d48/fc7 to d1/d7/d77/d32/da5/da8/dc5/df5/ffe 0 2024-09-16T00:50:21.433 INFO:tasks.workunit.client.1.smithi152.stdout:4/922: mkdir d2/db/d39/d3c/d7f/d98/def/d12b 0 2024-09-16T00:50:21.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/402: dread d4/dc/f14 [0,4194304] 0 2024-09-16T00:50:21.437 INFO:tasks.workunit.client.0.smithi053.stdout:0/403: mkdir d4/d5a/d82 0 2024-09-16T00:50:21.438 INFO:tasks.workunit.client.1.smithi152.stdout:1/882: write d9/d3e/d41/d31/d48/d4a/f137 [328536,69948] 0 2024-09-16T00:50:21.439 INFO:tasks.workunit.client.1.smithi152.stdout:9/796: mknod d1/d4e/d34/cff 0 2024-09-16T00:50:21.439 INFO:tasks.workunit.client.1.smithi152.stdout:9/797: fdatasync d1/d4e/d48/d26/d30/d8f/fbf 0 2024-09-16T00:50:21.442 INFO:tasks.workunit.client.1.smithi152.stdout:4/923: symlink d2/d1e/l12c 0 2024-09-16T00:50:21.442 INFO:tasks.workunit.client.1.smithi152.stdout:4/924: creat d2/d1e/f12d x:0 0 0 2024-09-16T00:50:21.442 INFO:tasks.workunit.client.1.smithi152.stdout:6/846: dread db/d12/d20/f2d [0,4194304] 0 2024-09-16T00:50:21.443 INFO:tasks.workunit.client.1.smithi152.stdout:0/787: dread d3/d6/d8/d1d/d23/d25/d2a/f66 [0,4194304] 0 2024-09-16T00:50:21.445 INFO:tasks.workunit.client.1.smithi152.stdout:7/811: dwrite d9/d31/dc4/ffb [0,4194304] 0 2024-09-16T00:50:21.446 INFO:tasks.workunit.client.1.smithi152.stdout:1/883: symlink d9/d3e/d4b/l143 0 2024-09-16T00:50:21.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/812: chown d9/d31/d65/d8a/d41/d46/c6d 1470 1 2024-09-16T00:50:21.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/813: readlink d9/d31/d64/d3c/lb4 0 2024-09-16T00:50:21.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/814: fdatasync d9/d31/d65/d8a/d41/d46/d7d/fb0 0 2024-09-16T00:50:21.448 INFO:tasks.workunit.client.1.smithi152.stdout:8/621: dwrite dd/d25/da4/fcd [0,4194304] 0 2024-09-16T00:50:21.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/798: link d1/d4e/d48/d26/l52 d1/d4e/d48/d26/d92/l100 0 2024-09-16T00:50:21.450 INFO:tasks.workunit.client.1.smithi152.stdout:3/761: dwrite dc/d10/d17/d1c/d8d/d8e/f76 [0,4194304] 0 2024-09-16T00:50:21.455 INFO:tasks.workunit.client.1.smithi152.stdout:4/925: mknod d2/d8e/df9/d127/c12e 0 2024-09-16T00:50:21.456 INFO:tasks.workunit.client.1.smithi152.stdout:2/740: dwrite d4/d44/d7a/dc7/de4/f78 [0,4194304] 0 2024-09-16T00:50:21.456 INFO:tasks.workunit.client.0.smithi053.stdout:0/404: mknod d4/dc/d1e/d1f/d40/d73/c83 0 2024-09-16T00:50:21.459 INFO:tasks.workunit.client.1.smithi152.stdout:6/847: mknod db/d12/d23/d3a/c10e 0 2024-09-16T00:50:21.462 INFO:tasks.workunit.client.1.smithi152.stdout:0/788: rename d3/d6/d51/dbb to d3/d6/d8/d1d/d23/d25/d2a/d5c/d10a 0 2024-09-16T00:50:21.462 INFO:tasks.workunit.client.1.smithi152.stdout:0/789: chown d3/d6/d64/cce 7070412 1 2024-09-16T00:50:21.463 INFO:tasks.workunit.client.0.smithi053.stdout:0/405: dread d4/dc/d25/f3f [0,4194304] 0 2024-09-16T00:50:21.474 INFO:tasks.workunit.client.1.smithi152.stdout:7/815: dwrite d9/d31/d65/d6b/f77 [0,4194304] 0 2024-09-16T00:50:21.478 INFO:tasks.workunit.client.1.smithi152.stdout:9/799: dwrite d1/f8b [0,4194304] 0 2024-09-16T00:50:21.479 INFO:tasks.workunit.client.0.smithi053.stdout:7/338: sync 2024-09-16T00:50:21.479 INFO:tasks.workunit.client.0.smithi053.stdout:6/278: sync 2024-09-16T00:50:21.479 INFO:tasks.workunit.client.0.smithi053.stdout:6/279: stat d1/dc/d43 0 2024-09-16T00:50:21.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/622: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2 0 2024-09-16T00:50:21.484 INFO:tasks.workunit.client.0.smithi053.stdout:6/280: symlink d1/dc/d3c/d4a/l63 0 2024-09-16T00:50:21.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/790: dwrite d3/d6/d8/d1d/d65/d6e/f100 [0,4194304] 0 2024-09-16T00:50:21.495 INFO:tasks.workunit.client.0.smithi053.stdout:0/406: dwrite d4/dc/d1e/d1f/d40/f62 [4194304,4194304] 0 2024-09-16T00:50:21.495 INFO:tasks.workunit.client.0.smithi053.stdout:6/281: creat d1/dc/d54/f64 x:0 0 0 2024-09-16T00:50:21.495 INFO:tasks.workunit.client.0.smithi053.stdout:6/282: write d1/dc/f32 [250044,122170] 0 2024-09-16T00:50:21.495 INFO:tasks.workunit.client.1.smithi152.stdout:3/762: mknod dc/d10/d17/d1c/d8d/cef 0 2024-09-16T00:50:21.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/623: dread dd/f1f [0,4194304] 0 2024-09-16T00:50:21.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/926: dwrite d2/d1e/d28/d7b/fa7 [0,4194304] 0 2024-09-16T00:50:21.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/624: chown dd/d98/db8/dcf/f99 236 1 2024-09-16T00:50:21.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/625: dread - dd/d15/d49/fa0 zero size 2024-09-16T00:50:21.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/626: read dd/d15/d49/f3c [189771,22300] 0 2024-09-16T00:50:21.498 INFO:tasks.workunit.client.0.smithi053.stdout:7/339: rename d1/d2a/d4f/d52/d2c to d1/d60/d77 0 2024-09-16T00:50:21.498 INFO:tasks.workunit.client.0.smithi053.stdout:7/340: truncate d1/d35/d4a/f68 836317 0 2024-09-16T00:50:21.498 INFO:tasks.workunit.client.0.smithi053.stdout:7/341: fdatasync d1/d35/d4a/f4c 0 2024-09-16T00:50:21.501 INFO:tasks.workunit.client.1.smithi152.stdout:3/763: dread dc/d10/d17/d1c/d1f/d9e/fd6 [0,4194304] 0 2024-09-16T00:50:21.501 INFO:tasks.workunit.client.1.smithi152.stdout:6/848: mkdir db/d12/d23/d3a/dbc/d10f 0 2024-09-16T00:50:21.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/407: symlink d4/l84 0 2024-09-16T00:50:21.504 INFO:tasks.workunit.client.0.smithi053.stdout:6/283: dwrite d1/dc/f48 [0,4194304] 0 2024-09-16T00:50:21.507 INFO:tasks.workunit.client.1.smithi152.stdout:6/849: dread db/f31 [0,4194304] 0 2024-09-16T00:50:21.507 INFO:tasks.workunit.client.1.smithi152.stdout:6/850: fdatasync db/d12/faf 0 2024-09-16T00:50:21.507 INFO:tasks.workunit.client.0.smithi053.stdout:7/342: creat d1/d60/d70/f78 x:0 0 0 2024-09-16T00:50:21.507 INFO:tasks.workunit.client.0.smithi053.stdout:7/343: readlink d1/lf 0 2024-09-16T00:50:21.509 INFO:tasks.workunit.client.0.smithi053.stdout:3/408: sync 2024-09-16T00:50:21.509 INFO:tasks.workunit.client.0.smithi053.stdout:1/336: sync 2024-09-16T00:50:21.509 INFO:tasks.workunit.client.0.smithi053.stdout:4/247: sync 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:9/376: sync 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:2/286: sync 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:8/412: sync 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:8/413: truncate d10/d21/d28/d3c/d63/f74 104781 0 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:8/414: write d10/f20 [2854997,94388] 0 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:5/262: sync 2024-09-16T00:50:21.510 INFO:tasks.workunit.client.0.smithi053.stdout:0/408: mknod d4/dc/d1e/d1f/d40/d44/d54/c85 0 2024-09-16T00:50:21.514 INFO:tasks.workunit.client.1.smithi152.stdout:7/816: creat d9/d31/d65/d8a/d41/d46/d7d/d86/d117/f118 x:0 0 0 2024-09-16T00:50:21.514 INFO:tasks.workunit.client.1.smithi152.stdout:7/817: chown d9/d31/d64/d3c/lf2 145515 1 2024-09-16T00:50:21.523 INFO:tasks.workunit.client.0.smithi053.stdout:1/337: dread d5/d18/d1f/f35 [0,4194304] 0 2024-09-16T00:50:21.525 INFO:tasks.workunit.client.1.smithi152.stdout:9/800: rename d1/fb to d1/d7/d13/d80/f101 0 2024-09-16T00:50:21.526 INFO:tasks.workunit.client.0.smithi053.stdout:6/284: mkdir d1/dc/d1e/d65 0 2024-09-16T00:50:21.526 INFO:tasks.workunit.client.0.smithi053.stdout:6/285: stat d1/dc/d45/f59 0 2024-09-16T00:50:21.528 INFO:tasks.workunit.client.0.smithi053.stdout:6/286: write d1/dc/d3c/d4a/f53 [312073,16072] 0 2024-09-16T00:50:21.528 INFO:tasks.workunit.client.0.smithi053.stdout:3/409: mknod d1/d5/d14/c83 0 2024-09-16T00:50:21.534 INFO:tasks.workunit.client.0.smithi053.stdout:4/248: rename d0/l1f to d0/d3c/l5a 0 2024-09-16T00:50:21.534 INFO:tasks.workunit.client.0.smithi053.stdout:4/249: creat d0/d2/dd/d25/f5b x:0 0 0 2024-09-16T00:50:21.537 INFO:tasks.workunit.client.0.smithi053.stdout:7/344: dwrite d1/d35/d4a/f56 [0,4194304] 0 2024-09-16T00:50:21.537 INFO:tasks.workunit.client.1.smithi152.stdout:0/791: creat d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/f10b x:0 0 0 2024-09-16T00:50:21.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/851: dwrite db/f18 [0,4194304] 0 2024-09-16T00:50:21.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/852: dread - db/da8/db7/ff3 zero size 2024-09-16T00:50:21.541 INFO:tasks.workunit.client.0.smithi053.stdout:9/377: rmdir d8/d4c/d5b/d7e 0 2024-09-16T00:50:21.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/927: unlink d2/db/dce/fd4 0 2024-09-16T00:50:21.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/928: write d2/db/f47 [746706,124253] 0 2024-09-16T00:50:21.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/929: chown d2/d1e/d28/d7b/f99 36570 1 2024-09-16T00:50:21.547 INFO:tasks.workunit.client.1.smithi152.stdout:4/930: fdatasync d2/db/d39/d95/f96 0 2024-09-16T00:50:21.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/741: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/cf7 0 2024-09-16T00:50:21.554 INFO:tasks.workunit.client.0.smithi053.stdout:5/263: symlink d3/d7/d2b/d4b/d4f/l59 0 2024-09-16T00:50:21.554 INFO:tasks.workunit.client.1.smithi152.stdout:5/942: sync 2024-09-16T00:50:21.554 INFO:tasks.workunit.client.1.smithi152.stdout:5/943: write d6/d57/f7a [1472333,115228] 0 2024-09-16T00:50:21.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/764: mkdir dc/d10/d17/d5a/d68/da5/df0 0 2024-09-16T00:50:21.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/765: stat dc/d5c/cb6 0 2024-09-16T00:50:21.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/766: write f7 [7317549,118107] 0 2024-09-16T00:50:21.555 INFO:tasks.workunit.client.0.smithi053.stdout:6/287: dwrite d1/dc/d3c/d4a/f53 [0,4194304] 0 2024-09-16T00:50:21.555 INFO:tasks.workunit.client.0.smithi053.stdout:6/288: truncate d1/dc/d3d/f55 1618287 0 2024-09-16T00:50:21.558 INFO:tasks.workunit.client.1.smithi152.stdout:2/742: dread d4/d44/d7a/dc7/de4/f5b [0,4194304] 0 2024-09-16T00:50:21.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/853: dwrite db/d28/f32 [0,4194304] 0 2024-09-16T00:50:21.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/854: chown db/l16 180355 1 2024-09-16T00:50:21.560 INFO:tasks.workunit.client.1.smithi152.stdout:7/818: getdents d9/d31/d65/d8a/d41/d46/d7d/de2 0 2024-09-16T00:50:21.560 INFO:tasks.workunit.client.1.smithi152.stdout:7/819: chown d9/d31/d64/d3c/d5b/dd0/cf8 400 1 2024-09-16T00:50:21.561 INFO:tasks.workunit.client.0.smithi053.stdout:1/338: rmdir d5/d18 39 2024-09-16T00:50:21.561 INFO:tasks.workunit.client.0.smithi053.stdout:1/339: readlink d5/d5a/l68 0 2024-09-16T00:50:21.564 INFO:tasks.workunit.client.1.smithi152.stdout:8/627: rename dd/d98/db8/dcf/d29/d2f/l32 to dd/d15/ld3 0 2024-09-16T00:50:21.565 INFO:tasks.workunit.client.1.smithi152.stdout:4/931: dwrite d2/d1e/fd9 [4194304,4194304] 0 2024-09-16T00:50:21.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/410: getdents d1/d5 0 2024-09-16T00:50:21.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/411: stat d1/d5/d11/d3a/l48 0 2024-09-16T00:50:21.568 INFO:tasks.workunit.client.1.smithi152.stdout:9/801: link d1/ff d1/d4e/d48/d2b/d7c/f102 0 2024-09-16T00:50:21.568 INFO:tasks.workunit.client.1.smithi152.stdout:9/802: fsync d1/d4e/d48/d26/d58/faa 0 2024-09-16T00:50:21.570 INFO:tasks.workunit.client.1.smithi152.stdout:0/792: rmdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e 39 2024-09-16T00:50:21.570 INFO:tasks.workunit.client.1.smithi152.stdout:0/793: creat d3/d6/d8/d1d/d65/db0/df0/f10c x:0 0 0 2024-09-16T00:50:21.570 INFO:tasks.workunit.client.1.smithi152.stdout:0/794: readlink d3/d6/d8/d1d/d65/d6e/d82/da4/le0 0 2024-09-16T00:50:21.571 INFO:tasks.workunit.client.1.smithi152.stdout:9/803: dread d1/d7/d13/d80/f101 [0,4194304] 0 2024-09-16T00:50:21.572 INFO:tasks.workunit.client.0.smithi053.stdout:3/412: dread d1/d5/d11/f46 [0,4194304] 0 2024-09-16T00:50:21.572 INFO:tasks.workunit.client.0.smithi053.stdout:8/415: rename d10/d1c/d49/f5a to d10/d21/d28/d3c/f8e 0 2024-09-16T00:50:21.572 INFO:tasks.workunit.client.0.smithi053.stdout:8/416: readlink d10/d52/d5b/l87 0 2024-09-16T00:50:21.577 INFO:tasks.workunit.client.0.smithi053.stdout:7/345: creat d1/d2a/f79 x:0 0 0 2024-09-16T00:50:21.577 INFO:tasks.workunit.client.0.smithi053.stdout:7/346: fdatasync d1/d60/d77/f40 0 2024-09-16T00:50:21.581 INFO:tasks.workunit.client.0.smithi053.stdout:9/378: unlink d8/d19/d31/f50 0 2024-09-16T00:50:21.581 INFO:tasks.workunit.client.0.smithi053.stdout:9/379: dread d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:21.582 INFO:tasks.workunit.client.0.smithi053.stdout:8/417: write d10/f3f [338905,130667] 0 2024-09-16T00:50:21.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/767: rmdir dc/d10/d17 39 2024-09-16T00:50:21.590 INFO:tasks.workunit.client.0.smithi053.stdout:9/380: dread d8/d13/f80 [0,4194304] 0 2024-09-16T00:50:21.591 INFO:tasks.workunit.client.1.smithi152.stdout:2/743: mkdir d4/d44/d7a/df8 0 2024-09-16T00:50:21.593 INFO:tasks.workunit.client.0.smithi053.stdout:2/287: getdents d6/d9/dd/d28 0 2024-09-16T00:50:21.597 INFO:tasks.workunit.client.0.smithi053.stdout:8/418: dwrite d10/d1c/f26 [0,4194304] 0 2024-09-16T00:50:21.598 INFO:tasks.workunit.client.0.smithi053.stdout:8/419: write d10/d21/f3e [4287706,26884] 0 2024-09-16T00:50:21.598 INFO:tasks.workunit.client.0.smithi053.stdout:8/420: readlink d10/d21/d28/l2e 0 2024-09-16T00:50:21.599 INFO:tasks.workunit.client.1.smithi152.stdout:7/820: mknod d9/d31/d65/d8a/d41/d46/d7d/d86/c119 0 2024-09-16T00:50:21.603 INFO:tasks.workunit.client.0.smithi053.stdout:6/289: mkdir d1/dc/d66 0 2024-09-16T00:50:21.603 INFO:tasks.workunit.client.0.smithi053.stdout:6/290: creat d1/dc/d39/f67 x:0 0 0 2024-09-16T00:50:21.605 INFO:tasks.workunit.client.0.smithi053.stdout:0/409: symlink d4/dc/d25/l86 0 2024-09-16T00:50:21.605 INFO:tasks.workunit.client.0.smithi053.stdout:0/410: dread - d4/dc/d25/d34/f74 zero size 2024-09-16T00:50:21.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/884: sync 2024-09-16T00:50:21.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/885: write d9/da/fbf [172780,52823] 0 2024-09-16T00:50:21.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/886: write d9/d3e/d7b/df0/d107/fb0 [485664,129904] 0 2024-09-16T00:50:21.610 INFO:tasks.workunit.client.0.smithi053.stdout:7/347: mknod d1/d60/d62/c7a 0 2024-09-16T00:50:21.611 INFO:tasks.workunit.client.0.smithi053.stdout:7/348: fdatasync d1/d35/d14/d15/f5a 0 2024-09-16T00:50:21.611 INFO:tasks.workunit.client.0.smithi053.stdout:7/349: truncate d1/d35/d14/f41 837528 0 2024-09-16T00:50:21.615 INFO:tasks.workunit.client.0.smithi053.stdout:9/381: symlink d8/d1c/d2b/d49/l82 0 2024-09-16T00:50:21.617 INFO:tasks.workunit.client.1.smithi152.stdout:4/932: mkdir d2/d8e/d12f 0 2024-09-16T00:50:21.620 INFO:tasks.workunit.client.0.smithi053.stdout:2/288: getdents d6/d29 0 2024-09-16T00:50:21.620 INFO:tasks.workunit.client.0.smithi053.stdout:2/289: fsync d6/f8 0 2024-09-16T00:50:21.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/804: truncate d1/d4e/d48/d2b/d93/fa7 565861 0 2024-09-16T00:50:21.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/805: chown d1/d7/d77/fb3 0 1 2024-09-16T00:50:21.625 INFO:tasks.workunit.client.0.smithi053.stdout:5/264: rmdir d3/d7/d2b/d4b/d51/d53 39 2024-09-16T00:50:21.626 INFO:tasks.workunit.client.1.smithi152.stdout:1/887: dwrite d9/d3e/d41/d31/d48/d4a/f137 [0,4194304] 0 2024-09-16T00:50:21.627 INFO:tasks.workunit.client.1.smithi152.stdout:5/944: creat d6/d16/d1f/f158 x:0 0 0 2024-09-16T00:50:21.628 INFO:tasks.workunit.client.1.smithi152.stdout:8/628: dwrite dd/d98/db8/dcf/d29/f80 [0,4194304] 0 2024-09-16T00:50:21.629 INFO:tasks.workunit.client.0.smithi053.stdout:2/290: write d6/d9/dd/f31 [3652349,102233] 0 2024-09-16T00:50:21.629 INFO:tasks.workunit.client.0.smithi053.stdout:2/291: chown d6/d9/dd/d3e/c48 0 1 2024-09-16T00:50:21.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/768: mkdir dc/d5c/dae/df1 0 2024-09-16T00:50:21.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/769: chown dc/c32 21060 1 2024-09-16T00:50:21.630 INFO:tasks.workunit.client.0.smithi053.stdout:6/291: mknod d1/dc/d43/c68 0 2024-09-16T00:50:21.630 INFO:tasks.workunit.client.0.smithi053.stdout:6/292: chown d1/dc/d39/l19 15 1 2024-09-16T00:50:21.633 INFO:tasks.workunit.client.1.smithi152.stdout:2/744: unlink d4/d44/d7a/dc7/de4/d20/f47 0 2024-09-16T00:50:21.633 INFO:tasks.workunit.client.1.smithi152.stdout:2/745: write d4/d44/d7a/d9e/f7f [1201531,55520] 0 2024-09-16T00:50:21.636 INFO:tasks.workunit.client.1.smithi152.stdout:7/821: rename d9/d31/d64/l2d to d9/d31/d64/d3c/db9/dd3/de6/l11a 0 2024-09-16T00:50:21.636 INFO:tasks.workunit.client.1.smithi152.stdout:7/822: readlink d9/d31/d64/d3c/db9/dd3/d100/l8c 0 2024-09-16T00:50:21.638 INFO:tasks.workunit.client.0.smithi053.stdout:1/340: mkdir d5/d9/d73 0 2024-09-16T00:50:21.642 INFO:tasks.workunit.client.1.smithi152.stdout:1/888: dread d9/da/f58 [0,4194304] 0 2024-09-16T00:50:21.644 INFO:tasks.workunit.client.1.smithi152.stdout:4/933: unlink d2/d1e/f12d 0 2024-09-16T00:50:21.646 INFO:tasks.workunit.client.0.smithi053.stdout:7/350: mkdir d1/d60/d77/d7b 0 2024-09-16T00:50:21.646 INFO:tasks.workunit.client.0.smithi053.stdout:7/351: chown d1/d60/d77/d50/f5d 949 1 2024-09-16T00:50:21.647 INFO:tasks.workunit.client.0.smithi053.stdout:2/292: write d6/d9/d14/f15 [3231976,33807] 0 2024-09-16T00:50:21.647 INFO:tasks.workunit.client.0.smithi053.stdout:2/293: chown d6/d9/f1d 418431 1 2024-09-16T00:50:21.647 INFO:tasks.workunit.client.0.smithi053.stdout:2/294: write d6/f7 [1126725,45026] 0 2024-09-16T00:50:21.647 INFO:tasks.workunit.client.0.smithi053.stdout:2/295: stat d6 0 2024-09-16T00:50:21.650 INFO:tasks.workunit.client.1.smithi152.stdout:5/945: dwrite d6/ff [0,4194304] 0 2024-09-16T00:50:21.652 INFO:tasks.workunit.client.1.smithi152.stdout:5/946: dread d6/d57/d54/f84 [0,4194304] 0 2024-09-16T00:50:21.656 INFO:tasks.workunit.client.1.smithi152.stdout:9/806: unlink d1/d4e/d48/d26/d30/d4f/l7d 0 2024-09-16T00:50:21.659 INFO:tasks.workunit.client.0.smithi053.stdout:2/296: write d6/d9/f1d [5606440,43070] 0 2024-09-16T00:50:21.659 INFO:tasks.workunit.client.0.smithi053.stdout:2/297: fdatasync d6/f23 0 2024-09-16T00:50:21.660 INFO:tasks.workunit.client.1.smithi152.stdout:3/770: dwrite dc/d10/fa2 [0,4194304] 0 2024-09-16T00:50:21.660 INFO:tasks.workunit.client.1.smithi152.stdout:3/771: dread - dc/d10/d17/d5a/fd7 zero size 2024-09-16T00:50:21.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/421: mknod d10/c8f 0 2024-09-16T00:50:21.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/422: chown d10/d1c/d2b/d40/d76 214 1 2024-09-16T00:50:21.665 INFO:tasks.workunit.client.0.smithi053.stdout:5/265: creat d3/f5a x:0 0 0 2024-09-16T00:50:21.668 INFO:tasks.workunit.client.0.smithi053.stdout:6/293: link d1/dc/d39/f56 d1/dc/d1e/d41/f69 0 2024-09-16T00:50:21.669 INFO:tasks.workunit.client.1.smithi152.stdout:8/629: truncate dd/d15/d49/f21 1319810 0 2024-09-16T00:50:21.669 INFO:tasks.workunit.client.1.smithi152.stdout:8/630: creat dd/d15/d49/fd4 x:0 0 0 2024-09-16T00:50:21.672 INFO:tasks.workunit.client.0.smithi053.stdout:9/382: mkdir d8/d22/d26/d83 0 2024-09-16T00:50:21.673 INFO:tasks.workunit.client.1.smithi152.stdout:2/746: mknod d4/d44/d7a/d9e/da0/df1/cf9 0 2024-09-16T00:50:21.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/823: creat d9/d31/d64/d3c/db9/dd3/d100/f11b x:0 0 0 2024-09-16T00:50:21.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/824: chown d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f9c 400464 1 2024-09-16T00:50:21.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/825: readlink d9/d31/d65/d6b/l85 0 2024-09-16T00:50:21.675 INFO:tasks.workunit.client.0.smithi053.stdout:2/298: mknod d6/d9/dd/d3e/c4a 0 2024-09-16T00:50:21.675 INFO:tasks.workunit.client.0.smithi053.stdout:2/299: chown d6/d9/f12 22966 1 2024-09-16T00:50:21.675 INFO:tasks.workunit.client.1.smithi152.stdout:1/889: mkdir d9/d3e/d4b/d50/d115/d144 0 2024-09-16T00:50:21.676 INFO:tasks.workunit.client.0.smithi053.stdout:8/423: creat d10/d1c/d2b/d40/d50/f90 x:0 0 0 2024-09-16T00:50:21.678 INFO:tasks.workunit.client.0.smithi053.stdout:0/411: rename d4/d13/d2d to d4/dc/d87 0 2024-09-16T00:50:21.678 INFO:tasks.workunit.client.0.smithi053.stdout:6/294: rename d1 to d1/dc/d3d/d6a 22 2024-09-16T00:50:21.681 INFO:tasks.workunit.client.0.smithi053.stdout:2/300: creat d6/d9/dd/d3e/f4b x:0 0 0 2024-09-16T00:50:21.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/772: unlink dc/d10/d17/d1c/d1f/d9e/fd6 0 2024-09-16T00:50:21.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/773: read - dc/fbd zero size 2024-09-16T00:50:21.685 INFO:tasks.workunit.client.0.smithi053.stdout:0/412: dread d4/dc/d87/f60 [0,4194304] 0 2024-09-16T00:50:21.687 INFO:tasks.workunit.client.1.smithi152.stdout:2/747: creat d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/ffa x:0 0 0 2024-09-16T00:50:21.688 INFO:tasks.workunit.client.1.smithi152.stdout:2/748: stat d4/d44/d7a/dc7/de4/d20/d34 0 2024-09-16T00:50:21.688 INFO:tasks.workunit.client.0.smithi053.stdout:0/413: rmdir d4/dc/d1e/d1f/d40/d73 39 2024-09-16T00:50:21.689 INFO:tasks.workunit.client.1.smithi152.stdout:7/826: mkdir d9/d31/d64/d11c 0 2024-09-16T00:50:21.692 INFO:tasks.workunit.client.1.smithi152.stdout:1/890: mknod d9/da/d105/d13c/c145 0 2024-09-16T00:50:21.698 INFO:tasks.workunit.client.1.smithi152.stdout:3/774: creat dc/d10/d17/d5a/db2/d6f/ff2 x:0 0 0 2024-09-16T00:50:21.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/631: rmdir dd/d25 39 2024-09-16T00:50:21.699 INFO:tasks.workunit.client.0.smithi053.stdout:1/341: dwrite d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:21.699 INFO:tasks.workunit.client.0.smithi053.stdout:1/342: stat d5/d9/f4b 0 2024-09-16T00:50:21.700 INFO:tasks.workunit.client.1.smithi152.stdout:5/947: dwrite d6/d57/d2b/d50/d64/df5/ffc [0,4194304] 0 2024-09-16T00:50:21.700 INFO:tasks.workunit.client.1.smithi152.stdout:5/948: fsync d6/d16/d1f/d6c/de2/d106/f120 0 2024-09-16T00:50:21.700 INFO:tasks.workunit.client.0.smithi053.stdout:6/295: dread d1/dc/d1e/f30 [0,4194304] 0 2024-09-16T00:50:21.701 INFO:tasks.workunit.client.1.smithi152.stdout:4/934: dwrite d2/db/d39/f9d [4194304,4194304] 0 2024-09-16T00:50:21.701 INFO:tasks.workunit.client.1.smithi152.stdout:7/827: creat d9/d31/d64/d3c/db9/dd3/d100/d82/f11d x:0 0 0 2024-09-16T00:50:21.701 INFO:tasks.workunit.client.1.smithi152.stdout:7/828: stat d9/d31/ff5 0 2024-09-16T00:50:21.702 INFO:tasks.workunit.client.0.smithi053.stdout:7/352: dwrite d1/d35/d4a/f68 [0,4194304] 0 2024-09-16T00:50:21.702 INFO:tasks.workunit.client.0.smithi053.stdout:2/301: dwrite d6/d29/d2b/f47 [0,4194304] 0 2024-09-16T00:50:21.702 INFO:tasks.workunit.client.0.smithi053.stdout:7/353: chown d1/d60/d77/d7b 21261 1 2024-09-16T00:50:21.705 INFO:tasks.workunit.client.1.smithi152.stdout:1/891: link d9/d3e/d41/d31/d48/d7d/cd6 d9/d3e/d4b/c146 0 2024-09-16T00:50:21.706 INFO:tasks.workunit.client.0.smithi053.stdout:1/343: symlink d5/dd/d47/l74 0 2024-09-16T00:50:21.706 INFO:tasks.workunit.client.1.smithi152.stdout:1/892: readlink d9/da/le 0 2024-09-16T00:50:21.708 INFO:tasks.workunit.client.0.smithi053.stdout:5/266: dwrite d3/d7/d2b/d37/f44 [0,4194304] 0 2024-09-16T00:50:21.712 INFO:tasks.workunit.client.1.smithi152.stdout:8/632: write dd/d98/db8/dcf/d29/f58 [440286,103905] 0 2024-09-16T00:50:21.712 INFO:tasks.workunit.client.1.smithi152.stdout:8/633: read - dd/d98/db8/dcf/f99 zero size 2024-09-16T00:50:21.714 INFO:tasks.workunit.client.0.smithi053.stdout:6/296: mknod d1/dc/d45/c6b 0 2024-09-16T00:50:21.716 INFO:tasks.workunit.client.1.smithi152.stdout:7/829: write d9/d31/d65/d8a/d41/f62 [172556,129723] 0 2024-09-16T00:50:21.719 INFO:tasks.workunit.client.0.smithi053.stdout:9/383: mknod d8/d4c/d5a/c84 0 2024-09-16T00:50:21.719 INFO:tasks.workunit.client.0.smithi053.stdout:9/384: stat d8/d1c/d2b/d49/l82 0 2024-09-16T00:50:21.719 INFO:tasks.workunit.client.0.smithi053.stdout:9/385: chown d8/d22/d26 143061 1 2024-09-16T00:50:21.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/949: dwrite d6/f7c [4194304,4194304] 0 2024-09-16T00:50:21.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/950: dread - d6/d16/d1f/d6c/de2/d10f/f13f zero size 2024-09-16T00:50:21.724 INFO:tasks.workunit.client.0.smithi053.stdout:0/414: dwrite d4/dc/d25/d34/d2a/d27/d4a/f56 [0,4194304] 0 2024-09-16T00:50:21.726 INFO:tasks.workunit.client.1.smithi152.stdout:2/749: dwrite d4/d44/d7a/dc7/de4/d20/d28/f68 [0,4194304] 0 2024-09-16T00:50:21.729 INFO:tasks.workunit.client.1.smithi152.stdout:3/775: dwrite dc/d10/d17/d5a/db2/f5e [0,4194304] 0 2024-09-16T00:50:21.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/935: link d2/db/d39/d3c/d7f/f9f d2/db/d39/d3c/d7f/d98/f130 0 2024-09-16T00:50:21.729 INFO:tasks.workunit.client.0.smithi053.stdout:8/424: dwrite d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:21.732 INFO:tasks.workunit.client.1.smithi152.stdout:1/893: creat d9/d3e/d4b/db7/ddd/f147 x:0 0 0 2024-09-16T00:50:21.732 INFO:tasks.workunit.client.1.smithi152.stdout:1/894: readlink d9/d3e/d41/d31/d48/d4a/lfe 0 2024-09-16T00:50:21.733 INFO:tasks.workunit.client.1.smithi152.stdout:1/895: stat d9/da/le 0 2024-09-16T00:50:21.735 INFO:tasks.workunit.client.1.smithi152.stdout:1/896: dread d9/d3e/d7b/fa9 [0,4194304] 0 2024-09-16T00:50:21.735 INFO:tasks.workunit.client.1.smithi152.stdout:1/897: chown d9/da/fbf 3884 1 2024-09-16T00:50:21.737 INFO:tasks.workunit.client.1.smithi152.stdout:8/634: unlink dd/d98/db8/dcf/d29/f58 0 2024-09-16T00:50:21.739 INFO:tasks.workunit.client.0.smithi053.stdout:7/354: link d1/d35/d14/f43 d1/d60/d77/d50/f7c 0 2024-09-16T00:50:21.739 INFO:tasks.workunit.client.0.smithi053.stdout:7/355: write d1/f3a [444329,63650] 0 2024-09-16T00:50:21.739 INFO:tasks.workunit.client.0.smithi053.stdout:7/356: truncate d1/f3a 1348034 0 2024-09-16T00:50:21.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/936: dread d2/d1e/fd9 [0,4194304] 0 2024-09-16T00:50:21.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/937: write d2/db/d39/d3c/d76/db8/f124 [971620,14541] 0 2024-09-16T00:50:21.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/938: chown d2/db/d39/d3c/d7f/d98/l4b 12568304 1 2024-09-16T00:50:21.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/939: dread - d2/db/dce/fec zero size 2024-09-16T00:50:21.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/940: creat d2/db/dce/deb/f131 x:0 0 0 2024-09-16T00:50:21.742 INFO:tasks.workunit.client.0.smithi053.stdout:0/415: dwrite d4/dc/d25/d34/f74 [0,4194304] 0 2024-09-16T00:50:21.742 INFO:tasks.workunit.client.0.smithi053.stdout:0/416: fdatasync d4/dc/d1e/d1f/d40/f62 0 2024-09-16T00:50:21.743 INFO:tasks.workunit.client.1.smithi152.stdout:7/830: link d9/d31/d64/d3c/db9/dc2/fdd d9/d10/da5/f11e 0 2024-09-16T00:50:21.745 INFO:tasks.workunit.client.0.smithi053.stdout:1/344: stat d5/d9/c2e 0 2024-09-16T00:50:21.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/951: fdatasync d6/d57/d2b/dee/d135/d142/f145 0 2024-09-16T00:50:21.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/952: readlink l5 0 2024-09-16T00:50:21.754 INFO:tasks.workunit.client.0.smithi053.stdout:0/417: write d4/f4b [1720160,26038] 0 2024-09-16T00:50:21.756 INFO:tasks.workunit.client.1.smithi152.stdout:2/750: chown d4/d44/df6/l65 3105 1 2024-09-16T00:50:21.759 INFO:tasks.workunit.client.0.smithi053.stdout:5/267: mkdir d3/d7/d24/d34/d5b 0 2024-09-16T00:50:21.760 INFO:tasks.workunit.client.1.smithi152.stdout:4/941: dwrite d2/db/d39/d3c/d7f/f9f [0,4194304] 0 2024-09-16T00:50:21.763 INFO:tasks.workunit.client.0.smithi053.stdout:1/345: dwrite d5/d9/d4c/d61/f6e [0,4194304] 0 2024-09-16T00:50:21.763 INFO:tasks.workunit.client.0.smithi053.stdout:1/346: readlink d5/d18/d33/d30/l6d 0 2024-09-16T00:50:21.772 INFO:tasks.workunit.client.1.smithi152.stdout:4/942: write d2/db/d39/d3c/d76/db8/f79 [2564757,112491] 0 2024-09-16T00:50:21.772 INFO:tasks.workunit.client.1.smithi152.stdout:4/943: fsync d2/db/d39/d3c/d76/f108 0 2024-09-16T00:50:21.773 INFO:tasks.workunit.client.1.smithi152.stdout:6/855: sync 2024-09-16T00:50:21.773 INFO:tasks.workunit.client.1.smithi152.stdout:3/776: creat dc/d10/d17/d5a/d68/da5/ff3 x:0 0 0 2024-09-16T00:50:21.776 INFO:tasks.workunit.client.1.smithi152.stdout:1/898: symlink d9/d3e/d41/d31/da5/l148 0 2024-09-16T00:50:21.776 INFO:tasks.workunit.client.1.smithi152.stdout:1/899: chown d9/f29 137 1 2024-09-16T00:50:21.778 INFO:tasks.workunit.client.0.smithi053.stdout:6/297: link d1/dc/d1e/d41/c5a d1/dc/d3d/c6c 0 2024-09-16T00:50:21.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/635: symlink dd/d98/db8/dcf/d29/d2f/db6/ld5 0 2024-09-16T00:50:21.780 INFO:tasks.workunit.client.0.smithi053.stdout:1/347: dwrite d5/d18/f1b [4194304,4194304] 0 2024-09-16T00:50:21.780 INFO:tasks.workunit.client.0.smithi053.stdout:1/348: chown d5/d9/d4c/d61/f6e 248366 1 2024-09-16T00:50:21.781 INFO:tasks.workunit.client.0.smithi053.stdout:9/386: creat d8/d1c/d2b/d2c/f85 x:0 0 0 2024-09-16T00:50:21.784 INFO:tasks.workunit.client.1.smithi152.stdout:7/831: symlink d9/d31/dc4/l11f 0 2024-09-16T00:50:21.784 INFO:tasks.workunit.client.1.smithi152.stdout:7/832: creat d9/d31/d64/d3c/d5b/f120 x:0 0 0 2024-09-16T00:50:21.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/953: mknod d6/d16/d1f/d6c/de7/d128/c159 0 2024-09-16T00:50:21.790 INFO:tasks.workunit.client.1.smithi152.stdout:2/751: symlink d4/d44/d7a/dc7/de4/d20/d34/lfb 0 2024-09-16T00:50:21.791 INFO:tasks.workunit.client.0.smithi053.stdout:8/425: link d10/d1c/d2b/d58/c68 d10/d21/d28/d3c/d63/d6a/d88/c91 0 2024-09-16T00:50:21.794 INFO:tasks.workunit.client.0.smithi053.stdout:2/302: rmdir d6/d9/dd/d3e 39 2024-09-16T00:50:21.794 INFO:tasks.workunit.client.0.smithi053.stdout:2/303: creat d6/d9/d14/f4c x:0 0 0 2024-09-16T00:50:21.794 INFO:tasks.workunit.client.0.smithi053.stdout:2/304: write d6/d9/f49 [613999,92786] 0 2024-09-16T00:50:21.795 INFO:tasks.workunit.client.1.smithi152.stdout:4/944: creat d2/db/d39/d3c/d7f/d8b/f132 x:0 0 0 2024-09-16T00:50:21.795 INFO:tasks.workunit.client.1.smithi152.stdout:4/945: readlink d2/d1e/d28/d7b/l128 0 2024-09-16T00:50:21.795 INFO:tasks.workunit.client.0.smithi053.stdout:7/357: mknod d1/d35/d4a/d74/c7d 0 2024-09-16T00:50:21.797 INFO:tasks.workunit.client.1.smithi152.stdout:6/856: mknod db/d12/d1c/c110 0 2024-09-16T00:50:21.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/777: mkdir dc/d10/d17/d1c/d50/d55/d6d/dea/df4 0 2024-09-16T00:50:21.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/778: chown dc/d10/d17/d1c/f7e 31793 1 2024-09-16T00:50:21.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/779: truncate dc/d10/d17/d1c/d1f/d24/f39 1679619 0 2024-09-16T00:50:21.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/780: write dc/d10/d17/d1c/f7e [688731,74993] 0 2024-09-16T00:50:21.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/781: getdents dc/d5c/dae/df1 0 2024-09-16T00:50:21.805 INFO:tasks.workunit.client.1.smithi152.stdout:1/900: link d9/d3e/d41/d31/d48/db2/fe1 d9/d3e/d7b/df0/f149 0 2024-09-16T00:50:21.806 INFO:tasks.workunit.client.0.smithi053.stdout:0/418: link d4/d13/f41 d4/dc/d25/d34/f88 0 2024-09-16T00:50:21.806 INFO:tasks.workunit.client.0.smithi053.stdout:0/419: fdatasync d4/dc/d1e/d1f/d40/f62 0 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:8/636: mknod dd/d98/db8/dcf/d29/d2f/d5f/cd6 0 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:8/637: readlink dd/d15/d1a/l1c 0 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:0/795: sync 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:9/807: sync 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:9/808: creat d1/d4e/d48/f103 x:0 0 0 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:9/809: read - d1/d7/dca/fe4 zero size 2024-09-16T00:50:21.808 INFO:tasks.workunit.client.1.smithi152.stdout:9/810: chown d1/d7/d77/d3c/c97 10640509 1 2024-09-16T00:50:21.809 INFO:tasks.workunit.client.0.smithi053.stdout:5/268: truncate d3/d7/d2b/d37/d58/f4c 972556 0 2024-09-16T00:50:21.809 INFO:tasks.workunit.client.0.smithi053.stdout:5/269: stat d3/d7/d2b/d4b/d4f/f54 0 2024-09-16T00:50:21.809 INFO:tasks.workunit.client.0.smithi053.stdout:5/270: write d3/f9 [2926547,44113] 0 2024-09-16T00:50:21.809 INFO:tasks.workunit.client.0.smithi053.stdout:5/271: fsync d3/d7/d24/d34/f40 0 2024-09-16T00:50:21.813 INFO:tasks.workunit.client.1.smithi152.stdout:7/833: truncate d9/d31/d64/d3c/db9/dc2/fcd 33960 0 2024-09-16T00:50:21.814 INFO:tasks.workunit.client.1.smithi152.stdout:4/946: dwrite d2/d41/fe7 [0,4194304] 0 2024-09-16T00:50:21.814 INFO:tasks.workunit.client.1.smithi152.stdout:4/947: fdatasync d2/db/d39/d3c/f77 0 2024-09-16T00:50:21.815 INFO:tasks.workunit.client.0.smithi053.stdout:6/298: mkdir d1/dc/d43/d6d 0 2024-09-16T00:50:21.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/782: write dc/d10/fa2 [84348,45904] 0 2024-09-16T00:50:21.816 INFO:tasks.workunit.client.1.smithi152.stdout:5/954: mknod d6/d16/d1f/d6c/de2/c15a 0 2024-09-16T00:50:21.817 INFO:tasks.workunit.client.0.smithi053.stdout:0/420: dread d4/dc/d25/d34/d2a/d27/d4a/f56 [0,4194304] 0 2024-09-16T00:50:21.818 INFO:tasks.workunit.client.0.smithi053.stdout:0/421: chown d4/dc/f1b 5711888 1 2024-09-16T00:50:21.818 INFO:tasks.workunit.client.0.smithi053.stdout:0/422: readlink d4/dc/d25/l86 0 2024-09-16T00:50:21.818 INFO:tasks.workunit.client.1.smithi152.stdout:0/796: dread d3/d6/f7f [0,4194304] 0 2024-09-16T00:50:21.821 INFO:tasks.workunit.client.1.smithi152.stdout:2/752: link d4/d44/l64 d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/lfc 0 2024-09-16T00:50:21.821 INFO:tasks.workunit.client.0.smithi053.stdout:7/358: dwrite d1/d35/d14/d15/f1a [0,4194304] 0 2024-09-16T00:50:21.823 INFO:tasks.workunit.client.1.smithi152.stdout:1/901: dwrite d9/f36 [0,4194304] 0 2024-09-16T00:50:21.825 INFO:tasks.workunit.client.1.smithi152.stdout:6/857: creat db/d12/d23/d4a/f111 x:0 0 0 2024-09-16T00:50:21.828 INFO:tasks.workunit.client.1.smithi152.stdout:8/638: getdents dd 0 2024-09-16T00:50:21.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/955: read d6/f7c [2511575,66524] 0 2024-09-16T00:50:21.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/956: stat d6/d57/d2b/d50/l6d 0 2024-09-16T00:50:21.832 INFO:tasks.workunit.client.1.smithi152.stdout:9/811: stat d1/d4e/d48/d26/d30/l8c 0 2024-09-16T00:50:21.832 INFO:tasks.workunit.client.1.smithi152.stdout:9/812: chown d1/d4e/d48/d66/l6d 5225 1 2024-09-16T00:50:21.836 INFO:tasks.workunit.client.1.smithi152.stdout:7/834: rename d9/d31/d65/d8a/f3b to d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5/f121 0 2024-09-16T00:50:21.841 INFO:tasks.workunit.client.1.smithi152.stdout:3/783: unlink dc/d10/d17/d1c/d1f/c20 0 2024-09-16T00:50:21.841 INFO:tasks.workunit.client.1.smithi152.stdout:3/784: chown dc/d10/d17/d1c/d8d/fcd 0 1 2024-09-16T00:50:21.845 INFO:tasks.workunit.client.0.smithi053.stdout:0/423: dwrite d4/d13/f4f [0,4194304] 0 2024-09-16T00:50:21.845 INFO:tasks.workunit.client.0.smithi053.stdout:0/424: read - d4/dc/d1e/d22/f65 zero size 2024-09-16T00:50:21.846 INFO:tasks.workunit.client.1.smithi152.stdout:1/902: dwrite d9/da/df/f27 [4194304,4194304] 0 2024-09-16T00:50:21.846 INFO:tasks.workunit.client.1.smithi152.stdout:1/903: creat d9/da/d105/f14a x:0 0 0 2024-09-16T00:50:21.846 INFO:tasks.workunit.client.1.smithi152.stdout:1/904: stat d9/d3e/d4b/db7/dc4/fe7 0 2024-09-16T00:50:21.846 INFO:tasks.workunit.client.1.smithi152.stdout:0/797: write d3/d6/d2e/fd3 [4830263,119325] 0 2024-09-16T00:50:21.848 INFO:tasks.workunit.client.1.smithi152.stdout:2/753: link d4/d44/d7a/dc7/de4/d20/d28/d2c/c36 d4/d44/cfd 0 2024-09-16T00:50:21.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/639: dwrite dd/f38 [0,4194304] 0 2024-09-16T00:50:21.850 INFO:tasks.workunit.client.0.smithi053.stdout:2/305: symlink d6/d9/dd/d3e/l4d 0 2024-09-16T00:50:21.857 INFO:tasks.workunit.client.0.smithi053.stdout:7/359: creat d1/d35/d4a/d74/f7e x:0 0 0 2024-09-16T00:50:21.857 INFO:tasks.workunit.client.0.smithi053.stdout:7/360: creat d1/d60/d70/f7f x:0 0 0 2024-09-16T00:50:21.859 INFO:tasks.workunit.client.0.smithi053.stdout:1/349: mknod d5/d9/c75 0 2024-09-16T00:50:21.861 INFO:tasks.workunit.client.0.smithi053.stdout:9/387: rmdir d8/d4c/d5b 39 2024-09-16T00:50:21.861 INFO:tasks.workunit.client.0.smithi053.stdout:4/250: sync 2024-09-16T00:50:21.861 INFO:tasks.workunit.client.0.smithi053.stdout:3/413: sync 2024-09-16T00:50:21.862 INFO:tasks.workunit.client.0.smithi053.stdout:3/414: readlink d1/d5/d11/d3a/l48 0 2024-09-16T00:50:21.862 INFO:tasks.workunit.client.0.smithi053.stdout:3/415: write d1/d5/d31/f41 [682536,10346] 0 2024-09-16T00:50:21.865 INFO:tasks.workunit.client.1.smithi152.stdout:6/858: unlink db/d12/d1c/d80/l4c 0 2024-09-16T00:50:21.867 INFO:tasks.workunit.client.0.smithi053.stdout:3/416: dread d1/d5/d11/f25 [0,4194304] 0 2024-09-16T00:50:21.870 INFO:tasks.workunit.client.1.smithi152.stdout:9/813: truncate d1/d4e/d48/d2b/d7c/f102 1634325 0 2024-09-16T00:50:21.871 INFO:tasks.workunit.client.0.smithi053.stdout:1/350: dread d5/d9/f56 [0,4194304] 0 2024-09-16T00:50:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/835: creat d9/d31/d64/d3c/d5b/dd0/f122 x:0 0 0 2024-09-16T00:50:21.876 INFO:tasks.workunit.client.0.smithi053.stdout:2/306: link d6/d9/d14/f1f d6/d9/d14/f4e 0 2024-09-16T00:50:21.878 INFO:tasks.workunit.client.0.smithi053.stdout:6/299: getdents d1/dc/d3c/d4a 0 2024-09-16T00:50:21.882 INFO:tasks.workunit.client.0.smithi053.stdout:7/361: mkdir d1/d35/d14/d80 0 2024-09-16T00:50:21.885 INFO:tasks.workunit.client.1.smithi152.stdout:0/798: creat d3/d6/d8/d9e/dcb/f10d x:0 0 0 2024-09-16T00:50:21.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/754: chown d4/d44/df6/l26 0 1 2024-09-16T00:50:21.889 INFO:tasks.workunit.client.0.smithi053.stdout:4/251: creat d0/d3c/f5c x:0 0 0 2024-09-16T00:50:21.890 INFO:tasks.workunit.client.0.smithi053.stdout:6/300: write d1/dc/d45/f59 [3588631,90281] 0 2024-09-16T00:50:21.892 INFO:tasks.workunit.client.0.smithi053.stdout:8/426: rename d10/d52/d5b to d10/d1c/d92 0 2024-09-16T00:50:21.892 INFO:tasks.workunit.client.0.smithi053.stdout:8/427: chown d10/d21/d28/d3c/d63/d6a 36864 1 2024-09-16T00:50:21.894 INFO:tasks.workunit.client.0.smithi053.stdout:3/417: mknod d1/d5/d16/d47/d4c/c84 0 2024-09-16T00:50:21.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/640: symlink dd/d15/d49/ld7 0 2024-09-16T00:50:21.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/641: fsync dd/d98/db8/dcf/d29/d2f/f95 0 2024-09-16T00:50:21.897 INFO:tasks.workunit.client.0.smithi053.stdout:8/428: dread d10/d21/d28/d3c/d63/f74 [0,4194304] 0 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/859: link db/d28/fd6 db/d12/d23/d4a/d43/d48/d64/dab/de7/f112 0 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.1.smithi152.stdout:5/957: mkdir d6/d16/d10d/d10e/d15b 0 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.1.smithi152.stdout:5/958: truncate d6/d57/d2b/dee/f154 1036573 0 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.0.smithi053.stdout:9/388: getdents d8/d19/d51 0 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.0.smithi053.stdout:9/389: chown d8/d1c/l2d 412 1 2024-09-16T00:50:21.902 INFO:tasks.workunit.client.0.smithi053.stdout:2/307: dwrite d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:21.903 INFO:tasks.workunit.client.0.smithi053.stdout:7/362: dwrite d1/f3f [0,4194304] 0 2024-09-16T00:50:21.903 INFO:tasks.workunit.client.0.smithi053.stdout:7/363: creat d1/d2a/d4f/f81 x:0 0 0 2024-09-16T00:50:21.903 INFO:tasks.workunit.client.0.smithi053.stdout:7/364: creat d1/d2a/f82 x:0 0 0 2024-09-16T00:50:21.904 INFO:tasks.workunit.client.1.smithi152.stdout:3/785: rename dc/d10/fa2 to dc/d10/d17/d5a/d68/da5/df0/ff5 0 2024-09-16T00:50:21.907 INFO:tasks.workunit.client.0.smithi053.stdout:5/272: rename d3/d7/d2b/d4b/d51/d53/f55 to d3/d7/f5c 0 2024-09-16T00:50:21.907 INFO:tasks.workunit.client.0.smithi053.stdout:5/273: write d3/d7/d2b/d37/d58/f4c [1026213,97353] 0 2024-09-16T00:50:21.910 INFO:tasks.workunit.client.0.smithi053.stdout:8/429: creat d10/d21/d28/d3c/d63/d6a/f93 x:0 0 0 2024-09-16T00:50:21.910 INFO:tasks.workunit.client.0.smithi053.stdout:8/430: chown d10/d21/d28/d3c/d61 0 1 2024-09-16T00:50:21.912 INFO:tasks.workunit.client.1.smithi152.stdout:7/836: mkdir d9/d31/d64/d3c/d5b/dd0/d123 0 2024-09-16T00:50:21.912 INFO:tasks.workunit.client.1.smithi152.stdout:7/837: write d9/d31/d65/d8a/d41/d46/d7d/fb2 [456932,55776] 0 2024-09-16T00:50:21.913 INFO:tasks.workunit.client.0.smithi053.stdout:4/252: rmdir d0/d3c 39 2024-09-16T00:50:21.913 INFO:tasks.workunit.client.0.smithi053.stdout:6/301: dwrite d1/f2b [0,4194304] 0 2024-09-16T00:50:21.914 INFO:tasks.workunit.client.0.smithi053.stdout:8/431: dread d10/d52/f55 [0,4194304] 0 2024-09-16T00:50:21.917 INFO:tasks.workunit.client.1.smithi152.stdout:0/799: creat d3/d6/f10e x:0 0 0 2024-09-16T00:50:21.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/755: getdents d4/d44 0 2024-09-16T00:50:21.920 INFO:tasks.workunit.client.0.smithi053.stdout:2/308: mknod d6/c4f 0 2024-09-16T00:50:21.920 INFO:tasks.workunit.client.0.smithi053.stdout:2/309: readlink d6/d9/d14/l21 0 2024-09-16T00:50:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/642: mkdir dd/d98/db8/dcf/d88/dd8 0 2024-09-16T00:50:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/643: chown dd/d25/l8c 15 1 2024-09-16T00:50:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/644: write dd/d25/f70 [591963,94394] 0 2024-09-16T00:50:21.924 INFO:tasks.workunit.client.1.smithi152.stdout:0/800: dread d3/d6/d51/f57 [0,4194304] 0 2024-09-16T00:50:21.924 INFO:tasks.workunit.client.1.smithi152.stdout:0/801: truncate d3/d6/d64/d6a/d61/fef 194340 0 2024-09-16T00:50:21.928 INFO:tasks.workunit.client.1.smithi152.stdout:5/959: truncate d6/d57/d2b/d50/d66/fd6 148899 0 2024-09-16T00:50:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:5/960: fdatasync d6/d16/d1f/d65/f89 0 2024-09-16T00:50:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:5/961: fdatasync d6/f1a 0 2024-09-16T00:50:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:5/962: chown d6/d16/d1f/d65/dd2 17416736 1 2024-09-16T00:50:21.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/253: dread d0/d2/d26/f2c [0,4194304] 0 2024-09-16T00:50:21.932 INFO:tasks.workunit.client.1.smithi152.stdout:1/905: rename d9/d3e/d41/d31/d48/dc3/f128 to d9/da/d105/f14b 0 2024-09-16T00:50:21.935 INFO:tasks.workunit.client.1.smithi152.stdout:4/948: sync 2024-09-16T00:50:21.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/860: dwrite db/d12/d23/f81 [0,4194304] 0 2024-09-16T00:50:21.938 INFO:tasks.workunit.client.1.smithi152.stdout:8/645: write dd/f1f [648034,113996] 0 2024-09-16T00:50:21.938 INFO:tasks.workunit.client.0.smithi053.stdout:6/302: dwrite d1/dc/d39/f13 [4194304,4194304] 0 2024-09-16T00:50:21.939 INFO:tasks.workunit.client.0.smithi053.stdout:2/310: dwrite d6/d9/dd/f3a [0,4194304] 0 2024-09-16T00:50:21.939 INFO:tasks.workunit.client.0.smithi053.stdout:2/311: chown d6/f8 297 1 2024-09-16T00:50:21.939 INFO:tasks.workunit.client.1.smithi152.stdout:7/838: truncate d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f9c 2693611 0 2024-09-16T00:50:21.941 INFO:tasks.workunit.client.0.smithi053.stdout:7/365: mkdir d1/d2a/d83 0 2024-09-16T00:50:21.941 INFO:tasks.workunit.client.0.smithi053.stdout:7/366: write d1/d2a/f79 [983263,72162] 0 2024-09-16T00:50:21.943 INFO:tasks.workunit.client.1.smithi152.stdout:2/756: mknod d4/d44/d7a/dc7/de4/d20/d34/daa/cfe 0 2024-09-16T00:50:21.945 INFO:tasks.workunit.client.0.smithi053.stdout:3/418: rename d1/d5/d11/d3a/l48 to d1/d5/d16/d47/d64/l85 0 2024-09-16T00:50:21.946 INFO:tasks.workunit.client.1.smithi152.stdout:4/949: write d2/db/f2c [140887,20196] 0 2024-09-16T00:50:21.947 INFO:tasks.workunit.client.1.smithi152.stdout:1/906: rename d9/da/da2/f13d to d9/d3e/d41/d31/d48/dc3/f14c 0 2024-09-16T00:50:21.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/432: readlink l5 0 2024-09-16T00:50:21.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/433: chown d10/d1c/d2b/d40/d76 484610842 1 2024-09-16T00:50:21.948 INFO:tasks.workunit.client.1.smithi152.stdout:4/950: dread d2/d1e/d28/d7b/db0/f111 [0,4194304] 0 2024-09-16T00:50:21.949 INFO:tasks.workunit.client.1.smithi152.stdout:5/963: dwrite d6/d57/d2b/f6b [0,4194304] 0 2024-09-16T00:50:21.951 INFO:tasks.workunit.client.0.smithi053.stdout:4/254: link d0/d2/d1e/d4b/f57 d0/d2/dd/d25/d41/f5d 0 2024-09-16T00:50:21.955 INFO:tasks.workunit.client.0.smithi053.stdout:4/255: write d0/d2/dd/d25/f35 [1489921,89872] 0 2024-09-16T00:50:21.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/786: creat dc/d10/d17/d1c/d50/d55/d6d/dea/df4/ff6 x:0 0 0 2024-09-16T00:50:21.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/861: mknod db/d12/d1c/c113 0 2024-09-16T00:50:21.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/951: read d2/d1e/d28/f30 [6069485,68225] 0 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/646: symlink dd/d15/d69/ld9 0 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/647: dread - dd/d15/f4a zero size 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/648: creat dd/d15/d9b/fda x:0 0 0 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/649: chown dd/d25/d77/l9a 158 1 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/650: chown dd/d23/c6b 0 1 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/651: readlink dd/d98/db8/dcf/d29/ld0 0 2024-09-16T00:50:21.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/652: stat dd/d98/db8/dcf/d29/d2f 0 2024-09-16T00:50:21.963 INFO:tasks.workunit.client.0.smithi053.stdout:6/303: mknod d1/dc/d39/c6e 0 2024-09-16T00:50:21.967 INFO:tasks.workunit.client.0.smithi053.stdout:2/312: mknod d6/d29/d2b/c50 0 2024-09-16T00:50:21.969 INFO:tasks.workunit.client.1.smithi152.stdout:4/952: dread d2/db/d39/d3c/d7f/d8b/fdf [0,4194304] 0 2024-09-16T00:50:21.970 INFO:tasks.workunit.client.0.smithi053.stdout:8/434: dwrite d10/d1c/f73 [0,4194304] 0 2024-09-16T00:50:21.970 INFO:tasks.workunit.client.0.smithi053.stdout:8/435: write d10/d1c/d2b/d40/d50/f90 [518030,101657] 0 2024-09-16T00:50:21.972 INFO:tasks.workunit.client.0.smithi053.stdout:2/313: dread d6/d9/dd/f31 [0,4194304] 0 2024-09-16T00:50:21.972 INFO:tasks.workunit.client.0.smithi053.stdout:2/314: chown d6/d9/d14/l21 1887058458 1 2024-09-16T00:50:21.974 INFO:tasks.workunit.client.0.smithi053.stdout:9/390: rename d8/f12 to d8/d1c/d2b/f86 0 2024-09-16T00:50:21.975 INFO:tasks.workunit.client.1.smithi152.stdout:7/839: symlink d9/d31/d65/d8a/d41/d46/d7d/d86/l124 0 2024-09-16T00:50:21.975 INFO:tasks.workunit.client.1.smithi152.stdout:7/840: write d9/d31/d64/f35 [1011093,116447] 0 2024-09-16T00:50:21.978 INFO:tasks.workunit.client.0.smithi053.stdout:3/419: creat d1/d5/d16/d47/d65/d66/f86 x:0 0 0 2024-09-16T00:50:21.979 INFO:tasks.workunit.client.1.smithi152.stdout:2/757: mkdir d4/d44/d7a/d9e/dff 0 2024-09-16T00:50:21.981 INFO:tasks.workunit.client.0.smithi053.stdout:4/256: mknod d0/da/c5e 0 2024-09-16T00:50:21.981 INFO:tasks.workunit.client.0.smithi053.stdout:4/257: chown d0/d31/l3b 375 1 2024-09-16T00:50:21.981 INFO:tasks.workunit.client.0.smithi053.stdout:4/258: readlink d0/d31/l3b 0 2024-09-16T00:50:21.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/907: getdents d9/d3e/d4b 0 2024-09-16T00:50:21.989 INFO:tasks.workunit.client.0.smithi053.stdout:4/259: dread d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:21.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/964: mknod d6/d57/d54/d12c/c15c 0 2024-09-16T00:50:21.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/965: chown d6/d57/d54/d12c/f13e 560548 1 2024-09-16T00:50:21.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/966: write d6/d16/d1f/d6c/de2/f147 [1977108,128620] 0 2024-09-16T00:50:21.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/967: fdatasync d6/d16/d1f/f10b 0 2024-09-16T00:50:21.990 INFO:tasks.workunit.client.0.smithi053.stdout:8/436: creat d10/d1c/d92/f94 x:0 0 0 2024-09-16T00:50:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/787: mknod dc/cf7 0 2024-09-16T00:50:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/788: write dc/d10/d17/d5a/fd7 [618101,103690] 0 2024-09-16T00:50:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/789: write dc/d10/d17/d1c/d8d/fcd [129602,79339] 0 2024-09-16T00:50:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/790: write dc/d10/d17/d1c/d50/d55/d6d/dea/df4/ff6 [819320,122579] 0 2024-09-16T00:50:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/791: write dc/d10/d17/d1c/d8d/d8e/d2f/fe4 [708025,4060] 0 2024-09-16T00:50:21.992 INFO:tasks.workunit.client.0.smithi053.stdout:2/315: mknod d6/d9/c51 0 2024-09-16T00:50:21.994 INFO:tasks.workunit.client.0.smithi053.stdout:5/274: rename d3/c17 to d3/d7/d2b/d4b/d4f/c5d 0 2024-09-16T00:50:21.994 INFO:tasks.workunit.client.0.smithi053.stdout:5/275: stat d3/d7/d2b/d37/d58/f23 0 2024-09-16T00:50:21.995 INFO:tasks.workunit.client.0.smithi053.stdout:5/276: dread d3/d7/d2b/d37/d58/f14 [0,4194304] 0 2024-09-16T00:50:21.996 INFO:tasks.workunit.client.0.smithi053.stdout:9/391: unlink d8/d1c/d2b/f58 0 2024-09-16T00:50:21.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/420: mknod d1/d5/d31/d42/c87 0 2024-09-16T00:50:21.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/421: write d1/d5/d11/f46 [3280864,78822] 0 2024-09-16T00:50:22.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/653: getdents dd/d98/db8/dcf/d29/d2f/d5f 0 2024-09-16T00:50:22.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/654: fsync dd/d15/d69/f9e 0 2024-09-16T00:50:22.001 INFO:tasks.workunit.client.0.smithi053.stdout:6/304: getdents d1/dc/d39 0 2024-09-16T00:50:22.003 INFO:tasks.workunit.client.1.smithi152.stdout:4/953: rename d2/db/d39/d3c/f85 to d2/db/d39/d95/f133 0 2024-09-16T00:50:22.004 INFO:tasks.workunit.client.0.smithi053.stdout:2/316: mkdir d6/d9/dd/d3e/d52 0 2024-09-16T00:50:22.005 INFO:tasks.workunit.client.0.smithi053.stdout:4/260: dread d0/da/f3d [0,4194304] 0 2024-09-16T00:50:22.005 INFO:tasks.workunit.client.1.smithi152.stdout:7/841: symlink d9/d31/d64/d3c/d5b/dd0/l125 0 2024-09-16T00:50:22.005 INFO:tasks.workunit.client.1.smithi152.stdout:7/842: readlink d9/d10/dc0/lc8 0 2024-09-16T00:50:22.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/422: dread d1/d5/d16/f4d [0,4194304] 0 2024-09-16T00:50:22.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/423: fsync d1/d5/d14/f2d 0 2024-09-16T00:50:22.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/424: chown d1/d5/d14/d28/f7b 354946 1 2024-09-16T00:50:22.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/425: fdatasync d1/d5/d14/d28/f35 0 2024-09-16T00:50:22.011 INFO:tasks.workunit.client.0.smithi053.stdout:3/426: stat d1/d5/d11/l24 0 2024-09-16T00:50:22.012 INFO:tasks.workunit.client.0.smithi053.stdout:3/427: write d1/d5/d31/d3b/f44 [467578,5363] 0 2024-09-16T00:50:22.012 INFO:tasks.workunit.client.0.smithi053.stdout:8/437: rename d10/d1c/d2b/d40/c80 to d10/d4a/c95 0 2024-09-16T00:50:22.012 INFO:tasks.workunit.client.0.smithi053.stdout:5/277: getdents d3/d7/d24 0 2024-09-16T00:50:22.012 INFO:tasks.workunit.client.0.smithi053.stdout:9/392: mknod d8/d19/c87 0 2024-09-16T00:50:22.014 INFO:tasks.workunit.client.1.smithi152.stdout:9/814: sync 2024-09-16T00:50:22.014 INFO:tasks.workunit.client.1.smithi152.stdout:2/758: symlink d4/d44/d7a/df8/l100 0 2024-09-16T00:50:22.014 INFO:tasks.workunit.client.1.smithi152.stdout:7/843: dread d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f114 [0,4194304] 0 2024-09-16T00:50:22.014 INFO:tasks.workunit.client.1.smithi152.stdout:7/844: write d9/f1b [4579083,92360] 0 2024-09-16T00:50:22.014 INFO:tasks.workunit.client.1.smithi152.stdout:7/845: chown d9/l22 50 1 2024-09-16T00:50:22.015 INFO:tasks.workunit.client.1.smithi152.stdout:7/846: fdatasync d9/d31/d65/f7c 0 2024-09-16T00:50:22.016 INFO:tasks.workunit.client.0.smithi053.stdout:6/305: mknod d1/dc/d3d/c6f 0 2024-09-16T00:50:22.016 INFO:tasks.workunit.client.0.smithi053.stdout:6/306: chown d1/dc/d3c/d4b/d58 27 1 2024-09-16T00:50:22.017 INFO:tasks.workunit.client.1.smithi152.stdout:5/968: link d6/d57/d54/f70 d6/d16/d10d/d10e/d15b/f15d 0 2024-09-16T00:50:22.018 INFO:tasks.workunit.client.0.smithi053.stdout:2/317: symlink d6/l53 0 2024-09-16T00:50:22.018 INFO:tasks.workunit.client.0.smithi053.stdout:2/318: chown d6/d29/d2b/f47 18952777 1 2024-09-16T00:50:22.021 INFO:tasks.workunit.client.0.smithi053.stdout:4/261: creat d0/d3c/d48/f5f x:0 0 0 2024-09-16T00:50:22.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/655: symlink dd/d98/db8/dcf/ldb 0 2024-09-16T00:50:22.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/656: stat dd/d15/d1a/l56 0 2024-09-16T00:50:22.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/657: write dd/d25/da4/fbd [689056,29990] 0 2024-09-16T00:50:22.023 INFO:tasks.workunit.client.0.smithi053.stdout:3/428: symlink d1/d5/d16/l88 0 2024-09-16T00:50:22.027 INFO:tasks.workunit.client.0.smithi053.stdout:8/438: symlink d10/d1c/d49/l96 0 2024-09-16T00:50:22.027 INFO:tasks.workunit.client.0.smithi053.stdout:8/439: readlink d10/d1c/l25 0 2024-09-16T00:50:22.027 INFO:tasks.workunit.client.0.smithi053.stdout:8/440: write d10/d1c/f73 [4812733,8614] 0 2024-09-16T00:50:22.027 INFO:tasks.workunit.client.0.smithi053.stdout:2/319: read d6/d9/dd/d28/f2f [7413636,71375] 0 2024-09-16T00:50:22.027 INFO:tasks.workunit.client.0.smithi053.stdout:2/320: chown f5 762871 1 2024-09-16T00:50:22.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/908: rename d9/d138 to d9/d3e/d41/d31/da5/d12c/d14d 0 2024-09-16T00:50:22.029 INFO:tasks.workunit.client.0.smithi053.stdout:5/278: creat d3/d7/d24/d3f/f5e x:0 0 0 2024-09-16T00:50:22.029 INFO:tasks.workunit.client.0.smithi053.stdout:5/279: write d3/f6 [450888,56153] 0 2024-09-16T00:50:22.030 INFO:tasks.workunit.client.1.smithi152.stdout:9/815: mkdir d1/d4e/d48/d26/d30/d104 0 2024-09-16T00:50:22.030 INFO:tasks.workunit.client.1.smithi152.stdout:9/816: stat d1/d4e/d48/ffd 0 2024-09-16T00:50:22.031 INFO:tasks.workunit.client.0.smithi053.stdout:9/393: creat d8/d22/d26/d83/f88 x:0 0 0 2024-09-16T00:50:22.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/817: dread d1/fcd [0,4194304] 0 2024-09-16T00:50:22.032 INFO:tasks.workunit.client.1.smithi152.stdout:2/759: symlink d4/d44/d7a/dc7/de4/d94/d93/da4/l101 0 2024-09-16T00:50:22.033 INFO:tasks.workunit.client.0.smithi053.stdout:6/307: creat d1/dc/d3c/f70 x:0 0 0 2024-09-16T00:50:22.034 INFO:tasks.workunit.client.0.smithi053.stdout:4/262: mknod d0/d3c/c60 0 2024-09-16T00:50:22.034 INFO:tasks.workunit.client.0.smithi053.stdout:4/263: write d0/d2/dd/d25/f35 [782481,29308] 0 2024-09-16T00:50:22.036 INFO:tasks.workunit.client.1.smithi152.stdout:7/847: getdents d9/d31/d65/d8a/d41/d46 0 2024-09-16T00:50:22.037 INFO:tasks.workunit.client.0.smithi053.stdout:8/441: mkdir d10/d1c/d2b/d40/d76/d97 0 2024-09-16T00:50:22.038 INFO:tasks.workunit.client.1.smithi152.stdout:7/848: dread d9/d31/d64/d3c/db9/fed [0,4194304] 0 2024-09-16T00:50:22.038 INFO:tasks.workunit.client.1.smithi152.stdout:5/969: mkdir d6/d57/d2b/d50/d6e/d15e 0 2024-09-16T00:50:22.041 INFO:tasks.workunit.client.1.smithi152.stdout:6/862: rmdir db/d12/d23/d4a/d43/d59/d67/dc2/dd5 0 2024-09-16T00:50:22.047 INFO:tasks.workunit.client.1.smithi152.stdout:8/658: mknod dd/d98/db8/dcf/d29/d2f/d5f/dd2/cdc 0 2024-09-16T00:50:22.050 INFO:tasks.workunit.client.0.smithi053.stdout:5/280: dwrite d3/d7/f2a [4194304,4194304] 0 2024-09-16T00:50:22.052 INFO:tasks.workunit.client.1.smithi152.stdout:3/792: rename l9 to dc/d10/d17/d5a/db2/d6f/dbb/lf8 0 2024-09-16T00:50:22.054 INFO:tasks.workunit.client.1.smithi152.stdout:9/818: getdents d1/d4e/d48/d26/d58 0 2024-09-16T00:50:22.055 INFO:tasks.workunit.client.0.smithi053.stdout:9/394: symlink d8/d1c/d2b/l89 0 2024-09-16T00:50:22.056 INFO:tasks.workunit.client.0.smithi053.stdout:9/395: write d8/d1c/f1b [1293106,122310] 0 2024-09-16T00:50:22.056 INFO:tasks.workunit.client.0.smithi053.stdout:9/396: truncate d8/d1c/d2b/f47 5172456 0 2024-09-16T00:50:22.056 INFO:tasks.workunit.client.0.smithi053.stdout:9/397: fsync d8/f5f 0 2024-09-16T00:50:22.057 INFO:tasks.workunit.client.0.smithi053.stdout:6/308: rmdir d1/dc/d43/d6d 0 2024-09-16T00:50:22.060 INFO:tasks.workunit.client.0.smithi053.stdout:3/429: rename d1/d5/d14 to d1/d89 0 2024-09-16T00:50:22.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/659: creat dd/d25/da4/fdd x:0 0 0 2024-09-16T00:50:22.063 INFO:tasks.workunit.client.1.smithi152.stdout:5/970: dwrite d6/d16/d1f/d8c/ff8 [0,4194304] 0 2024-09-16T00:50:22.063 INFO:tasks.workunit.client.0.smithi053.stdout:6/309: read d1/dc/d39/f1c [2254460,97646] 0 2024-09-16T00:50:22.064 INFO:tasks.workunit.client.0.smithi053.stdout:6/310: chown d1/dc/d39/c4c 691130448 1 2024-09-16T00:50:22.064 INFO:tasks.workunit.client.0.smithi053.stdout:8/442: mknod d10/d21/d28/d3c/d84/c98 0 2024-09-16T00:50:22.064 INFO:tasks.workunit.client.0.smithi053.stdout:8/443: write d10/d21/d28/d3c/d63/d6a/f93 [542463,118461] 0 2024-09-16T00:50:22.066 INFO:tasks.workunit.client.0.smithi053.stdout:5/281: mknod d3/d7/d24/c5f 0 2024-09-16T00:50:22.070 INFO:tasks.workunit.client.1.smithi152.stdout:4/954: rename d2/db/de8 to d2/d8e/d134 0 2024-09-16T00:50:22.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/793: link dc/d5c/dae/ldf dc/d10/d17/d1c/d50/daa/dee/lf9 0 2024-09-16T00:50:22.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/794: chown dc/d10/d17/d1c/d8d/d8e/d2f/d75 0 1 2024-09-16T00:50:22.073 INFO:tasks.workunit.client.0.smithi053.stdout:9/398: unlink d8/d13/l28 0 2024-09-16T00:50:22.074 INFO:tasks.workunit.client.1.smithi152.stdout:5/971: dread d6/d16/d1f/d65/d77/f80 [0,4194304] 0 2024-09-16T00:50:22.076 INFO:tasks.workunit.client.0.smithi053.stdout:4/264: rename d0/d2/dd/d25/l1a to d0/d3c/d48/l61 0 2024-09-16T00:50:22.077 INFO:tasks.workunit.client.1.smithi152.stdout:8/660: dwrite dd/d98/db8/dcf/d29/d2f/d5f/f7f [0,4194304] 0 2024-09-16T00:50:22.078 INFO:tasks.workunit.client.1.smithi152.stdout:8/661: truncate dd/d98/fbe 1003386 0 2024-09-16T00:50:22.078 INFO:tasks.workunit.client.1.smithi152.stdout:9/819: symlink d1/d7/d77/d32/da5/df1/l105 0 2024-09-16T00:50:22.080 INFO:tasks.workunit.client.0.smithi053.stdout:3/430: mknod d1/d5/d31/d7c/c8a 0 2024-09-16T00:50:22.080 INFO:tasks.workunit.client.0.smithi053.stdout:6/311: dwrite d1/dc/d39/f23 [0,4194304] 0 2024-09-16T00:50:22.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/802: sync 2024-09-16T00:50:22.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/803: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/f10b [649797,18623] 0 2024-09-16T00:50:22.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/804: chown d3/d6/d8/d1d/d65/db0/db6/fda 495505941 1 2024-09-16T00:50:22.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/805: fsync d3/d6/d8/f84 0 2024-09-16T00:50:22.086 INFO:tasks.workunit.client.0.smithi053.stdout:8/444: symlink d10/d4a/d54/l99 0 2024-09-16T00:50:22.086 INFO:tasks.workunit.client.0.smithi053.stdout:8/445: fsync d10/d1c/f73 0 2024-09-16T00:50:22.086 INFO:tasks.workunit.client.0.smithi053.stdout:8/446: fsync d10/d1c/d92/d66/f7a 0 2024-09-16T00:50:22.086 INFO:tasks.workunit.client.0.smithi053.stdout:8/447: readlink d10/d1c/l1f 0 2024-09-16T00:50:22.086 INFO:tasks.workunit.client.0.smithi053.stdout:8/448: write d10/d21/d28/d3c/f7c [802213,30187] 0 2024-09-16T00:50:22.088 INFO:tasks.workunit.client.1.smithi152.stdout:3/795: dwrite dc/d10/d17/d1c/d50/fd0 [0,4194304] 0 2024-09-16T00:50:22.088 INFO:tasks.workunit.client.1.smithi152.stdout:2/760: mknod d4/d44/df6/c102 0 2024-09-16T00:50:22.088 INFO:tasks.workunit.client.1.smithi152.stdout:2/761: readlink d4/d44/d7a/dc7/le1 0 2024-09-16T00:50:22.091 INFO:tasks.workunit.client.0.smithi053.stdout:5/282: link d3/d7/l52 d3/d7/d42/d57/l60 0 2024-09-16T00:50:22.092 INFO:tasks.workunit.client.0.smithi053.stdout:6/312: write d1/dc/d39/f23 [2630253,121635] 0 2024-09-16T00:50:22.098 INFO:tasks.workunit.client.0.smithi053.stdout:9/399: unlink d8/f11 0 2024-09-16T00:50:22.106 INFO:tasks.workunit.client.1.smithi152.stdout:4/955: rmdir d2/db/d39 39 2024-09-16T00:50:22.108 INFO:tasks.workunit.client.0.smithi053.stdout:6/313: dwrite d1/dc/d3c/d4a/f53 [0,4194304] 0 2024-09-16T00:50:22.108 INFO:tasks.workunit.client.0.smithi053.stdout:8/449: mknod d10/d1c/d92/c9a 0 2024-09-16T00:50:22.108 INFO:tasks.workunit.client.0.smithi053.stdout:8/450: write d10/d1c/d49/f89 [553096,99156] 0 2024-09-16T00:50:22.109 INFO:tasks.workunit.client.0.smithi053.stdout:3/431: dwrite d1/d89/f2d [0,4194304] 0 2024-09-16T00:50:22.109 INFO:tasks.workunit.client.0.smithi053.stdout:3/432: stat d1/d5/d11/c61 0 2024-09-16T00:50:22.109 INFO:tasks.workunit.client.0.smithi053.stdout:3/433: chown d1/d5/d16/d47/d64/l81 46 1 2024-09-16T00:50:22.110 INFO:tasks.workunit.client.1.smithi152.stdout:9/820: dwrite d1/d7/fc8 [0,4194304] 0 2024-09-16T00:50:22.110 INFO:tasks.workunit.client.1.smithi152.stdout:9/821: fdatasync d1/d7/d77/f33 0 2024-09-16T00:50:22.110 INFO:tasks.workunit.client.1.smithi152.stdout:5/972: truncate d6/ff 3727693 0 2024-09-16T00:50:22.113 INFO:tasks.workunit.client.0.smithi053.stdout:9/400: dread d8/d1c/d2b/f47 [0,4194304] 0 2024-09-16T00:50:22.113 INFO:tasks.workunit.client.0.smithi053.stdout:9/401: creat d8/d13/f8a x:0 0 0 2024-09-16T00:50:22.113 INFO:tasks.workunit.client.0.smithi053.stdout:9/402: readlink d8/l3b 0 2024-09-16T00:50:22.113 INFO:tasks.workunit.client.0.smithi053.stdout:9/403: fsync d8/d22/d54/f7f 0 2024-09-16T00:50:22.117 INFO:tasks.workunit.client.1.smithi152.stdout:8/662: creat dd/d98/db8/dcf/fde x:0 0 0 2024-09-16T00:50:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/663: chown dd/d15/f18 4 1 2024-09-16T00:50:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/664: stat dd/d98/db8/dcf/d29/d2f/f4b 0 2024-09-16T00:50:22.120 INFO:tasks.workunit.client.0.smithi053.stdout:4/265: unlink d0/d3c/d48/l61 0 2024-09-16T00:50:22.122 INFO:tasks.workunit.client.1.smithi152.stdout:0/806: mknod d3/c10f 0 2024-09-16T00:50:22.122 INFO:tasks.workunit.client.1.smithi152.stdout:0/807: creat d3/d6/d2e/f110 x:0 0 0 2024-09-16T00:50:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:3/796: mkdir dc/d10/d17/d1c/d50/daa/dfa 0 2024-09-16T00:50:22.126 INFO:tasks.workunit.client.0.smithi053.stdout:8/451: creat d10/d1c/d2b/d58/f9b x:0 0 0 2024-09-16T00:50:22.126 INFO:tasks.workunit.client.0.smithi053.stdout:8/452: stat d10/d21/f33 0 2024-09-16T00:50:22.135 INFO:tasks.workunit.client.0.smithi053.stdout:4/266: dread d0/d2/d1e/d4b/f36 [0,4194304] 0 2024-09-16T00:50:22.136 INFO:tasks.workunit.client.1.smithi152.stdout:4/956: link d2/db/dce/fe0 d2/db/d39/d3c/d76/db8/f135 0 2024-09-16T00:50:22.136 INFO:tasks.workunit.client.1.smithi152.stdout:4/957: fsync d2/db/d44/f53 0 2024-09-16T00:50:22.137 INFO:tasks.workunit.client.0.smithi053.stdout:6/314: dread d1/fd [0,4194304] 0 2024-09-16T00:50:22.137 INFO:tasks.workunit.client.0.smithi053.stdout:6/315: dread - d1/f57 zero size 2024-09-16T00:50:22.137 INFO:tasks.workunit.client.0.smithi053.stdout:6/316: write d1/dc/f32 [275476,86046] 0 2024-09-16T00:50:22.142 INFO:tasks.workunit.client.0.smithi053.stdout:4/267: write d0/d2/dd/f3e [636132,58006] 0 2024-09-16T00:50:22.151 INFO:tasks.workunit.client.1.smithi152.stdout:0/808: dwrite d3/fc [0,4194304] 0 2024-09-16T00:50:22.151 INFO:tasks.workunit.client.1.smithi152.stdout:0/809: creat d3/d6/d8/d9e/dcb/f111 x:0 0 0 2024-09-16T00:50:22.151 INFO:tasks.workunit.client.1.smithi152.stdout:0/810: chown d3/d6/d8/d1d/d23/d25/d2a/f66 0 1 2024-09-16T00:50:22.151 INFO:tasks.workunit.client.0.smithi053.stdout:8/453: dwrite d10/d1c/d2b/f4e [0,4194304] 0 2024-09-16T00:50:22.155 INFO:tasks.workunit.client.1.smithi152.stdout:9/822: mknod d1/d7/c106 0 2024-09-16T00:50:22.155 INFO:tasks.workunit.client.1.smithi152.stdout:9/823: chown d1/d7/d77/d32/l40 130623 1 2024-09-16T00:50:22.155 INFO:tasks.workunit.client.1.smithi152.stdout:9/824: getdents d1/d4e/d48/d26/d58 0 2024-09-16T00:50:22.156 INFO:tasks.workunit.client.1.smithi152.stdout:3/797: dwrite dc/d10/d17/d1c/f23 [0,4194304] 0 2024-09-16T00:50:22.156 INFO:tasks.workunit.client.1.smithi152.stdout:5/973: creat d6/d57/d2b/d50/d6e/d15e/f15f x:0 0 0 2024-09-16T00:50:22.157 INFO:tasks.workunit.client.1.smithi152.stdout:5/974: chown d6/d57/ddc/fea 1907 1 2024-09-16T00:50:22.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/665: creat dd/d98/db8/dcf/d88/dd8/fdf x:0 0 0 2024-09-16T00:50:22.163 INFO:tasks.workunit.client.0.smithi053.stdout:6/317: unlink d1/f2b 0 2024-09-16T00:50:22.163 INFO:tasks.workunit.client.0.smithi053.stdout:6/318: dread - d1/dc/f3b zero size 2024-09-16T00:50:22.163 INFO:tasks.workunit.client.0.smithi053.stdout:6/319: fsync d1/dc/d3c/f70 0 2024-09-16T00:50:22.165 INFO:tasks.workunit.client.0.smithi053.stdout:9/404: dwrite d8/d4c/d5a/f6a [0,4194304] 0 2024-09-16T00:50:22.165 INFO:tasks.workunit.client.0.smithi053.stdout:9/405: chown d8/d19/f3f 7 1 2024-09-16T00:50:22.167 INFO:tasks.workunit.client.1.smithi152.stdout:4/958: creat d2/db/d39/d95/f136 x:0 0 0 2024-09-16T00:50:22.174 INFO:tasks.workunit.client.1.smithi152.stdout:8/666: dwrite dd/d98/db8/dcf/d29/d2f/d5f/f7f [0,4194304] 0 2024-09-16T00:50:22.175 INFO:tasks.workunit.client.1.smithi152.stdout:9/825: symlink d1/d7/d77/dfc/l107 0 2024-09-16T00:50:22.182 INFO:tasks.workunit.client.0.smithi053.stdout:6/320: mknod d1/dc/d66/c71 0 2024-09-16T00:50:22.183 INFO:tasks.workunit.client.1.smithi152.stdout:3/798: mknod dc/d10/d17/d5a/cfb 0 2024-09-16T00:50:22.184 INFO:tasks.workunit.client.1.smithi152.stdout:9/826: dread d1/d4e/d48/d2b/d93/fc6 [0,4194304] 0 2024-09-16T00:50:22.189 INFO:tasks.workunit.client.0.smithi053.stdout:4/268: rename d0/d2/dd/f3e to d0/d2/d1e/d4b/f62 0 2024-09-16T00:50:22.189 INFO:tasks.workunit.client.0.smithi053.stdout:4/269: fdatasync d0/da/f4a 0 2024-09-16T00:50:22.189 INFO:tasks.workunit.client.0.smithi053.stdout:4/270: creat d0/d31/f63 x:0 0 0 2024-09-16T00:50:22.193 INFO:tasks.workunit.client.1.smithi152.stdout:1/909: rename d9/da/df/dcb/df2 to d9/da/d14e 0 2024-09-16T00:50:22.193 INFO:tasks.workunit.client.1.smithi152.stdout:1/910: truncate d9/d3e/d41/d31/d48/fc2 1631368 0 2024-09-16T00:50:22.194 INFO:tasks.workunit.client.1.smithi152.stdout:8/667: dwrite dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:22.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/975: dread d6/d16/f33 [0,4194304] 0 2024-09-16T00:50:22.197 INFO:tasks.workunit.client.0.smithi053.stdout:9/406: mkdir d8/d1c/d2b/d8b 0 2024-09-16T00:50:22.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/811: getdents d3/d6 0 2024-09-16T00:50:22.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/812: fsync d3/d6/d8/d1d/d23/d25/d2a/d5c/f103 0 2024-09-16T00:50:22.200 INFO:tasks.workunit.client.0.smithi053.stdout:6/321: symlink d1/dc/d3d/l72 0 2024-09-16T00:50:22.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/799: creat dc/d10/ffc x:0 0 0 2024-09-16T00:50:22.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/800: fdatasync dc/d10/d17/f26 0 2024-09-16T00:50:22.203 INFO:tasks.workunit.client.0.smithi053.stdout:8/454: rename d10/d1c/d2b/d40/f8a to d10/d52/f9c 0 2024-09-16T00:50:22.204 INFO:tasks.workunit.client.1.smithi152.stdout:6/863: sync 2024-09-16T00:50:22.205 INFO:tasks.workunit.client.1.smithi152.stdout:9/827: link d1/d59/l8e d1/d7/l108 0 2024-09-16T00:50:22.206 INFO:tasks.workunit.client.1.smithi152.stdout:6/864: dread db/d12/d23/d4a/d43/d48/d64/dab/feb [0,4194304] 0 2024-09-16T00:50:22.206 INFO:tasks.workunit.client.1.smithi152.stdout:7/849: rename d9/l2e to d9/d31/d64/d3c/d5b/dd0/l126 0 2024-09-16T00:50:22.206 INFO:tasks.workunit.client.1.smithi152.stdout:7/850: fdatasync f3 0 2024-09-16T00:50:22.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/828: write d1/d4e/d48/d26/d30/f3f [3841660,52998] 0 2024-09-16T00:50:22.223 INFO:tasks.workunit.client.1.smithi152.stdout:7/851: dwrite d9/d31/d64/d3c/f8b [0,4194304] 0 2024-09-16T00:50:22.264 INFO:tasks.workunit.client.0.smithi053.stdout:0/425: sync 2024-09-16T00:50:22.264 INFO:tasks.workunit.client.0.smithi053.stdout:1/351: sync 2024-09-16T00:50:22.283 INFO:tasks.workunit.client.0.smithi053.stdout:4/271: creat d0/d2/dd/d25/d41/f64 x:0 0 0 2024-09-16T00:50:22.283 INFO:tasks.workunit.client.0.smithi053.stdout:4/272: dread - d0/d3c/f5c zero size 2024-09-16T00:50:22.284 INFO:tasks.workunit.client.1.smithi152.stdout:5/976: mknod d6/d57/ddc/d11a/c160 0 2024-09-16T00:50:22.284 INFO:tasks.workunit.client.1.smithi152.stdout:8/668: mkdir dd/d98/db8/dcf/d88/dd8/de0 0 2024-09-16T00:50:22.286 INFO:tasks.workunit.client.0.smithi053.stdout:6/322: rename d1/dc/d1e/f5f to d1/dc/d3c/d4b/f73 0 2024-09-16T00:50:22.286 INFO:tasks.workunit.client.0.smithi053.stdout:6/323: write d1/f4f [2620536,47667] 0 2024-09-16T00:50:22.286 INFO:tasks.workunit.client.0.smithi053.stdout:6/324: write d1/dc/d3c/d4b/f73 [195152,51842] 0 2024-09-16T00:50:22.286 INFO:tasks.workunit.client.1.smithi152.stdout:4/959: getdents d2/db/d39/d3c/d7f 0 2024-09-16T00:50:22.288 INFO:tasks.workunit.client.0.smithi053.stdout:1/352: link d5/d18/d1f/f35 d5/d7/f76 0 2024-09-16T00:50:22.288 INFO:tasks.workunit.client.0.smithi053.stdout:1/353: chown d5/dd/f6f 8 1 2024-09-16T00:50:22.288 INFO:tasks.workunit.client.0.smithi053.stdout:0/426: symlink d4/dc/d25/d34/d2a/l89 0 2024-09-16T00:50:22.289 INFO:tasks.workunit.client.1.smithi152.stdout:3/801: truncate dc/d10/d17/d5a/d68/da5/df0/ff5 2931581 0 2024-09-16T00:50:22.290 INFO:tasks.workunit.client.0.smithi053.stdout:9/407: symlink d8/d13/l8c 0 2024-09-16T00:50:22.291 INFO:tasks.workunit.client.0.smithi053.stdout:9/408: dread d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:22.292 INFO:tasks.workunit.client.0.smithi053.stdout:9/409: chown d8/d1c/d2b/d2c/f48 0 1 2024-09-16T00:50:22.295 INFO:tasks.workunit.client.0.smithi053.stdout:6/325: chown d1/l3 1933 1 2024-09-16T00:50:22.295 INFO:tasks.workunit.client.0.smithi053.stdout:6/326: write d1/dc/d3d/f55 [2086028,38339] 0 2024-09-16T00:50:22.296 INFO:tasks.workunit.client.0.smithi053.stdout:1/354: unlink d5/d9/d4c/d61/f37 0 2024-09-16T00:50:22.298 INFO:tasks.workunit.client.1.smithi152.stdout:6/865: symlink db/d12/d23/d4a/d43/d48/l114 0 2024-09-16T00:50:22.298 INFO:tasks.workunit.client.1.smithi152.stdout:6/866: stat db/d28/fd6 0 2024-09-16T00:50:22.298 INFO:tasks.workunit.client.1.smithi152.stdout:6/867: write db/d12/d20/d86/d91/fbd [493117,70287] 0 2024-09-16T00:50:22.298 INFO:tasks.workunit.client.1.smithi152.stdout:6/868: chown db/d12/d23/d4a/d43/d48/d64/l98 6541555 1 2024-09-16T00:50:22.299 INFO:tasks.workunit.client.0.smithi053.stdout:0/427: symlink d4/dc/d25/d34/d2a/d27/l8a 0 2024-09-16T00:50:22.301 INFO:tasks.workunit.client.1.smithi152.stdout:2/762: rename d4/d44/f4e to d4/d44/d7a/d9e/f103 0 2024-09-16T00:50:22.303 INFO:tasks.workunit.client.0.smithi053.stdout:6/327: dread d1/f15 [0,4194304] 0 2024-09-16T00:50:22.304 INFO:tasks.workunit.client.0.smithi053.stdout:9/410: rmdir d8/d19/d51 39 2024-09-16T00:50:22.308 INFO:tasks.workunit.client.0.smithi053.stdout:4/273: getdents d0/d2/dd/d25/d41 0 2024-09-16T00:50:22.310 INFO:tasks.workunit.client.1.smithi152.stdout:4/960: dwrite d2/db/dce/fec [0,4194304] 0 2024-09-16T00:50:22.310 INFO:tasks.workunit.client.1.smithi152.stdout:7/852: mkdir d9/d10/da5/d127 0 2024-09-16T00:50:22.312 INFO:tasks.workunit.client.0.smithi053.stdout:6/328: mknod d1/dc/d66/c74 0 2024-09-16T00:50:22.312 INFO:tasks.workunit.client.1.smithi152.stdout:6/869: dread db/d12/d20/f7e [0,4194304] 0 2024-09-16T00:50:22.313 INFO:tasks.workunit.client.0.smithi053.stdout:4/274: write d0/d2/d1e/d4b/f36 [1138027,72704] 0 2024-09-16T00:50:22.313 INFO:tasks.workunit.client.1.smithi152.stdout:2/763: read d4/d44/d7a/dc7/fdf [279587,16899] 0 2024-09-16T00:50:22.314 INFO:tasks.workunit.client.1.smithi152.stdout:5/977: creat d6/d16/d1f/d6c/d125/d13b/f161 x:0 0 0 2024-09-16T00:50:22.316 INFO:tasks.workunit.client.0.smithi053.stdout:9/411: unlink d8/d4c/d5a/f6a 0 2024-09-16T00:50:22.316 INFO:tasks.workunit.client.0.smithi053.stdout:9/412: truncate d8/d22/f72 874726 0 2024-09-16T00:50:22.317 INFO:tasks.workunit.client.0.smithi053.stdout:9/413: dread - d8/d22/d26/f6f zero size 2024-09-16T00:50:22.317 INFO:tasks.workunit.client.0.smithi053.stdout:0/428: dread d4/d13/f1c [4194304,4194304] 0 2024-09-16T00:50:22.318 INFO:tasks.workunit.client.0.smithi053.stdout:0/429: write d4/dc/d1e/d1f/d40/f7b [35432,85154] 0 2024-09-16T00:50:22.318 INFO:tasks.workunit.client.0.smithi053.stdout:0/430: write d4/dc/d87/f60 [1353742,48306] 0 2024-09-16T00:50:22.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/669: creat dd/d25/fe1 x:0 0 0 2024-09-16T00:50:22.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/670: truncate dd/d25/da4/fc3 455283 0 2024-09-16T00:50:22.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/870: dread db/d12/d23/d4a/d43/d48/f4d [0,4194304] 0 2024-09-16T00:50:22.319 INFO:tasks.workunit.client.0.smithi053.stdout:1/355: mkdir d5/d9/d77 0 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 168 MiB/s rd, 209 MiB/s wr, 333 op/s 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:21 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/802: rmdir dc/d10/d17/d1c/d50/d55/d6d/dea 39 2024-09-16T00:50:22.321 INFO:tasks.workunit.client.1.smithi152.stdout:7/853: dread d9/f93 [0,4194304] 0 2024-09-16T00:50:22.323 INFO:tasks.workunit.client.0.smithi053.stdout:6/329: unlink d1/dc/f31 0 2024-09-16T00:50:22.323 INFO:tasks.workunit.client.0.smithi053.stdout:6/330: dread - d1/dc/d39/f56 zero size 2024-09-16T00:50:22.328 INFO:tasks.workunit.client.0.smithi053.stdout:0/431: dread d4/dc/d87/f5d [0,4194304] 0 2024-09-16T00:50:22.328 INFO:tasks.workunit.client.0.smithi053.stdout:0/432: readlink d4/dc/d87/l66 0 2024-09-16T00:50:22.328 INFO:tasks.workunit.client.1.smithi152.stdout:6/871: dread db/d12/d23/d4a/d43/d48/f5d [0,4194304] 0 2024-09-16T00:50:22.328 INFO:tasks.workunit.client.1.smithi152.stdout:0/813: rename d3/d6/d8/c37 to d3/d6/d2e/de9/df6/c112 0 2024-09-16T00:50:22.333 INFO:tasks.workunit.client.0.smithi053.stdout:9/414: fsync d8/d13/f29 0 2024-09-16T00:50:22.339 INFO:tasks.workunit.client.0.smithi053.stdout:6/331: mkdir d1/dc/d3c/d4b/d75 0 2024-09-16T00:50:22.341 INFO:tasks.workunit.client.1.smithi152.stdout:8/671: dwrite dd/d15/f18 [0,4194304] 0 2024-09-16T00:50:22.341 INFO:tasks.workunit.client.1.smithi152.stdout:8/672: fsync dd/f42 0 2024-09-16T00:50:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:4/961: rmdir d2/db/d39/d3c/d7f/ded 39 2024-09-16T00:50:22.343 INFO:tasks.workunit.client.1.smithi152.stdout:4/962: chown d2/d1e/d28/d69/cbc 300 1 2024-09-16T00:50:22.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/814: dwrite d3/d6/d8/d1d/d65/d6e/d82/f91 [4194304,4194304] 0 2024-09-16T00:50:22.347 INFO:tasks.workunit.client.1.smithi152.stdout:2/764: creat d4/f104 x:0 0 0 2024-09-16T00:50:22.351 INFO:tasks.workunit.client.1.smithi152.stdout:5/978: symlink d6/d16/d1f/d65/dd2/d123/d130/d149/l162 0 2024-09-16T00:50:22.351 INFO:tasks.workunit.client.1.smithi152.stdout:5/979: write d6/d16/d1f/f10b [851615,69655] 0 2024-09-16T00:50:22.353 INFO:tasks.workunit.client.0.smithi053.stdout:4/275: mkdir d0/d65 0 2024-09-16T00:50:22.353 INFO:tasks.workunit.client.0.smithi053.stdout:4/276: write d0/d2/dd/d25/f5b [927410,13266] 0 2024-09-16T00:50:22.354 INFO:tasks.workunit.client.1.smithi152.stdout:1/911: sync 2024-09-16T00:50:22.356 INFO:tasks.workunit.client.1.smithi152.stdout:7/854: mknod d9/d31/d65/d8a/d41/d46/c128 0 2024-09-16T00:50:22.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/855: write d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5/f111 [350666,92667] 0 2024-09-16T00:50:22.363 INFO:tasks.workunit.client.1.smithi152.stdout:3/803: rename dc/d10/d17/d5a/db2/d6f/d74/db5/de2/cec to dc/d10/d17/d1c/d50/d63/cfd 0 2024-09-16T00:50:22.363 INFO:tasks.workunit.client.1.smithi152.stdout:9/829: sync 2024-09-16T00:50:22.364 INFO:tasks.workunit.client.1.smithi152.stdout:2/765: dwrite d4/d44/d7a/dc7/de4/f4f [0,4194304] 0 2024-09-16T00:50:22.364 INFO:tasks.workunit.client.0.smithi053.stdout:9/415: creat d8/d1c/d2b/d49/f8d x:0 0 0 2024-09-16T00:50:22.364 INFO:tasks.workunit.client.0.smithi053.stdout:9/416: write d8/f5f [1307323,48534] 0 2024-09-16T00:50:22.366 INFO:tasks.workunit.client.0.smithi053.stdout:6/332: rmdir d1/dc/d3c/d4b 39 2024-09-16T00:50:22.367 INFO:tasks.workunit.client.0.smithi053.stdout:6/333: creat d1/dc/d45/f76 x:0 0 0 2024-09-16T00:50:22.367 INFO:tasks.workunit.client.1.smithi152.stdout:4/963: mknod d2/db/d39/d3c/d7f/c137 0 2024-09-16T00:50:22.369 INFO:tasks.workunit.client.0.smithi053.stdout:0/433: link d4/f17 d4/d13/f8b 0 2024-09-16T00:50:22.370 INFO:tasks.workunit.client.0.smithi053.stdout:0/434: write d4/dc/d1e/d22/f65 [787908,16705] 0 2024-09-16T00:50:22.373 INFO:tasks.workunit.client.0.smithi053.stdout:6/334: mknod d1/dc/d45/c77 0 2024-09-16T00:50:22.376 INFO:tasks.workunit.client.0.smithi053.stdout:4/277: dwrite d0/d2/dd/d25/d41/f64 [0,4194304] 0 2024-09-16T00:50:22.377 INFO:tasks.workunit.client.0.smithi053.stdout:6/335: truncate d1/f4f 1872889 0 2024-09-16T00:50:22.377 INFO:tasks.workunit.client.0.smithi053.stdout:6/336: stat d1/dc/d39/f1c 0 2024-09-16T00:50:22.377 INFO:tasks.workunit.client.0.smithi053.stdout:6/337: write d1/f57 [593138,72167] 0 2024-09-16T00:50:22.377 INFO:tasks.workunit.client.0.smithi053.stdout:6/338: dread - d1/dc/d39/f67 zero size 2024-09-16T00:50:22.379 INFO:tasks.workunit.client.1.smithi152.stdout:5/980: read - d6/d16/f12f zero size 2024-09-16T00:50:22.381 INFO:tasks.workunit.client.0.smithi053.stdout:0/435: rmdir d4/d5a 39 2024-09-16T00:50:22.381 INFO:tasks.workunit.client.0.smithi053.stdout:4/278: dread d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:22.382 INFO:tasks.workunit.client.1.smithi152.stdout:4/964: dread d2/d1e/d28/d69/f6d [0,4194304] 0 2024-09-16T00:50:22.382 INFO:tasks.workunit.client.1.smithi152.stdout:4/965: truncate d2/d1e/d28/d69/f105 1181795 0 2024-09-16T00:50:22.384 INFO:tasks.workunit.client.1.smithi152.stdout:1/912: mkdir d9/d3e/d41/d31/d48/d4a/d114/d14f 0 2024-09-16T00:50:22.384 INFO:tasks.workunit.client.1.smithi152.stdout:2/766: dread d4/d44/d7a/dc7/de4/d20/d28/f50 [4194304,4194304] 0 2024-09-16T00:50:22.388 INFO:tasks.workunit.client.1.smithi152.stdout:7/856: unlink d9/d31/d65/f10f 0 2024-09-16T00:50:22.389 INFO:tasks.workunit.client.1.smithi152.stdout:5/981: dread d6/d57/d2b/f6b [0,4194304] 0 2024-09-16T00:50:22.392 INFO:tasks.workunit.client.1.smithi152.stdout:6/872: rename db/d12/d23/d3a/l62 to db/d12/d20/l115 0 2024-09-16T00:50:22.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/982: dread d6/d57/d2b/d50/d64/fa4 [0,4194304] 0 2024-09-16T00:50:22.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/983: readlink d6/d57/ddc/d11a/d11f/l143 0 2024-09-16T00:50:22.392 INFO:tasks.workunit.client.1.smithi152.stdout:6/873: write db/d12/d23/d4a/d43/d48/f9e [891044,110881] 0 2024-09-16T00:50:22.393 INFO:tasks.workunit.client.0.smithi053.stdout:6/339: truncate d1/dc/d39/f2c 1027531 0 2024-09-16T00:50:22.394 INFO:tasks.workunit.client.1.smithi152.stdout:3/804: rmdir dc/d10/d17/d5a/db2/d6f/dbb 39 2024-09-16T00:50:22.395 INFO:tasks.workunit.client.0.smithi053.stdout:9/417: dwrite f4 [4194304,4194304] 0 2024-09-16T00:50:22.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/830: dwrite d1/d7/d77/f43 [0,4194304] 0 2024-09-16T00:50:22.396 INFO:tasks.workunit.client.0.smithi053.stdout:0/436: creat d4/dc/d25/d34/d71/f8c x:0 0 0 2024-09-16T00:50:22.398 INFO:tasks.workunit.client.1.smithi152.stdout:8/673: rmdir dd/d15/d9b 39 2024-09-16T00:50:22.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/966: mknod d2/d8e/dc9/c138 0 2024-09-16T00:50:22.403 INFO:tasks.workunit.client.1.smithi152.stdout:1/913: creat d9/da/df/f150 x:0 0 0 2024-09-16T00:50:22.406 INFO:tasks.workunit.client.0.smithi053.stdout:9/418: rename d8/d19/d51/c65 to d8/d4c/c8e 0 2024-09-16T00:50:22.406 INFO:tasks.workunit.client.0.smithi053.stdout:7/367: sync 2024-09-16T00:50:22.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/767: symlink d4/d44/df6/d3e/l105 0 2024-09-16T00:50:22.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/768: fsync d4/d44/d7a/dc7/de4/d94/d93/da4/ff4 0 2024-09-16T00:50:22.408 INFO:tasks.workunit.client.0.smithi053.stdout:0/437: dread d4/dc/d25/f5f [0,4194304] 0 2024-09-16T00:50:22.408 INFO:tasks.workunit.client.0.smithi053.stdout:0/438: write d4/dc/d1e/d1f/d40/f62 [3455141,27789] 0 2024-09-16T00:50:22.408 INFO:tasks.workunit.client.0.smithi053.stdout:0/439: creat d4/dc/d1e/d1f/d40/f8d x:0 0 0 2024-09-16T00:50:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:8/674: dread dd/d23/f3e [0,4194304] 0 2024-09-16T00:50:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:8/675: readlink dd/d98/db8/dcf/d29/d2f/db6/ld5 0 2024-09-16T00:50:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:4/967: dread d2/d1e/d28/d69/f8f [0,4194304] 0 2024-09-16T00:50:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/857: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/d129 0 2024-09-16T00:50:22.414 INFO:tasks.workunit.client.0.smithi053.stdout:6/340: mknod d1/c78 0 2024-09-16T00:50:22.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/984: symlink d6/d16/d10d/d10e/d15b/l163 0 2024-09-16T00:50:22.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/985: truncate d6/fa2 478339 0 2024-09-16T00:50:22.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/986: chown d6/d57/ddc/d11a/d11f 1669642 1 2024-09-16T00:50:22.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/987: chown d6/c11 363786546 1 2024-09-16T00:50:22.415 INFO:tasks.workunit.client.1.smithi152.stdout:6/874: truncate db/d12/d23/d4a/d43/d59/fe6 2063221 0 2024-09-16T00:50:22.416 INFO:tasks.workunit.client.1.smithi152.stdout:3/805: mknod dc/d10/d17/d1c/d50/cfe 0 2024-09-16T00:50:22.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/831: creat d1/d4e/d48/d2b/d93/d96/dd1/f109 x:0 0 0 2024-09-16T00:50:22.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/832: creat d1/d4e/d48/f10a x:0 0 0 2024-09-16T00:50:22.421 INFO:tasks.workunit.client.0.smithi053.stdout:9/419: rename d8/f5f to d8/d1c/d2b/d8b/f8f 0 2024-09-16T00:50:22.422 INFO:tasks.workunit.client.1.smithi152.stdout:9/833: dread d1/d4e/f67 [0,4194304] 0 2024-09-16T00:50:22.423 INFO:tasks.workunit.client.1.smithi152.stdout:1/914: link d9/d3e/d41/d31/d48/d4a/c6f d9/d3e/d4b/d6b/d6d/d99/c151 0 2024-09-16T00:50:22.423 INFO:tasks.workunit.client.1.smithi152.stdout:5/988: dread d6/d16/d1f/f22 [0,4194304] 0 2024-09-16T00:50:22.424 INFO:tasks.workunit.client.0.smithi053.stdout:7/368: mkdir d1/d2a/d83/d84 0 2024-09-16T00:50:22.424 INFO:tasks.workunit.client.0.smithi053.stdout:7/369: stat d1/d60/d77/d50 0 2024-09-16T00:50:22.424 INFO:tasks.workunit.client.0.smithi053.stdout:7/370: fsync d1/d3/f1f 0 2024-09-16T00:50:22.425 INFO:tasks.workunit.client.1.smithi152.stdout:6/875: dread f9 [0,4194304] 0 2024-09-16T00:50:22.425 INFO:tasks.workunit.client.1.smithi152.stdout:8/676: dwrite dd/f4c [0,4194304] 0 2024-09-16T00:50:22.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/968: mkdir d2/db/d39/d95/d139 0 2024-09-16T00:50:22.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/969: creat d2/d1e/d28/d69/f13a x:0 0 0 2024-09-16T00:50:22.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/970: chown d2/db/cff 17011628 1 2024-09-16T00:50:22.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/971: stat d2/db/d39/d3c/d76/db8 0 2024-09-16T00:50:22.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/972: write d2/d1e/d28/d7b/f110 [469179,22185] 0 2024-09-16T00:50:22.428 INFO:tasks.workunit.client.0.smithi053.stdout:6/341: symlink d1/dc/d1e/d65/l79 0 2024-09-16T00:50:22.428 INFO:tasks.workunit.client.0.smithi053.stdout:6/342: fsync d1/dc/d39/f34 0 2024-09-16T00:50:22.428 INFO:tasks.workunit.client.0.smithi053.stdout:6/343: creat d1/dc/d1e/f7a x:0 0 0 2024-09-16T00:50:22.428 INFO:tasks.workunit.client.0.smithi053.stdout:6/344: creat d1/dc/d3d/f7b x:0 0 0 2024-09-16T00:50:22.430 INFO:tasks.workunit.client.1.smithi152.stdout:7/858: mkdir d9/d31/d64/d3c/d5b/dd0/d12a 0 2024-09-16T00:50:22.432 INFO:tasks.workunit.client.1.smithi152.stdout:3/806: link dc/d10/d17/d5a/db2/d6f/dbb/lf8 dc/d10/d17/d1c/d50/daa/dee/lff 0 2024-09-16T00:50:22.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/440: rename d4/dc/f14 to d4/dc/d1e/d1f/d40/d73/f8e 0 2024-09-16T00:50:22.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/441: chown d4/f30 21 1 2024-09-16T00:50:22.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/442: creat d4/dc/d25/d34/f8f x:0 0 0 2024-09-16T00:50:22.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/443: chown d4/dc/d87/f50 212598989 1 2024-09-16T00:50:22.436 INFO:tasks.workunit.client.0.smithi053.stdout:9/420: getdents d8/d1c 0 2024-09-16T00:50:22.438 INFO:tasks.workunit.client.1.smithi152.stdout:9/834: symlink d1/d4e/d48/d26/d30/d4f/dcb/l10b 0 2024-09-16T00:50:22.439 INFO:tasks.workunit.client.1.smithi152.stdout:7/859: write d9/d31/d64/d3c/f8b [721797,14948] 0 2024-09-16T00:50:22.440 INFO:tasks.workunit.client.0.smithi053.stdout:7/371: mkdir d1/d3/d85 0 2024-09-16T00:50:22.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/915: mknod d9/d3e/d41/d31/d48/d4a/c152 0 2024-09-16T00:50:22.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 168 MiB/s rd, 209 MiB/s wr, 333 op/s 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:21 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:22.448 INFO:tasks.workunit.client.1.smithi152.stdout:1/916: dread d9/d3e/d41/d31/d48/d7d/fbb [0,4194304] 0 2024-09-16T00:50:22.448 INFO:tasks.workunit.client.1.smithi152.stdout:1/917: creat d9/d3e/d4b/d50/d115/f153 x:0 0 0 2024-09-16T00:50:22.449 INFO:tasks.workunit.client.0.smithi053.stdout:6/345: unlink d1/f4f 0 2024-09-16T00:50:22.450 INFO:tasks.workunit.client.1.smithi152.stdout:5/989: read d6/d57/ddc/fea [2704,75903] 0 2024-09-16T00:50:22.452 INFO:tasks.workunit.client.0.smithi053.stdout:7/372: dread d1/d35/d14/f41 [0,4194304] 0 2024-09-16T00:50:22.452 INFO:tasks.workunit.client.0.smithi053.stdout:0/444: getdents d4/d13 0 2024-09-16T00:50:22.453 INFO:tasks.workunit.client.0.smithi053.stdout:0/445: dread - d4/d5a/d68/f75 zero size 2024-09-16T00:50:22.454 INFO:tasks.workunit.client.0.smithi053.stdout:6/346: mknod d1/c7c 0 2024-09-16T00:50:22.455 INFO:tasks.workunit.client.1.smithi152.stdout:4/973: creat d2/d8e/d12f/f13b x:0 0 0 2024-09-16T00:50:22.455 INFO:tasks.workunit.client.1.smithi152.stdout:2/769: dwrite d4/d44/df6/f41 [4194304,4194304] 0 2024-09-16T00:50:22.455 INFO:tasks.workunit.client.1.smithi152.stdout:6/876: dwrite db/d12/d1c/fae [0,4194304] 0 2024-09-16T00:50:22.456 INFO:tasks.workunit.client.0.smithi053.stdout:9/421: dwrite d8/d1c/d2b/d49/f8d [0,4194304] 0 2024-09-16T00:50:22.457 INFO:tasks.workunit.client.1.smithi152.stdout:3/807: mkdir dc/d10/d17/d5a/d68/da5/df0/d100 0 2024-09-16T00:50:22.459 INFO:tasks.workunit.client.0.smithi053.stdout:0/446: symlink d4/d5a/d82/l90 0 2024-09-16T00:50:22.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/835: truncate d1/d7/d13/d80/fe8 49768 0 2024-09-16T00:50:22.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/836: read - d1/d7/d77/d3c/dc9/fe3 zero size 2024-09-16T00:50:22.465 INFO:tasks.workunit.client.0.smithi053.stdout:6/347: write d1/dc/d3c/d4a/f53 [3603305,92643] 0 2024-09-16T00:50:22.465 INFO:tasks.workunit.client.0.smithi053.stdout:6/348: stat d1/dc/d1e/d65/l79 0 2024-09-16T00:50:22.465 INFO:tasks.workunit.client.0.smithi053.stdout:7/373: rename d1/d35/d5b/c63 to d1/d2a/d4f/d52/c86 0 2024-09-16T00:50:22.468 INFO:tasks.workunit.client.1.smithi152.stdout:5/990: dwrite d6/d57/d2b/d50/d64/df5/d10a/f144 [0,4194304] 0 2024-09-16T00:50:22.470 INFO:tasks.workunit.client.1.smithi152.stdout:3/808: write f6 [768611,55929] 0 2024-09-16T00:50:22.473 INFO:tasks.workunit.client.1.smithi152.stdout:7/860: rename d9/d31/d64/d3c/f42 to d9/d31/d65/d8a/d90/f12b 0 2024-09-16T00:50:22.479 INFO:tasks.workunit.client.0.smithi053.stdout:9/422: mknod d8/d1c/d2b/d8b/c90 0 2024-09-16T00:50:22.480 INFO:tasks.workunit.client.1.smithi152.stdout:1/918: mknod d9/d3e/d4b/d6b/d6d/d99/c154 0 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:5/283: sync 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:2/321: sync 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:2/322: chown f5 1442 1 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:2/323: write d6/d9/dd/d3e/f4b [1033987,77389] 0 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:2/324: write d6/d9/d14/f37 [5157388,92483] 0 2024-09-16T00:50:22.481 INFO:tasks.workunit.client.0.smithi053.stdout:2/325: chown d6/d9/dd/d3e/f42 0 1 2024-09-16T00:50:22.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/677: getdents dd/d15/d1a 0 2024-09-16T00:50:22.486 INFO:tasks.workunit.client.0.smithi053.stdout:0/447: dwrite d4/dc/d1e/d1f/d40/f62 [4194304,4194304] 0 2024-09-16T00:50:22.487 INFO:tasks.workunit.client.0.smithi053.stdout:5/284: link d3/f2c d3/d7/d42/d57/f61 0 2024-09-16T00:50:22.489 INFO:tasks.workunit.client.0.smithi053.stdout:6/349: dwrite d1/dc/d1e/d41/f69 [0,4194304] 0 2024-09-16T00:50:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:5/991: dwrite d6/d57/d54/d12c/f13e [4194304,4194304] 0 2024-09-16T00:50:22.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/974: mkdir d2/db/d39/d95/d13c 0 2024-09-16T00:50:22.494 INFO:tasks.workunit.client.0.smithi053.stdout:0/448: link d4/dc/d25/d34/d2a/l80 d4/dc/d1e/d1f/d40/l91 0 2024-09-16T00:50:22.496 INFO:tasks.workunit.client.1.smithi152.stdout:2/770: creat d4/d44/d7a/dc7/de4/d94/d8f/f106 x:0 0 0 2024-09-16T00:50:22.500 INFO:tasks.workunit.client.0.smithi053.stdout:5/285: dread d3/f13 [0,4194304] 0 2024-09-16T00:50:22.502 INFO:tasks.workunit.client.0.smithi053.stdout:6/350: rename d1/dc/d39/f2e to d1/d2f/f7d 0 2024-09-16T00:50:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:6/877: mkdir db/d12/d23/d4a/d43/d48/d6a/d116 0 2024-09-16T00:50:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:6/878: write db/da8/db7/fd2 [996775,107827] 0 2024-09-16T00:50:22.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/449: truncate d4/d13/f4f 2138636 0 2024-09-16T00:50:22.505 INFO:tasks.workunit.client.1.smithi152.stdout:9/837: mknod d1/d4e/d48/d26/c10c 0 2024-09-16T00:50:22.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/879: dread db/d12/d1c/f89 [0,4194304] 0 2024-09-16T00:50:22.506 INFO:tasks.workunit.client.0.smithi053.stdout:5/286: getdents d3/d7/d2b/d4b/d4f 0 2024-09-16T00:50:22.506 INFO:tasks.workunit.client.0.smithi053.stdout:5/287: chown d3/f27 19 1 2024-09-16T00:50:22.506 INFO:tasks.workunit.client.1.smithi152.stdout:0/815: sync 2024-09-16T00:50:22.506 INFO:tasks.workunit.client.1.smithi152.stdout:0/816: write d3/d6/d2e/d58/f78 [7198784,71113] 0 2024-09-16T00:50:22.508 INFO:tasks.workunit.client.0.smithi053.stdout:9/423: dwrite d8/f17 [0,4194304] 0 2024-09-16T00:50:22.509 INFO:tasks.workunit.client.1.smithi152.stdout:9/838: dread d1/fcd [0,4194304] 0 2024-09-16T00:50:22.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/817: dread d3/d6/d6d/db7/fc0 [0,4194304] 0 2024-09-16T00:50:22.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/818: write d3/d6/f1e [1179719,26290] 0 2024-09-16T00:50:22.511 INFO:tasks.workunit.client.0.smithi053.stdout:6/351: truncate d1/dc/d45/f59 1723530 0 2024-09-16T00:50:22.513 INFO:tasks.workunit.client.0.smithi053.stdout:2/326: dwrite d6/f8 [0,4194304] 0 2024-09-16T00:50:22.514 INFO:tasks.workunit.client.0.smithi053.stdout:0/450: symlink d4/d5a/d68/l92 0 2024-09-16T00:50:22.515 INFO:tasks.workunit.client.1.smithi152.stdout:3/809: getdents dc/d10/d17/d5a/db2 0 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/288: mknod d3/d7/d24/d34/d5b/c62 0 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/289: stat d3/d7/d2b/d4b 0 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/290: write d3/f2d [1721021,27279] 0 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/291: chown d3/d7/d2b/d37/d58/f38 998181 1 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/292: fsync d3/d7/d24/d3f/f5e 0 2024-09-16T00:50:22.517 INFO:tasks.workunit.client.0.smithi053.stdout:5/293: chown d3/d7 9370077 1 2024-09-16T00:50:22.518 INFO:tasks.workunit.client.1.smithi152.stdout:7/861: creat d9/d31/d64/d3c/d5b/dd0/d12a/f12c x:0 0 0 2024-09-16T00:50:22.519 INFO:tasks.workunit.client.0.smithi053.stdout:9/424: truncate f4 2504069 0 2024-09-16T00:50:22.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/919: mkdir d9/d3e/d4b/d50/d115/d144/d155 0 2024-09-16T00:50:22.523 INFO:tasks.workunit.client.0.smithi053.stdout:6/352: creat d1/dc/d1e/d41/f7e x:0 0 0 2024-09-16T00:50:22.524 INFO:tasks.workunit.client.1.smithi152.stdout:8/678: mkdir dd/d98/db8/dcf/d29/dc6/de2 0 2024-09-16T00:50:22.525 INFO:tasks.workunit.client.0.smithi053.stdout:5/294: dread d3/d7/f1f [0,4194304] 0 2024-09-16T00:50:22.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/839: dwrite d1/d4e/d48/d2b/d93/d96/fab [4194304,4194304] 0 2024-09-16T00:50:22.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/840: write d1/d4e/d48/d26/d30/f3f [2719090,9813] 0 2024-09-16T00:50:22.529 INFO:tasks.workunit.client.0.smithi053.stdout:0/451: getdents d4/dc/d87 0 2024-09-16T00:50:22.530 INFO:tasks.workunit.client.1.smithi152.stdout:5/992: creat d6/d16/d1f/db5/dd3/f164 x:0 0 0 2024-09-16T00:50:22.531 INFO:tasks.workunit.client.0.smithi053.stdout:9/425: creat d8/d4c/d5b/f91 x:0 0 0 2024-09-16T00:50:22.532 INFO:tasks.workunit.client.1.smithi152.stdout:4/975: mknod d2/db/d39/d95/d139/c13d 0 2024-09-16T00:50:22.533 INFO:tasks.workunit.client.0.smithi053.stdout:6/353: symlink d1/dc/d39/l7f 0 2024-09-16T00:50:22.535 INFO:tasks.workunit.client.0.smithi053.stdout:2/327: getdents d6/d9/dd 0 2024-09-16T00:50:22.535 INFO:tasks.workunit.client.1.smithi152.stdout:1/920: write d9/d3e/d7b/df0/d107/f8a [1294371,130361] 0 2024-09-16T00:50:22.537 INFO:tasks.workunit.client.1.smithi152.stdout:0/819: rename d3/c33 to d3/d6/d8/d1d/d23/d25/c113 0 2024-09-16T00:50:22.537 INFO:tasks.workunit.client.0.smithi053.stdout:9/426: symlink d8/d22/l92 0 2024-09-16T00:50:22.538 INFO:tasks.workunit.client.1.smithi152.stdout:0/820: write d3/d6/d64/f6c [1019295,77897] 0 2024-09-16T00:50:22.539 INFO:tasks.workunit.client.1.smithi152.stdout:8/679: dread dd/d15/d49/f6f [0,4194304] 0 2024-09-16T00:50:22.548 INFO:tasks.workunit.client.0.smithi053.stdout:6/354: mknod d1/dc/d1e/d41/c80 0 2024-09-16T00:50:22.548 INFO:tasks.workunit.client.0.smithi053.stdout:6/355: chown d1/dc/d3d/l5e 55 1 2024-09-16T00:50:22.551 INFO:tasks.workunit.client.0.smithi053.stdout:2/328: mknod d6/d29/d2b/c54 0 2024-09-16T00:50:22.556 INFO:tasks.workunit.client.0.smithi053.stdout:6/356: readlink d1/l24 0 2024-09-16T00:50:22.559 INFO:tasks.workunit.client.0.smithi053.stdout:6/357: mkdir d1/dc/d1e/d65/d81 0 2024-09-16T00:50:22.559 INFO:tasks.workunit.client.0.smithi053.stdout:6/358: creat d1/dc/d3c/f82 x:0 0 0 2024-09-16T00:50:22.560 INFO:tasks.workunit.client.1.smithi152.stdout:7/862: symlink d9/d31/d64/d3c/db9/l12d 0 2024-09-16T00:50:22.561 INFO:tasks.workunit.client.1.smithi152.stdout:7/863: stat d9/d31/d65/d8a/lcc 0 2024-09-16T00:50:22.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/452: dwrite d4/f4b [0,4194304] 0 2024-09-16T00:50:22.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/453: fdatasync d4/dc/d25/d34/d2a/d27/f33 0 2024-09-16T00:50:22.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/454: dread - d4/dc/d25/d34/f7f zero size 2024-09-16T00:50:22.564 INFO:tasks.workunit.client.0.smithi053.stdout:6/359: creat d1/dc/d43/f83 x:0 0 0 2024-09-16T00:50:22.564 INFO:tasks.workunit.client.0.smithi053.stdout:6/360: stat d1/dc/d3c/d4a/l63 0 2024-09-16T00:50:22.564 INFO:tasks.workunit.client.0.smithi053.stdout:6/361: stat d1/dc/d3d/c50 0 2024-09-16T00:50:22.565 INFO:tasks.workunit.client.1.smithi152.stdout:9/841: symlink d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/l10d 0 2024-09-16T00:50:22.567 INFO:tasks.workunit.client.1.smithi152.stdout:2/771: write d4/d44/d7a/dc7/de4/d20/d28/f81 [418279,41331] 0 2024-09-16T00:50:22.568 INFO:tasks.workunit.client.1.smithi152.stdout:2/772: truncate d4/f104 273212 0 2024-09-16T00:50:22.568 INFO:tasks.workunit.client.1.smithi152.stdout:2/773: chown d4/d44/d7a/dc7/de4/d20/d34/c4c 75770 1 2024-09-16T00:50:22.568 INFO:tasks.workunit.client.1.smithi152.stdout:5/993: mknod d6/d16/d10d/d10e/c165 0 2024-09-16T00:50:22.568 INFO:tasks.workunit.client.1.smithi152.stdout:5/994: fdatasync d6/f40 0 2024-09-16T00:50:22.570 INFO:tasks.workunit.client.1.smithi152.stdout:4/976: link d2/db/d39/d3c/d76/db4/fc3 d2/db/d39/d3c/d76/db8/f13e 0 2024-09-16T00:50:22.570 INFO:tasks.workunit.client.1.smithi152.stdout:4/977: chown d2/d1e/d28/d69/cdd 3 1 2024-09-16T00:50:22.570 INFO:tasks.workunit.client.1.smithi152.stdout:9/842: dread d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:22.571 INFO:tasks.workunit.client.1.smithi152.stdout:9/843: readlink d1/d4e/d48/d26/d58/la1 0 2024-09-16T00:50:22.571 INFO:tasks.workunit.client.1.smithi152.stdout:9/844: creat d1/d7/d77/d3c/dc9/f10e x:0 0 0 2024-09-16T00:50:22.571 INFO:tasks.workunit.client.0.smithi053.stdout:6/362: creat d1/dc/d1e/d65/d81/f84 x:0 0 0 2024-09-16T00:50:22.571 INFO:tasks.workunit.client.0.smithi053.stdout:6/363: dread - d1/dc/d3c/f82 zero size 2024-09-16T00:50:22.571 INFO:tasks.workunit.client.0.smithi053.stdout:6/364: write d1/dc/d3c/d4a/f53 [315251,13021] 0 2024-09-16T00:50:22.573 INFO:tasks.workunit.client.1.smithi152.stdout:1/921: creat d9/da/df/f156 x:0 0 0 2024-09-16T00:50:22.575 INFO:tasks.workunit.client.1.smithi152.stdout:8/680: creat dd/d23/fe3 x:0 0 0 2024-09-16T00:50:22.575 INFO:tasks.workunit.client.1.smithi152.stdout:8/681: write dd/d98/db8/dcf/d88/fbc [69300,30676] 0 2024-09-16T00:50:22.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/821: dwrite d3/d6/d8/f40 [4194304,4194304] 0 2024-09-16T00:50:22.576 INFO:tasks.workunit.client.0.smithi053.stdout:9/427: dwrite d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:22.576 INFO:tasks.workunit.client.0.smithi053.stdout:2/329: dwrite d6/f2c [4194304,4194304] 0 2024-09-16T00:50:22.577 INFO:tasks.workunit.client.1.smithi152.stdout:7/864: mknod d9/d31/d64/d3c/db9/dd3/d100/c12e 0 2024-09-16T00:50:22.584 INFO:tasks.workunit.client.1.smithi152.stdout:2/774: read d4/d44/d7a/f7e [1472198,49317] 0 2024-09-16T00:50:22.584 INFO:tasks.workunit.client.1.smithi152.stdout:5/995: truncate d6/d57/d54/f90 147658 0 2024-09-16T00:50:22.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/865: write d9/d31/d65/f59 [2130485,11835] 0 2024-09-16T00:50:22.587 INFO:tasks.workunit.client.1.smithi152.stdout:7/866: readlink d9/d31/d64/d3c/lc7 0 2024-09-16T00:50:22.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/978: creat d2/db/d39/d3c/d7f/d98/def/d10f/f13f x:0 0 0 2024-09-16T00:50:22.591 INFO:tasks.workunit.client.0.smithi053.stdout:2/330: symlink d6/d9/dd/d28/l55 0 2024-09-16T00:50:22.591 INFO:tasks.workunit.client.0.smithi053.stdout:2/331: fsync d6/f8 0 2024-09-16T00:50:22.591 INFO:tasks.workunit.client.0.smithi053.stdout:2/332: stat d6/d29/d2b/d39 0 2024-09-16T00:50:22.591 INFO:tasks.workunit.client.0.smithi053.stdout:2/333: creat d6/d9/f56 x:0 0 0 2024-09-16T00:50:22.591 INFO:tasks.workunit.client.0.smithi053.stdout:2/334: chown d6/f2c 63 1 2024-09-16T00:50:22.594 INFO:tasks.workunit.client.1.smithi152.stdout:9/845: rmdir d1/d4e/d34 39 2024-09-16T00:50:22.605 INFO:tasks.workunit.client.0.smithi053.stdout:2/335: truncate d6/d9/dd/f31 712641 0 2024-09-16T00:50:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:2/775: write d4/d44/d7a/dc7/de4/d94/fb3 [4096158,100457] 0 2024-09-16T00:50:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:5/996: rmdir d6/d57/ddc 39 2024-09-16T00:50:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:5/997: write d6/d16/d1f/f158 [495970,34228] 0 2024-09-16T00:50:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:5/998: readlink d6/d16/d1f/db5/lc9 0 2024-09-16T00:50:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:5/999: read d6/d16/d1f/f2e [728484,87362] 0 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.0.smithi053.stdout:2/336: rename d6/d9/dd/f1a to d6/d9/dd/d28/f57 0 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.0.smithi053.stdout:9/428: dwrite d8/d13/f8a [0,4194304] 0 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.0.smithi053.stdout:9/429: dread d8/d1c/d2b/d2c/f77 [0,4194304] 0 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.0.smithi053.stdout:9/430: chown d8/d1c/d2b/d2c/f60 43017 1 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.1.smithi152.stdout:8/682: dwrite dd/d98/db8/dcf/d88/dd8/fdf [0,4194304] 0 2024-09-16T00:50:22.608 INFO:tasks.workunit.client.1.smithi152.stdout:0/822: dwrite d3/d6/d8/d1d/d23/d25/fee [0,4194304] 0 2024-09-16T00:50:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:0/823: truncate d3/d6/d8/fc4 495114 0 2024-09-16T00:50:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:7/867: mknod d9/c12f 0 2024-09-16T00:50:22.609 INFO:tasks.workunit.client.0.smithi053.stdout:0/455: truncate d4/f4b 122134 0 2024-09-16T00:50:22.609 INFO:tasks.workunit.client.0.smithi053.stdout:0/456: chown d4/dc/d1e/d1f/d40 225 1 2024-09-16T00:50:22.610 INFO:tasks.workunit.client.1.smithi152.stdout:4/979: mkdir d2/db/d39/d3c/d76/db4/d140 0 2024-09-16T00:50:22.610 INFO:tasks.workunit.client.1.smithi152.stdout:4/980: truncate d2/d41/df1/f103 1033072 0 2024-09-16T00:50:22.613 INFO:tasks.workunit.client.0.smithi053.stdout:2/337: creat d6/d29/f58 x:0 0 0 2024-09-16T00:50:22.616 INFO:tasks.workunit.client.1.smithi152.stdout:9/846: symlink d1/d4e/d48/d2b/d7c/l10f 0 2024-09-16T00:50:22.618 INFO:tasks.workunit.client.0.smithi053.stdout:6/365: rmdir d1/dc/d1e 39 2024-09-16T00:50:22.618 INFO:tasks.workunit.client.1.smithi152.stdout:0/824: read d3/d6/d6d/f8f [6933802,51071] 0 2024-09-16T00:50:22.625 INFO:tasks.workunit.client.0.smithi053.stdout:9/431: creat d8/d1c/d2b/f93 x:0 0 0 2024-09-16T00:50:22.625 INFO:tasks.workunit.client.0.smithi053.stdout:9/432: read - d8/d4c/d5b/f91 zero size 2024-09-16T00:50:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/776: dwrite d4/d44/f48 [0,4194304] 0 2024-09-16T00:50:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/777: chown d4/d44/d7a/d9e/d87/dd8 8562212 1 2024-09-16T00:50:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/778: fsync d4/d44/d7a/dc7/de4/d94/d8f/fee 0 2024-09-16T00:50:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/779: write d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/ffa [67489,27165] 0 2024-09-16T00:50:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/780: chown d4/d44/d7a/dc7/de4/d20/l2e 405719 1 2024-09-16T00:50:22.627 INFO:tasks.workunit.client.1.smithi152.stdout:4/981: dwrite d2/d1e/d28/d69/fb5 [0,4194304] 0 2024-09-16T00:50:22.628 INFO:tasks.workunit.client.0.smithi053.stdout:0/457: rename d4/dc/d87/f5d to d4/d5a/d82/f93 0 2024-09-16T00:50:22.632 INFO:tasks.workunit.client.0.smithi053.stdout:2/338: link d6/f2c d6/d9/dd/d3e/f59 0 2024-09-16T00:50:22.634 INFO:tasks.workunit.client.0.smithi053.stdout:6/366: mknod d1/dc/d54/c85 0 2024-09-16T00:50:22.637 INFO:tasks.workunit.client.1.smithi152.stdout:8/683: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4 0 2024-09-16T00:50:22.637 INFO:tasks.workunit.client.0.smithi053.stdout:9/433: unlink d8/d1c/f1b 0 2024-09-16T00:50:22.637 INFO:tasks.workunit.client.0.smithi053.stdout:9/434: creat d8/d1c/d2b/d5c/f94 x:0 0 0 2024-09-16T00:50:22.641 INFO:tasks.workunit.client.0.smithi053.stdout:2/339: unlink d6/d29/d2b/c50 0 2024-09-16T00:50:22.643 INFO:tasks.workunit.client.0.smithi053.stdout:6/367: dread d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:22.645 INFO:tasks.workunit.client.1.smithi152.stdout:7/868: mkdir d9/d31/d65/d8a/d41/d130 0 2024-09-16T00:50:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:9/847: link d1/d7/d77/d32/da5/da8/cd4 d1/d4e/d48/d26/d58/c110 0 2024-09-16T00:50:22.652 INFO:tasks.workunit.client.0.smithi053.stdout:2/340: creat d6/d9/dd/f5a x:0 0 0 2024-09-16T00:50:22.652 INFO:tasks.workunit.client.0.smithi053.stdout:2/341: write d6/d9/dd/f5a [991756,104800] 0 2024-09-16T00:50:22.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/825: symlink d3/d6/d64/l114 0 2024-09-16T00:50:22.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/826: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/la6 61 1 2024-09-16T00:50:22.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/827: creat d3/d6/d8/d1d/d65/db0/df0/f115 x:0 0 0 2024-09-16T00:50:22.655 INFO:tasks.workunit.client.0.smithi053.stdout:6/368: creat d1/f86 x:0 0 0 2024-09-16T00:50:22.662 INFO:tasks.workunit.client.0.smithi053.stdout:6/369: truncate d1/dc/f3e 2714128 0 2024-09-16T00:50:22.662 INFO:tasks.workunit.client.0.smithi053.stdout:6/370: fsync d1/dc/d3d/f40 0 2024-09-16T00:50:22.665 INFO:tasks.workunit.client.0.smithi053.stdout:3/434: sync 2024-09-16T00:50:22.665 INFO:tasks.workunit.client.0.smithi053.stdout:3/435: readlink d1/d5/d16/d47/d4c/d50/l57 0 2024-09-16T00:50:22.665 INFO:tasks.workunit.client.0.smithi053.stdout:3/436: chown d1/d5/d16/d47/l56 0 1 2024-09-16T00:50:22.665 INFO:tasks.workunit.client.0.smithi053.stdout:3/437: chown d1/d5/d16/d5e/d79/d7f 1174585 1 2024-09-16T00:50:22.666 INFO:tasks.workunit.client.0.smithi053.stdout:2/342: rmdir d6/d9/d14 39 2024-09-16T00:50:22.666 INFO:tasks.workunit.client.0.smithi053.stdout:2/343: write d6/d9/f1d [8463472,32162] 0 2024-09-16T00:50:22.666 INFO:tasks.workunit.client.0.smithi053.stdout:8/455: sync 2024-09-16T00:50:22.668 INFO:tasks.workunit.client.0.smithi053.stdout:2/344: write d6/d9/f49 [386290,31138] 0 2024-09-16T00:50:22.668 INFO:tasks.workunit.client.0.smithi053.stdout:2/345: read - d6/d9/dd/d28/f3f zero size 2024-09-16T00:50:22.668 INFO:tasks.workunit.client.0.smithi053.stdout:2/346: truncate d6/d9/dd/f5a 1477542 0 2024-09-16T00:50:22.668 INFO:tasks.workunit.client.0.smithi053.stdout:2/347: write d6/d29/d2b/d39/f40 [937090,20959] 0 2024-09-16T00:50:22.668 INFO:tasks.workunit.client.0.smithi053.stdout:6/371: mknod d1/dc/d1e/d41/c87 0 2024-09-16T00:50:22.670 INFO:tasks.workunit.client.1.smithi152.stdout:2/781: dwrite d4/d44/d7a/dc7/de4/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:22.670 INFO:tasks.workunit.client.1.smithi152.stdout:2/782: truncate d4/d44/d7a/d9e/d66/f9a 951166 0 2024-09-16T00:50:22.671 INFO:tasks.workunit.client.0.smithi053.stdout:3/438: rename d1/d5/d16/d47/d4c/d50/l57 to d1/d5/d16/d5e/d69/l8b 0 2024-09-16T00:50:22.674 INFO:tasks.workunit.client.0.smithi053.stdout:8/456: mkdir d10/d1c/d92/d66/d9d 0 2024-09-16T00:50:22.675 INFO:tasks.workunit.client.0.smithi053.stdout:0/458: dwrite d4/d5a/f7e [0,4194304] 0 2024-09-16T00:50:22.678 INFO:tasks.workunit.client.0.smithi053.stdout:6/372: link d1/dc/d54/f64 d1/dc/d39/f88 0 2024-09-16T00:50:22.683 INFO:tasks.workunit.client.1.smithi152.stdout:8/684: dwrite dd/d98/db8/dcf/d88/dd8/fdf [0,4194304] 0 2024-09-16T00:50:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/685: write dd/f42 [5077472,998] 0 2024-09-16T00:50:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:7/869: dwrite d9/d31/d65/d8a/d41/d46/d7d/fb0 [0,4194304] 0 2024-09-16T00:50:22.684 INFO:tasks.workunit.client.0.smithi053.stdout:9/435: dwrite d8/d13/f20 [0,4194304] 0 2024-09-16T00:50:22.684 INFO:tasks.workunit.client.0.smithi053.stdout:9/436: chown d8/d13/l8c 3931 1 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/437: readlink d8/l18 0 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/438: read - d8/d1c/d2b/d5c/f94 zero size 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/439: chown d8/d22/l92 1 1 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/440: fdatasync d8/d4c/d5b/f91 0 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.0.smithi053.stdout:9/441: dread d8/f35 [0,4194304] 0 2024-09-16T00:50:22.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/982: link d2/d1e/c55 d2/db/d39/d3c/d11f/c141 0 2024-09-16T00:50:22.689 INFO:tasks.workunit.client.0.smithi053.stdout:0/459: dread d4/dc/d25/d34/d2a/f4e [4194304,4194304] 0 2024-09-16T00:50:22.695 INFO:tasks.workunit.client.0.smithi053.stdout:3/439: dwrite d1/f6d [4194304,4194304] 0 2024-09-16T00:50:22.696 INFO:tasks.workunit.client.0.smithi053.stdout:2/348: dwrite d6/d9/dd/d3e/f4b [0,4194304] 0 2024-09-16T00:50:22.696 INFO:tasks.workunit.client.0.smithi053.stdout:2/349: creat d6/d29/d2b/f5b x:0 0 0 2024-09-16T00:50:22.697 INFO:tasks.workunit.client.0.smithi053.stdout:6/373: dwrite d1/dc/d3d/f55 [0,4194304] 0 2024-09-16T00:50:22.697 INFO:tasks.workunit.client.0.smithi053.stdout:6/374: readlink d1/dc/d39/l19 0 2024-09-16T00:50:22.697 INFO:tasks.workunit.client.0.smithi053.stdout:6/375: dread - d1/dc/d54/f64 zero size 2024-09-16T00:50:22.697 INFO:tasks.workunit.client.1.smithi152.stdout:0/828: symlink d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/l116 0 2024-09-16T00:50:22.697 INFO:tasks.workunit.client.1.smithi152.stdout:0/829: truncate d3/d6/f1f 865779 0 2024-09-16T00:50:22.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/686: write dd/d25/da4/fcd [445911,18461] 0 2024-09-16T00:50:22.699 INFO:tasks.workunit.client.1.smithi152.stdout:2/783: mkdir d4/d44/d7a/dc7/d107 0 2024-09-16T00:50:22.708 INFO:tasks.workunit.client.1.smithi152.stdout:0/830: dread d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe4 [0,4194304] 0 2024-09-16T00:50:22.716 INFO:tasks.workunit.client.0.smithi053.stdout:9/442: rmdir d8/d19/d51 39 2024-09-16T00:50:22.719 INFO:tasks.workunit.client.1.smithi152.stdout:7/870: creat d9/d31/d65/d8a/d41/d46/d7d/de2/df0/d10a/f131 x:0 0 0 2024-09-16T00:50:22.720 INFO:tasks.workunit.client.1.smithi152.stdout:7/871: dread - d9/d31/ff5 zero size 2024-09-16T00:50:22.721 INFO:tasks.workunit.client.0.smithi053.stdout:8/457: mkdir d10/d9e 0 2024-09-16T00:50:22.722 INFO:tasks.workunit.client.1.smithi152.stdout:6/880: sync 2024-09-16T00:50:22.722 INFO:tasks.workunit.client.1.smithi152.stdout:6/881: chown db/d12/d23/d3a/c8c 7 1 2024-09-16T00:50:22.724 INFO:tasks.workunit.client.0.smithi053.stdout:0/460: creat d4/d5a/f94 x:0 0 0 2024-09-16T00:50:22.730 INFO:tasks.workunit.client.0.smithi053.stdout:3/440: truncate d1/d89/f71 861352 0 2024-09-16T00:50:22.730 INFO:tasks.workunit.client.0.smithi053.stdout:3/441: stat d1/d5/d11/d3a 0 2024-09-16T00:50:22.732 INFO:tasks.workunit.client.1.smithi152.stdout:8/687: rmdir dd/d98/db8/dcf/d88/dd8/de0 0 2024-09-16T00:50:22.735 INFO:tasks.workunit.client.0.smithi053.stdout:6/376: dwrite d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:22.735 INFO:tasks.workunit.client.0.smithi053.stdout:6/377: fsync d1/f86 0 2024-09-16T00:50:22.735 INFO:tasks.workunit.client.1.smithi152.stdout:7/872: dwrite d9/d31/fb5 [0,4194304] 0 2024-09-16T00:50:22.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/848: rename d1/d4e/d48/d26/d92 to d1/d4e/d48/d26/d30/d8f/dc4/d111 0 2024-09-16T00:50:22.744 INFO:tasks.workunit.client.1.smithi152.stdout:8/688: mknod dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4/ce5 0 2024-09-16T00:50:22.744 INFO:tasks.workunit.client.1.smithi152.stdout:7/873: write d9/d31/d65/d6b/f77 [1301656,25825] 0 2024-09-16T00:50:22.751 INFO:tasks.workunit.client.1.smithi152.stdout:9/849: dread d1/d4e/d48/d2b/f70 [0,4194304] 0 2024-09-16T00:50:22.753 INFO:tasks.workunit.client.1.smithi152.stdout:8/689: dread dd/d15/d49/f51 [0,4194304] 0 2024-09-16T00:50:22.755 INFO:tasks.workunit.client.1.smithi152.stdout:4/983: rename d2/db/d39/c27 to d2/d41/dd8/c142 0 2024-09-16T00:50:22.756 INFO:tasks.workunit.client.0.smithi053.stdout:8/458: getdents d10/d21/d28/d6f 0 2024-09-16T00:50:22.760 INFO:tasks.workunit.client.0.smithi053.stdout:0/461: mknod d4/dc/d25/d34/d2a/c95 0 2024-09-16T00:50:22.763 INFO:tasks.workunit.client.1.smithi152.stdout:7/874: creat d9/d10/f132 x:0 0 0 2024-09-16T00:50:22.765 INFO:tasks.workunit.client.1.smithi152.stdout:9/850: dread d1/d7/d77/d32/da5/da8/fac [0,4194304] 0 2024-09-16T00:50:22.768 INFO:tasks.workunit.client.1.smithi152.stdout:2/784: rename d4/d44/d7a/dc7/de4/d20/d28/f50 to d4/d44/d7a/d9e/d87/d9c/f108 0 2024-09-16T00:50:22.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/875: mkdir d9/d31/d64/d3c/d5b/dd0/d12a/d133 0 2024-09-16T00:50:22.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/876: chown d9/d31/d64/d3c/lb4 6 1 2024-09-16T00:50:22.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/877: chown d9/d31/d65/d8a/d41/d46/d7d/dac/fe9 62 1 2024-09-16T00:50:22.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/878: truncate d9/d31/d65/f59 4117278 0 2024-09-16T00:50:22.772 INFO:tasks.workunit.client.1.smithi152.stdout:9/851: creat d1/de2/f112 x:0 0 0 2024-09-16T00:50:22.778 INFO:tasks.workunit.client.0.smithi053.stdout:6/378: creat d1/dc/d39/f89 x:0 0 0 2024-09-16T00:50:22.780 INFO:tasks.workunit.client.0.smithi053.stdout:2/350: truncate d6/d9/f1d 5117865 0 2024-09-16T00:50:22.780 INFO:tasks.workunit.client.0.smithi053.stdout:2/351: readlink d6/l33 0 2024-09-16T00:50:22.780 INFO:tasks.workunit.client.0.smithi053.stdout:2/352: creat d6/d29/d2b/f5c x:0 0 0 2024-09-16T00:50:22.786 INFO:tasks.workunit.client.1.smithi152.stdout:8/690: dwrite dd/d25/f5d [0,4194304] 0 2024-09-16T00:50:22.789 INFO:tasks.workunit.client.1.smithi152.stdout:7/879: truncate d9/d31/d65/d6b/f77 1880641 0 2024-09-16T00:50:22.789 INFO:tasks.workunit.client.1.smithi152.stdout:7/880: write d9/d31/d65/d8a/d90/fa4 [948151,6224] 0 2024-09-16T00:50:22.793 INFO:tasks.workunit.client.0.smithi053.stdout:2/353: write f5 [4038833,98241] 0 2024-09-16T00:50:22.795 INFO:tasks.workunit.client.0.smithi053.stdout:2/354: creat d6/d9/dd/d28/f5d x:0 0 0 2024-09-16T00:50:22.797 INFO:tasks.workunit.client.0.smithi053.stdout:6/379: dread d1/dc/d39/f56 [0,4194304] 0 2024-09-16T00:50:22.798 INFO:tasks.workunit.client.0.smithi053.stdout:6/380: chown d1/l44 240207 1 2024-09-16T00:50:22.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/691: dread dd/d98/db8/dcf/d29/d2f/f95 [0,4194304] 0 2024-09-16T00:50:22.800 INFO:tasks.workunit.client.1.smithi152.stdout:8/692: fsync dd/d25/da4/fdd 0 2024-09-16T00:50:22.800 INFO:tasks.workunit.client.0.smithi053.stdout:6/381: mknod d1/dc/d43/c8a 0 2024-09-16T00:50:22.801 INFO:tasks.workunit.client.0.smithi053.stdout:9/443: dwrite d8/f17 [0,4194304] 0 2024-09-16T00:50:22.804 INFO:tasks.workunit.client.1.smithi152.stdout:7/881: dread d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f66 [0,4194304] 0 2024-09-16T00:50:22.805 INFO:tasks.workunit.client.1.smithi152.stdout:3/810: sync 2024-09-16T00:50:22.805 INFO:tasks.workunit.client.1.smithi152.stdout:1/922: sync 2024-09-16T00:50:22.805 INFO:tasks.workunit.client.0.smithi053.stdout:9/444: symlink d8/d4c/d5a/l95 0 2024-09-16T00:50:22.806 INFO:tasks.workunit.client.0.smithi053.stdout:8/459: dwrite d10/f3a [0,4194304] 0 2024-09-16T00:50:22.806 INFO:tasks.workunit.client.1.smithi152.stdout:2/785: dwrite d4/f9 [0,4194304] 0 2024-09-16T00:50:22.806 INFO:tasks.workunit.client.1.smithi152.stdout:9/852: dwrite d1/d7/d77/d32/da5/da8/ff7 [0,4194304] 0 2024-09-16T00:50:22.807 INFO:tasks.workunit.client.0.smithi053.stdout:9/445: creat d8/d1c/d2b/f96 x:0 0 0 2024-09-16T00:50:22.809 INFO:tasks.workunit.client.0.smithi053.stdout:0/462: rename d4/dc/d25/d34/d2a to d4/dc/d25/d34/d71/d96 0 2024-09-16T00:50:22.810 INFO:tasks.workunit.client.0.smithi053.stdout:1/356: sync 2024-09-16T00:50:22.811 INFO:tasks.workunit.client.0.smithi053.stdout:4/279: sync 2024-09-16T00:50:22.813 INFO:tasks.workunit.client.1.smithi152.stdout:4/984: dwrite d2/db/d39/d3c/d76/f106 [0,4194304] 0 2024-09-16T00:50:22.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/693: dread dd/f42 [0,4194304] 0 2024-09-16T00:50:22.813 INFO:tasks.workunit.client.0.smithi053.stdout:8/460: link d10/d1c/d2b/f72 d10/d21/d28/d3c/d61/f9f 0 2024-09-16T00:50:22.818 INFO:tasks.workunit.client.1.smithi152.stdout:2/786: write d4/d44/fd7 [3672469,43518] 0 2024-09-16T00:50:22.819 INFO:tasks.workunit.client.0.smithi053.stdout:4/280: dread d0/d2/f28 [0,4194304] 0 2024-09-16T00:50:22.819 INFO:tasks.workunit.client.1.smithi152.stdout:7/882: rmdir d9/d31/d64/d3c/d5b 39 2024-09-16T00:50:22.820 INFO:tasks.workunit.client.1.smithi152.stdout:3/811: write dc/d10/d17/d1c/d1f/d24/f85 [767774,16837] 0 2024-09-16T00:50:22.823 INFO:tasks.workunit.client.0.smithi053.stdout:2/355: rename d6/d29/f58 to d6/d9/f5e 0 2024-09-16T00:50:22.823 INFO:tasks.workunit.client.0.smithi053.stdout:7/374: sync 2024-09-16T00:50:22.823 INFO:tasks.workunit.client.0.smithi053.stdout:5/295: sync 2024-09-16T00:50:22.827 INFO:tasks.workunit.client.0.smithi053.stdout:1/357: unlink d5/d7/d39/f48 0 2024-09-16T00:50:22.831 INFO:tasks.workunit.client.1.smithi152.stdout:9/853: mkdir d1/d7/ded/d113 0 2024-09-16T00:50:22.832 INFO:tasks.workunit.client.0.smithi053.stdout:4/281: mkdir d0/d2/d66 0 2024-09-16T00:50:22.832 INFO:tasks.workunit.client.0.smithi053.stdout:4/282: fsync d0/d2/f28 0 2024-09-16T00:50:22.834 INFO:tasks.workunit.client.0.smithi053.stdout:5/296: dread d3/f35 [0,4194304] 0 2024-09-16T00:50:22.834 INFO:tasks.workunit.client.0.smithi053.stdout:5/297: dread - d3/d7/f5c zero size 2024-09-16T00:50:22.834 INFO:tasks.workunit.client.0.smithi053.stdout:5/298: write d3/f2e [579831,33772] 0 2024-09-16T00:50:22.835 INFO:tasks.workunit.client.0.smithi053.stdout:7/375: rename d1/c11 to d1/d60/c87 0 2024-09-16T00:50:22.835 INFO:tasks.workunit.client.0.smithi053.stdout:7/376: chown d1/d2a/d4f/d52/f30 24479008 1 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.1.smithi152.stdout:8/694: unlink dd/d15/ld3 0 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.1.smithi152.stdout:8/695: chown dd/d98/db8/dcf/d29/d2f/f35 315738 1 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.1.smithi152.stdout:8/696: creat dd/db9/fe6 x:0 0 0 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.1.smithi152.stdout:8/697: chown dd/d15/d1a/f3f 3178 1 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.0.smithi053.stdout:1/358: write d5/d9/f17 [4562856,93842] 0 2024-09-16T00:50:22.838 INFO:tasks.workunit.client.0.smithi053.stdout:1/359: creat d5/dd/d47/d58/f78 x:0 0 0 2024-09-16T00:50:22.839 INFO:tasks.workunit.client.1.smithi152.stdout:4/985: mkdir d2/d41/dd8/d143 0 2024-09-16T00:50:22.840 INFO:tasks.workunit.client.0.smithi053.stdout:6/382: dwrite d1/dc/d3c/f82 [0,4194304] 0 2024-09-16T00:50:22.840 INFO:tasks.workunit.client.0.smithi053.stdout:0/463: dwrite d4/d5a/f94 [0,4194304] 0 2024-09-16T00:50:22.840 INFO:tasks.workunit.client.0.smithi053.stdout:0/464: readlink d4/dc/d25/l48 0 2024-09-16T00:50:22.840 INFO:tasks.workunit.client.0.smithi053.stdout:0/465: readlink d4/l3b 0 2024-09-16T00:50:22.840 INFO:tasks.workunit.client.0.smithi053.stdout:0/466: fsync d4/f4b 0 2024-09-16T00:50:22.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/299: symlink d3/d7/d2b/d4b/d51/d53/l63 0 2024-09-16T00:50:22.844 INFO:tasks.workunit.client.0.smithi053.stdout:5/300: read d3/f9 [4049917,91938] 0 2024-09-16T00:50:22.844 INFO:tasks.workunit.client.0.smithi053.stdout:7/377: write d1/d2a/d4f/d52/f37 [144523,54784] 0 2024-09-16T00:50:22.846 INFO:tasks.workunit.client.0.smithi053.stdout:4/283: write d0/d2/f34 [4071851,613] 0 2024-09-16T00:50:22.848 INFO:tasks.workunit.client.1.smithi152.stdout:2/787: creat d4/d44/df6/d3e/f109 x:0 0 0 2024-09-16T00:50:22.848 INFO:tasks.workunit.client.1.smithi152.stdout:2/788: chown d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/dcf/fd4 29364 1 2024-09-16T00:50:22.848 INFO:tasks.workunit.client.1.smithi152.stdout:2/789: truncate d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc 626994 0 2024-09-16T00:50:22.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/698: dread dd/d15/d49/f22 [4194304,4194304] 0 2024-09-16T00:50:22.852 INFO:tasks.workunit.client.1.smithi152.stdout:7/883: rename d9/d31/d64/caa to d9/d10/da5/d127/c134 0 2024-09-16T00:50:22.856 INFO:tasks.workunit.client.1.smithi152.stdout:9/854: symlink d1/d4e/d34/l114 0 2024-09-16T00:50:22.861 INFO:tasks.workunit.client.1.smithi152.stdout:4/986: mknod d2/db/d39/d3c/d7f/d98/def/d10f/c144 0 2024-09-16T00:50:22.861 INFO:tasks.workunit.client.1.smithi152.stdout:4/987: chown d2/d8e/lab 39809054 1 2024-09-16T00:50:22.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/790: mknod d4/d44/d7a/d9e/d66/dec/c10a 0 2024-09-16T00:50:22.864 INFO:tasks.workunit.client.1.smithi152.stdout:3/812: dwrite dc/d10/d17/d5a/fd7 [0,4194304] 0 2024-09-16T00:50:22.864 INFO:tasks.workunit.client.0.smithi053.stdout:6/383: link d1/d2f/f7d d1/dc/d3c/d4b/d75/f8b 0 2024-09-16T00:50:22.864 INFO:tasks.workunit.client.0.smithi053.stdout:6/384: chown d1/dc/d1e/f7a 521352990 1 2024-09-16T00:50:22.864 INFO:tasks.workunit.client.0.smithi053.stdout:6/385: fsync d1/dc/d45/f59 0 2024-09-16T00:50:22.865 INFO:tasks.workunit.client.1.smithi152.stdout:8/699: symlink dd/d98/db8/dcf/le7 0 2024-09-16T00:50:22.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/855: dread d1/d7/f8d [0,4194304] 0 2024-09-16T00:50:22.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/856: chown d1/d7/d13/l90 62213 1 2024-09-16T00:50:22.867 INFO:tasks.workunit.client.0.smithi053.stdout:1/360: write d5/d18/d1f/f3d [3351396,504] 0 2024-09-16T00:50:22.867 INFO:tasks.workunit.client.0.smithi053.stdout:2/356: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:22.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/884: rename d9/d31/d65/l2b to d9/db6/dde/l135 0 2024-09-16T00:50:22.871 INFO:tasks.workunit.client.0.smithi053.stdout:5/301: dwrite d3/f32 [0,4194304] 0 2024-09-16T00:50:22.875 INFO:tasks.workunit.client.1.smithi152.stdout:4/988: creat d2/d1e/d28/db7/f145 x:0 0 0 2024-09-16T00:50:22.875 INFO:tasks.workunit.client.0.smithi053.stdout:0/467: creat d4/dc/d25/d34/d71/d96/f97 x:0 0 0 2024-09-16T00:50:22.878 INFO:tasks.workunit.client.0.smithi053.stdout:7/378: mknod d1/d60/d70/c88 0 2024-09-16T00:50:22.881 INFO:tasks.workunit.client.0.smithi053.stdout:9/446: rename d8/d22/l44 to d8/d13/l97 0 2024-09-16T00:50:22.883 INFO:tasks.workunit.client.1.smithi152.stdout:0/831: sync 2024-09-16T00:50:22.885 INFO:tasks.workunit.client.0.smithi053.stdout:4/284: unlink d0/d2/d1e/d4b/f36 0 2024-09-16T00:50:22.885 INFO:tasks.workunit.client.0.smithi053.stdout:4/285: creat d0/d3c/d48/f67 x:0 0 0 2024-09-16T00:50:22.886 INFO:tasks.workunit.client.0.smithi053.stdout:5/302: dread d3/d7/d24/d34/f39 [0,4194304] 0 2024-09-16T00:50:22.887 INFO:tasks.workunit.client.0.smithi053.stdout:0/468: dread d4/d13/f8b [0,4194304] 0 2024-09-16T00:50:22.887 INFO:tasks.workunit.client.0.smithi053.stdout:0/469: chown d4/dc/l1a 13 1 2024-09-16T00:50:22.890 INFO:tasks.workunit.client.1.smithi152.stdout:3/813: symlink dc/d10/d17/d5a/d68/da5/l101 0 2024-09-16T00:50:22.890 INFO:tasks.workunit.client.1.smithi152.stdout:3/814: getdents dc/d10/d17/d5a/d68/da5/df0/d100 0 2024-09-16T00:50:22.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/885: mknod d9/d31/dc4/c136 0 2024-09-16T00:50:22.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/886: dread - d9/d31/d65/d8a/d41/d46/d7d/de2/df0/d10a/f131 zero size 2024-09-16T00:50:22.893 INFO:tasks.workunit.client.0.smithi053.stdout:6/386: unlink d1/dc/d3c/d4a/f53 0 2024-09-16T00:50:22.893 INFO:tasks.workunit.client.0.smithi053.stdout:6/387: creat d1/dc/d3d/f8c x:0 0 0 2024-09-16T00:50:22.894 INFO:tasks.workunit.client.1.smithi152.stdout:4/989: truncate d2/d1e/d28/d7b/fa7 2833015 0 2024-09-16T00:50:22.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/887: dread d9/d31/d65/d6b/fc9 [4194304,4194304] 0 2024-09-16T00:50:22.896 INFO:tasks.workunit.client.1.smithi152.stdout:2/791: mkdir d4/d44/df6/d10b 0 2024-09-16T00:50:22.896 INFO:tasks.workunit.client.1.smithi152.stdout:2/792: truncate d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc 1025108 0 2024-09-16T00:50:22.897 INFO:tasks.workunit.client.0.smithi053.stdout:4/286: dread d0/d2/dd/d25/d41/f64 [0,4194304] 0 2024-09-16T00:50:22.897 INFO:tasks.workunit.client.0.smithi053.stdout:1/361: creat d5/d18/f79 x:0 0 0 2024-09-16T00:50:22.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/832: mknod d3/d6/d64/c117 0 2024-09-16T00:50:22.901 INFO:tasks.workunit.client.0.smithi053.stdout:2/357: mknod d6/d9/dd/d28/c5f 0 2024-09-16T00:50:22.902 INFO:tasks.workunit.client.1.smithi152.stdout:2/793: dread d4/d44/d7a/d9e/d87/d9c/f108 [4194304,4194304] 0 2024-09-16T00:50:22.902 INFO:tasks.workunit.client.1.smithi152.stdout:3/815: mknod dc/d10/d17/d5a/db2/c102 0 2024-09-16T00:50:22.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/990: mkdir d2/d1e/d146 0 2024-09-16T00:50:22.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/991: write d2/db/dce/f101 [4750825,83714] 0 2024-09-16T00:50:22.906 INFO:tasks.workunit.client.0.smithi053.stdout:7/379: rename d1/c45 to d1/d35/d5b/c89 0 2024-09-16T00:50:22.907 INFO:tasks.workunit.client.1.smithi152.stdout:4/992: dread d2/db/d39/d3c/f119 [0,4194304] 0 2024-09-16T00:50:22.907 INFO:tasks.workunit.client.1.smithi152.stdout:7/888: getdents d9/d31/d64/d3c/d5b/dd0 0 2024-09-16T00:50:22.910 INFO:tasks.workunit.client.0.smithi053.stdout:9/447: creat d8/d1c/d2b/d8b/f98 x:0 0 0 2024-09-16T00:50:22.911 INFO:tasks.workunit.client.1.smithi152.stdout:0/833: unlink d3/d6/d2e/f110 0 2024-09-16T00:50:22.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/794: creat d4/d44/d7a/dc7/de4/d20/d34/f10c x:0 0 0 2024-09-16T00:50:22.915 INFO:tasks.workunit.client.0.smithi053.stdout:5/303: rmdir d3/d7/d24/d34/d5b 39 2024-09-16T00:50:22.915 INFO:tasks.workunit.client.0.smithi053.stdout:5/304: dread - d3/d7/f3b zero size 2024-09-16T00:50:22.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/816: rmdir dc/d10/d17/d1c/d1f/d24/db9 39 2024-09-16T00:50:22.918 INFO:tasks.workunit.client.1.smithi152.stdout:3/817: write dc/d10/d17/d1c/d8d/d8e/d2f/f7b [1019367,59117] 0 2024-09-16T00:50:22.918 INFO:tasks.workunit.client.1.smithi152.stdout:3/818: read dc/d10/d17/d1c/d1f/f91 [284241,100421] 0 2024-09-16T00:50:22.918 INFO:tasks.workunit.client.1.smithi152.stdout:6/882: sync 2024-09-16T00:50:22.918 INFO:tasks.workunit.client.1.smithi152.stdout:6/883: write db/d28/dd8/fdc [836297,9501] 0 2024-09-16T00:50:22.918 INFO:tasks.workunit.client.0.smithi053.stdout:0/470: creat d4/dc/d1e/d1f/d40/d44/d54/f98 x:0 0 0 2024-09-16T00:50:22.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/993: write d2/f6 [15219,35667] 0 2024-09-16T00:50:22.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/994: dread - d2/d1e/d28/d69/f13a zero size 2024-09-16T00:50:22.921 INFO:tasks.workunit.client.1.smithi152.stdout:7/889: rmdir d9/d31/d64/d3c 39 2024-09-16T00:50:22.922 INFO:tasks.workunit.client.1.smithi152.stdout:9/857: dwrite d1/d7/d77/d32/f35 [4194304,4194304] 0 2024-09-16T00:50:22.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/700: dwrite dd/d98/db8/dcf/d29/d2f/f31 [0,4194304] 0 2024-09-16T00:50:22.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/701: readlink dd/d15/d49/ld7 0 2024-09-16T00:50:22.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/702: chown dd/d25/d77/fa3 97 1 2024-09-16T00:50:22.925 INFO:tasks.workunit.client.0.smithi053.stdout:6/388: unlink d1/dc/d43/c8a 0 2024-09-16T00:50:22.925 INFO:tasks.workunit.client.0.smithi053.stdout:2/358: dwrite d6/d29/d2b/f46 [4194304,4194304] 0 2024-09-16T00:50:22.925 INFO:tasks.workunit.client.0.smithi053.stdout:2/359: write d6/d9/f1d [5455247,57294] 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/834: symlink d3/d6/d8/d1d/d65/db0/l118 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/835: readlink d3/d6/d2e/lc1 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/858: dread d1/d7/d13/f27 [0,4194304] 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/859: stat d1/d4e/d48/d26/d30/d104 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/860: truncate d1/d4e/d48/d2b/d93/d96/dd1/f109 164653 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/861: readlink d1/d4e/d48/d26/d30/l8c 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.0.smithi053.stdout:1/362: mknod d5/d18/d5b/c7a 0 2024-09-16T00:50:22.927 INFO:tasks.workunit.client.0.smithi053.stdout:1/363: write d5/d7/f66 [148988,82550] 0 2024-09-16T00:50:22.928 INFO:tasks.workunit.client.1.smithi152.stdout:2/795: truncate f2 778738 0 2024-09-16T00:50:22.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/836: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/db4/f10b [383328,49612] 0 2024-09-16T00:50:22.929 INFO:tasks.workunit.client.1.smithi152.stdout:0/837: fdatasync d3/d6/d8/d1d/d65/d6e/d82/da4/f101 0 2024-09-16T00:50:22.929 INFO:tasks.workunit.client.0.smithi053.stdout:9/448: chown d8/d19/d51/f56 115392 1 2024-09-16T00:50:22.930 INFO:tasks.workunit.client.1.smithi152.stdout:3/819: symlink dc/d10/d17/d1c/d50/daa/l103 0 2024-09-16T00:50:22.932 INFO:tasks.workunit.client.0.smithi053.stdout:5/305: creat d3/d7/d24/d34/d3e/f64 x:0 0 0 2024-09-16T00:50:22.932 INFO:tasks.workunit.client.0.smithi053.stdout:5/306: write d3/d7/d42/d57/f61 [3407255,15438] 0 2024-09-16T00:50:22.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/307: readlink d3/la 0 2024-09-16T00:50:22.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/308: write d3/f5a [688713,109603] 0 2024-09-16T00:50:22.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/309: write d3/d7/f5c [762637,112962] 0 2024-09-16T00:50:22.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/310: write d3/d7/d2b/d37/d58/f21 [896661,71091] 0 2024-09-16T00:50:22.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/311: fdatasync d3/d7/d2b/d37/d58/f38 0 2024-09-16T00:50:22.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/995: creat d2/db/d39/d95/d139/f147 x:0 0 0 2024-09-16T00:50:22.938 INFO:tasks.workunit.client.0.smithi053.stdout:6/389: creat d1/dc/d1e/f8d x:0 0 0 2024-09-16T00:50:22.938 INFO:tasks.workunit.client.0.smithi053.stdout:6/390: fsync d1/dc/d3c/f82 0 2024-09-16T00:50:22.938 INFO:tasks.workunit.client.0.smithi053.stdout:6/391: read - d1/dc/d1e/f7a zero size 2024-09-16T00:50:22.939 INFO:tasks.workunit.client.0.smithi053.stdout:6/392: stat d1/dc/d1e/c29 0 2024-09-16T00:50:22.939 INFO:tasks.workunit.client.0.smithi053.stdout:6/393: dread - d1/dc/d3c/f70 zero size 2024-09-16T00:50:22.940 INFO:tasks.workunit.client.0.smithi053.stdout:6/394: dread d1/dc/f32 [0,4194304] 0 2024-09-16T00:50:22.941 INFO:tasks.workunit.client.0.smithi053.stdout:2/360: rename d6/f8 to d6/d29/d2b/f60 0 2024-09-16T00:50:22.942 INFO:tasks.workunit.client.0.smithi053.stdout:1/364: creat d5/d9/d77/f7b x:0 0 0 2024-09-16T00:50:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:5/312: unlink d3/d7/d2b/d2f/f43 0 2024-09-16T00:50:22.948 INFO:tasks.workunit.client.1.smithi152.stdout:8/703: link dd/d98/db8/dcf/d29/d2f/c4f dd/d15/ce8 0 2024-09-16T00:50:22.948 INFO:tasks.workunit.client.1.smithi152.stdout:8/704: chown dd/d98/da5/dbb 2172685 1 2024-09-16T00:50:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:9/449: write d8/d1c/d2b/f76 [3813614,72252] 0 2024-09-16T00:50:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:9/450: fsync f4 0 2024-09-16T00:50:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:2/361: unlink d6/d29/d2b/f34 0 2024-09-16T00:50:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:9/451: dread d8/d1c/f33 [0,4194304] 0 2024-09-16T00:50:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:9/452: truncate d8/d1c/d2b/f96 198970 0 2024-09-16T00:50:22.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/862: rename d1/d4e/d48/d2b/d93/d96/fab to d1/d7/d77/d3c/dc9/f115 0 2024-09-16T00:50:22.952 INFO:tasks.workunit.client.0.smithi053.stdout:6/395: dread d1/dc/d39/f56 [0,4194304] 0 2024-09-16T00:50:22.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/863: dread d1/d4e/f67 [0,4194304] 0 2024-09-16T00:50:22.957 INFO:tasks.workunit.client.0.smithi053.stdout:2/362: mknod d6/c61 0 2024-09-16T00:50:22.958 INFO:tasks.workunit.client.1.smithi152.stdout:3/820: symlink dc/d10/d17/d1c/d1f/d8a/l104 0 2024-09-16T00:50:22.959 INFO:tasks.workunit.client.1.smithi152.stdout:7/890: dwrite d9/d31/f5f [0,4194304] 0 2024-09-16T00:50:22.959 INFO:tasks.workunit.client.1.smithi152.stdout:7/891: truncate d9/d31/d64/d3c/db9/dd3/f105 384671 0 2024-09-16T00:50:22.960 INFO:tasks.workunit.client.0.smithi053.stdout:0/471: dwrite d4/dc/d1e/d1f/d40/d44/d49/f70 [0,4194304] 0 2024-09-16T00:50:22.960 INFO:tasks.workunit.client.0.smithi053.stdout:0/472: fdatasync d4/dc/d87/f50 0 2024-09-16T00:50:22.960 INFO:tasks.workunit.client.0.smithi053.stdout:0/473: creat d4/dc/d25/d34/d71/d96/f99 x:0 0 0 2024-09-16T00:50:22.961 INFO:tasks.workunit.client.0.smithi053.stdout:6/396: symlink d1/dc/d3d/l8e 0 2024-09-16T00:50:22.961 INFO:tasks.workunit.client.0.smithi053.stdout:6/397: dread - d1/dc/d45/f76 zero size 2024-09-16T00:50:22.961 INFO:tasks.workunit.client.1.smithi152.stdout:0/838: dwrite d3/d6/d8/d1d/d23/d25/d2a/d5c/f89 [0,4194304] 0 2024-09-16T00:50:22.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/864: dread d1/d4e/d34/f5e [0,4194304] 0 2024-09-16T00:50:22.962 INFO:tasks.workunit.client.1.smithi152.stdout:4/996: creat d2/d1e/d146/f148 x:0 0 0 2024-09-16T00:50:22.964 INFO:tasks.workunit.client.1.smithi152.stdout:8/705: unlink dd/d23/fe3 0 2024-09-16T00:50:22.965 INFO:tasks.workunit.client.1.smithi152.stdout:7/892: dread d9/f93 [0,4194304] 0 2024-09-16T00:50:22.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/796: dwrite d4/d44/d7a/dc7/de4/d94/d8f/fee [0,4194304] 0 2024-09-16T00:50:22.965 INFO:tasks.workunit.client.0.smithi053.stdout:1/365: rmdir d5/d7/d39 39 2024-09-16T00:50:22.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/313: truncate d3/f32 1693733 0 2024-09-16T00:50:22.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/314: fdatasync d3/f27 0 2024-09-16T00:50:22.975 INFO:tasks.workunit.client.0.smithi053.stdout:5/315: chown d3/d7/d2b/d4b/d4f 50563133 1 2024-09-16T00:50:22.976 INFO:tasks.workunit.client.0.smithi053.stdout:5/316: write d3/d7/f1f [4774699,2457] 0 2024-09-16T00:50:22.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/363: symlink d6/d29/d2b/l62 0 2024-09-16T00:50:22.977 INFO:tasks.workunit.client.0.smithi053.stdout:5/317: dread d3/d7/f5c [0,4194304] 0 2024-09-16T00:50:22.978 INFO:tasks.workunit.client.1.smithi152.stdout:0/839: mkdir d3/d6/d64/d6a/d61/d119 0 2024-09-16T00:50:22.981 INFO:tasks.workunit.client.0.smithi053.stdout:9/453: mkdir d8/d4c/d5a/d99 0 2024-09-16T00:50:22.981 INFO:tasks.workunit.client.0.smithi053.stdout:9/454: write d8/d1c/d2b/d2c/f60 [851531,130269] 0 2024-09-16T00:50:22.982 INFO:tasks.workunit.client.0.smithi053.stdout:9/455: stat d8/d22/l92 0 2024-09-16T00:50:22.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/997: creat d2/db/d39/d3c/d76/db4/f149 x:0 0 0 2024-09-16T00:50:22.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/998: write d2/d1e/d28/d7b/f110 [1279871,91321] 0 2024-09-16T00:50:22.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/706: mknod dd/d98/db8/ce9 0 2024-09-16T00:50:22.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/893: creat d9/d31/d65/d8a/d90/f137 x:0 0 0 2024-09-16T00:50:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:2/797: truncate d4/d44/df6/f41 5065337 0 2024-09-16T00:50:22.990 INFO:tasks.workunit.client.1.smithi152.stdout:2/798: fdatasync d4/d44/d7a/dc7/de4/f27 0 2024-09-16T00:50:22.990 INFO:tasks.workunit.client.1.smithi152.stdout:2/799: chown d4/d44/d7a/d9e/da0 4141 1 2024-09-16T00:50:22.991 INFO:tasks.workunit.client.0.smithi053.stdout:6/398: rename d1/dc/d3c/d4a/l63 to d1/dc/d3c/d4b/d75/l8f 0 2024-09-16T00:50:22.992 INFO:tasks.workunit.client.1.smithi152.stdout:7/894: dread d9/d31/d65/d6b/fdc [0,4194304] 0 2024-09-16T00:50:22.992 INFO:tasks.workunit.client.1.smithi152.stdout:0/840: mkdir d3/d6/d4e/d11a 0 2024-09-16T00:50:22.996 INFO:tasks.workunit.client.1.smithi152.stdout:4/999: rename c0 to d2/d1e/d28/db7/c14a 0 2024-09-16T00:50:22.997 INFO:tasks.workunit.client.1.smithi152.stdout:8/707: unlink dd/d98/cb0 0 2024-09-16T00:50:22.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/800: mknod d4/d44/d7a/d9e/d87/d9c/dd9/c10d 0 2024-09-16T00:50:23.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/895: creat d9/d31/d65/d8a/f138 x:0 0 0 2024-09-16T00:50:23.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/896: fdatasync d9/d31/d64/d3c/db9/fc6 0 2024-09-16T00:50:23.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/841: symlink d3/d6/d2e/de9/dff/l11b 0 2024-09-16T00:50:23.007 INFO:tasks.workunit.client.0.smithi053.stdout:6/399: read d1/dc/d39/f34 [1876519,65302] 0 2024-09-16T00:50:23.007 INFO:tasks.workunit.client.0.smithi053.stdout:6/400: truncate d1/dc/d1e/f8d 582321 0 2024-09-16T00:50:23.009 INFO:tasks.workunit.client.1.smithi152.stdout:8/708: creat dd/d15/d9b/fea x:0 0 0 2024-09-16T00:50:23.012 INFO:tasks.workunit.client.1.smithi152.stdout:2/801: truncate d4/d44/f48 1585117 0 2024-09-16T00:50:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/802: fsync d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/dcf/fd4 0 2024-09-16T00:50:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/803: stat d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/lc5 0 2024-09-16T00:50:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/804: dread - d4/d44/d7a/dc7/de4/d94/d8f/f106 zero size 2024-09-16T00:50:23.014 INFO:tasks.workunit.client.0.smithi053.stdout:2/364: rename d6/l33 to d6/d9/l63 0 2024-09-16T00:50:23.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/923: sync 2024-09-16T00:50:23.015 INFO:tasks.workunit.client.1.smithi152.stdout:7/897: truncate d9/d31/d65/d6b/fdc 550010 0 2024-09-16T00:50:23.016 INFO:tasks.workunit.client.1.smithi152.stdout:3/821: dwrite dc/d10/d17/d5a/fd7 [0,4194304] 0 2024-09-16T00:50:23.016 INFO:tasks.workunit.client.1.smithi152.stdout:7/898: truncate d9/d31/d64/d3c/d5b/dd0/d12a/f12c 432042 0 2024-09-16T00:50:23.017 INFO:tasks.workunit.client.1.smithi152.stdout:0/842: mknod d3/d6/d2e/d58/c11c 0 2024-09-16T00:50:23.018 INFO:tasks.workunit.client.0.smithi053.stdout:5/318: getdents d3/d7/d24/d34/d3e 0 2024-09-16T00:50:23.021 INFO:tasks.workunit.client.0.smithi053.stdout:9/456: dwrite d8/d1c/d2b/d2c/f48 [0,4194304] 0 2024-09-16T00:50:23.021 INFO:tasks.workunit.client.0.smithi053.stdout:2/365: dread d6/d9/d14/f37 [4194304,4194304] 0 2024-09-16T00:50:23.021 INFO:tasks.workunit.client.0.smithi053.stdout:1/366: dwrite d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:23.021 INFO:tasks.workunit.client.1.smithi152.stdout:9/865: dwrite d1/d7/d77/d32/da5/da8/fac [0,4194304] 0 2024-09-16T00:50:23.022 INFO:tasks.workunit.client.1.smithi152.stdout:8/709: creat dd/d98/db8/dcf/d29/d2f/d5f/feb x:0 0 0 2024-09-16T00:50:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:6/401: mkdir d1/d90 0 2024-09-16T00:50:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:6/402: write d1/dc/d39/f67 [723520,50271] 0 2024-09-16T00:50:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:6/403: dread - d1/dc/d43/f83 zero size 2024-09-16T00:50:23.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/805: symlink d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/l10e 0 2024-09-16T00:50:23.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/924: dread d9/da/df/f27 [4194304,4194304] 0 2024-09-16T00:50:23.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/925: chown d9 33437 1 2024-09-16T00:50:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:3/822: mkdir dc/d10/d17/d1c/d50/d63/d105 0 2024-09-16T00:50:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:3/823: fdatasync dc/d10/d17/d4f/f60 0 2024-09-16T00:50:23.036 INFO:tasks.workunit.client.1.smithi152.stdout:9/866: dread d1/d7/d77/d32/f49 [0,4194304] 0 2024-09-16T00:50:23.037 INFO:tasks.workunit.client.1.smithi152.stdout:7/899: mknod d9/d31/d64/d3c/db9/dc2/c139 0 2024-09-16T00:50:23.039 INFO:tasks.workunit.client.1.smithi152.stdout:1/926: write d9/d3e/d41/d31/d48/d4a/f137 [253977,42079] 0 2024-09-16T00:50:23.039 INFO:tasks.workunit.client.0.smithi053.stdout:2/366: link d6/c4f d6/d9/c64 0 2024-09-16T00:50:23.043 INFO:tasks.workunit.client.0.smithi053.stdout:1/367: creat d5/d18/f7c x:0 0 0 2024-09-16T00:50:23.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/843: dwrite d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe7 [0,4194304] 0 2024-09-16T00:50:23.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/844: chown d3/d6/d8/d1d/d65/db0/df0 375456715 1 2024-09-16T00:50:23.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/845: write d3/d6/d64/d6a/fb3 [922300,40173] 0 2024-09-16T00:50:23.056 INFO:tasks.workunit.client.1.smithi152.stdout:8/710: symlink dd/d25/lec 0 2024-09-16T00:50:23.056 INFO:tasks.workunit.client.1.smithi152.stdout:8/711: creat dd/d23/fed x:0 0 0 2024-09-16T00:50:23.057 INFO:tasks.workunit.client.0.smithi053.stdout:1/368: creat d5/f7d x:0 0 0 2024-09-16T00:50:23.057 INFO:tasks.workunit.client.0.smithi053.stdout:1/369: chown d5/d7/c3f 8562551 1 2024-09-16T00:50:23.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/806: mknod d4/d44/d7a/dc7/de4/d20/d28/d8b/c10f 0 2024-09-16T00:50:23.060 INFO:tasks.workunit.client.1.smithi152.stdout:3/824: dwrite dc/d10/d17/f52 [0,4194304] 0 2024-09-16T00:50:23.060 INFO:tasks.workunit.client.0.smithi053.stdout:6/404: dwrite d1/f86 [0,4194304] 0 2024-09-16T00:50:23.060 INFO:tasks.workunit.client.0.smithi053.stdout:9/457: dwrite d8/d1c/d2b/f86 [0,4194304] 0 2024-09-16T00:50:23.061 INFO:tasks.workunit.client.1.smithi152.stdout:9/867: unlink d1/d4e/d48/d26/d58/faa 0 2024-09-16T00:50:23.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/825: dread dc/d10/d17/d5a/db2/d6f/dbb/fad [0,4194304] 0 2024-09-16T00:50:23.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/826: fsync dc/fbd 0 2024-09-16T00:50:23.062 INFO:tasks.workunit.client.0.smithi053.stdout:1/370: creat d5/d5a/f7e x:0 0 0 2024-09-16T00:50:23.063 INFO:tasks.workunit.client.0.smithi053.stdout:5/319: truncate d3/f5a 524307 0 2024-09-16T00:50:23.063 INFO:tasks.workunit.client.0.smithi053.stdout:5/320: readlink d3/l18 0 2024-09-16T00:50:23.064 INFO:tasks.workunit.client.1.smithi152.stdout:7/900: symlink d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5/l13a 0 2024-09-16T00:50:23.064 INFO:tasks.workunit.client.1.smithi152.stdout:0/846: write d3/d6/f17 [3888948,128481] 0 2024-09-16T00:50:23.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/827: dread dc/d10/d17/d1c/f7e [0,4194304] 0 2024-09-16T00:50:23.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/828: write dc/d10/d17/d5a/db2/d6f/ff2 [200177,119296] 0 2024-09-16T00:50:23.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/829: chown f6 3960 1 2024-09-16T00:50:23.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/830: chown dc/d10/d17/d1c/d8d/d8e/f84 1 1 2024-09-16T00:50:23.068 INFO:tasks.workunit.client.1.smithi152.stdout:7/901: dread d9/d31/d65/ff7 [0,4194304] 0 2024-09-16T00:50:23.071 INFO:tasks.workunit.client.1.smithi152.stdout:1/927: mkdir d9/d3e/d4b/db7/dc4/d157 0 2024-09-16T00:50:23.071 INFO:tasks.workunit.client.1.smithi152.stdout:1/928: creat d9/da/d105/f158 x:0 0 0 2024-09-16T00:50:23.071 INFO:tasks.workunit.client.1.smithi152.stdout:1/929: write d9/d3e/d4b/d6b/d6d/d82/fed [295524,41974] 0 2024-09-16T00:50:23.071 INFO:tasks.workunit.client.0.smithi053.stdout:5/321: write d3/d7/f10 [3056826,16464] 0 2024-09-16T00:50:23.072 INFO:tasks.workunit.client.0.smithi053.stdout:6/405: creat d1/dc/d3c/d4b/f91 x:0 0 0 2024-09-16T00:50:23.076 INFO:tasks.workunit.client.1.smithi152.stdout:0/847: write d3/d6/d51/f85 [664533,7176] 0 2024-09-16T00:50:23.076 INFO:tasks.workunit.client.0.smithi053.stdout:9/458: rename d8/d19/d51/f5d to d8/d22/d54/f9a 0 2024-09-16T00:50:23.076 INFO:tasks.workunit.client.0.smithi053.stdout:9/459: truncate d8/d19/d51/d6d/f79 322244 0 2024-09-16T00:50:23.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/868: dwrite d1/d7/d13/d80/f86 [0,4194304] 0 2024-09-16T00:50:23.081 INFO:tasks.workunit.client.0.smithi053.stdout:1/371: mkdir d5/dd/d7f 0 2024-09-16T00:50:23.087 INFO:tasks.workunit.client.1.smithi152.stdout:8/712: mkdir dd/d98/db8/dee 0 2024-09-16T00:50:23.087 INFO:tasks.workunit.client.1.smithi152.stdout:8/713: stat dd/d15/d69/f9e 0 2024-09-16T00:50:23.091 INFO:tasks.workunit.client.1.smithi152.stdout:2/807: creat d4/d44/d7a/d9e/d66/dec/f110 x:0 0 0 2024-09-16T00:50:23.092 INFO:tasks.workunit.client.1.smithi152.stdout:8/714: dread dd/d98/db8/dcf/d88/fb3 [0,4194304] 0 2024-09-16T00:50:23.093 INFO:tasks.workunit.client.0.smithi053.stdout:6/406: dwrite d1/dc/d54/f64 [0,4194304] 0 2024-09-16T00:50:23.093 INFO:tasks.workunit.client.0.smithi053.stdout:6/407: chown d1/l3 8124 1 2024-09-16T00:50:23.096 INFO:tasks.workunit.client.0.smithi053.stdout:1/372: unlink d5/d18/c42 0 2024-09-16T00:50:23.099 INFO:tasks.workunit.client.1.smithi152.stdout:3/831: symlink dc/d10/d17/d5a/db2/d6f/d74/db5/l106 0 2024-09-16T00:50:23.100 INFO:tasks.workunit.client.0.smithi053.stdout:6/408: symlink d1/dc/d1e/l92 0 2024-09-16T00:50:23.100 INFO:tasks.workunit.client.0.smithi053.stdout:6/409: dread - d1/dc/d3d/f7b zero size 2024-09-16T00:50:23.101 INFO:tasks.workunit.client.1.smithi152.stdout:7/902: getdents d9/d31/d65/d8a/d41/d46 0 2024-09-16T00:50:23.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/903: chown d9/d31/d65/d8a/d41/d46/d7d/dac/cec 1 1 2024-09-16T00:50:23.103 INFO:tasks.workunit.client.0.smithi053.stdout:1/373: symlink d5/dd/d7f/l80 0 2024-09-16T00:50:23.103 INFO:tasks.workunit.client.0.smithi053.stdout:1/374: fsync d5/d18/d1f/f4a 0 2024-09-16T00:50:23.103 INFO:tasks.workunit.client.0.smithi053.stdout:1/375: fdatasync d5/d7/f52 0 2024-09-16T00:50:23.103 INFO:tasks.workunit.client.0.smithi053.stdout:1/376: truncate d5/d9/d4c/d61/f5c 288763 0 2024-09-16T00:50:23.105 INFO:tasks.workunit.client.0.smithi053.stdout:6/410: rename d1/dc/d3c/f82 to d1/dc/d66/f93 0 2024-09-16T00:50:23.105 INFO:tasks.workunit.client.0.smithi053.stdout:6/411: readlink d1/d2f/l46 0 2024-09-16T00:50:23.106 INFO:tasks.workunit.client.1.smithi152.stdout:0/848: truncate d3/d6/d8/fca 50304 0 2024-09-16T00:50:23.106 INFO:tasks.workunit.client.1.smithi152.stdout:0/849: write d3/d6/f10e [185096,114485] 0 2024-09-16T00:50:23.107 INFO:tasks.workunit.client.0.smithi053.stdout:1/377: creat d5/d9/d73/f81 x:0 0 0 2024-09-16T00:50:23.107 INFO:tasks.workunit.client.0.smithi053.stdout:1/378: dread - d5/dd/d47/d58/f71 zero size 2024-09-16T00:50:23.107 INFO:tasks.workunit.client.1.smithi152.stdout:1/930: dwrite d9/d3e/f52 [0,4194304] 0 2024-09-16T00:50:23.108 INFO:tasks.workunit.client.0.smithi053.stdout:9/460: dwrite d8/d1c/d2b/f86 [0,4194304] 0 2024-09-16T00:50:23.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/869: mknod d1/d4e/d48/d26/c116 0 2024-09-16T00:50:23.108 INFO:tasks.workunit.client.0.smithi053.stdout:6/412: stat d1/d2f/c3a 0 2024-09-16T00:50:23.112 INFO:tasks.workunit.client.1.smithi152.stdout:8/715: unlink dd/d23/l75 0 2024-09-16T00:50:23.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/716: readlink dd/d15/d1a/l56 0 2024-09-16T00:50:23.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/717: fsync dd/d15/d1a/f3a 0 2024-09-16T00:50:23.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/884: sync 2024-09-16T00:50:23.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/885: truncate db/d12/d23/d4a/d43/d48/d64/ff9 267842 0 2024-09-16T00:50:23.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/886: write db/d12/f1a [1826775,130864] 0 2024-09-16T00:50:23.115 INFO:tasks.workunit.client.1.smithi152.stdout:3/832: mkdir dc/d10/d17/d1c/d8d/d107 0 2024-09-16T00:50:23.116 INFO:tasks.workunit.client.1.smithi152.stdout:9/870: write d1/d7/d13/f37 [6068145,109569] 0 2024-09-16T00:50:23.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/850: write d3/d6/d64/f95 [284326,77318] 0 2024-09-16T00:50:23.117 INFO:tasks.workunit.client.1.smithi152.stdout:7/904: creat d9/d31/d65/d8a/d41/d130/f13b x:0 0 0 2024-09-16T00:50:23.122 INFO:tasks.workunit.client.1.smithi152.stdout:1/931: mknod d9/d3e/d4b/d6b/d6d/d12f/c159 0 2024-09-16T00:50:23.124 INFO:tasks.workunit.client.1.smithi152.stdout:8/718: truncate dd/d98/db8/dcf/d29/f7e 3433635 0 2024-09-16T00:50:23.124 INFO:tasks.workunit.client.1.smithi152.stdout:8/719: chown dd/d25/da4/fcd 8849694 1 2024-09-16T00:50:23.130 INFO:tasks.workunit.client.1.smithi152.stdout:6/887: creat db/d12/d20/d86/d91/dde/f117 x:0 0 0 2024-09-16T00:50:23.130 INFO:tasks.workunit.client.1.smithi152.stdout:1/932: dread d9/da/df/f2c [0,4194304] 0 2024-09-16T00:50:23.130 INFO:tasks.workunit.client.1.smithi152.stdout:1/933: dread - d9/da/df/f150 zero size 2024-09-16T00:50:23.134 INFO:tasks.workunit.client.1.smithi152.stdout:3/833: mkdir dc/d5c/dae/df1/d108 0 2024-09-16T00:50:23.134 INFO:tasks.workunit.client.1.smithi152.stdout:3/834: write dc/f15 [9238888,89375] 0 2024-09-16T00:50:23.135 INFO:tasks.workunit.client.0.smithi053.stdout:9/461: unlink d8/d22/d26/c38 0 2024-09-16T00:50:23.136 INFO:tasks.workunit.client.0.smithi053.stdout:9/462: chown d8/d4c/d5b/f91 1 1 2024-09-16T00:50:23.138 INFO:tasks.workunit.client.1.smithi152.stdout:9/871: creat d1/d7/d77/dfc/f117 x:0 0 0 2024-09-16T00:50:23.138 INFO:tasks.workunit.client.0.smithi053.stdout:6/413: rmdir d1/dc/d3c/d4b 39 2024-09-16T00:50:23.139 INFO:tasks.workunit.client.0.smithi053.stdout:6/414: write d1/dc/d39/f34 [941104,31260] 0 2024-09-16T00:50:23.139 INFO:tasks.workunit.client.0.smithi053.stdout:6/415: creat d1/dc/d45/f94 x:0 0 0 2024-09-16T00:50:23.139 INFO:tasks.workunit.client.0.smithi053.stdout:6/416: fdatasync d1/dc/d3c/d4b/f91 0 2024-09-16T00:50:23.140 INFO:tasks.workunit.client.1.smithi152.stdout:0/851: getdents d3/d6/d8/d1d/d65/db0/dc6 0 2024-09-16T00:50:23.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/322: unlink d3/f5a 0 2024-09-16T00:50:23.143 INFO:tasks.workunit.client.0.smithi053.stdout:5/323: dread - d3/d7/d24/d3f/f5e zero size 2024-09-16T00:50:23.144 INFO:tasks.workunit.client.1.smithi152.stdout:7/905: mknod d9/d31/d65/d8a/d41/d46/d7d/c13c 0 2024-09-16T00:50:23.144 INFO:tasks.workunit.client.1.smithi152.stdout:7/906: creat d9/db6/f13d x:0 0 0 2024-09-16T00:50:23.146 INFO:tasks.workunit.client.0.smithi053.stdout:1/379: rename d5/d18/d5b to d5/d7/d39/d57/d82 0 2024-09-16T00:50:23.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/888: dwrite db/d12/fe5 [0,4194304] 0 2024-09-16T00:50:23.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/889: stat db/d12/d23/d4a/d43/d48/d6a/c9f 0 2024-09-16T00:50:23.148 INFO:tasks.workunit.client.1.smithi152.stdout:8/720: link dd/d15/d49/f7b dd/d15/d1a/fef 0 2024-09-16T00:50:23.148 INFO:tasks.workunit.client.1.smithi152.stdout:8/721: dread - dd/d15/d69/f87 zero size 2024-09-16T00:50:23.149 INFO:tasks.workunit.client.0.smithi053.stdout:9/463: readlink d8/l2a 0 2024-09-16T00:50:23.149 INFO:tasks.workunit.client.0.smithi053.stdout:5/324: dread d3/f32 [0,4194304] 0 2024-09-16T00:50:23.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/934: mknod d9/d3e/d41/d31/da5/d12c/d14d/c15a 0 2024-09-16T00:50:23.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/935: write d9/d3e/d41/d31/d48/f135 [915285,84251] 0 2024-09-16T00:50:23.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/936: dread - d9/da/d14e/ffa zero size 2024-09-16T00:50:23.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/808: fsync d4/d44/d7a/d9e/d66/dec/f110 0 2024-09-16T00:50:23.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/809: write d4/d44/d7a/f7e [2584709,68621] 0 2024-09-16T00:50:23.154 INFO:tasks.workunit.client.1.smithi152.stdout:3/835: creat dc/f109 x:0 0 0 2024-09-16T00:50:23.156 INFO:tasks.workunit.client.0.smithi053.stdout:5/325: rmdir d3/d7/d24/d34 39 2024-09-16T00:50:23.157 INFO:tasks.workunit.client.1.smithi152.stdout:9/872: getdents d1/d4e/d48/d26/d30/d8f 0 2024-09-16T00:50:23.157 INFO:tasks.workunit.client.1.smithi152.stdout:9/873: dread - d1/d7/d77/d32/da5/da8/dc5/df5/ffe zero size 2024-09-16T00:50:23.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/326: write d3/f20 [825896,13282] 0 2024-09-16T00:50:23.161 INFO:tasks.workunit.client.1.smithi152.stdout:7/907: symlink d9/d31/d65/d8a/d41/d130/l13e 0 2024-09-16T00:50:23.164 INFO:tasks.workunit.client.0.smithi053.stdout:5/327: creat d3/d7/d24/f65 x:0 0 0 2024-09-16T00:50:23.164 INFO:tasks.workunit.client.0.smithi053.stdout:5/328: creat d3/d7/d24/f66 x:0 0 0 2024-09-16T00:50:23.164 INFO:tasks.workunit.client.0.smithi053.stdout:5/329: fdatasync d3/d7/f2a 0 2024-09-16T00:50:23.164 INFO:tasks.workunit.client.0.smithi053.stdout:1/380: write d5/d9/d4c/d61/f15 [3359064,61423] 0 2024-09-16T00:50:23.164 INFO:tasks.workunit.client.0.smithi053.stdout:6/417: dwrite d1/f86 [0,4194304] 0 2024-09-16T00:50:23.166 INFO:tasks.workunit.client.0.smithi053.stdout:6/418: write d1/dc/d1e/f8d [477082,98630] 0 2024-09-16T00:50:23.168 INFO:tasks.workunit.client.0.smithi053.stdout:6/419: dread d1/f57 [0,4194304] 0 2024-09-16T00:50:23.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/890: mkdir db/d12/d20/d118 0 2024-09-16T00:50:23.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/891: fdatasync db/d12/d23/d4a/d43/d48/d6a/f102 0 2024-09-16T00:50:23.175 INFO:tasks.workunit.client.1.smithi152.stdout:1/937: truncate d9/d3e/d4b/f11e 681096 0 2024-09-16T00:50:23.175 INFO:tasks.workunit.client.0.smithi053.stdout:5/330: mkdir d3/d7/d2b/d2f/d67 0 2024-09-16T00:50:23.175 INFO:tasks.workunit.client.0.smithi053.stdout:5/331: dread - d3/d7/d2b/d4b/d4f/f54 zero size 2024-09-16T00:50:23.179 INFO:tasks.workunit.client.0.smithi053.stdout:9/464: dwrite d8/d19/d51/f56 [0,4194304] 0 2024-09-16T00:50:23.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/722: dwrite dd/f42 [0,4194304] 0 2024-09-16T00:50:23.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/810: rename d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/fbe to d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/f111 0 2024-09-16T00:50:23.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/811: truncate d4/d44/d7a/dc7/de4/d20/fd3 625828 0 2024-09-16T00:50:23.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/812: write d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/fd1 [790997,107144] 0 2024-09-16T00:50:23.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/813: fdatasync d4/d44/d7a/dc7/de4/f4f 0 2024-09-16T00:50:23.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/852: getdents d3/d6/d2e/d58 0 2024-09-16T00:50:23.187 INFO:tasks.workunit.client.0.smithi053.stdout:6/420: dwrite d1/d2f/f7d [0,4194304] 0 2024-09-16T00:50:23.190 INFO:tasks.workunit.client.0.smithi053.stdout:5/332: mkdir d3/d7/d2b/d2f/d68 0 2024-09-16T00:50:23.190 INFO:tasks.workunit.client.0.smithi053.stdout:1/381: dwrite d5/d5a/f7e [0,4194304] 0 2024-09-16T00:50:23.191 INFO:tasks.workunit.client.1.smithi152.stdout:7/908: getdents d9/d31/d65/d8a/d41 0 2024-09-16T00:50:23.192 INFO:tasks.workunit.client.1.smithi152.stdout:7/909: write d9/d31/d65/d8a/d41/d46/d7d/de2/f107 [600068,20832] 0 2024-09-16T00:50:23.193 INFO:tasks.workunit.client.1.smithi152.stdout:2/814: dread d4/d44/f96 [0,4194304] 0 2024-09-16T00:50:23.193 INFO:tasks.workunit.client.1.smithi152.stdout:2/815: write d4/d44/df6/f41 [348823,80019] 0 2024-09-16T00:50:23.193 INFO:tasks.workunit.client.1.smithi152.stdout:2/816: read d4/d44/d7a/dc7/de4/d94/f69 [2369190,123793] 0 2024-09-16T00:50:23.193 INFO:tasks.workunit.client.1.smithi152.stdout:2/817: dread - d4/d44/d7a/dc7/de4/d20/d28/d2c/fc4 zero size 2024-09-16T00:50:23.194 INFO:tasks.workunit.client.1.smithi152.stdout:6/892: truncate f9 1036663 0 2024-09-16T00:50:23.194 INFO:tasks.workunit.client.1.smithi152.stdout:6/893: chown db/d12/d23/d3a/c8c 521876 1 2024-09-16T00:50:23.196 INFO:tasks.workunit.client.1.smithi152.stdout:1/938: creat d9/d3e/d7b/f15b x:0 0 0 2024-09-16T00:50:23.197 INFO:tasks.workunit.client.0.smithi053.stdout:9/465: mkdir d8/d1c/d2b/d2c/d9b 0 2024-09-16T00:50:23.205 INFO:tasks.workunit.client.0.smithi053.stdout:5/333: dread d3/d7/d2b/d37/d58/f23 [0,4194304] 0 2024-09-16T00:50:23.206 INFO:tasks.workunit.client.1.smithi152.stdout:3/836: rename dc/d10/d17/d5a/db2/d6f/dbb/le7 to dc/d10/d17/d5a/db2/l10a 0 2024-09-16T00:50:23.206 INFO:tasks.workunit.client.1.smithi152.stdout:9/874: rename d1/d4e/d48/d26 to d1/d4e/d48/d26/d30/d4f/d50/d118 22 2024-09-16T00:50:23.207 INFO:tasks.workunit.client.0.smithi053.stdout:6/421: creat d1/dc/f95 x:0 0 0 2024-09-16T00:50:23.212 INFO:tasks.workunit.client.1.smithi152.stdout:6/894: dwrite db/d12/f14 [0,4194304] 0 2024-09-16T00:50:23.214 INFO:tasks.workunit.client.1.smithi152.stdout:7/910: mkdir d9/d31/dc4/d13f 0 2024-09-16T00:50:23.215 INFO:tasks.workunit.client.1.smithi152.stdout:7/911: chown d9/d31/d64/d3c/db9/dd3/d100/d82/ffa 433563419 1 2024-09-16T00:50:23.215 INFO:tasks.workunit.client.1.smithi152.stdout:7/912: creat d9/d31/d65/d8a/d41/d46/d7d/d86/f140 x:0 0 0 2024-09-16T00:50:23.220 INFO:tasks.workunit.client.0.smithi053.stdout:1/382: creat d5/dd/d7f/f83 x:0 0 0 2024-09-16T00:50:23.224 INFO:tasks.workunit.client.0.smithi053.stdout:5/334: symlink d3/d7/d24/d34/l69 0 2024-09-16T00:50:23.224 INFO:tasks.workunit.client.0.smithi053.stdout:5/335: chown d3/f2c 34 1 2024-09-16T00:50:23.226 INFO:tasks.workunit.client.0.smithi053.stdout:6/422: symlink d1/dc/d66/l96 0 2024-09-16T00:50:23.227 INFO:tasks.workunit.client.0.smithi053.stdout:6/423: chown d1/dc/d39/f1c 1708 1 2024-09-16T00:50:23.227 INFO:tasks.workunit.client.0.smithi053.stdout:6/424: write d1/dc/d3c/d4b/f91 [798648,46299] 0 2024-09-16T00:50:23.228 INFO:tasks.workunit.client.1.smithi152.stdout:2/818: mkdir d4/d44/d7a/dc7/de4/d20/d28/d112 0 2024-09-16T00:50:23.231 INFO:tasks.workunit.client.1.smithi152.stdout:2/819: dread d4/f104 [0,4194304] 0 2024-09-16T00:50:23.233 INFO:tasks.workunit.client.0.smithi053.stdout:9/466: rmdir d8/d4c 39 2024-09-16T00:50:23.235 INFO:tasks.workunit.client.0.smithi053.stdout:5/336: rmdir d3/d7/d2b/d2f/d68 0 2024-09-16T00:50:23.238 INFO:tasks.workunit.client.0.smithi053.stdout:1/383: dwrite d5/d7/d39/f55 [0,4194304] 0 2024-09-16T00:50:23.238 INFO:tasks.workunit.client.0.smithi053.stdout:6/425: mknod d1/dc/d3c/d4a/c97 0 2024-09-16T00:50:23.240 INFO:tasks.workunit.client.0.smithi053.stdout:9/467: creat d8/d4c/d5b/f9c x:0 0 0 2024-09-16T00:50:23.246 INFO:tasks.workunit.client.0.smithi053.stdout:5/337: write d3/f4 [1992425,19911] 0 2024-09-16T00:50:23.246 INFO:tasks.workunit.client.0.smithi053.stdout:1/384: mkdir d5/d9/d73/d84 0 2024-09-16T00:50:23.246 INFO:tasks.workunit.client.0.smithi053.stdout:1/385: creat d5/d9/d4c/d61/f85 x:0 0 0 2024-09-16T00:50:23.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/723: rename dd/d25/l3b to dd/d98/db8/dcf/d29/d2f/d5f/lf0 0 2024-09-16T00:50:23.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/724: creat dd/d15/d9b/ff1 x:0 0 0 2024-09-16T00:50:23.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/725: creat dd/d15/d49/ff2 x:0 0 0 2024-09-16T00:50:23.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/726: write dd/d25/da4/fcd [1068001,51583] 0 2024-09-16T00:50:23.248 INFO:tasks.workunit.client.0.smithi053.stdout:6/426: mknod d1/d2f/c98 0 2024-09-16T00:50:23.249 INFO:tasks.workunit.client.1.smithi152.stdout:8/727: read dd/d98/db8/dcf/d29/d2f/d53/f73 [374999,14050] 0 2024-09-16T00:50:23.249 INFO:tasks.workunit.client.1.smithi152.stdout:8/728: dread - dd/d98/db8/dcf/d88/fbf zero size 2024-09-16T00:50:23.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/875: getdents d1/d7 0 2024-09-16T00:50:23.251 INFO:tasks.workunit.client.1.smithi152.stdout:3/837: mkdir dc/d10/d17/d4f/d10b 0 2024-09-16T00:50:23.253 INFO:tasks.workunit.client.0.smithi053.stdout:5/338: rename d3/d7/d24/d34/l41 to d3/d7/d2b/l6a 0 2024-09-16T00:50:23.254 INFO:tasks.workunit.client.1.smithi152.stdout:6/895: truncate db/d28/db3/fc4 3803929 0 2024-09-16T00:50:23.254 INFO:tasks.workunit.client.1.smithi152.stdout:6/896: dread - db/d12/d23/d4a/d33/dbe/f104 zero size 2024-09-16T00:50:23.257 INFO:tasks.workunit.client.0.smithi053.stdout:6/427: dread d1/dc/d3c/d4b/f91 [0,4194304] 0 2024-09-16T00:50:23.257 INFO:tasks.workunit.client.0.smithi053.stdout:6/428: chown d1/dc/d66/f93 2259937 1 2024-09-16T00:50:23.257 INFO:tasks.workunit.client.0.smithi053.stdout:6/429: chown d1/dc/d66/f93 55642824 1 2024-09-16T00:50:23.257 INFO:tasks.workunit.client.0.smithi053.stdout:9/468: dwrite d8/d1c/d2b/f96 [0,4194304] 0 2024-09-16T00:50:23.257 INFO:tasks.workunit.client.0.smithi053.stdout:1/386: rmdir d5/d9 39 2024-09-16T00:50:23.258 INFO:tasks.workunit.client.0.smithi053.stdout:8/461: sync 2024-09-16T00:50:23.258 INFO:tasks.workunit.client.0.smithi053.stdout:3/442: sync 2024-09-16T00:50:23.258 INFO:tasks.workunit.client.0.smithi053.stdout:8/462: truncate d10/d52/f9c 1019948 0 2024-09-16T00:50:23.258 INFO:tasks.workunit.client.0.smithi053.stdout:8/463: chown d10/c17 7 1 2024-09-16T00:50:23.259 INFO:tasks.workunit.client.1.smithi152.stdout:7/913: symlink d9/d31/d65/d8a/d41/d130/l141 0 2024-09-16T00:50:23.261 INFO:tasks.workunit.client.1.smithi152.stdout:1/939: getdents d9/d3e/d41/d31/d48 0 2024-09-16T00:50:23.262 INFO:tasks.workunit.client.0.smithi053.stdout:5/339: write d3/d7/d2b/d37/d58/f4e [1486481,91839] 0 2024-09-16T00:50:23.265 INFO:tasks.workunit.client.0.smithi053.stdout:6/430: dread d1/dc/d39/f56 [0,4194304] 0 2024-09-16T00:50:23.265 INFO:tasks.workunit.client.0.smithi053.stdout:6/431: chown d1/dc/d3d/l8e 18 1 2024-09-16T00:50:23.265 INFO:tasks.workunit.client.0.smithi053.stdout:6/432: readlink d1/dc/d66/l96 0 2024-09-16T00:50:23.265 INFO:tasks.workunit.client.0.smithi053.stdout:6/433: creat d1/dc/f99 x:0 0 0 2024-09-16T00:50:23.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/820: rename d4/d44/d7a/dc7/de4/d20/d28/d2c/lc0 to d4/d44/df6/d10b/l113 0 2024-09-16T00:50:23.268 INFO:tasks.workunit.client.0.smithi053.stdout:9/469: symlink d8/d1c/d2b/d2c/l9d 0 2024-09-16T00:50:23.272 INFO:tasks.workunit.client.0.smithi053.stdout:3/443: link d1/f6d d1/d5/d31/d42/f8c 0 2024-09-16T00:50:23.272 INFO:tasks.workunit.client.0.smithi053.stdout:3/444: write d1/d5/d31/d3b/f44 [972154,68305] 0 2024-09-16T00:50:23.272 INFO:tasks.workunit.client.0.smithi053.stdout:3/445: readlink d1/d5/d16/d47/d6c/l75 0 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:3/446: chown d1/d5/d16 393 1 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:3/447: creat d1/d4e/f8d x:0 0 0 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:1/387: dwrite d5/d9/d4c/d61/f6e [0,4194304] 0 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:1/388: stat d5/d7/f22 0 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:1/389: chown d5/dd/d47/d58/f2a 7583 1 2024-09-16T00:50:23.273 INFO:tasks.workunit.client.0.smithi053.stdout:1/390: creat d5/d7/f86 x:0 0 0 2024-09-16T00:50:23.274 INFO:tasks.workunit.client.0.smithi053.stdout:8/464: getdents d10/d21/d28 0 2024-09-16T00:50:23.275 INFO:tasks.workunit.client.0.smithi053.stdout:8/465: read d10/f1d [508697,29275] 0 2024-09-16T00:50:23.277 INFO:tasks.workunit.client.0.smithi053.stdout:3/448: dread d1/d5/f19 [0,4194304] 0 2024-09-16T00:50:23.279 INFO:tasks.workunit.client.0.smithi053.stdout:6/434: unlink d1/c78 0 2024-09-16T00:50:23.281 INFO:tasks.workunit.client.0.smithi053.stdout:9/470: readlink d8/d13/l23 0 2024-09-16T00:50:23.281 INFO:tasks.workunit.client.0.smithi053.stdout:9/471: write d8/d22/d26/f68 [491628,97191] 0 2024-09-16T00:50:23.284 INFO:tasks.workunit.client.1.smithi152.stdout:9/876: link d1/d4e/d48/d2b/d93/d96/fee d1/d4e/d48/d26/d58/de1/f119 0 2024-09-16T00:50:23.284 INFO:tasks.workunit.client.1.smithi152.stdout:9/877: readlink d1/d7/d13/l90 0 2024-09-16T00:50:23.287 INFO:tasks.workunit.client.1.smithi152.stdout:3/838: mknod dc/d10/d17/d4f/d10b/c10c 0 2024-09-16T00:50:23.287 INFO:tasks.workunit.client.1.smithi152.stdout:3/839: chown dc/d10/d17/d4f/d10b/c10c 1919757 1 2024-09-16T00:50:23.289 INFO:tasks.workunit.client.0.smithi053.stdout:3/449: write d1/d5/d31/f3d [2442197,101898] 0 2024-09-16T00:50:23.291 INFO:tasks.workunit.client.1.smithi152.stdout:6/897: creat db/d12/d23/d4a/dc5/dd0/f119 x:0 0 0 2024-09-16T00:50:23.291 INFO:tasks.workunit.client.1.smithi152.stdout:6/898: creat db/d28/dd8/f11a x:0 0 0 2024-09-16T00:50:23.294 INFO:tasks.workunit.client.1.smithi152.stdout:7/914: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d142 0 2024-09-16T00:50:23.295 INFO:tasks.workunit.client.0.smithi053.stdout:6/435: dwrite d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:23.295 INFO:tasks.workunit.client.0.smithi053.stdout:6/436: stat d1/dc/d39/f67 0 2024-09-16T00:50:23.295 INFO:tasks.workunit.client.0.smithi053.stdout:6/437: dread - d1/dc/d43/f83 zero size 2024-09-16T00:50:23.297 INFO:tasks.workunit.client.1.smithi152.stdout:1/940: symlink d9/d3e/d41/d31/da5/l15c 0 2024-09-16T00:50:23.297 INFO:tasks.workunit.client.1.smithi152.stdout:1/941: chown d9/d3e/d41/f4e 498809399 1 2024-09-16T00:50:23.298 INFO:tasks.workunit.client.0.smithi053.stdout:1/391: link d5/d9/d77/f7b d5/d18/d1f/f87 0 2024-09-16T00:50:23.301 INFO:tasks.workunit.client.0.smithi053.stdout:8/466: truncate d10/d21/d28/d3c/d63/d6a/f93 374430 0 2024-09-16T00:50:23.307 INFO:tasks.workunit.client.1.smithi152.stdout:2/821: creat d4/d44/d7a/d9e/d87/d9c/dd9/f114 x:0 0 0 2024-09-16T00:50:23.310 INFO:tasks.workunit.client.0.smithi053.stdout:3/450: symlink d1/d5/d11/l8e 0 2024-09-16T00:50:23.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/878: creat d1/d7/d13/d5d/dbd/f11a x:0 0 0 2024-09-16T00:50:23.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/942: dwrite d9/d3e/f103 [0,4194304] 0 2024-09-16T00:50:23.315 INFO:tasks.workunit.client.1.smithi152.stdout:8/729: write dd/d15/d49/f21 [932594,51808] 0 2024-09-16T00:50:23.315 INFO:tasks.workunit.client.1.smithi152.stdout:7/915: dwrite d9/d10/da5/fbd [0,4194304] 0 2024-09-16T00:50:23.315 INFO:tasks.workunit.client.1.smithi152.stdout:8/730: fdatasync dd/d15/d69/f87 0 2024-09-16T00:50:23.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/731: fdatasync dd/d15/f62 0 2024-09-16T00:50:23.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/732: creat dd/d98/db8/dcf/ff3 x:0 0 0 2024-09-16T00:50:23.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/733: truncate dd/d98/db8/dcf/faa 880143 0 2024-09-16T00:50:23.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/899: mkdir db/da8/db7/d11b 0 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi152 to 2240M 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:23.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:22 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:50:23.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/822: readlink d4/d44/df6/lbb 0 2024-09-16T00:50:23.325 INFO:tasks.workunit.client.0.smithi053.stdout:6/438: mknod d1/dc/d1e/c9a 0 2024-09-16T00:50:23.325 INFO:tasks.workunit.client.0.smithi053.stdout:6/439: readlink d1/d2f/l36 0 2024-09-16T00:50:23.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/840: mknod dc/d10/d47/c10d 0 2024-09-16T00:50:23.330 INFO:tasks.workunit.client.1.smithi152.stdout:8/734: dwrite dd/d15/d49/fa0 [0,4194304] 0 2024-09-16T00:50:23.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/853: sync 2024-09-16T00:50:23.331 INFO:tasks.workunit.client.0.smithi053.stdout:8/467: link d10/d21/d28/d3c/d61/c6b d10/d1c/d92/d66/d9d/ca0 0 2024-09-16T00:50:23.332 INFO:tasks.workunit.client.0.smithi053.stdout:8/468: stat d10/d4a/d54/c8c 0 2024-09-16T00:50:23.333 INFO:tasks.workunit.client.0.smithi053.stdout:3/451: mknod d1/d5/d16/d5e/d69/c8f 0 2024-09-16T00:50:23.333 INFO:tasks.workunit.client.0.smithi053.stdout:3/452: chown d1/d5/d16/d47/d64/l81 1570420988 1 2024-09-16T00:50:23.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/943: creat d9/d3e/d4b/d50/d115/d144/d155/f15d x:0 0 0 2024-09-16T00:50:23.336 INFO:tasks.workunit.client.0.smithi053.stdout:6/440: mkdir d1/d2f/d9b 0 2024-09-16T00:50:23.336 INFO:tasks.workunit.client.0.smithi053.stdout:6/441: creat d1/dc/d3d/f9c x:0 0 0 2024-09-16T00:50:23.339 INFO:tasks.workunit.client.1.smithi152.stdout:2/823: dwrite d4/d44/df6/d3e/f109 [0,4194304] 0 2024-09-16T00:50:23.339 INFO:tasks.workunit.client.0.smithi053.stdout:1/392: rename d5/d9/d4c/d61/d5f to d5/d9/d88 0 2024-09-16T00:50:23.339 INFO:tasks.workunit.client.0.smithi053.stdout:1/393: chown d5/d9/d4c/d61/l54 22 1 2024-09-16T00:50:23.340 INFO:tasks.workunit.client.0.smithi053.stdout:1/394: read - d5/d18/f79 zero size 2024-09-16T00:50:23.343 INFO:tasks.workunit.client.0.smithi053.stdout:8/469: creat d10/d21/d28/fa1 x:0 0 0 2024-09-16T00:50:23.344 INFO:tasks.workunit.client.0.smithi053.stdout:8/470: chown d10 53274397 1 2024-09-16T00:50:23.344 INFO:tasks.workunit.client.0.smithi053.stdout:8/471: dread - d10/d21/d28/fa1 zero size 2024-09-16T00:50:23.346 INFO:tasks.workunit.client.0.smithi053.stdout:3/453: mkdir d1/d5/d16/d5e/d90 0 2024-09-16T00:50:23.347 INFO:tasks.workunit.client.1.smithi152.stdout:6/900: symlink db/d12/d23/d4a/dc5/dd0/l11c 0 2024-09-16T00:50:23.353 INFO:tasks.workunit.client.0.smithi053.stdout:1/395: link d5/d5a/f7e d5/d9/d4c/f89 0 2024-09-16T00:50:23.354 INFO:tasks.workunit.client.1.smithi152.stdout:3/841: write dc/d10/f87 [4828582,106081] 0 2024-09-16T00:50:23.356 INFO:tasks.workunit.client.0.smithi053.stdout:3/454: write d1/f6d [2619426,85862] 0 2024-09-16T00:50:23.358 INFO:tasks.workunit.client.0.smithi053.stdout:1/396: mkdir d5/d18/d33/d8a 0 2024-09-16T00:50:23.359 INFO:tasks.workunit.client.0.smithi053.stdout:8/472: getdents d10/d21/d28/d3c/d63/d6a 0 2024-09-16T00:50:23.359 INFO:tasks.workunit.client.0.smithi053.stdout:8/473: fdatasync d10/d1c/d2b/f5d 0 2024-09-16T00:50:23.360 INFO:tasks.workunit.client.1.smithi152.stdout:8/735: link dd/d15/d49/fa0 dd/d15/d1a/ff4 0 2024-09-16T00:50:23.361 INFO:tasks.workunit.client.0.smithi053.stdout:6/442: dwrite d1/dc/d39/f13 [0,4194304] 0 2024-09-16T00:50:23.361 INFO:tasks.workunit.client.0.smithi053.stdout:6/443: write d1/dc/d3d/f61 [296820,46304] 0 2024-09-16T00:50:23.361 INFO:tasks.workunit.client.0.smithi053.stdout:1/397: link d5/d9/f4b d5/d7/d39/d57/d82/f8b 0 2024-09-16T00:50:23.364 INFO:tasks.workunit.client.1.smithi152.stdout:0/854: symlink d3/d6/d64/de5/l11d 0 2024-09-16T00:50:23.365 INFO:tasks.workunit.client.0.smithi053.stdout:8/474: rename d10/d21/d28/d3c/d61 to d10/d21/d28/da2 0 2024-09-16T00:50:23.366 INFO:tasks.workunit.client.0.smithi053.stdout:8/475: creat d10/d1c/d2b/d40/fa3 x:0 0 0 2024-09-16T00:50:23.366 INFO:tasks.workunit.client.1.smithi152.stdout:3/842: write dc/d10/d17/d1c/d1f/d24/f65 [1446616,4995] 0 2024-09-16T00:50:23.366 INFO:tasks.workunit.client.1.smithi152.stdout:3/843: creat dc/d10/d17/d1c/d50/d55/d6d/dea/df4/f10e x:0 0 0 2024-09-16T00:50:23.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/944: mkdir d9/d3e/d4b/d6b/d6d/d99/d15e 0 2024-09-16T00:50:23.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/945: creat d9/d3e/d41/d31/da5/f15f x:0 0 0 2024-09-16T00:50:23.369 INFO:tasks.workunit.client.0.smithi053.stdout:1/398: mknod d5/c8c 0 2024-09-16T00:50:23.372 INFO:tasks.workunit.client.1.smithi152.stdout:2/824: symlink d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/l115 0 2024-09-16T00:50:23.373 INFO:tasks.workunit.client.1.smithi152.stdout:8/736: read dd/d98/db8/dcf/d29/d2f/d5f/f7f [864552,4569] 0 2024-09-16T00:50:23.375 INFO:tasks.workunit.client.1.smithi152.stdout:7/916: truncate d9/d31/d64/f8e 1036423 0 2024-09-16T00:50:23.375 INFO:tasks.workunit.client.1.smithi152.stdout:7/917: stat d9/d31/d64/d3c/f44 0 2024-09-16T00:50:23.375 INFO:tasks.workunit.client.1.smithi152.stdout:3/844: dread dc/f1a [0,4194304] 0 2024-09-16T00:50:23.376 INFO:tasks.workunit.client.0.smithi053.stdout:1/399: unlink d5/lb 0 2024-09-16T00:50:23.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/879: rename d1/d7/d77/dfc to d1/d4e/d48/d2b/d11b 0 2024-09-16T00:50:23.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/880: dread - d1/d4e/d48/ffd zero size 2024-09-16T00:50:23.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/881: chown d1/d7/d13/d80/f91 619313444 1 2024-09-16T00:50:23.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/882: chown d1/d4e/d48/d2b/d93/d96 47 1 2024-09-16T00:50:23.380 INFO:tasks.workunit.client.0.smithi053.stdout:8/476: getdents d10/d1c/d49 0 2024-09-16T00:50:23.382 INFO:tasks.workunit.client.0.smithi053.stdout:6/444: dwrite d1/fd [0,4194304] 0 2024-09-16T00:50:23.384 INFO:tasks.workunit.client.1.smithi152.stdout:0/855: symlink d3/d6/d8/d1d/d65/db0/dc6/l11e 0 2024-09-16T00:50:23.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/477: mknod d10/ca4 0 2024-09-16T00:50:23.389 INFO:tasks.workunit.client.1.smithi152.stdout:8/737: dread dd/d98/db8/dcf/d29/f80 [0,4194304] 0 2024-09-16T00:50:23.389 INFO:tasks.workunit.client.1.smithi152.stdout:8/738: write dd/d15/d69/f87 [495724,24306] 0 2024-09-16T00:50:23.390 INFO:tasks.workunit.client.1.smithi152.stdout:9/883: dread d1/de2/fe5 [0,4194304] 0 2024-09-16T00:50:23.394 INFO:tasks.workunit.client.0.smithi053.stdout:8/478: truncate d10/d1c/d49/f64 1608187 0 2024-09-16T00:50:23.394 INFO:tasks.workunit.client.1.smithi152.stdout:9/884: dread d1/d7/d13/fad [0,4194304] 0 2024-09-16T00:50:23.395 INFO:tasks.workunit.client.1.smithi152.stdout:1/946: symlink d9/d3e/d4b/d6b/d6d/d99/d15e/l160 0 2024-09-16T00:50:23.395 INFO:tasks.workunit.client.1.smithi152.stdout:1/947: write d9/d3e/d41/d31/d48/db2/fe1 [4591146,54229] 0 2024-09-16T00:50:23.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/825: truncate d4/d44/d7a/dc7/de4/f4f 3024367 0 2024-09-16T00:50:23.398 INFO:tasks.workunit.client.0.smithi053.stdout:1/400: dwrite d5/dd/d47/d58/f78 [0,4194304] 0 2024-09-16T00:50:23.398 INFO:tasks.workunit.client.0.smithi053.stdout:1/401: truncate d5/d9/d4c/d61/f12 1569987 0 2024-09-16T00:50:23.399 INFO:tasks.workunit.client.0.smithi053.stdout:1/402: dread - d5/d18/f79 zero size 2024-09-16T00:50:23.399 INFO:tasks.workunit.client.1.smithi152.stdout:7/918: symlink d9/d31/d65/d8a/d41/l143 0 2024-09-16T00:50:23.399 INFO:tasks.workunit.client.1.smithi152.stdout:7/919: creat d9/db6/f144 x:0 0 0 2024-09-16T00:50:23.400 INFO:tasks.workunit.client.1.smithi152.stdout:3/845: mknod dc/d10/d17/d5a/db2/d6f/dbb/c10f 0 2024-09-16T00:50:23.401 INFO:tasks.workunit.client.1.smithi152.stdout:9/885: write d1/d7/d13/f37 [123486,60586] 0 2024-09-16T00:50:23.401 INFO:tasks.workunit.client.1.smithi152.stdout:9/886: dread - d1/d7/d77/d3c/dc9/fe3 zero size 2024-09-16T00:50:23.402 INFO:tasks.workunit.client.1.smithi152.stdout:0/856: getdents d3/d6/d8/d1d/d23/d25/d45/d6f 0 2024-09-16T00:50:23.402 INFO:tasks.workunit.client.1.smithi152.stdout:0/857: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/d102 4 1 2024-09-16T00:50:23.402 INFO:tasks.workunit.client.0.smithi053.stdout:6/445: dwrite d1/dc/f48 [0,4194304] 0 2024-09-16T00:50:23.403 INFO:tasks.workunit.client.0.smithi053.stdout:7/380: sync 2024-09-16T00:50:23.404 INFO:tasks.workunit.client.0.smithi053.stdout:4/287: sync 2024-09-16T00:50:23.404 INFO:tasks.workunit.client.0.smithi053.stdout:0/474: sync 2024-09-16T00:50:23.404 INFO:tasks.workunit.client.0.smithi053.stdout:4/288: fdatasync d0/d3c/f5c 0 2024-09-16T00:50:23.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/826: mknod d4/d44/d7a/d9e/da0/df1/c116 0 2024-09-16T00:50:23.409 INFO:tasks.workunit.client.1.smithi152.stdout:8/739: dread dd/f1f [0,4194304] 0 2024-09-16T00:50:23.411 INFO:tasks.workunit.client.1.smithi152.stdout:7/920: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d142/d145 0 2024-09-16T00:50:23.414 INFO:tasks.workunit.client.1.smithi152.stdout:8/740: write dd/d15/d49/f6f [1198766,19271] 0 2024-09-16T00:50:23.414 INFO:tasks.workunit.client.1.smithi152.stdout:8/741: write dd/d98/db8/dcf/d88/fbc [866113,124870] 0 2024-09-16T00:50:23.414 INFO:tasks.workunit.client.1.smithi152.stdout:8/742: write dd/f4c [4575525,129597] 0 2024-09-16T00:50:23.414 INFO:tasks.workunit.client.1.smithi152.stdout:8/743: write dd/d98/db8/dcf/d29/f80 [4341969,38495] 0 2024-09-16T00:50:23.417 INFO:tasks.workunit.client.1.smithi152.stdout:0/858: read d3/d6/d8/d1d/d65/d6e/d82/f91 [6991102,6672] 0 2024-09-16T00:50:23.417 INFO:tasks.workunit.client.1.smithi152.stdout:0/859: read - d3/d6/d64/d6a/fd5 zero size 2024-09-16T00:50:23.417 INFO:tasks.workunit.client.1.smithi152.stdout:0/860: truncate d3/d6/d8/d1d/d23/d4b/d54/ffd 48466 0 2024-09-16T00:50:23.417 INFO:tasks.workunit.client.0.smithi053.stdout:6/446: mknod d1/dc/d43/c9d 0 2024-09-16T00:50:23.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/887: symlink d1/l11c 0 2024-09-16T00:50:23.420 INFO:tasks.workunit.client.1.smithi152.stdout:9/888: write d1/d4e/d48/d26/d58/de1/f119 [64409,10796] 0 2024-09-16T00:50:23.420 INFO:tasks.workunit.client.1.smithi152.stdout:9/889: chown d1/d4e/d48/d26/d30/d4f/dcb 29480721 1 2024-09-16T00:50:23.421 INFO:tasks.workunit.client.0.smithi053.stdout:7/381: stat d1/d2a/d4f/l61 0 2024-09-16T00:50:23.424 INFO:tasks.workunit.client.0.smithi053.stdout:4/289: rmdir d0/d2/d66 0 2024-09-16T00:50:23.427 INFO:tasks.workunit.client.1.smithi152.stdout:2/827: mkdir d4/d44/d7a/dc7/de4/d20/d28/d8b/d117 0 2024-09-16T00:50:23.427 INFO:tasks.workunit.client.1.smithi152.stdout:2/828: write d4/d44/d7a/dc7/de4/d94/f69 [5111476,26196] 0 2024-09-16T00:50:23.428 INFO:tasks.workunit.client.0.smithi053.stdout:1/403: dwrite d5/dd/d7f/f83 [0,4194304] 0 2024-09-16T00:50:23.430 INFO:tasks.workunit.client.1.smithi152.stdout:1/948: dwrite d9/da/d14e/d10f/f12e [0,4194304] 0 2024-09-16T00:50:23.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/475: mkdir d4/dc/d1e/d1f/d40/d9a 0 2024-09-16T00:50:23.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/447: truncate d1/d2f/f7d 2939119 0 2024-09-16T00:50:23.436 INFO:tasks.workunit.client.1.smithi152.stdout:0/861: dread d3/d6/d8/d1d/d23/d25/d2a/d5c/fa9 [0,4194304] 0 2024-09-16T00:50:23.438 INFO:tasks.workunit.client.0.smithi053.stdout:4/290: creat d0/d2/f68 x:0 0 0 2024-09-16T00:50:23.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/291: write d0/d3c/f5c [570128,66953] 0 2024-09-16T00:50:23.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/292: write d0/d31/f63 [757675,70289] 0 2024-09-16T00:50:23.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/293: creat d0/da/f69 x:0 0 0 2024-09-16T00:50:23.439 INFO:tasks.workunit.client.1.smithi152.stdout:7/921: truncate d9/d31/fbe 2078988 0 2024-09-16T00:50:23.446 INFO:tasks.workunit.client.1.smithi152.stdout:3/846: rmdir dc/d10/d17/d1c/d50/d63 39 2024-09-16T00:50:23.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi152 to 2240M 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:22 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:50:23.448 INFO:tasks.workunit.client.0.smithi053.stdout:1/404: mknod d5/dd/c8d 0 2024-09-16T00:50:23.449 INFO:tasks.workunit.client.0.smithi053.stdout:0/476: symlink d4/dc/d1e/d1f/d40/d73/l9b 0 2024-09-16T00:50:23.449 INFO:tasks.workunit.client.0.smithi053.stdout:0/477: write d4/dc/d25/d34/d71/d96/d27/f37 [4134798,39328] 0 2024-09-16T00:50:23.449 INFO:tasks.workunit.client.1.smithi152.stdout:9/890: mkdir d1/d4e/d48/d26/d58/d11d 0 2024-09-16T00:50:23.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/891: fdatasync d1/d59/f2f 0 2024-09-16T00:50:23.453 INFO:tasks.workunit.client.0.smithi053.stdout:4/294: rename d0/d2/f68 to d0/d2/d26/f6a 0 2024-09-16T00:50:23.453 INFO:tasks.workunit.client.0.smithi053.stdout:4/295: chown d0/d2/dd/d25/d37/l49 2050690 1 2024-09-16T00:50:23.455 INFO:tasks.workunit.client.1.smithi152.stdout:8/744: dwrite dd/d98/db8/dcf/faa [0,4194304] 0 2024-09-16T00:50:23.455 INFO:tasks.workunit.client.0.smithi053.stdout:1/405: dread d5/d18/d33/f53 [0,4194304] 0 2024-09-16T00:50:23.457 INFO:tasks.workunit.client.0.smithi053.stdout:0/478: truncate d4/d13/f63 3581661 0 2024-09-16T00:50:23.460 INFO:tasks.workunit.client.0.smithi053.stdout:0/479: rename d4/dc/f1b to d4/d5a/d82/f9c 0 2024-09-16T00:50:23.460 INFO:tasks.workunit.client.1.smithi152.stdout:9/892: dread d1/d7/d13/f73 [0,4194304] 0 2024-09-16T00:50:23.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/893: write d1/d7/d13/f73 [5144603,73211] 0 2024-09-16T00:50:23.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/894: chown d1/de2/fe5 3 1 2024-09-16T00:50:23.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/895: write d1/d7/d77/d3c/dc9/fe3 [3488,130844] 0 2024-09-16T00:50:23.462 INFO:tasks.workunit.client.0.smithi053.stdout:0/480: unlink d4/dc/d87/c3d 0 2024-09-16T00:50:23.463 INFO:tasks.workunit.client.0.smithi053.stdout:1/406: dread d5/d9/f17 [0,4194304] 0 2024-09-16T00:50:23.465 INFO:tasks.workunit.client.0.smithi053.stdout:1/407: mkdir d5/dd/d8e 0 2024-09-16T00:50:23.465 INFO:tasks.workunit.client.0.smithi053.stdout:1/408: chown d5/d9/f4b 421 1 2024-09-16T00:50:23.465 INFO:tasks.workunit.client.0.smithi053.stdout:1/409: chown d5/d18/f1b 4521262 1 2024-09-16T00:50:23.468 INFO:tasks.workunit.client.0.smithi053.stdout:1/410: unlink d5/d18/c41 0 2024-09-16T00:50:23.471 INFO:tasks.workunit.client.1.smithi152.stdout:0/862: creat d3/d6/d4e/ddb/f11f x:0 0 0 2024-09-16T00:50:23.472 INFO:tasks.workunit.client.0.smithi053.stdout:1/411: creat d5/d18/d1f/f8f x:0 0 0 2024-09-16T00:50:23.472 INFO:tasks.workunit.client.0.smithi053.stdout:1/412: stat d5/dd/d47/d58/f2a 0 2024-09-16T00:50:23.472 INFO:tasks.workunit.client.0.smithi053.stdout:4/296: read d0/f38 [2415222,90512] 0 2024-09-16T00:50:23.472 INFO:tasks.workunit.client.0.smithi053.stdout:4/297: read - d0/d3c/d48/f5f zero size 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.0.smithi053.stdout:6/448: dwrite d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.0.smithi053.stdout:7/382: dwrite d1/d2a/f79 [0,4194304] 0 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.0.smithi053.stdout:7/383: chown d1/d2a/l32 1 1 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.1.smithi152.stdout:1/949: dwrite d9/da/d105/f158 [0,4194304] 0 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.1.smithi152.stdout:1/950: write d9/da/df/dcb/fd0 [295857,25462] 0 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.1.smithi152.stdout:2/829: dwrite d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/dcf/fd4 [0,4194304] 0 2024-09-16T00:50:23.474 INFO:tasks.workunit.client.1.smithi152.stdout:2/830: write d4/d44/fd2 [101943,63929] 0 2024-09-16T00:50:23.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/922: symlink d9/d31/d65/d8a/d90/l146 0 2024-09-16T00:50:23.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/923: write d9/d31/d65/d8a/d90/f12b [4357569,74336] 0 2024-09-16T00:50:23.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/924: dread - d9/d31/d65/d8a/d41/d46/d7d/d86/f140 zero size 2024-09-16T00:50:23.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/925: write d9/d31/d64/d3c/db9/dd3/d100/d82/f11d [542236,62002] 0 2024-09-16T00:50:23.475 INFO:tasks.workunit.client.0.smithi053.stdout:1/413: creat d5/d18/d33/d30/f90 x:0 0 0 2024-09-16T00:50:23.476 INFO:tasks.workunit.client.0.smithi053.stdout:1/414: stat d5/d9/f56 0 2024-09-16T00:50:23.476 INFO:tasks.workunit.client.1.smithi152.stdout:9/896: dread d1/d7/d77/f33 [0,4194304] 0 2024-09-16T00:50:23.476 INFO:tasks.workunit.client.1.smithi152.stdout:9/897: write d1/d7/f99 [1024593,50093] 0 2024-09-16T00:50:23.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/745: mknod dd/cf5 0 2024-09-16T00:50:23.479 INFO:tasks.workunit.client.0.smithi053.stdout:6/449: symlink d1/dc/d1e/l9e 0 2024-09-16T00:50:23.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/951: dread d9/d3e/d41/d31/da5/d12c/fff [0,4194304] 0 2024-09-16T00:50:23.487 INFO:tasks.workunit.client.1.smithi152.stdout:3/847: dwrite f6 [0,4194304] 0 2024-09-16T00:50:23.489 INFO:tasks.workunit.client.0.smithi053.stdout:7/384: mknod d1/d35/d14/d15/c8a 0 2024-09-16T00:50:23.492 INFO:tasks.workunit.client.0.smithi053.stdout:6/450: creat d1/d90/f9f x:0 0 0 2024-09-16T00:50:23.492 INFO:tasks.workunit.client.0.smithi053.stdout:6/451: write d1/dc/d39/f34 [2660650,39648] 0 2024-09-16T00:50:23.493 INFO:tasks.workunit.client.0.smithi053.stdout:6/452: dread - d1/dc/d1e/f7a zero size 2024-09-16T00:50:23.493 INFO:tasks.workunit.client.0.smithi053.stdout:6/453: chown d1/dc/d3d/c50 3233 1 2024-09-16T00:50:23.493 INFO:tasks.workunit.client.0.smithi053.stdout:6/454: truncate d1/dc/d43/f83 881764 0 2024-09-16T00:50:23.493 INFO:tasks.workunit.client.0.smithi053.stdout:7/385: rmdir d1/d60/d77 39 2024-09-16T00:50:23.494 INFO:tasks.workunit.client.0.smithi053.stdout:6/455: symlink d1/dc/d54/la0 0 2024-09-16T00:50:23.496 INFO:tasks.workunit.client.0.smithi053.stdout:7/386: symlink d1/d2a/d4f/l8b 0 2024-09-16T00:50:23.496 INFO:tasks.workunit.client.0.smithi053.stdout:7/387: fsync d1/d3/f3c 0 2024-09-16T00:50:23.497 INFO:tasks.workunit.client.1.smithi152.stdout:7/926: unlink d9/d10/cc1 0 2024-09-16T00:50:23.499 INFO:tasks.workunit.client.0.smithi053.stdout:6/456: mknod d1/dc/d3c/d4b/ca1 0 2024-09-16T00:50:23.500 INFO:tasks.workunit.client.1.smithi152.stdout:1/952: dread d9/d3e/d7b/df0/d107/f43 [4194304,4194304] 0 2024-09-16T00:50:23.501 INFO:tasks.workunit.client.1.smithi152.stdout:1/953: chown d9/da/df/f8c 31616793 1 2024-09-16T00:50:23.501 INFO:tasks.workunit.client.1.smithi152.stdout:1/954: fdatasync d9/d3e/d7b/f15b 0 2024-09-16T00:50:23.501 INFO:tasks.workunit.client.0.smithi053.stdout:0/481: dwrite d4/d13/f1c [4194304,4194304] 0 2024-09-16T00:50:23.501 INFO:tasks.workunit.client.0.smithi053.stdout:0/482: chown d4/dc/d25/d34/c77 437 1 2024-09-16T00:50:23.503 INFO:tasks.workunit.client.1.smithi152.stdout:8/746: mknod dd/d15/cf6 0 2024-09-16T00:50:23.503 INFO:tasks.workunit.client.1.smithi152.stdout:8/747: chown dd/d98/db8/dcf/d88/fbf 12745 1 2024-09-16T00:50:23.505 INFO:tasks.workunit.client.1.smithi152.stdout:0/863: rename d3/d6/d51/f5e to d3/d6/d8/d1d/f120 0 2024-09-16T00:50:23.506 INFO:tasks.workunit.client.0.smithi053.stdout:6/457: mknod d1/d2f/d9b/ca2 0 2024-09-16T00:50:23.508 INFO:tasks.workunit.client.0.smithi053.stdout:0/483: creat d4/dc/d25/f9d x:0 0 0 2024-09-16T00:50:23.510 INFO:tasks.workunit.client.0.smithi053.stdout:6/458: unlink d1/f62 0 2024-09-16T00:50:23.512 INFO:tasks.workunit.client.0.smithi053.stdout:4/298: dwrite d0/d3c/d48/f52 [4194304,4194304] 0 2024-09-16T00:50:23.513 INFO:tasks.workunit.client.0.smithi053.stdout:7/388: dwrite d1/d3/f1f [0,4194304] 0 2024-09-16T00:50:23.514 INFO:tasks.workunit.client.0.smithi053.stdout:1/415: dwrite d5/d9/d4c/d61/f85 [0,4194304] 0 2024-09-16T00:50:23.514 INFO:tasks.workunit.client.1.smithi152.stdout:7/927: mknod d9/d31/d65/d8a/d41/d46/d7d/d86/d117/c147 0 2024-09-16T00:50:23.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/848: dwrite dc/d10/d17/d1c/d1f/d24/f65 [0,4194304] 0 2024-09-16T00:50:23.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/748: creat dd/d98/db8/dee/ff7 x:0 0 0 2024-09-16T00:50:23.528 INFO:tasks.workunit.client.1.smithi152.stdout:9/898: rename d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/l10d to d1/d7/ded/l11e 0 2024-09-16T00:50:23.528 INFO:tasks.workunit.client.1.smithi152.stdout:9/899: readlink d1/d7/d13/d5d/d69/l6a 0 2024-09-16T00:50:23.532 INFO:tasks.workunit.client.0.smithi053.stdout:4/299: dread d0/f38 [0,4194304] 0 2024-09-16T00:50:23.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/864: mkdir d3/d6/d8/d1d/d65/d6e/d82/da4/d121 0 2024-09-16T00:50:23.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/865: fdatasync d3/d6/d8/d1d/d23/d25/fee 0 2024-09-16T00:50:23.539 INFO:tasks.workunit.client.1.smithi152.stdout:3/849: chown dc/d10/cab 0 1 2024-09-16T00:50:23.541 INFO:tasks.workunit.client.1.smithi152.stdout:8/749: unlink dd/d15/f62 0 2024-09-16T00:50:23.545 INFO:tasks.workunit.client.1.smithi152.stdout:9/900: dread d1/d7/d13/d80/f86 [0,4194304] 0 2024-09-16T00:50:23.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/750: write dd/d98/db8/dcf/d29/f80 [1902375,114057] 0 2024-09-16T00:50:23.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/751: chown dd/d98/db8/dcf/d29/d2f/f3d 117411501 1 2024-09-16T00:50:23.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/955: write d9/da/d105/f158 [4944501,88170] 0 2024-09-16T00:50:23.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/956: chown d9/d3e/d4b/d6b/d6d/d97/feb 3944 1 2024-09-16T00:50:23.548 INFO:tasks.workunit.client.1.smithi152.stdout:9/901: mknod d1/d7/d13/c11f 0 2024-09-16T00:50:23.550 INFO:tasks.workunit.client.1.smithi152.stdout:7/928: dwrite d9/d10/f36 [0,4194304] 0 2024-09-16T00:50:23.551 INFO:tasks.workunit.client.0.smithi053.stdout:6/459: dwrite d1/dc/d39/f1c [0,4194304] 0 2024-09-16T00:50:23.551 INFO:tasks.workunit.client.0.smithi053.stdout:0/484: dwrite d4/dc/d25/d34/f8f [0,4194304] 0 2024-09-16T00:50:23.551 INFO:tasks.workunit.client.0.smithi053.stdout:0/485: creat d4/d5a/f9e x:0 0 0 2024-09-16T00:50:23.552 INFO:tasks.workunit.client.0.smithi053.stdout:1/416: rename d5/d18/d33/f53 to d5/d9/d4c/d61/f91 0 2024-09-16T00:50:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/850: read dc/d10/f31 [791330,11896] 0 2024-09-16T00:50:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/851: fsync dc/d10/d17/d1c/d1f/fe6 0 2024-09-16T00:50:23.558 INFO:tasks.workunit.client.0.smithi053.stdout:7/389: rmdir d1/d35/d4a 39 2024-09-16T00:50:23.560 INFO:tasks.workunit.client.1.smithi152.stdout:9/902: symlink d1/d7/d77/d32/da5/da8/dc5/l120 0 2024-09-16T00:50:23.561 INFO:tasks.workunit.client.0.smithi053.stdout:4/300: symlink d0/d2/d26/l6b 0 2024-09-16T00:50:23.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/852: rmdir dc/d10/d17/d1c/d50/daa 39 2024-09-16T00:50:23.570 INFO:tasks.workunit.client.1.smithi152.stdout:7/929: dwrite d9/d31/d64/d3c/f75 [0,4194304] 0 2024-09-16T00:50:23.571 INFO:tasks.workunit.client.0.smithi053.stdout:6/460: dwrite d1/dc/d3d/f8c [0,4194304] 0 2024-09-16T00:50:23.571 INFO:tasks.workunit.client.1.smithi152.stdout:8/752: rmdir dd/d98/db8/dcf/d88/dd8 39 2024-09-16T00:50:23.571 INFO:tasks.workunit.client.1.smithi152.stdout:8/753: truncate dd/d98/db8/dcf/d88/fbf 1034430 0 2024-09-16T00:50:23.573 INFO:tasks.workunit.client.0.smithi053.stdout:0/486: rename d4/f30 to d4/dc/d25/d34/f9f 0 2024-09-16T00:50:23.573 INFO:tasks.workunit.client.0.smithi053.stdout:0/487: chown c2 12852205 1 2024-09-16T00:50:23.575 INFO:tasks.workunit.client.1.smithi152.stdout:1/957: getdents d9/d3e/d4b/db7 0 2024-09-16T00:50:23.575 INFO:tasks.workunit.client.1.smithi152.stdout:1/958: truncate d9/d3e/f119 2049577 0 2024-09-16T00:50:23.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/903: link d1/d7/l1f d1/d7/d77/d32/da5/l121 0 2024-09-16T00:50:23.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/904: creat d1/d4e/d48/d66/d76/f122 x:0 0 0 2024-09-16T00:50:23.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/905: creat d1/d7/dca/f123 x:0 0 0 2024-09-16T00:50:23.577 INFO:tasks.workunit.client.0.smithi053.stdout:7/390: getdents d1/d60/d77 0 2024-09-16T00:50:23.577 INFO:tasks.workunit.client.0.smithi053.stdout:7/391: chown d1/d2a/d4f/d52/f30 53 1 2024-09-16T00:50:23.578 INFO:tasks.workunit.client.1.smithi152.stdout:7/930: mkdir d9/d31/d65/d8a/d41/d46/d7d/d86/d142/d145/d148 0 2024-09-16T00:50:23.585 INFO:tasks.workunit.client.0.smithi053.stdout:7/392: write d1/d3/f1f [1832696,34537] 0 2024-09-16T00:50:23.585 INFO:tasks.workunit.client.0.smithi053.stdout:0/488: dread d4/d5a/f7e [0,4194304] 0 2024-09-16T00:50:23.587 INFO:tasks.workunit.client.0.smithi053.stdout:1/417: getdents d5/d9/d77 0 2024-09-16T00:50:23.589 INFO:tasks.workunit.client.0.smithi053.stdout:1/418: dread d5/d9/f40 [0,4194304] 0 2024-09-16T00:50:23.592 INFO:tasks.workunit.client.1.smithi152.stdout:7/931: symlink d9/d31/d65/d8a/d90/l149 0 2024-09-16T00:50:23.592 INFO:tasks.workunit.client.1.smithi152.stdout:7/932: stat d9/d31/d64/d3c/d5b/f7a 0 2024-09-16T00:50:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:8/754: dwrite dd/d15/d9b/fea [0,4194304] 0 2024-09-16T00:50:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:1/959: symlink d9/da/df/l161 0 2024-09-16T00:50:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:1/960: write d9/d3e/d41/d31/da5/f15f [620786,9201] 0 2024-09-16T00:50:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:1/961: creat d9/d3e/d41/d31/d48/d4a/dc1/f162 x:0 0 0 2024-09-16T00:50:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:1/962: readlink d9/d3e/d41/d31/d48/d7d/lcc 0 2024-09-16T00:50:23.595 INFO:tasks.workunit.client.0.smithi053.stdout:1/419: symlink d5/d5a/l92 0 2024-09-16T00:50:23.598 INFO:tasks.workunit.client.1.smithi152.stdout:9/906: getdents d1/d4e/d48/d26/d30/d4f/d50/d83/d9b 0 2024-09-16T00:50:23.600 INFO:tasks.workunit.client.1.smithi152.stdout:7/933: symlink d9/d31/d65/d8a/d41/d46/d7d/d86/d142/d145/d148/l14a 0 2024-09-16T00:50:23.601 INFO:tasks.workunit.client.0.smithi053.stdout:7/393: dread d1/d2a/f79 [0,4194304] 0 2024-09-16T00:50:23.601 INFO:tasks.workunit.client.0.smithi053.stdout:7/394: fdatasync d1/d35/d4a/f56 0 2024-09-16T00:50:23.603 INFO:tasks.workunit.client.0.smithi053.stdout:1/420: rename d5/dd/d19/f34 to d5/dd/d7f/f93 0 2024-09-16T00:50:23.606 INFO:tasks.workunit.client.0.smithi053.stdout:7/395: truncate d1/d35/d14/d15/f1d 543422 0 2024-09-16T00:50:23.606 INFO:tasks.workunit.client.0.smithi053.stdout:0/489: dwrite d4/dc/d25/d34/d71/d96/d27/d4a/f56 [0,4194304] 0 2024-09-16T00:50:23.608 INFO:tasks.workunit.client.0.smithi053.stdout:1/421: mknod d5/d7/d39/d57/d82/c94 0 2024-09-16T00:50:23.609 INFO:tasks.workunit.client.0.smithi053.stdout:2/367: sync 2024-09-16T00:50:23.611 INFO:tasks.workunit.client.0.smithi053.stdout:1/422: dread d5/d9/d4c/d61/f91 [0,4194304] 0 2024-09-16T00:50:23.612 INFO:tasks.workunit.client.1.smithi152.stdout:8/755: dwrite dd/d98/db8/dee/ff7 [0,4194304] 0 2024-09-16T00:50:23.613 INFO:tasks.workunit.client.1.smithi152.stdout:1/963: rename d9/d3e/d41/d31/d48/db2/c133 to d9/d3e/d4b/db7/dc4/d10c/c163 0 2024-09-16T00:50:23.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/901: sync 2024-09-16T00:50:23.615 INFO:tasks.workunit.client.0.smithi053.stdout:7/396: mknod d1/d35/c8c 0 2024-09-16T00:50:23.615 INFO:tasks.workunit.client.0.smithi053.stdout:7/397: dread - d1/d2a/d4f/f81 zero size 2024-09-16T00:50:23.616 INFO:tasks.workunit.client.1.smithi152.stdout:6/902: dread db/d12/d1c/f3f [0,4194304] 0 2024-09-16T00:50:23.619 INFO:tasks.workunit.client.1.smithi152.stdout:8/756: dread dd/d15/d49/f3c [0,4194304] 0 2024-09-16T00:50:23.621 INFO:tasks.workunit.client.0.smithi053.stdout:2/368: truncate d6/f23 567502 0 2024-09-16T00:50:23.628 INFO:tasks.workunit.client.0.smithi053.stdout:0/490: rmdir d4/dc/d1e/d1f/d40/d44 39 2024-09-16T00:50:23.628 INFO:tasks.workunit.client.0.smithi053.stdout:0/491: truncate d4/dc/d1e/d22/f65 1196652 0 2024-09-16T00:50:23.629 INFO:tasks.workunit.client.0.smithi053.stdout:0/492: chown d4/dc/d1e/d1f/d40/d44/d54/c85 407177 1 2024-09-16T00:50:23.629 INFO:tasks.workunit.client.0.smithi053.stdout:0/493: truncate d4/dc/d25/d34/d71/d96/f67 1117513 0 2024-09-16T00:50:23.630 INFO:tasks.workunit.client.1.smithi152.stdout:1/964: creat d9/d3e/d41/d31/d48/d4a/f164 x:0 0 0 2024-09-16T00:50:23.630 INFO:tasks.workunit.client.0.smithi053.stdout:7/398: dwrite d1/d35/d14/f2f [0,4194304] 0 2024-09-16T00:50:23.631 INFO:tasks.workunit.client.0.smithi053.stdout:2/369: mkdir d6/d9/dd/d3e/d52/d65 0 2024-09-16T00:50:23.632 INFO:tasks.workunit.client.1.smithi152.stdout:6/903: creat db/d12/d23/d3a/dbc/f11d x:0 0 0 2024-09-16T00:50:23.633 INFO:tasks.workunit.client.0.smithi053.stdout:1/423: getdents d5/d5a 0 2024-09-16T00:50:23.633 INFO:tasks.workunit.client.0.smithi053.stdout:7/399: dread d1/d35/d14/f38 [0,4194304] 0 2024-09-16T00:50:23.634 INFO:tasks.workunit.client.0.smithi053.stdout:1/424: dread d5/d7/f66 [0,4194304] 0 2024-09-16T00:50:23.635 INFO:tasks.workunit.client.1.smithi152.stdout:8/757: mkdir dd/d15/d69/df8 0 2024-09-16T00:50:23.637 INFO:tasks.workunit.client.0.smithi053.stdout:0/494: getdents d4 0 2024-09-16T00:50:23.640 INFO:tasks.workunit.client.1.smithi152.stdout:9/907: rename d1/f8b to d1/d4e/d48/d2b/d93/d96/f124 0 2024-09-16T00:50:23.642 INFO:tasks.workunit.client.1.smithi152.stdout:1/965: creat d9/f165 x:0 0 0 2024-09-16T00:50:23.646 INFO:tasks.workunit.client.1.smithi152.stdout:6/904: mkdir db/d12/d23/d4a/d43/d48/d6a/de0/d11e 0 2024-09-16T00:50:23.646 INFO:tasks.workunit.client.1.smithi152.stdout:6/905: readlink db/d12/d23/d4a/d43/d48/l114 0 2024-09-16T00:50:23.647 INFO:tasks.workunit.client.0.smithi053.stdout:1/425: rmdir d5/d9/d88 39 2024-09-16T00:50:23.649 INFO:tasks.workunit.client.1.smithi152.stdout:8/758: creat dd/ff9 x:0 0 0 2024-09-16T00:50:23.649 INFO:tasks.workunit.client.1.smithi152.stdout:8/759: chown dd/c90 113 1 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/400: dwrite d1/d35/d4a/d74/f7e [0,4194304] 0 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/401: chown d1/d35/d5b/l6c 284851 1 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/402: write d1/f36 [3310340,99306] 0 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/403: write d1/d35/d4a/f5e [1224301,57768] 0 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/404: fsync d1/d2a/d4f/d52/f26 0 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/405: dread - d1/d35/f46 zero size 2024-09-16T00:50:23.650 INFO:tasks.workunit.client.0.smithi053.stdout:7/406: readlink d1/d35/d14/l4e 0 2024-09-16T00:50:23.651 INFO:tasks.workunit.client.0.smithi053.stdout:0/495: unlink d4/d5a/d68/l92 0 2024-09-16T00:50:23.651 INFO:tasks.workunit.client.0.smithi053.stdout:0/496: write d4/dc/d1e/d1f/d40/f7b [869617,21807] 0 2024-09-16T00:50:23.651 INFO:tasks.workunit.client.0.smithi053.stdout:0/497: dread - d4/dc/d25/d34/f7f zero size 2024-09-16T00:50:23.654 INFO:tasks.workunit.client.1.smithi152.stdout:7/934: rename d9/db6/dde to d9/d31/dfc/d14b 0 2024-09-16T00:50:23.654 INFO:tasks.workunit.client.1.smithi152.stdout:7/935: fdatasync d9/d31/fbe 0 2024-09-16T00:50:23.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/908: creat d1/d4e/d48/d2b/f125 x:0 0 0 2024-09-16T00:50:23.660 INFO:tasks.workunit.client.0.smithi053.stdout:1/426: creat d5/d7/d39/d57/f95 x:0 0 0 2024-09-16T00:50:23.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/909: dread d1/d4e/f67 [0,4194304] 0 2024-09-16T00:50:23.661 INFO:tasks.workunit.client.1.smithi152.stdout:9/910: readlink d1/d7/d77/d32/da5/df1/l105 0 2024-09-16T00:50:23.663 INFO:tasks.workunit.client.1.smithi152.stdout:1/966: link d9/faf d9/d3e/d41/d31/d48/f166 0 2024-09-16T00:50:23.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/936: mknod d9/d31/d65/d8a/d41/d46/c14c 0 2024-09-16T00:50:23.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/937: chown d9/d31/d65/d8a/d41/d46/d7d/d86/d97/dd5/l13a 119 1 2024-09-16T00:50:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:9/911: symlink d1/d7/d77/d32/da5/da8/l126 0 2024-09-16T00:50:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/906: dwrite db/d12/d20/f3e [4194304,4194304] 0 2024-09-16T00:50:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/907: chown db/d12/d20/d86/d91/fa6 9 1 2024-09-16T00:50:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:1/967: truncate d9/d3e/d41/d31/d48/f70 1529731 0 2024-09-16T00:50:23.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/938: truncate d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/f114 2744759 0 2024-09-16T00:50:23.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/939: fdatasync d9/d31/d65/f69 0 2024-09-16T00:50:23.675 INFO:tasks.workunit.client.0.smithi053.stdout:0/498: creat d4/dc/d87/fa0 x:0 0 0 2024-09-16T00:50:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:0/499: dread d4/dc/d25/d34/d71/d96/f58 [0,4194304] 0 2024-09-16T00:50:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:1/427: link d5/d7/d39/d57/f95 d5/d18/d33/d8a/f96 0 2024-09-16T00:50:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:1/428: fsync d5/d18/d33/d30/f90 0 2024-09-16T00:50:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:1/429: truncate d5/d7/d39/d57/d82/f8b 4854811 0 2024-09-16T00:50:23.678 INFO:tasks.workunit.client.0.smithi053.stdout:1/430: creat d5/dd/d7f/f97 x:0 0 0 2024-09-16T00:50:23.681 INFO:tasks.workunit.client.1.smithi152.stdout:6/908: write db/d12/d23/d4a/d33/f38 [1061024,58373] 0 2024-09-16T00:50:23.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/940: creat d9/d31/dc4/d13f/f14d x:0 0 0 2024-09-16T00:50:23.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/941: creat d9/d31/d65/d8a/d41/d46/d7d/d86/d117/f14e x:0 0 0 2024-09-16T00:50:23.689 INFO:tasks.workunit.client.1.smithi152.stdout:6/909: read db/d12/d1c/f5c [2253956,115914] 0 2024-09-16T00:50:23.689 INFO:tasks.workunit.client.1.smithi152.stdout:6/910: chown db/d12/d23/d4a/d43/d48/d64/dab/de7/lf7 149837 1 2024-09-16T00:50:23.689 INFO:tasks.workunit.client.0.smithi053.stdout:7/407: rmdir d1/d35 39 2024-09-16T00:50:23.690 INFO:tasks.workunit.client.0.smithi053.stdout:7/408: write d1/d60/d70/f78 [523171,54268] 0 2024-09-16T00:50:23.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/760: dwrite dd/d98/db8/dcf/d29/d2f/d53/f73 [0,4194304] 0 2024-09-16T00:50:23.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/761: write dd/ff9 [881974,112194] 0 2024-09-16T00:50:23.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/942: getdents d9/d10/da5/d127 0 2024-09-16T00:50:23.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/943: write d9/d31/d64/d3c/f8b [3033899,70421] 0 2024-09-16T00:50:23.696 INFO:tasks.workunit.client.1.smithi152.stdout:9/912: rename d1/d4e/d48/d66/d76 to d1/d7/ded/d113/d127 0 2024-09-16T00:50:23.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/370: dwrite d6/f32 [0,4194304] 0 2024-09-16T00:50:23.705 INFO:tasks.workunit.client.1.smithi152.stdout:7/944: link d9/d31/d65/f69 d9/d31/d65/d8a/d41/d46/d7d/de2/f14f 0 2024-09-16T00:50:23.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/945: truncate d9/d31/d65/d8a/d41/d46/d7d/d86/f140 853413 0 2024-09-16T00:50:23.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/946: stat d9/d31/d64/d3c/db9/dd3/d100/cd2 0 2024-09-16T00:50:23.708 INFO:tasks.workunit.client.0.smithi053.stdout:1/431: dwrite f2 [4194304,4194304] 0 2024-09-16T00:50:23.710 INFO:tasks.workunit.client.0.smithi053.stdout:0/500: dwrite d4/dc/d1e/d1f/d40/d44/d54/f98 [0,4194304] 0 2024-09-16T00:50:23.710 INFO:tasks.workunit.client.0.smithi053.stdout:0/501: write d4/dc/d25/d34/f5e [179199,5403] 0 2024-09-16T00:50:23.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/911: dwrite db/d12/d20/f2d [4194304,4194304] 0 2024-09-16T00:50:23.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/912: write db/d12/d23/d4a/f5a [3372456,51285] 0 2024-09-16T00:50:23.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/913: write db/f1e [55839,48699] 0 2024-09-16T00:50:23.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/914: write db/d28/dd8/f11a [920374,58794] 0 2024-09-16T00:50:23.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/915: write db/d12/d23/d3a/dbc/fc8 [928697,111521] 0 2024-09-16T00:50:23.714 INFO:tasks.workunit.client.1.smithi152.stdout:6/916: chown db/d12/d23/d4a/d33/fa3 41 1 2024-09-16T00:50:23.714 INFO:tasks.workunit.client.1.smithi152.stdout:7/947: unlink d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/cb1 0 2024-09-16T00:50:23.716 INFO:tasks.workunit.client.0.smithi053.stdout:7/409: dwrite d1/d35/d14/d15/f1a [0,4194304] 0 2024-09-16T00:50:23.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/968: rename d9/da/l18 to d9/da/d14e/l167 0 2024-09-16T00:50:23.726 INFO:tasks.workunit.client.0.smithi053.stdout:0/502: symlink d4/dc/d1e/d1f/d40/d44/d49/la1 0 2024-09-16T00:50:23.726 INFO:tasks.workunit.client.0.smithi053.stdout:0/503: write d4/dc/d1e/d1f/d40/f7b [1490633,58016] 0 2024-09-16T00:50:23.731 INFO:tasks.workunit.client.1.smithi152.stdout:6/917: link db/d12/d23/d4a/d43/d48/d6a/c106 db/d12/d23/d4a/dc5/dd0/c11f 0 2024-09-16T00:50:23.731 INFO:tasks.workunit.client.1.smithi152.stdout:6/918: creat db/d12/d23/d4a/dc5/dd0/f120 x:0 0 0 2024-09-16T00:50:23.731 INFO:tasks.workunit.client.1.smithi152.stdout:6/919: readlink db/d12/d23/d4a/d43/d48/d64/dab/de7/lf7 0 2024-09-16T00:50:23.734 INFO:tasks.workunit.client.1.smithi152.stdout:1/969: symlink d9/d3e/d41/d31/d48/d4a/dc1/l168 0 2024-09-16T00:50:23.737 INFO:tasks.workunit.client.0.smithi053.stdout:7/410: symlink d1/d35/d14/d15/l8d 0 2024-09-16T00:50:23.737 INFO:tasks.workunit.client.0.smithi053.stdout:7/411: fsync d1/d35/d14/f38 0 2024-09-16T00:50:23.737 INFO:tasks.workunit.client.1.smithi152.stdout:6/920: symlink db/d12/d23/d4a/dc5/l121 0 2024-09-16T00:50:23.738 INFO:tasks.workunit.client.1.smithi152.stdout:1/970: write d9/d3e/d41/fac [201643,1497] 0 2024-09-16T00:50:23.740 INFO:tasks.workunit.client.1.smithi152.stdout:1/971: symlink d9/da/d14e/d10f/l169 0 2024-09-16T00:50:23.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/831: sync 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.1.smithi152.stdout:9/913: dwrite d1/d4e/d48/d2b/d11b/f117 [0,4194304] 0 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/762: dwrite dd/d15/f4d [0,4194304] 0 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.0.smithi053.stdout:0/504: dread d4/f69 [0,4194304] 0 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.0.smithi053.stdout:0/505: chown d4/d5a/d68/f75 6819 1 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.0.smithi053.stdout:0/506: write d4/d5a/d82/f9c [5324340,17018] 0 2024-09-16T00:50:23.743 INFO:tasks.workunit.client.0.smithi053.stdout:1/432: dwrite d5/d7/f76 [4194304,4194304] 0 2024-09-16T00:50:23.744 INFO:tasks.workunit.client.1.smithi152.stdout:7/948: dwrite d9/d31/d65/d8a/d41/d46/d7d/fb2 [0,4194304] 0 2024-09-16T00:50:23.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/507: unlink d4/dc/d1e/d1f/l6c 0 2024-09-16T00:50:23.748 INFO:tasks.workunit.client.1.smithi152.stdout:1/972: truncate d9/f16 379195 0 2024-09-16T00:50:23.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/832: write d4/d44/d7a/f7c [296386,68141] 0 2024-09-16T00:50:23.754 INFO:tasks.workunit.client.1.smithi152.stdout:9/914: symlink d1/d4e/d48/d26/d30/d4f/d50/d79/l128 0 2024-09-16T00:50:23.755 INFO:tasks.workunit.client.1.smithi152.stdout:9/915: truncate d1/d7/d13/f27 2099761 0 2024-09-16T00:50:23.760 INFO:tasks.workunit.client.1.smithi152.stdout:6/921: rmdir db/d12/d23/d4a/d43/d48/d6a 39 2024-09-16T00:50:23.764 INFO:tasks.workunit.client.0.smithi053.stdout:1/433: mkdir d5/d18/d33/d8a/d98 0 2024-09-16T00:50:23.764 INFO:tasks.workunit.client.0.smithi053.stdout:1/434: write d5/d7/d39/d57/f95 [4497,94952] 0 2024-09-16T00:50:23.766 INFO:tasks.workunit.client.0.smithi053.stdout:0/508: mkdir d4/dc/d1e/d1f/da2 0 2024-09-16T00:50:23.769 INFO:tasks.workunit.client.0.smithi053.stdout:0/509: unlink d4/dc/d1e/d1f/l81 0 2024-09-16T00:50:23.770 INFO:tasks.workunit.client.0.smithi053.stdout:1/435: unlink d5/d9/l25 0 2024-09-16T00:50:23.772 INFO:tasks.workunit.client.0.smithi053.stdout:1/436: mknod d5/d7/d39/c99 0 2024-09-16T00:50:23.772 INFO:tasks.workunit.client.0.smithi053.stdout:1/437: creat d5/d9/d4c/d61/f9a x:0 0 0 2024-09-16T00:50:23.773 INFO:tasks.workunit.client.0.smithi053.stdout:7/412: dwrite d1/d3/f3c [0,4194304] 0 2024-09-16T00:50:23.773 INFO:tasks.workunit.client.1.smithi152.stdout:7/949: creat d9/d10/da5/f150 x:0 0 0 2024-09-16T00:50:23.773 INFO:tasks.workunit.client.1.smithi152.stdout:8/763: dwrite dd/d98/db8/dcf/d29/d2f/d5f/f7f [0,4194304] 0 2024-09-16T00:50:23.775 INFO:tasks.workunit.client.0.smithi053.stdout:1/438: link d5/dd/f31 d5/d18/d33/d30/f9b 0 2024-09-16T00:50:23.775 INFO:tasks.workunit.client.0.smithi053.stdout:1/439: chown d5/d18/d33/d8a/d98 6028956 1 2024-09-16T00:50:23.775 INFO:tasks.workunit.client.0.smithi053.stdout:1/440: write d5/d18/d33/d8a/f96 [841315,9594] 0 2024-09-16T00:50:23.775 INFO:tasks.workunit.client.1.smithi152.stdout:2/833: dwrite d4/d44/df6/d3e/f4b [0,4194304] 0 2024-09-16T00:50:23.778 INFO:tasks.workunit.client.1.smithi152.stdout:9/916: unlink d1/d7/d13/f27 0 2024-09-16T00:50:23.780 INFO:tasks.workunit.client.0.smithi053.stdout:7/413: symlink d1/d35/d4a/d74/l8e 0 2024-09-16T00:50:23.782 INFO:tasks.workunit.client.1.smithi152.stdout:6/922: truncate db/d12/d20/d86/d91/fa6 6955656 0 2024-09-16T00:50:23.785 INFO:tasks.workunit.client.0.smithi053.stdout:1/441: rename d5/d9/d4c/l69 to d5/d9/d4c/d61/l9c 0 2024-09-16T00:50:23.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/950: symlink d9/d31/d65/d8a/l151 0 2024-09-16T00:50:23.789 INFO:tasks.workunit.client.0.smithi053.stdout:7/414: creat d1/d35/d5b/f8f x:0 0 0 2024-09-16T00:50:23.789 INFO:tasks.workunit.client.0.smithi053.stdout:7/415: creat d1/d2a/f90 x:0 0 0 2024-09-16T00:50:23.789 INFO:tasks.workunit.client.1.smithi152.stdout:9/917: read d1/d7/d77/f33 [728358,3482] 0 2024-09-16T00:50:23.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/764: rmdir dd/d98/db8/dcf/d29/d2f 39 2024-09-16T00:50:23.794 INFO:tasks.workunit.client.1.smithi152.stdout:1/973: getdents d9/d3e/d41/d31/d48/dc3 0 2024-09-16T00:50:23.796 INFO:tasks.workunit.client.0.smithi053.stdout:1/442: mknod d5/d9/d77/c9d 0 2024-09-16T00:50:23.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/834: dwrite d4/d44/fd7 [0,4194304] 0 2024-09-16T00:50:23.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/835: dread - d4/d44/d7a/dc7/de4/d20/d28/d2c/fc4 zero size 2024-09-16T00:50:23.799 INFO:tasks.workunit.client.0.smithi053.stdout:0/510: dwrite d4/dc/d1e/d1f/d40/f62 [4194304,4194304] 0 2024-09-16T00:50:23.800 INFO:tasks.workunit.client.1.smithi152.stdout:6/923: mkdir db/d12/d23/d3a/d122 0 2024-09-16T00:50:23.809 INFO:tasks.workunit.client.0.smithi053.stdout:7/416: symlink d1/d3/d85/l91 0 2024-09-16T00:50:23.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/951: rename d9/d31/d65/d8a/d90/cba to d9/d31/d65/d8a/d41/d46/d7d/dac/c152 0 2024-09-16T00:50:23.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/918: truncate d1/d7/d13/f73 184255 0 2024-09-16T00:50:23.810 INFO:tasks.workunit.client.1.smithi152.stdout:7/952: creat d9/d31/d65/d8a/d90/f153 x:0 0 0 2024-09-16T00:50:23.810 INFO:tasks.workunit.client.0.smithi053.stdout:0/511: dread - d4/dc/d1e/d1f/d40/d44/f76 zero size 2024-09-16T00:50:23.810 INFO:tasks.workunit.client.0.smithi053.stdout:0/512: fdatasync d4/dc/d25/d34/d71/d96/d27/f33 0 2024-09-16T00:50:23.812 INFO:tasks.workunit.client.1.smithi152.stdout:2/836: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/c118 0 2024-09-16T00:50:23.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/974: dwrite d9/d3e/d7b/fa9 [0,4194304] 0 2024-09-16T00:50:23.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/975: dread - d9/d3e/d4b/d50/d115/f11c zero size 2024-09-16T00:50:23.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/976: chown d9/d3e/d7b/df0/d107/cab 13368493 1 2024-09-16T00:50:23.817 INFO:tasks.workunit.client.1.smithi152.stdout:8/765: rename dd/d25/fe1 to dd/d98/db8/dcf/ffa 0 2024-09-16T00:50:23.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/919: creat d1/d4e/d34/f129 x:0 0 0 2024-09-16T00:50:23.821 INFO:tasks.workunit.client.1.smithi152.stdout:0/866: sync 2024-09-16T00:50:23.822 INFO:tasks.workunit.client.1.smithi152.stdout:3/853: sync 2024-09-16T00:50:23.822 INFO:tasks.workunit.client.1.smithi152.stdout:0/867: chown d3/d6/d64/de5/cf9 0 1 2024-09-16T00:50:23.826 INFO:tasks.workunit.client.1.smithi152.stdout:2/837: dread d4/d44/d7a/d9e/f103 [0,4194304] 0 2024-09-16T00:50:23.826 INFO:tasks.workunit.client.1.smithi152.stdout:2/838: write d4/d44/df6/f41 [4067927,124018] 0 2024-09-16T00:50:23.826 INFO:tasks.workunit.client.1.smithi152.stdout:2/839: fdatasync d4/d44/f48 0 2024-09-16T00:50:23.826 INFO:tasks.workunit.client.1.smithi152.stdout:2/840: fdatasync d4/d44/d7a/d9e/d66/dec/f110 0 2024-09-16T00:50:23.829 INFO:tasks.workunit.client.1.smithi152.stdout:1/977: dread d9/da/da2/fd4 [0,4194304] 0 2024-09-16T00:50:23.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/766: symlink dd/d98/db8/dcf/d29/d2f/lfb 0 2024-09-16T00:50:23.830 INFO:tasks.workunit.client.0.smithi053.stdout:7/417: dwrite d1/d35/d5b/f72 [0,4194304] 0 2024-09-16T00:50:23.831 INFO:tasks.workunit.client.0.smithi053.stdout:7/418: chown d1/d35/d5b 1659315 1 2024-09-16T00:50:23.831 INFO:tasks.workunit.client.1.smithi152.stdout:7/953: dwrite f4 [0,4194304] 0 2024-09-16T00:50:23.831 INFO:tasks.workunit.client.1.smithi152.stdout:7/954: readlink d9/d31/d65/d6b/l85 0 2024-09-16T00:50:23.831 INFO:tasks.workunit.client.1.smithi152.stdout:9/920: unlink d1/d7/d77/d32/da5/da8/dc5/cf9 0 2024-09-16T00:50:23.831 INFO:tasks.workunit.client.1.smithi152.stdout:9/921: read d1/d4e/d48/d26/d30/d4f/da2/fb9 [3099474,15847] 0 2024-09-16T00:50:23.833 INFO:tasks.workunit.client.1.smithi152.stdout:0/868: symlink d3/d6/d8/d1d/d65/l122 0 2024-09-16T00:50:23.833 INFO:tasks.workunit.client.1.smithi152.stdout:0/869: chown d3/d6/d8/d1d/d65/d6e/d82/c83 1 1 2024-09-16T00:50:23.835 INFO:tasks.workunit.client.1.smithi152.stdout:3/854: symlink dc/d10/d17/d4f/l110 0 2024-09-16T00:50:23.835 INFO:tasks.workunit.client.1.smithi152.stdout:3/855: readlink dc/d10/d17/d1c/d50/daa/dee/lff 0 2024-09-16T00:50:23.838 INFO:tasks.workunit.client.1.smithi152.stdout:2/841: truncate d4/d44/d7a/f8a 467237 0 2024-09-16T00:50:23.839 INFO:tasks.workunit.client.0.smithi053.stdout:7/419: mkdir d1/d60/d70/d92 0 2024-09-16T00:50:23.841 INFO:tasks.workunit.client.1.smithi152.stdout:1/978: symlink d9/d3e/d4b/d6b/d6d/d97/l16a 0 2024-09-16T00:50:23.842 INFO:tasks.workunit.client.1.smithi152.stdout:8/767: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc 0 2024-09-16T00:50:23.842 INFO:tasks.workunit.client.1.smithi152.stdout:8/768: creat dd/d15/ffd x:0 0 0 2024-09-16T00:50:23.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/922: write d1/d7/d13/f2c [1038234,122641] 0 2024-09-16T00:50:23.843 INFO:tasks.workunit.client.0.smithi053.stdout:0/513: dwrite d4/d13/f4f [0,4194304] 0 2024-09-16T00:50:23.844 INFO:tasks.workunit.client.1.smithi152.stdout:2/842: dread d4/d44/d7a/d9e/f103 [0,4194304] 0 2024-09-16T00:50:23.844 INFO:tasks.workunit.client.0.smithi053.stdout:0/514: write d4/dc/d1e/d22/f65 [238903,38156] 0 2024-09-16T00:50:23.845 INFO:tasks.workunit.client.1.smithi152.stdout:7/955: symlink d9/d10/da5/d127/l154 0 2024-09-16T00:50:23.845 INFO:tasks.workunit.client.0.smithi053.stdout:7/420: write d1/d2a/f79 [33467,69477] 0 2024-09-16T00:50:23.846 INFO:tasks.workunit.client.1.smithi152.stdout:0/870: creat d3/d6/d64/d6a/d61/d119/f123 x:0 0 0 2024-09-16T00:50:23.846 INFO:tasks.workunit.client.1.smithi152.stdout:0/871: chown d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fac 22788423 1 2024-09-16T00:50:23.851 INFO:tasks.workunit.client.0.smithi053.stdout:5/340: sync 2024-09-16T00:50:23.852 INFO:tasks.workunit.client.1.smithi152.stdout:3/856: rmdir dc/d10/d17/d5a/db2/d6f/dbb 39 2024-09-16T00:50:23.854 INFO:tasks.workunit.client.0.smithi053.stdout:7/421: mkdir d1/d35/d5b/d93 0 2024-09-16T00:50:23.854 INFO:tasks.workunit.client.0.smithi053.stdout:7/422: chown d1/d35/d4a/f4c 535890528 1 2024-09-16T00:50:23.855 INFO:tasks.workunit.client.1.smithi152.stdout:3/857: dread dc/d10/d17/d5a/db2/d6f/d74/db5/fa0 [0,4194304] 0 2024-09-16T00:50:23.859 INFO:tasks.workunit.client.0.smithi053.stdout:7/423: mknod d1/d2a/c94 0 2024-09-16T00:50:23.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/979: link d9/da/d14e/d10f/f12e d9/d3e/d4b/d6b/f16b 0 2024-09-16T00:50:23.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/980: write d9/d3e/d7b/fdb [691226,128724] 0 2024-09-16T00:50:23.865 INFO:tasks.workunit.client.1.smithi152.stdout:1/981: dread d9/d3e/d41/ff3 [0,4194304] 0 2024-09-16T00:50:23.865 INFO:tasks.workunit.client.0.smithi053.stdout:7/424: rename d1/d35/c12 to d1/d35/d5b/d93/c95 0 2024-09-16T00:50:23.867 INFO:tasks.workunit.client.0.smithi053.stdout:5/341: read d3/f8 [5448544,71115] 0 2024-09-16T00:50:23.867 INFO:tasks.workunit.client.0.smithi053.stdout:5/342: write d3/d7/d2b/d37/d58/f21 [1428040,21139] 0 2024-09-16T00:50:23.867 INFO:tasks.workunit.client.1.smithi152.stdout:8/769: mknod dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4/cfe 0 2024-09-16T00:50:23.868 INFO:tasks.workunit.client.1.smithi152.stdout:7/956: dwrite d9/d31/d65/d8a/f138 [0,4194304] 0 2024-09-16T00:50:23.868 INFO:tasks.workunit.client.1.smithi152.stdout:7/957: fsync d9/fa6 0 2024-09-16T00:50:23.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/958: fdatasync d9/d31/fb5 0 2024-09-16T00:50:23.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/959: creat d9/d31/d65/d8a/d90/f155 x:0 0 0 2024-09-16T00:50:23.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/960: chown f3 1 1 2024-09-16T00:50:23.870 INFO:tasks.workunit.client.1.smithi152.stdout:9/923: creat d1/d4e/d48/d2b/d93/f12a x:0 0 0 2024-09-16T00:50:23.871 INFO:tasks.workunit.client.0.smithi053.stdout:5/343: truncate d3/d7/d2b/d37/d58/f4e 4175426 0 2024-09-16T00:50:23.873 INFO:tasks.workunit.client.0.smithi053.stdout:0/515: dwrite d4/dc/d1e/d22/f65 [0,4194304] 0 2024-09-16T00:50:23.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/843: truncate d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/fb5 692566 0 2024-09-16T00:50:23.874 INFO:tasks.workunit.client.0.smithi053.stdout:0/516: read d4/dc/d1e/d22/f42 [290461,61772] 0 2024-09-16T00:50:23.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/425: write d1/d35/d4a/f56 [3193373,117582] 0 2024-09-16T00:50:23.876 INFO:tasks.workunit.client.1.smithi152.stdout:3/858: creat dc/d10/d47/f111 x:0 0 0 2024-09-16T00:50:23.876 INFO:tasks.workunit.client.1.smithi152.stdout:0/872: dwrite d3/d6/d8/d1d/f68 [0,4194304] 0 2024-09-16T00:50:23.878 INFO:tasks.workunit.client.0.smithi053.stdout:5/344: creat d3/d7/d2b/d37/d58/f6b x:0 0 0 2024-09-16T00:50:23.878 INFO:tasks.workunit.client.0.smithi053.stdout:5/345: chown d3/d7/d24/d34/f40 729 1 2024-09-16T00:50:23.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/924: write d1/d7/d77/d32/da5/da8/fac [591341,103784] 0 2024-09-16T00:50:23.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/859: unlink dc/d10/d17/d5a/db2/d6f/f9a 0 2024-09-16T00:50:23.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/860: write dc/d10/d17/d5a/d68/f9d [666825,79961] 0 2024-09-16T00:50:23.894 INFO:tasks.workunit.client.0.smithi053.stdout:0/517: creat d4/dc/d1e/d1f/d40/d9a/fa3 x:0 0 0 2024-09-16T00:50:23.894 INFO:tasks.workunit.client.0.smithi053.stdout:0/518: fdatasync d4/d13/f63 0 2024-09-16T00:50:23.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/770: dwrite dd/d15/d49/f13 [0,4194304] 0 2024-09-16T00:50:23.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/961: dwrite d9/db6/fe4 [0,4194304] 0 2024-09-16T00:50:23.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/962: readlink d9/d31/d65/l34 0 2024-09-16T00:50:23.897 INFO:tasks.workunit.client.1.smithi152.stdout:0/873: creat d3/d6/d2e/de9/df6/f124 x:0 0 0 2024-09-16T00:50:23.898 INFO:tasks.workunit.client.1.smithi152.stdout:0/874: read d3/d6/d8/d1d/d23/f3b [747278,23414] 0 2024-09-16T00:50:23.898 INFO:tasks.workunit.client.0.smithi053.stdout:5/346: symlink d3/d7/d24/d3f/l6c 0 2024-09-16T00:50:23.900 INFO:tasks.workunit.client.1.smithi152.stdout:1/982: rename d9/d3e/d41/f3d to d9/da/d105/d129/f16c 0 2024-09-16T00:50:23.901 INFO:tasks.workunit.client.1.smithi152.stdout:8/771: write dd/d15/d49/f3c [1139008,118192] 0 2024-09-16T00:50:23.901 INFO:tasks.workunit.client.0.smithi053.stdout:0/519: symlink d4/dc/d1e/d1f/d40/la4 0 2024-09-16T00:50:23.905 INFO:tasks.workunit.client.0.smithi053.stdout:5/347: rename d3/f2e to d3/d7/d2b/f6d 0 2024-09-16T00:50:23.909 INFO:tasks.workunit.client.0.smithi053.stdout:0/520: symlink d4/dc/d1e/d1f/d40/la5 0 2024-09-16T00:50:23.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/963: link d9/d31/d65/d8a/d41/d46/d7d/d86/f116 d9/d31/d65/d8a/d41/d46/d7d/d86/d97/f156 0 2024-09-16T00:50:23.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/964: read d9/d31/d65/f7c [586351,81831] 0 2024-09-16T00:50:23.914 INFO:tasks.workunit.client.0.smithi053.stdout:0/521: rmdir d4/dc/d1e/d1f/d40/d44 39 2024-09-16T00:50:23.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/844: rename d4/c14 to d4/d44/d7a/d9e/da0/df1/c119 0 2024-09-16T00:50:23.923 INFO:tasks.workunit.client.1.smithi152.stdout:1/983: creat d9/d3e/d4b/db7/f16d x:0 0 0 2024-09-16T00:50:23.923 INFO:tasks.workunit.client.1.smithi152.stdout:1/984: stat d9/d3e/d41/d31/c111 0 2024-09-16T00:50:23.923 INFO:tasks.workunit.client.1.smithi152.stdout:1/985: fsync d9/d3e/d7b/f15b 0 2024-09-16T00:50:23.924 INFO:tasks.workunit.client.1.smithi152.stdout:7/965: creat d9/d31/d65/d8a/d41/d46/d7d/f157 x:0 0 0 2024-09-16T00:50:23.925 INFO:tasks.workunit.client.1.smithi152.stdout:1/986: truncate d9/d3e/d41/d31/da5/f15f 157841 0 2024-09-16T00:50:23.925 INFO:tasks.workunit.client.1.smithi152.stdout:1/987: fdatasync d9/d3e/d41/d31/da5/f15f 0 2024-09-16T00:50:23.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/966: symlink d9/d31/dfc/l158 0 2024-09-16T00:50:23.926 INFO:tasks.workunit.client.1.smithi152.stdout:7/967: chown d9/d10/f9d 1 1 2024-09-16T00:50:23.928 INFO:tasks.workunit.client.1.smithi152.stdout:1/988: mknod d9/d3e/d41/d31/da5/d12c/d14d/c16e 0 2024-09-16T00:50:23.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/989: creat d9/d3e/d4b/f16f x:0 0 0 2024-09-16T00:50:23.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/990: fdatasync d9/d3e/d41/f4e 0 2024-09-16T00:50:23.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/991: write d9/da/df/f156 [416340,74530] 0 2024-09-16T00:50:23.930 INFO:tasks.workunit.client.1.smithi152.stdout:9/925: rename d1/d4e/d34 to d1/d4e/d48/d2b/d93/d96/d12b 0 2024-09-16T00:50:23.932 INFO:tasks.workunit.client.1.smithi152.stdout:9/926: link d1/d4e/d48/d26/d30/d8f/dc4/d111/fbb d1/d59/f12c 0 2024-09-16T00:50:23.932 INFO:tasks.workunit.client.1.smithi152.stdout:9/927: chown d1/d4e/d48/d26/d30/d4f 248458 1 2024-09-16T00:50:23.932 INFO:tasks.workunit.client.1.smithi152.stdout:9/928: chown d1/d7/d77/d3c/dc9/dc3 16123 1 2024-09-16T00:50:23.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/875: rename d3/d6/d4e/dc2 to d3/d6/d8/d1d/d23/d25/d2a/d5c/d125 0 2024-09-16T00:50:23.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/876: truncate d3/d6/d8/d1d/d65/db0/df0/f115 730245 0 2024-09-16T00:50:23.935 INFO:tasks.workunit.client.1.smithi152.stdout:2/845: rename d4/d44/d7a/f7c to d4/d44/d7a/dc7/de4/f11a 0 2024-09-16T00:50:23.935 INFO:tasks.workunit.client.1.smithi152.stdout:2/846: fdatasync d4/f16 0 2024-09-16T00:50:23.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/877: creat d3/d6/d2e/de9/f126 x:0 0 0 2024-09-16T00:50:23.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/878: chown d3/d6/d8/c14 13 1 2024-09-16T00:50:23.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/879: fdatasync d3/d6/d8/d1d/d65/db0/db6/f106 0 2024-09-16T00:50:23.937 INFO:tasks.workunit.client.1.smithi152.stdout:2/847: symlink d4/d44/d7a/dc7/de4/d94/d93/da4/l11b 0 2024-09-16T00:50:23.937 INFO:tasks.workunit.client.1.smithi152.stdout:0/880: write d3/d6/d64/f6c [742836,124086] 0 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/881: chown d3/d6/d8/d9e/dcb/f111 7388899 1 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/882: truncate d3/d6/d8/d1d/d23/d4b/d54/ffd 858892 0 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/883: fdatasync d3/d6/d8/d9e/dcb/f10d 0 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/884: readlink d3/d6/d64/de5/l11d 0 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/885: mknod d3/d6/d8/d9e/c127 0 2024-09-16T00:50:23.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/886: readlink d3/d6/d8/d1d/d23/d25/l3a 0 2024-09-16T00:50:23.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/992: write d9/d3e/fba [1732276,60771] 0 2024-09-16T00:50:23.946 INFO:tasks.workunit.client.1.smithi152.stdout:1/993: write d9/d3e/d4b/d6b/d6d/ffc [457705,112172] 0 2024-09-16T00:50:23.948 INFO:tasks.workunit.client.1.smithi152.stdout:1/994: mknod d9/d3e/d4b/d6b/d6d/c170 0 2024-09-16T00:50:23.949 INFO:tasks.workunit.client.1.smithi152.stdout:1/995: rmdir d9/d3e/d41/d9a 39 2024-09-16T00:50:23.951 INFO:tasks.workunit.client.1.smithi152.stdout:1/996: getdents d9/da 0 2024-09-16T00:50:23.952 INFO:tasks.workunit.client.1.smithi152.stdout:1/997: getdents d9/d3e/d4b/d6b/d6d/d97 0 2024-09-16T00:50:23.953 INFO:tasks.workunit.client.1.smithi152.stdout:1/998: link d9/d3e/d4b/d6b/d6d/d82/f8e d9/d3e/d41/d9a/f171 0 2024-09-16T00:50:23.956 INFO:tasks.workunit.client.0.smithi053.stdout:0/522: dwrite d4/d13/f63 [0,4194304] 0 2024-09-16T00:50:23.957 INFO:tasks.workunit.client.0.smithi053.stdout:0/523: creat d4/fa6 x:0 0 0 2024-09-16T00:50:23.957 INFO:tasks.workunit.client.1.smithi152.stdout:1/999: dread d9/d3e/d41/d31/d48/f63 [0,4194304] 0 2024-09-16T00:50:23.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/848: dwrite d4/d44/df6/f62 [0,4194304] 0 2024-09-16T00:50:23.957 INFO:tasks.workunit.client.1.smithi152.stdout:7/968: dwrite d9/db6/f13d [0,4194304] 0 2024-09-16T00:50:23.958 INFO:tasks.workunit.client.0.smithi053.stdout:0/524: unlink d4/dc/d25/d34/d71/d96/f97 0 2024-09-16T00:50:23.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/969: mknod d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/d129/c159 0 2024-09-16T00:50:23.962 INFO:tasks.workunit.client.0.smithi053.stdout:7/426: fsync d1/d35/d4a/f56 0 2024-09-16T00:50:23.964 INFO:tasks.workunit.client.1.smithi152.stdout:7/970: mkdir d9/d31/d65/d8a/d41/d46/d7d/dac/d15a 0 2024-09-16T00:50:23.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/849: dread d4/d44/fd2 [0,4194304] 0 2024-09-16T00:50:23.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/850: chown d4/c1f 7 1 2024-09-16T00:50:23.966 INFO:tasks.workunit.client.0.smithi053.stdout:7/427: getdents d1/d60 0 2024-09-16T00:50:23.966 INFO:tasks.workunit.client.0.smithi053.stdout:7/428: getdents d1/d35/d14/d80 0 2024-09-16T00:50:23.966 INFO:tasks.workunit.client.0.smithi053.stdout:7/429: readlink d1/d35/d14/d15/l2b 0 2024-09-16T00:50:23.966 INFO:tasks.workunit.client.0.smithi053.stdout:7/430: read d1/d2a/d4f/f53 [1132898,115417] 0 2024-09-16T00:50:23.967 INFO:tasks.workunit.client.0.smithi053.stdout:7/431: dread d1/d35/d14/f64 [0,4194304] 0 2024-09-16T00:50:23.971 INFO:tasks.workunit.client.1.smithi152.stdout:7/971: rename d9/d31/d64/d3c/db9/dc2/c139 to d9/d31/d64/c15b 0 2024-09-16T00:50:23.971 INFO:tasks.workunit.client.0.smithi053.stdout:0/525: dread d4/dc/d25/d34/f74 [0,4194304] 0 2024-09-16T00:50:23.974 INFO:tasks.workunit.client.0.smithi053.stdout:7/432: link d1/d35/d14/f64 d1/d35/d5b/d93/f96 0 2024-09-16T00:50:23.974 INFO:tasks.workunit.client.0.smithi053.stdout:7/433: stat d1/d35/f46 0 2024-09-16T00:50:23.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/861: dwrite dc/d10/d17/d1c/f7e [0,4194304] 0 2024-09-16T00:50:23.978 INFO:tasks.workunit.client.0.smithi053.stdout:0/526: link d4/dc/d1e/d1f/d40/d44/d49/c4c d4/d13/ca7 0 2024-09-16T00:50:23.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/434: symlink d1/d35/d5b/d93/l97 0 2024-09-16T00:50:23.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/435: stat d1/d35/d14/f41 0 2024-09-16T00:50:23.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/436: stat d1/d35/f6b 0 2024-09-16T00:50:23.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/437: fsync d1/d60/d70/f78 0 2024-09-16T00:50:23.990 INFO:tasks.workunit.client.0.smithi053.stdout:7/438: chown d1/d35/d4a/d74/c7d 193723 1 2024-09-16T00:50:23.992 INFO:tasks.workunit.client.0.smithi053.stdout:7/439: rename d1/d60/d62/c7a to d1/d60/c98 0 2024-09-16T00:50:23.995 INFO:tasks.workunit.client.0.smithi053.stdout:7/440: dread d1/d35/d4a/f5e [0,4194304] 0 2024-09-16T00:50:23.996 INFO:tasks.workunit.client.0.smithi053.stdout:7/441: creat d1/d2a/f99 x:0 0 0 2024-09-16T00:50:23.996 INFO:tasks.workunit.client.0.smithi053.stdout:7/442: read - d1/d2a/f90 zero size 2024-09-16T00:50:23.996 INFO:tasks.workunit.client.0.smithi053.stdout:5/348: unlink d3/d7/d2b/f6d 0 2024-09-16T00:50:23.996 INFO:tasks.workunit.client.0.smithi053.stdout:5/349: chown d3 44 1 2024-09-16T00:50:23.997 INFO:tasks.workunit.client.1.smithi152.stdout:7/972: dwrite d9/d31/d65/d8a/d41/d46/d7d/d86/f116 [0,4194304] 0 2024-09-16T00:50:23.997 INFO:tasks.workunit.client.1.smithi152.stdout:7/973: fdatasync d9/f93 0 2024-09-16T00:50:24.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/851: dwrite d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/ffa [0,4194304] 0 2024-09-16T00:50:24.005 INFO:tasks.workunit.client.0.smithi053.stdout:5/350: rename d3/d7/d24/d34/l48 to d3/d7/d2b/d4b/d4f/l6e 0 2024-09-16T00:50:24.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/351: write d3/d7/d2b/d37/d58/f4e [2320536,80358] 0 2024-09-16T00:50:24.011 INFO:tasks.workunit.client.1.smithi152.stdout:3/862: dwrite dc/d10/d17/d5a/db2/d6f/dbb/f98 [8388608,4194304] 0 2024-09-16T00:50:24.012 INFO:tasks.workunit.client.0.smithi053.stdout:0/527: dwrite d4/dc/d25/d34/d71/d96/d27/d4a/f56 [0,4194304] 0 2024-09-16T00:50:24.013 INFO:tasks.workunit.client.1.smithi152.stdout:7/974: mknod d9/d31/dc4/c15c 0 2024-09-16T00:50:24.020 INFO:tasks.workunit.client.1.smithi152.stdout:2/852: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da5/dcf/c11c 0 2024-09-16T00:50:24.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/863: getdents dc/d10/d17/d1c/d1f/d24/db9 0 2024-09-16T00:50:24.022 INFO:tasks.workunit.client.1.smithi152.stdout:0/887: rmdir d3/d6/d8 39 2024-09-16T00:50:24.023 INFO:tasks.workunit.client.1.smithi152.stdout:7/975: mkdir d9/d31/d64/d3c/db9/dd3/d100/d15d 0 2024-09-16T00:50:24.023 INFO:tasks.workunit.client.1.smithi152.stdout:7/976: dread - d9/d31/d65/d8a/d90/fbb zero size 2024-09-16T00:50:24.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/853: creat d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/f11d x:0 0 0 2024-09-16T00:50:24.027 INFO:tasks.workunit.client.1.smithi152.stdout:3/864: chown dc/d10/c41 6114054 1 2024-09-16T00:50:24.029 INFO:tasks.workunit.client.1.smithi152.stdout:0/888: creat d3/d6/d8/d1d/d23/d25/d2a/d5c/d10a/f128 x:0 0 0 2024-09-16T00:50:24.029 INFO:tasks.workunit.client.0.smithi053.stdout:5/352: dwrite d3/d7/d24/f28 [0,4194304] 0 2024-09-16T00:50:24.030 INFO:tasks.workunit.client.1.smithi152.stdout:2/854: creat d4/d44/d7a/d9e/f11e x:0 0 0 2024-09-16T00:50:24.031 INFO:tasks.workunit.client.1.smithi152.stdout:2/855: creat d4/d44/d7a/dc7/de4/d94/d8f/f11f x:0 0 0 2024-09-16T00:50:24.033 INFO:tasks.workunit.client.0.smithi053.stdout:5/353: mknod d3/d7/d2b/d37/d58/c6f 0 2024-09-16T00:50:24.034 INFO:tasks.workunit.client.1.smithi152.stdout:0/889: symlink d3/d6/d8/d1d/d65/db0/db6/l129 0 2024-09-16T00:50:24.037 INFO:tasks.workunit.client.0.smithi053.stdout:5/354: creat d3/d7/d24/d34/d3e/f70 x:0 0 0 2024-09-16T00:50:24.038 INFO:tasks.workunit.client.1.smithi152.stdout:2/856: mkdir d4/d44/d7a/dc7/de4/d94/d93/d120 0 2024-09-16T00:50:24.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/865: getdents dc/d10 0 2024-09-16T00:50:24.040 INFO:tasks.workunit.client.0.smithi053.stdout:0/528: dwrite d4/dc/d1e/d1f/d40/d44/d49/f7c [0,4194304] 0 2024-09-16T00:50:24.041 INFO:tasks.workunit.client.0.smithi053.stdout:0/529: fsync d4/dc/d25/d34/d71/d96/f99 0 2024-09-16T00:50:24.041 INFO:tasks.workunit.client.0.smithi053.stdout:0/530: chown d4/dc/d87/l66 19 1 2024-09-16T00:50:24.041 INFO:tasks.workunit.client.1.smithi152.stdout:7/977: dwrite d9/db6/fe4 [0,4194304] 0 2024-09-16T00:50:24.041 INFO:tasks.workunit.client.0.smithi053.stdout:5/355: truncate d3/d7/f10 2566301 0 2024-09-16T00:50:24.044 INFO:tasks.workunit.client.1.smithi152.stdout:0/890: rename d3/d6/d8/d1d/d23/d25/d2a/d5c/d10a/f128 to d3/d6/d64/d6a/f12a 0 2024-09-16T00:50:24.044 INFO:tasks.workunit.client.0.smithi053.stdout:5/356: dread d3/d7/d2b/d37/d58/f21 [0,4194304] 0 2024-09-16T00:50:24.044 INFO:tasks.workunit.client.0.smithi053.stdout:5/357: write d3/f9 [193085,42920] 0 2024-09-16T00:50:24.045 INFO:tasks.workunit.client.0.smithi053.stdout:5/358: fsync d3/f20 0 2024-09-16T00:50:24.046 INFO:tasks.workunit.client.0.smithi053.stdout:5/359: dread d3/d7/f5c [0,4194304] 0 2024-09-16T00:50:24.047 INFO:tasks.workunit.client.1.smithi152.stdout:2/857: mknod d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/c121 0 2024-09-16T00:50:24.050 INFO:tasks.workunit.client.0.smithi053.stdout:0/531: creat d4/dc/d1e/d1f/da2/fa8 x:0 0 0 2024-09-16T00:50:24.053 INFO:tasks.workunit.client.1.smithi152.stdout:7/978: read d9/d10/f36 [1113326,70182] 0 2024-09-16T00:50:24.053 INFO:tasks.workunit.client.1.smithi152.stdout:7/979: readlink d9/d31/d65/d8a/d41/l94 0 2024-09-16T00:50:24.054 INFO:tasks.workunit.client.0.smithi053.stdout:5/360: mkdir d3/d7/d2b/d71 0 2024-09-16T00:50:24.054 INFO:tasks.workunit.client.0.smithi053.stdout:5/361: write d3/d7/d24/d34/d3e/f70 [376594,20286] 0 2024-09-16T00:50:24.058 INFO:tasks.workunit.client.1.smithi152.stdout:3/866: rename dc/d10/d17/d5a/d68/da5/df0 to dc/d10/d17/d1c/d8d/d8e/d112 0 2024-09-16T00:50:24.058 INFO:tasks.workunit.client.1.smithi152.stdout:3/867: readlink dc/d10/d17/d1c/d1f/d8a/l104 0 2024-09-16T00:50:24.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/858: write d4/d44/d7a/dc7/de4/f5b [452886,1115] 0 2024-09-16T00:50:24.062 INFO:tasks.workunit.client.1.smithi152.stdout:7/980: mkdir d9/d31/d64/d3c/d5b/dd0/d12a/d15e 0 2024-09-16T00:50:24.062 INFO:tasks.workunit.client.1.smithi152.stdout:7/981: chown d9/d31/d64/lbf 7 1 2024-09-16T00:50:24.064 INFO:tasks.workunit.client.0.smithi053.stdout:0/532: dwrite d4/dc/d1e/d1f/d40/f7b [0,4194304] 0 2024-09-16T00:50:24.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/891: rename d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fad to d3/d6/d8/d1d/d65/db0/df0/f12b 0 2024-09-16T00:50:24.068 INFO:tasks.workunit.client.1.smithi152.stdout:2/859: rename d4/d44/d7a/dc7/de4/f4f to d4/d44/d7a/dc7/de4/f122 0 2024-09-16T00:50:24.069 INFO:tasks.workunit.client.0.smithi053.stdout:9/472: sync 2024-09-16T00:50:24.069 INFO:tasks.workunit.client.0.smithi053.stdout:9/473: chown d8/d4c/d5b/f91 15858051 1 2024-09-16T00:50:24.069 INFO:tasks.workunit.client.1.smithi152.stdout:7/982: dread d9/d31/d65/f7c [0,4194304] 0 2024-09-16T00:50:24.070 INFO:tasks.workunit.client.0.smithi053.stdout:9/474: chown d8/d22/d26/d83/f88 0 1 2024-09-16T00:50:24.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/892: mknod d3/d6/d8/d1d/d23/d25/d45/c12c 0 2024-09-16T00:50:24.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/893: chown d3/d6/d8/d1d/d23/d25/d2a/d5c/d10a/dbf 486053268 1 2024-09-16T00:50:24.075 INFO:tasks.workunit.client.0.smithi053.stdout:7/443: write d1/d35/d14/d15/f1d [1126772,52798] 0 2024-09-16T00:50:24.075 INFO:tasks.workunit.client.0.smithi053.stdout:7/444: fdatasync d1/d35/f6b 0 2024-09-16T00:50:24.075 INFO:tasks.workunit.client.0.smithi053.stdout:7/445: readlink d1/d35/d5b/l6c 0 2024-09-16T00:50:24.075 INFO:tasks.workunit.client.0.smithi053.stdout:7/446: chown d1/d35/d14/d15/f1d 15634363 1 2024-09-16T00:50:24.075 INFO:tasks.workunit.client.0.smithi053.stdout:7/447: chown d1/d35/d14/d15/l2b 1 1 2024-09-16T00:50:24.077 INFO:tasks.workunit.client.1.smithi152.stdout:7/983: mknod d9/d31/d65/d8a/d41/d46/d7d/d86/d97/def/d129/c15f 0 2024-09-16T00:50:24.077 INFO:tasks.workunit.client.1.smithi152.stdout:7/984: stat d9/d31/d64/d3c 0 2024-09-16T00:50:24.079 INFO:tasks.workunit.client.0.smithi053.stdout:9/475: rmdir d8/d13 39 2024-09-16T00:50:24.082 INFO:tasks.workunit.client.1.smithi152.stdout:2/860: dread d4/d44/d7a/d9e/faf [0,4194304] 0 2024-09-16T00:50:24.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/894: symlink d3/d6/d8/d9e/l12d 0 2024-09-16T00:50:24.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/895: chown d3/d6/d8/d1d/d23/d25/d2a/d5c/d10a/dbf/fcf 22698611 1 2024-09-16T00:50:24.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/896: chown d3/d6/d8/d1d/d65/l93 549 1 2024-09-16T00:50:24.083 INFO:tasks.workunit.client.1.smithi152.stdout:3/868: dwrite dc/d10/d17/f26 [0,4194304] 0 2024-09-16T00:50:24.083 INFO:tasks.workunit.client.1.smithi152.stdout:3/869: truncate dc/d10/d17/d1c/d50/d55/d6d/f8b 597320 0 2024-09-16T00:50:24.083 INFO:tasks.workunit.client.1.smithi152.stdout:3/870: write dc/d10/d17/d1c/d1f/d24/db9/fd1 [238435,115512] 0 2024-09-16T00:50:24.084 INFO:tasks.workunit.client.0.smithi053.stdout:5/362: dwrite d3/f35 [0,4194304] 0 2024-09-16T00:50:24.086 INFO:tasks.workunit.client.1.smithi152.stdout:7/985: creat d9/f160 x:0 0 0 2024-09-16T00:50:24.087 INFO:tasks.workunit.client.1.smithi152.stdout:6/924: sync 2024-09-16T00:50:24.088 INFO:tasks.workunit.client.1.smithi152.stdout:6/925: dread - db/d12/d23/d4a/f10a zero size 2024-09-16T00:50:24.088 INFO:tasks.workunit.client.0.smithi053.stdout:7/448: getdents d1/d60/d77/d50 0 2024-09-16T00:50:24.089 INFO:tasks.workunit.client.0.smithi053.stdout:7/449: dread - d1/d2a/f99 zero size 2024-09-16T00:50:24.089 INFO:tasks.workunit.client.0.smithi053.stdout:0/533: dread d4/d5a/f7e [0,4194304] 0 2024-09-16T00:50:24.089 INFO:tasks.workunit.client.0.smithi053.stdout:0/534: fsync d4/dc/d87/f50 0 2024-09-16T00:50:24.089 INFO:tasks.workunit.client.0.smithi053.stdout:0/535: write d4/dc/d25/d34/d71/d96/f67 [1850234,55815] 0 2024-09-16T00:50:24.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/861: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/c123 0 2024-09-16T00:50:24.094 INFO:tasks.workunit.client.1.smithi152.stdout:2/862: write d4/d44/d7a/d9e/d87/d9c/fae [956091,130064] 0 2024-09-16T00:50:24.095 INFO:tasks.workunit.client.1.smithi152.stdout:0/897: creat d3/d6/d8/d1d/d65/d6e/f12e x:0 0 0 2024-09-16T00:50:24.100 INFO:tasks.workunit.client.0.smithi053.stdout:5/363: rename d3/d7/d24/l31 to d3/d7/d24/d3f/l72 0 2024-09-16T00:50:24.104 INFO:tasks.workunit.client.1.smithi152.stdout:6/926: creat db/d12/d20/d118/f123 x:0 0 0 2024-09-16T00:50:24.106 INFO:tasks.workunit.client.1.smithi152.stdout:6/927: write db/d12/d23/d4a/d43/d59/d67/dc2/fdd [701371,124108] 0 2024-09-16T00:50:24.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/863: mkdir d4/d44/d7a/d9e/d124 0 2024-09-16T00:50:24.107 INFO:tasks.workunit.client.1.smithi152.stdout:7/986: dwrite d9/d31/d64/d3c/d5b/f120 [0,4194304] 0 2024-09-16T00:50:24.112 INFO:tasks.workunit.client.0.smithi053.stdout:0/536: dwrite d4/dc/d1e/d1f/d40/d44/f76 [0,4194304] 0 2024-09-16T00:50:24.113 INFO:tasks.workunit.client.0.smithi053.stdout:7/450: unlink d1/l1b 0 2024-09-16T00:50:24.113 INFO:tasks.workunit.client.0.smithi053.stdout:7/451: chown d1/d2a/d4f/c76 0 1 2024-09-16T00:50:24.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/898: dwrite d3/d6/d8/d1d/d65/db0/db6/f106 [0,4194304] 0 2024-09-16T00:50:24.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/899: dread - d3/d6/d8/d1d/d23/d25/d2a/d5c/f103 zero size 2024-09-16T00:50:24.119 INFO:tasks.workunit.client.0.smithi053.stdout:5/364: creat d3/d7/d2b/d4b/d4f/f73 x:0 0 0 2024-09-16T00:50:24.119 INFO:tasks.workunit.client.0.smithi053.stdout:5/365: creat d3/d7/d2b/d37/d58/f74 x:0 0 0 2024-09-16T00:50:24.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/928: dread db/d12/d1c/d80/f7a [0,4194304] 0 2024-09-16T00:50:24.123 INFO:tasks.workunit.client.1.smithi152.stdout:2/864: rename d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/lfc to d4/d44/d7a/dc7/d107/l125 0 2024-09-16T00:50:24.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/987: dread d9/d10/da5/fbd [0,4194304] 0 2024-09-16T00:50:24.123 INFO:tasks.workunit.client.1.smithi152.stdout:8/772: sync 2024-09-16T00:50:24.126 INFO:tasks.workunit.client.1.smithi152.stdout:0/900: write d3/d6/d6d/f8f [3411308,77596] 0 2024-09-16T00:50:24.126 INFO:tasks.workunit.client.1.smithi152.stdout:0/901: fdatasync d3/d6/d64/d6a/d61/fef 0 2024-09-16T00:50:24.127 INFO:tasks.workunit.client.0.smithi053.stdout:0/537: mknod d4/d5a/d82/ca9 0 2024-09-16T00:50:24.127 INFO:tasks.workunit.client.0.smithi053.stdout:0/538: write d4/dc/d25/d34/f5e [1179116,27235] 0 2024-09-16T00:50:24.127 INFO:tasks.workunit.client.0.smithi053.stdout:5/366: dread d3/d7/d24/f28 [0,4194304] 0 2024-09-16T00:50:24.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/929: sync 2024-09-16T00:50:24.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/930: truncate d1/d4e/d48/d2b/d93/d96/d12b/f39 2456970 0 2024-09-16T00:50:24.129 INFO:tasks.workunit.client.0.smithi053.stdout:0/539: fsync d4/dc/d25/d34/f5e 0 2024-09-16T00:50:24.129 INFO:tasks.workunit.client.0.smithi053.stdout:0/540: write d4/dc/d25/d34/f88 [2157357,130882] 0 2024-09-16T00:50:24.129 INFO:tasks.workunit.client.0.smithi053.stdout:0/541: truncate d4/dc/d25/d34/d71/d96/f99 922333 0 2024-09-16T00:50:24.140 INFO:tasks.workunit.client.1.smithi152.stdout:7/988: creat d9/d31/d65/d8a/d41/d46/d7d/d86/d142/d145/d148/f161 x:0 0 0 2024-09-16T00:50:24.141 INFO:tasks.workunit.client.0.smithi053.stdout:0/542: mknod d4/dc/d1e/d1f/da2/caa 0 2024-09-16T00:50:24.141 INFO:tasks.workunit.client.0.smithi053.stdout:0/543: fsync d4/dc/d25/f2f 0 2024-09-16T00:50:24.142 INFO:tasks.workunit.client.1.smithi152.stdout:8/773: symlink dd/d15/d69/dca/lff 0 2024-09-16T00:50:24.142 INFO:tasks.workunit.client.1.smithi152.stdout:8/774: creat dd/db9/f100 x:0 0 0 2024-09-16T00:50:24.143 INFO:tasks.workunit.client.1.smithi152.stdout:0/902: creat d3/d6/d4e/d11a/f12f x:0 0 0 2024-09-16T00:50:24.145 INFO:tasks.workunit.client.1.smithi152.stdout:9/931: symlink d1/d7/d77/d32/da5/da8/dc5/l12d 0 2024-09-16T00:50:24.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/929: getdents db/d12/d23/d4a/d33/dbe 0 2024-09-16T00:50:24.149 INFO:tasks.workunit.client.1.smithi152.stdout:6/930: write db/da8/db7/ff3 [1040896,60390] 0 2024-09-16T00:50:24.150 INFO:tasks.workunit.client.1.smithi152.stdout:7/989: mknod d9/d10/da5/c162 0 2024-09-16T00:50:24.151 INFO:tasks.workunit.client.0.smithi053.stdout:5/367: rename d3/f8 to d3/d7/d24/d3f/f75 0 2024-09-16T00:50:24.157 INFO:tasks.workunit.client.1.smithi152.stdout:0/903: mknod d3/d6/d8/d1d/d65/db0/df0/c130 0 2024-09-16T00:50:24.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/368: link d3/f4 d3/d7/d24/d34/f76 0 2024-09-16T00:50:24.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/369: creat d3/d7/d2b/d2f/f77 x:0 0 0 2024-09-16T00:50:24.160 INFO:tasks.workunit.client.0.smithi053.stdout:5/370: fsync d3/d7/f1f 0 2024-09-16T00:50:24.161 INFO:tasks.workunit.client.1.smithi152.stdout:9/932: unlink d1/d4e/d48/d2b/d93/d96/dd1/fde 0 2024-09-16T00:50:24.163 INFO:tasks.workunit.client.1.smithi152.stdout:0/904: truncate d3/d6/d64/f95 4174484 0 2024-09-16T00:50:24.163 INFO:tasks.workunit.client.1.smithi152.stdout:0/905: fdatasync d3/d6/d8/f3d 0 2024-09-16T00:50:24.163 INFO:tasks.workunit.client.1.smithi152.stdout:0/906: write d3/d6/d2e/fd3 [652894,87035] 0 2024-09-16T00:50:24.163 INFO:tasks.workunit.client.1.smithi152.stdout:0/907: stat d3/d6/d2e/de9/f126 0 2024-09-16T00:50:24.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/908: write d3/d6/d64/d6a/f12a [829341,26788] 0 2024-09-16T00:50:24.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/909: readlink d3/d6/d8/lb8 0 2024-09-16T00:50:24.165 INFO:tasks.workunit.client.0.smithi053.stdout:5/371: rmdir d3/d7/d2b/d2f/d67 0 2024-09-16T00:50:24.165 INFO:tasks.workunit.client.0.smithi053.stdout:5/372: chown d3/d7/d24/d34/f76 5 1 2024-09-16T00:50:24.165 INFO:tasks.workunit.client.1.smithi152.stdout:9/933: write d1/d7/d13/d5d/f6b [1188868,78694] 0 2024-09-16T00:50:24.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/934: creat d1/d7/f12e x:0 0 0 2024-09-16T00:50:24.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/935: truncate d1/d4e/d48/ffd 210782 0 2024-09-16T00:50:24.170 INFO:tasks.workunit.client.0.smithi053.stdout:5/373: dread d3/f20 [0,4194304] 0 2024-09-16T00:50:24.173 INFO:tasks.workunit.client.0.smithi053.stdout:5/374: rename d3/d7/d2b/d4b/d51/d53/l63 to d3/d7/d24/d34/l78 0 2024-09-16T00:50:24.175 INFO:tasks.workunit.client.0.smithi053.stdout:5/375: mkdir d3/d7/d2b/d37/d58/d79 0 2024-09-16T00:50:24.176 INFO:tasks.workunit.client.0.smithi053.stdout:5/376: mknod d3/d7/d2b/d37/c7a 0 2024-09-16T00:50:24.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/775: rename dd/d15/d69/dca to dd/d98/da5/d101 0 2024-09-16T00:50:24.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/776: read - dd/f97 zero size 2024-09-16T00:50:24.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/777: dread - dd/d98/db8/dcf/d88/fce zero size 2024-09-16T00:50:24.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/778: readlink dd/d15/d49/l4e 0 2024-09-16T00:50:24.179 INFO:tasks.workunit.client.0.smithi053.stdout:5/377: creat d3/d7/d24/d34/d5b/f7b x:0 0 0 2024-09-16T00:50:24.181 INFO:tasks.workunit.client.1.smithi152.stdout:6/931: rename db/d12/d23/d4a/d43/d48/d64/f6d to db/d28/dd8/f124 0 2024-09-16T00:50:24.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/990: rename f3 to d9/d31/d64/d3c/d5b/f163 0 2024-09-16T00:50:24.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/991: dread - d9/d31/ff5 zero size 2024-09-16T00:50:24.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/910: rename d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe7 to d3/d6/d2e/de9/dff/f131 0 2024-09-16T00:50:24.186 INFO:tasks.workunit.client.1.smithi152.stdout:7/992: link d9/d10/f36 d9/d31/d65/d8a/d41/f164 0 2024-09-16T00:50:24.186 INFO:tasks.workunit.client.1.smithi152.stdout:7/993: readlink d9/l2c 0 2024-09-16T00:50:24.188 INFO:tasks.workunit.client.1.smithi152.stdout:8/779: rename dd/d25/d77 to dd/d98/db8/dcf/d29/dc6/d102 0 2024-09-16T00:50:24.189 INFO:tasks.workunit.client.0.smithi053.stdout:7/452: dwrite d1/d35/d14/f41 [0,4194304] 0 2024-09-16T00:50:24.191 INFO:tasks.workunit.client.1.smithi152.stdout:7/994: unlink d9/d31/d65/d8a/d41/d46/c57 0 2024-09-16T00:50:24.191 INFO:tasks.workunit.client.1.smithi152.stdout:8/780: dread dd/d98/db8/dcf/d29/d2f/f35 [0,4194304] 0 2024-09-16T00:50:24.192 INFO:tasks.workunit.client.1.smithi152.stdout:8/781: stat dd/d98/db8/dcf/d29/d2f/f31 0 2024-09-16T00:50:24.192 INFO:tasks.workunit.client.1.smithi152.stdout:8/782: chown dd/d15/f5a 11 1 2024-09-16T00:50:24.192 INFO:tasks.workunit.client.1.smithi152.stdout:8/783: chown dd/d98/db8/dcf/d88/fbf 0 1 2024-09-16T00:50:24.192 INFO:tasks.workunit.client.1.smithi152.stdout:9/936: dwrite d1/d7/d13/fad [0,4194304] 0 2024-09-16T00:50:24.196 INFO:tasks.workunit.client.1.smithi152.stdout:7/995: creat d9/d31/d64/d3c/d5b/f165 x:0 0 0 2024-09-16T00:50:24.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/932: dread db/d12/d23/d4a/d43/d48/f5d [0,4194304] 0 2024-09-16T00:50:24.197 INFO:tasks.workunit.client.1.smithi152.stdout:6/933: chown db/d12/d23/d4a/d43/d59/d67/dc2 1 1 2024-09-16T00:50:24.198 INFO:tasks.workunit.client.0.smithi053.stdout:5/378: dread d3/f2c [0,4194304] 0 2024-09-16T00:50:24.198 INFO:tasks.workunit.client.0.smithi053.stdout:7/453: creat d1/d3/f9a x:0 0 0 2024-09-16T00:50:24.203 INFO:tasks.workunit.client.1.smithi152.stdout:8/784: truncate dd/d98/db8/dcf/d29/f7e 1593728 0 2024-09-16T00:50:24.206 INFO:tasks.workunit.client.0.smithi053.stdout:5/379: mknod d3/c7c 0 2024-09-16T00:50:24.208 INFO:tasks.workunit.client.0.smithi053.stdout:5/380: symlink d3/d7/d2b/d37/d58/l7d 0 2024-09-16T00:50:24.209 INFO:tasks.workunit.client.1.smithi152.stdout:8/785: symlink dd/d15/d69/l103 0 2024-09-16T00:50:24.209 INFO:tasks.workunit.client.1.smithi152.stdout:7/996: dread d9/d31/d65/d8a/d41/d46/d7d/fb0 [0,4194304] 0 2024-09-16T00:50:24.209 INFO:tasks.workunit.client.0.smithi053.stdout:5/381: symlink d3/d7/d2b/d2f/l7e 0 2024-09-16T00:50:24.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/382: mknod d3/d7/d2b/d4b/c7f 0 2024-09-16T00:50:24.239 INFO:tasks.workunit.client.1.smithi152.stdout:0/911: dwrite d3/d6/d64/d6a/f12a [0,4194304] 0 2024-09-16T00:50:24.240 INFO:tasks.workunit.client.1.smithi152.stdout:6/934: dwrite db/d12/d1c/d80/f7a [4194304,4194304] 0 2024-09-16T00:50:24.240 INFO:tasks.workunit.client.1.smithi152.stdout:6/935: write f9 [1422570,51281] 0 2024-09-16T00:50:24.250 INFO:tasks.workunit.client.1.smithi152.stdout:8/786: dwrite dd/d98/db8/dcf/d88/fbc [0,4194304] 0 2024-09-16T00:50:24.250 INFO:tasks.workunit.client.0.smithi053.stdout:7/454: dwrite d1/d35/d5b/d93/f96 [0,4194304] 0 2024-09-16T00:50:24.250 INFO:tasks.workunit.client.0.smithi053.stdout:7/455: fdatasync d1/d35/d5b/f8f 0 2024-09-16T00:50:24.251 INFO:tasks.workunit.client.1.smithi152.stdout:7/997: dwrite d9/d10/f16 [0,4194304] 0 2024-09-16T00:50:24.251 INFO:tasks.workunit.client.1.smithi152.stdout:0/912: dread d3/d6/d8/d1d/d23/f3b [0,4194304] 0 2024-09-16T00:50:24.251 INFO:tasks.workunit.client.1.smithi152.stdout:7/998: dread - d9/d31/d64/d3c/d5b/f165 zero size 2024-09-16T00:50:24.251 INFO:tasks.workunit.client.1.smithi152.stdout:9/937: dwrite d1/d7/d13/d5d/f94 [0,4194304] 0 2024-09-16T00:50:24.261 INFO:tasks.workunit.client.1.smithi152.stdout:8/787: dread dd/d15/d1a/ff4 [0,4194304] 0 2024-09-16T00:50:24.277 INFO:tasks.workunit.client.1.smithi152.stdout:8/788: dwrite dd/d23/fa6 [0,4194304] 0 2024-09-16T00:50:24.277 INFO:tasks.workunit.client.1.smithi152.stdout:8/789: creat dd/db9/f104 x:0 0 0 2024-09-16T00:50:24.286 INFO:tasks.workunit.client.1.smithi152.stdout:8/790: dread dd/d15/f7a [0,4194304] 0 2024-09-16T00:50:24.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:23 smithi053 ceph-mon[27950]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 276 MiB/s rd, 330 MiB/s wr, 513 op/s 2024-09-16T00:50:24.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:23 smithi053 ceph-mon[27950]: Adjusting osd_memory_target on smithi053 to 1217M 2024-09-16T00:50:24.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:23 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:50:24.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:23 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:50:24.332 INFO:tasks.workunit.client.0.smithi053.stdout:5/383: unlink d3/d7/d24/d34/f3c 0 2024-09-16T00:50:24.332 INFO:tasks.workunit.client.0.smithi053.stdout:5/384: read - d3/d7/d2b/f3a zero size 2024-09-16T00:50:24.346 INFO:tasks.workunit.client.0.smithi053.stdout:5/385: mkdir d3/d7/d24/d34/d80 0 2024-09-16T00:50:24.347 INFO:tasks.workunit.client.0.smithi053.stdout:5/386: read - d3/d7/d2b/f3a zero size 2024-09-16T00:50:24.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/936: symlink db/da8/db7/d11b/l125 0 2024-09-16T00:50:24.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/937: chown db/d12/d23/d4a/d43/d48/f5d 1 1 2024-09-16T00:50:24.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/938: dread - db/f10c zero size 2024-09-16T00:50:24.351 INFO:tasks.workunit.client.0.smithi053.stdout:5/387: rename d3/d7/d2b/l6a to d3/d7/d24/l81 0 2024-09-16T00:50:24.367 INFO:tasks.workunit.client.1.smithi152.stdout:7/999: link d9/d31/d64/d3c/db9/dd3/de6/l102 d9/d31/d65/d8a/d41/d46/d7d/de2/l166 0 2024-09-16T00:50:24.368 INFO:tasks.workunit.client.1.smithi152.stdout:9/938: mkdir d1/d7/ded/d113/d12f 0 2024-09-16T00:50:24.374 INFO:tasks.workunit.client.0.smithi053.stdout:5/388: dwrite d3/d7/d24/d34/f39 [4194304,4194304] 0 2024-09-16T00:50:24.374 INFO:tasks.workunit.client.0.smithi053.stdout:5/389: write d3/d7/d2b/d37/d58/f38 [353301,101864] 0 2024-09-16T00:50:24.374 INFO:tasks.workunit.client.0.smithi053.stdout:5/390: fsync d3/d7/d24/d34/d3e/f70 0 2024-09-16T00:50:24.376 INFO:tasks.workunit.client.1.smithi152.stdout:6/939: rename db/d12/le4 to db/d12/d1c/l126 0 2024-09-16T00:50:24.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/939: write d1/d7/d77/f43 [4105443,22657] 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/391: fdatasync d3/f27 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/392: stat d3/d7/d24/d34/l69 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/393: stat d3/f20 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/394: fsync d3/d7/d2b/d2f/f77 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/395: creat d3/d7/d2b/d37/d58/f82 x:0 0 0 2024-09-16T00:50:24.381 INFO:tasks.workunit.client.0.smithi053.stdout:5/396: stat d3/d7/d2b/d37 0 2024-09-16T00:50:24.382 INFO:tasks.workunit.client.1.smithi152.stdout:0/913: getdents d3/d6/d64/d6a/d61 0 2024-09-16T00:50:24.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/940: read db/d28/db3/fc4 [517703,60119] 0 2024-09-16T00:50:24.386 INFO:tasks.workunit.client.1.smithi152.stdout:6/941: chown db/d12/d23/d4a/d43/d59/d67/dc2/fdd 0 1 2024-09-16T00:50:24.387 INFO:tasks.workunit.client.0.smithi053.stdout:5/397: dread d3/d7/d2b/d37/d58/f4c [0,4194304] 0 2024-09-16T00:50:24.387 INFO:tasks.workunit.client.1.smithi152.stdout:8/791: getdents dd/d98/db8/dcf/d29 0 2024-09-16T00:50:24.388 INFO:tasks.workunit.client.1.smithi152.stdout:8/792: creat dd/db9/f105 x:0 0 0 2024-09-16T00:50:24.388 INFO:tasks.workunit.client.1.smithi152.stdout:8/793: readlink dd/d98/da5/dbb/lcb 0 2024-09-16T00:50:24.388 INFO:tasks.workunit.client.1.smithi152.stdout:0/914: creat d3/d6/d8/d1d/d23/d25/d45/d6f/f132 x:0 0 0 2024-09-16T00:50:24.391 INFO:tasks.workunit.client.1.smithi152.stdout:6/942: mkdir db/d12/d23/d4a/d43/d127 0 2024-09-16T00:50:24.392 INFO:tasks.workunit.client.0.smithi053.stdout:5/398: dread d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:24.393 INFO:tasks.workunit.client.1.smithi152.stdout:8/794: mknod dd/d98/db8/dcf/d29/d2f/db6/c106 0 2024-09-16T00:50:24.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/943: creat db/d12/d23/d4a/d43/d48/d6a/de0/d11e/f128 x:0 0 0 2024-09-16T00:50:24.395 INFO:tasks.workunit.client.0.smithi053.stdout:5/399: link d3/d7/lc d3/d7/d2b/d4b/d51/d53/l83 0 2024-09-16T00:50:24.396 INFO:tasks.workunit.client.0.smithi053.stdout:5/400: creat d3/d7/d2b/d37/d58/d79/f84 x:0 0 0 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/865: sync 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:3/871: sync 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/866: chown d4/d44/d7a/d9e/d87/d9c/ca1 5255 1 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:3/872: chown dc/d10/d17/d1c/d1f/d9e/le0 1135 1 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/867: fdatasync d4/d44/d7a/d9e/faf 0 2024-09-16T00:50:24.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/868: fdatasync d4/d44/d7a/dc7/de4/d94/d93/fcc 0 2024-09-16T00:50:24.399 INFO:tasks.workunit.client.0.smithi053.stdout:5/401: mknod d3/c85 0 2024-09-16T00:50:24.399 INFO:tasks.workunit.client.0.smithi053.stdout:5/402: read d3/d7/d24/d34/f39 [3093319,32049] 0 2024-09-16T00:50:24.404 INFO:tasks.workunit.client.1.smithi152.stdout:0/915: read d3/f19 [3893593,60649] 0 2024-09-16T00:50:24.404 INFO:tasks.workunit.client.1.smithi152.stdout:9/940: dwrite d1/d7/ded/d113/d127/fa4 [0,4194304] 0 2024-09-16T00:50:24.404 INFO:tasks.workunit.client.1.smithi152.stdout:3/873: creat dc/d10/d17/f113 x:0 0 0 2024-09-16T00:50:24.404 INFO:tasks.workunit.client.1.smithi152.stdout:3/874: stat dc/d5c/dae/df1 0 2024-09-16T00:50:24.407 INFO:tasks.workunit.client.0.smithi053.stdout:5/403: link d3/d7/d2b/d4b/d4f/f54 d3/d7/d24/d3f/f86 0 2024-09-16T00:50:24.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/916: mknod d3/d6/d8/d1d/d23/d25/d2a/d5c/c133 0 2024-09-16T00:50:24.409 INFO:tasks.workunit.client.1.smithi152.stdout:9/941: unlink d1/d4e/d48/d2b/d93/d96/d12b/l114 0 2024-09-16T00:50:24.412 INFO:tasks.workunit.client.0.smithi053.stdout:5/404: read d3/f2d [1390440,103337] 0 2024-09-16T00:50:24.412 INFO:tasks.workunit.client.0.smithi053.stdout:5/405: write d3/d7/f1f [2014249,103378] 0 2024-09-16T00:50:24.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/875: mknod dc/d10/d17/d1c/c114 0 2024-09-16T00:50:24.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/876: creat dc/d10/d17/d4f/f115 x:0 0 0 2024-09-16T00:50:24.415 INFO:tasks.workunit.client.0.smithi053.stdout:3/455: sync 2024-09-16T00:50:24.416 INFO:tasks.workunit.client.1.smithi152.stdout:0/917: getdents d3/d6/d51 0 2024-09-16T00:50:24.416 INFO:tasks.workunit.client.1.smithi152.stdout:0/918: write d3/d6/f1f [168456,5195] 0 2024-09-16T00:50:24.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/942: symlink d1/d4e/d48/d26/d30/d4f/d50/d83/l130 0 2024-09-16T00:50:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/795: dwrite dd/d15/d9b/ff1 [0,4194304] 0 2024-09-16T00:50:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/796: chown dd/d15/ce8 945399 1 2024-09-16T00:50:24.420 INFO:tasks.workunit.client.0.smithi053.stdout:5/406: rmdir d3/d7/d2b/d37 39 2024-09-16T00:50:24.420 INFO:tasks.workunit.client.0.smithi053.stdout:5/407: creat d3/d7/d2b/d4b/d4f/f87 x:0 0 0 2024-09-16T00:50:24.427 INFO:tasks.workunit.client.1.smithi152.stdout:0/919: mknod d3/d6/d64/c134 0 2024-09-16T00:50:24.432 INFO:tasks.workunit.client.1.smithi152.stdout:3/877: write dc/d10/d17/d1c/f23 [1015859,64284] 0 2024-09-16T00:50:24.432 INFO:tasks.workunit.client.1.smithi152.stdout:2/869: dwrite d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/fea [0,4194304] 0 2024-09-16T00:50:24.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/797: dwrite dd/db9/f100 [0,4194304] 0 2024-09-16T00:50:24.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/798: creat dd/d98/db8/dcf/f107 x:0 0 0 2024-09-16T00:50:24.438 INFO:tasks.workunit.client.1.smithi152.stdout:8/799: fdatasync dd/d25/f30 0 2024-09-16T00:50:24.438 INFO:tasks.workunit.client.1.smithi152.stdout:8/800: chown dd/l27 23338211 1 2024-09-16T00:50:24.438 INFO:tasks.workunit.client.1.smithi152.stdout:0/920: rename d3/d6/d8/d1d/d23/d25/d2a/lec to d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/l135 0 2024-09-16T00:50:24.444 INFO:tasks.workunit.client.0.smithi053.stdout:3/456: rename d1/d5/d16 to d1/d5/d91 0 2024-09-16T00:50:24.446 INFO:tasks.workunit.client.0.smithi053.stdout:3/457: read d1/d5/f22 [379273,72370] 0 2024-09-16T00:50:24.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:23 smithi152 ceph-mon[33237]: pgmap v12: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 276 MiB/s rd, 330 MiB/s wr, 513 op/s 2024-09-16T00:50:24.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:23 smithi152 ceph-mon[33237]: Adjusting osd_memory_target on smithi053 to 1217M 2024-09-16T00:50:24.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:23 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:50:24.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:23 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:50:24.448 INFO:tasks.workunit.client.1.smithi152.stdout:9/943: dwrite d1/d4e/d48/d2b/f70 [0,4194304] 0 2024-09-16T00:50:24.449 INFO:tasks.workunit.client.0.smithi053.stdout:3/458: mknod d1/d5/d91/d5e/d69/c92 0 2024-09-16T00:50:24.455 INFO:tasks.workunit.client.1.smithi152.stdout:8/801: mknod dd/d15/c108 0 2024-09-16T00:50:24.455 INFO:tasks.workunit.client.1.smithi152.stdout:8/802: fsync dd/f72 0 2024-09-16T00:50:24.455 INFO:tasks.workunit.client.1.smithi152.stdout:8/803: write dd/d15/fc8 [535640,112877] 0 2024-09-16T00:50:24.457 INFO:tasks.workunit.client.1.smithi152.stdout:0/921: truncate d3/d6/d8/d1d/d23/d25/d2a/f8d 1709761 0 2024-09-16T00:50:24.459 INFO:tasks.workunit.client.1.smithi152.stdout:9/944: mknod d1/d4e/d48/d2b/c131 0 2024-09-16T00:50:24.459 INFO:tasks.workunit.client.1.smithi152.stdout:9/945: dread - d1/d4e/d48/d2b/f125 zero size 2024-09-16T00:50:24.460 INFO:tasks.workunit.client.1.smithi152.stdout:0/922: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/d136 0 2024-09-16T00:50:24.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/923: readlink d3/d6/d8/d1d/d23/d4b/l7c 0 2024-09-16T00:50:24.461 INFO:tasks.workunit.client.1.smithi152.stdout:8/804: dread dd/d98/db8/dcf/d29/d2f/f3d [0,4194304] 0 2024-09-16T00:50:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:2/870: dwrite d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/ffa [0,4194304] 0 2024-09-16T00:50:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:9/946: unlink d1/d59/f2f 0 2024-09-16T00:50:24.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/924: creat d3/d6/d8/d1d/d23/d25/d2a/f137 x:0 0 0 2024-09-16T00:50:24.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/925: fdatasync d3/d6/d64/d6a/fd5 0 2024-09-16T00:50:24.465 INFO:tasks.workunit.client.1.smithi152.stdout:8/805: creat dd/d98/db8/dcf/d29/dc6/de2/f109 x:0 0 0 2024-09-16T00:50:24.467 INFO:tasks.workunit.client.1.smithi152.stdout:2/871: unlink d4/d44/d7a/dc7/de4/d20/d28/c80 0 2024-09-16T00:50:24.468 INFO:tasks.workunit.client.1.smithi152.stdout:2/872: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8/f126 x:0 0 0 2024-09-16T00:50:24.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/947: link d1/d4e/d48/d26/d30/d8f/dc4/d111/l100 d1/d4e/d48/d2b/d7c/l132 0 2024-09-16T00:50:24.469 INFO:tasks.workunit.client.1.smithi152.stdout:8/806: rmdir dd/d98/db8/dcf/d29/d2f/d5f/dd2 39 2024-09-16T00:50:24.471 INFO:tasks.workunit.client.1.smithi152.stdout:2/873: symlink d4/d44/d7a/dc7/de4/d94/l127 0 2024-09-16T00:50:24.471 INFO:tasks.workunit.client.1.smithi152.stdout:2/874: write d4/d44/d7a/dc7/de4/d20/d28/fb1 [250768,46174] 0 2024-09-16T00:50:24.472 INFO:tasks.workunit.client.1.smithi152.stdout:2/875: read d4/d44/d7a/dc7/de4/f11a [61493,4424] 0 2024-09-16T00:50:24.472 INFO:tasks.workunit.client.1.smithi152.stdout:2/876: chown d4/d44/d7a/dc7/de4/d20/d28/d2c/de6 192 1 2024-09-16T00:50:24.472 INFO:tasks.workunit.client.1.smithi152.stdout:9/948: rmdir d1/d7/d77/d32/da5/df1 39 2024-09-16T00:50:24.472 INFO:tasks.workunit.client.1.smithi152.stdout:9/949: write d1/d4e/d48/d2b/d93/d96/d12b/f129 [88084,15873] 0 2024-09-16T00:50:24.473 INFO:tasks.workunit.client.1.smithi152.stdout:9/950: mkdir d1/d7/dca/d133 0 2024-09-16T00:50:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/807: dread dd/d98/db8/dcf/d29/f7e [0,4194304] 0 2024-09-16T00:50:24.475 INFO:tasks.workunit.client.1.smithi152.stdout:8/808: write dd/d98/db8/dcf/d29/d2f/d53/f65 [4489825,103487] 0 2024-09-16T00:50:24.475 INFO:tasks.workunit.client.1.smithi152.stdout:8/809: dread dd/d23/f55 [0,4194304] 0 2024-09-16T00:50:24.476 INFO:tasks.workunit.client.1.smithi152.stdout:8/810: rmdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4 39 2024-09-16T00:50:24.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/811: creat dd/d98/db8/dcf/d29/d2f/d53/f10a x:0 0 0 2024-09-16T00:50:24.478 INFO:tasks.workunit.client.1.smithi152.stdout:2/877: read d4/d44/d7a/d9e/d66/f9a [926044,23826] 0 2024-09-16T00:50:24.478 INFO:tasks.workunit.client.1.smithi152.stdout:8/812: creat dd/d98/db8/dcf/d29/d2f/f10b x:0 0 0 2024-09-16T00:50:24.478 INFO:tasks.workunit.client.0.smithi053.stdout:3/459: dwrite d1/d89/f2d [0,4194304] 0 2024-09-16T00:50:24.479 INFO:tasks.workunit.client.0.smithi053.stdout:3/460: fsync d1/d89/f18 0 2024-09-16T00:50:24.479 INFO:tasks.workunit.client.0.smithi053.stdout:3/461: write d1/d5/d11/f46 [3373148,82416] 0 2024-09-16T00:50:24.479 INFO:tasks.workunit.client.1.smithi152.stdout:0/926: dwrite d3/d6/d4e/ddb/ffe [0,4194304] 0 2024-09-16T00:50:24.479 INFO:tasks.workunit.client.1.smithi152.stdout:0/927: write d3/d6/d2e/de9/f126 [242994,44214] 0 2024-09-16T00:50:24.480 INFO:tasks.workunit.client.0.smithi053.stdout:3/462: truncate d1/d5/d31/d42/f8c 3092858 0 2024-09-16T00:50:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/951: dread d1/d4e/d48/d2b/d93/d96/d12b/f129 [0,4194304] 0 2024-09-16T00:50:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:2/878: symlink d4/d44/d7a/d9e/da0/l128 0 2024-09-16T00:50:24.483 INFO:tasks.workunit.client.1.smithi152.stdout:9/952: rename d1/d4e/d48/d66/l6d to d1/d4e/d48/d26/d30/d4f/d50/l134 0 2024-09-16T00:50:24.489 INFO:tasks.workunit.client.1.smithi152.stdout:0/928: dread d3/d6/d51/f85 [0,4194304] 0 2024-09-16T00:50:24.492 INFO:tasks.workunit.client.1.smithi152.stdout:9/953: write d1/d7/d77/d32/da5/da8/ff7 [3083617,24771] 0 2024-09-16T00:50:24.495 INFO:tasks.workunit.client.1.smithi152.stdout:0/929: mkdir d3/d6/d8/d1d/d23/d25/d2a/d5c/d125/d138 0 2024-09-16T00:50:24.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/954: creat d1/d4e/d48/d2b/d93/d96/f135 x:0 0 0 2024-09-16T00:50:24.498 INFO:tasks.workunit.client.1.smithi152.stdout:9/955: write d1/d7/f12e [153593,58554] 0 2024-09-16T00:50:24.498 INFO:tasks.workunit.client.1.smithi152.stdout:9/956: write d1/d4e/d48/d2b/d93/fc6 [1195518,55904] 0 2024-09-16T00:50:24.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/930: getdents d3/d6/d8 0 2024-09-16T00:50:24.499 INFO:tasks.workunit.client.1.smithi152.stdout:8/813: dwrite dd/d23/f55 [0,4194304] 0 2024-09-16T00:50:24.499 INFO:tasks.workunit.client.1.smithi152.stdout:8/814: chown dd/d98/db8/dcf/fb2 910931 1 2024-09-16T00:50:24.502 INFO:tasks.workunit.client.1.smithi152.stdout:2/879: dwrite d4/d44/d7a/d9e/d66/dec/f110 [0,4194304] 0 2024-09-16T00:50:24.502 INFO:tasks.workunit.client.1.smithi152.stdout:9/957: mknod d1/d4e/c136 0 2024-09-16T00:50:24.505 INFO:tasks.workunit.client.1.smithi152.stdout:8/815: rmdir dd/d98/db8/dcf/d29 39 2024-09-16T00:50:24.512 INFO:tasks.workunit.client.1.smithi152.stdout:9/958: dread d1/d59/f12c [0,4194304] 0 2024-09-16T00:50:24.514 INFO:tasks.workunit.client.1.smithi152.stdout:2/880: dread d4/d44/d7a/dc7/de4/d20/fd3 [0,4194304] 0 2024-09-16T00:50:24.515 INFO:tasks.workunit.client.1.smithi152.stdout:8/816: rename dd/d98/da5 to dd/d98/db8/d10c 0 2024-09-16T00:50:24.517 INFO:tasks.workunit.client.0.smithi053.stdout:3/463: rmdir d1 39 2024-09-16T00:50:24.517 INFO:tasks.workunit.client.1.smithi152.stdout:0/931: dwrite d3/d6/d8/d1d/d65/db0/fc9 [0,4194304] 0 2024-09-16T00:50:24.518 INFO:tasks.workunit.client.1.smithi152.stdout:0/932: creat d3/d6/d4e/d11a/f139 x:0 0 0 2024-09-16T00:50:24.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/959: symlink d1/d4e/d48/d26/d30/d4f/d50/d83/d9b/l137 0 2024-09-16T00:50:24.520 INFO:tasks.workunit.client.1.smithi152.stdout:2/881: creat d4/d44/d7a/dc7/de4/d20/d28/d112/f129 x:0 0 0 2024-09-16T00:50:24.520 INFO:tasks.workunit.client.1.smithi152.stdout:2/882: chown d4/d44/d7a/dc7/de4/d20/d28/f68 618730725 1 2024-09-16T00:50:24.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/817: creat dd/d98/db8/dcf/d29/f10d x:0 0 0 2024-09-16T00:50:24.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/818: write dd/d98/fbe [1362936,1267] 0 2024-09-16T00:50:24.522 INFO:tasks.workunit.client.1.smithi152.stdout:8/819: creat dd/d98/db8/dcf/d29/d2f/d53/f10e x:0 0 0 2024-09-16T00:50:24.526 INFO:tasks.workunit.client.0.smithi053.stdout:3/464: read d1/f6f [4826768,35727] 0 2024-09-16T00:50:24.530 INFO:tasks.workunit.client.0.smithi053.stdout:3/465: creat d1/d5/f93 x:0 0 0 2024-09-16T00:50:24.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/933: unlink d3/d6/d8/d9e/fc8 0 2024-09-16T00:50:24.533 INFO:tasks.workunit.client.1.smithi152.stdout:2/883: write d4/d44/d7a/d9e/d87/d9c/f108 [6674591,112013] 0 2024-09-16T00:50:24.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/960: dwrite d1/d4e/d48/f10a [0,4194304] 0 2024-09-16T00:50:24.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/961: write d1/d7/d77/d32/da5/da8/fd3 [966797,112347] 0 2024-09-16T00:50:24.541 INFO:tasks.workunit.client.1.smithi152.stdout:8/820: mkdir dd/d15/d49/d10f 0 2024-09-16T00:50:24.543 INFO:tasks.workunit.client.1.smithi152.stdout:2/884: dread d4/d44/d7a/dc7/de4/d20/d28/f52 [0,4194304] 0 2024-09-16T00:50:24.543 INFO:tasks.workunit.client.1.smithi152.stdout:0/934: link d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/l116 d3/d6/d6d/l13a 0 2024-09-16T00:50:24.544 INFO:tasks.workunit.client.0.smithi053.stdout:3/466: dwrite d1/d5/d91/f2b [0,4194304] 0 2024-09-16T00:50:24.544 INFO:tasks.workunit.client.0.smithi053.stdout:3/467: fdatasync d1/d5/d11/d3a/f67 0 2024-09-16T00:50:24.548 INFO:tasks.workunit.client.1.smithi152.stdout:9/962: dread d1/d4e/d48/d26/d30/d4f/da2/fb9 [0,4194304] 0 2024-09-16T00:50:24.548 INFO:tasks.workunit.client.1.smithi152.stdout:9/963: readlink d1/d7/d13/d5d/d69/l6a 0 2024-09-16T00:50:24.555 INFO:tasks.workunit.client.1.smithi152.stdout:8/821: truncate dd/d15/d1a/ff4 1363510 0 2024-09-16T00:50:24.556 INFO:tasks.workunit.client.1.smithi152.stdout:9/964: write d1/d7/d77/d3c/dc9/f115 [7828175,25449] 0 2024-09-16T00:50:24.556 INFO:tasks.workunit.client.1.smithi152.stdout:2/885: rmdir d4/d44/d7a/d9e/d87/dd8 39 2024-09-16T00:50:24.556 INFO:tasks.workunit.client.1.smithi152.stdout:2/886: chown d4/d44/d7a/dc7/de4/d94/d93/da4/fbd 21558354 1 2024-09-16T00:50:24.557 INFO:tasks.workunit.client.1.smithi152.stdout:8/822: dread dd/d98/db8/dcf/d29/d2f/f35 [0,4194304] 0 2024-09-16T00:50:24.557 INFO:tasks.workunit.client.1.smithi152.stdout:9/965: symlink d1/d59/l138 0 2024-09-16T00:50:24.559 INFO:tasks.workunit.client.0.smithi053.stdout:3/468: dwrite d1/d5/d11/f12 [0,4194304] 0 2024-09-16T00:50:24.560 INFO:tasks.workunit.client.1.smithi152.stdout:2/887: mkdir d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/d12a 0 2024-09-16T00:50:24.563 INFO:tasks.workunit.client.0.smithi053.stdout:3/469: symlink d1/d5/d91/d47/d4c/d50/l94 0 2024-09-16T00:50:24.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/966: symlink d1/d4e/d48/d2b/d11b/l139 0 2024-09-16T00:50:24.566 INFO:tasks.workunit.client.1.smithi152.stdout:9/967: dread d1/d7/d77/fa3 [0,4194304] 0 2024-09-16T00:50:24.567 INFO:tasks.workunit.client.1.smithi152.stdout:2/888: mknod d4/d44/d7a/dc7/de4/d94/d93/d120/c12b 0 2024-09-16T00:50:24.571 INFO:tasks.workunit.client.0.smithi053.stdout:3/470: creat d1/d5/d11/f95 x:0 0 0 2024-09-16T00:50:24.575 INFO:tasks.workunit.client.0.smithi053.stdout:3/471: rename d1/d5/d11/c1e to d1/d5/d91/d47/c96 0 2024-09-16T00:50:24.580 INFO:tasks.workunit.client.0.smithi053.stdout:3/472: rename d1/d5/d91/d5e/d79 to d1/d5/d91/d47/d65/d97 0 2024-09-16T00:50:24.580 INFO:tasks.workunit.client.1.smithi152.stdout:6/944: sync 2024-09-16T00:50:24.583 INFO:tasks.workunit.client.1.smithi152.stdout:8/823: rmdir dd/d98 39 2024-09-16T00:50:24.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/968: link d1/d4e/d48/d26/d30/f3f d1/d7/d77/d32/da5/da8/dc5/f13a 0 2024-09-16T00:50:24.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/969: fdatasync d1/d4e/d48/d2b/d93/f12a 0 2024-09-16T00:50:24.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/970: write d1/d4e/d48/d2b/d93/d96/dd1/f109 [176506,96622] 0 2024-09-16T00:50:24.588 INFO:tasks.workunit.client.0.smithi053.stdout:3/473: dread d1/d5/d91/f1f [0,4194304] 0 2024-09-16T00:50:24.589 INFO:tasks.workunit.client.1.smithi152.stdout:8/824: rmdir dd/d98/db8/d10c/dbb 39 2024-09-16T00:50:24.589 INFO:tasks.workunit.client.1.smithi152.stdout:8/825: dread - dd/d98/db8/dcf/f99 zero size 2024-09-16T00:50:24.591 INFO:tasks.workunit.client.0.smithi053.stdout:3/474: dread d1/d5/d31/f3d [0,4194304] 0 2024-09-16T00:50:24.596 INFO:tasks.workunit.client.1.smithi152.stdout:8/826: read dd/d15/d1a/fef [2942776,45435] 0 2024-09-16T00:50:24.597 INFO:tasks.workunit.client.1.smithi152.stdout:8/827: stat dd/d98/db8/dcf/le7 0 2024-09-16T00:50:24.597 INFO:tasks.workunit.client.1.smithi152.stdout:8/828: write dd/d98/db8/dcf/d29/d2f/d53/f10e [917411,102304] 0 2024-09-16T00:50:24.597 INFO:tasks.workunit.client.1.smithi152.stdout:8/829: stat dd/l27 0 2024-09-16T00:50:24.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/830: rmdir dd/d98/db8/dcf/d29/d2f/d5f 39 2024-09-16T00:50:24.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/831: chown dd/d98/db8/dcf/d88 922 1 2024-09-16T00:50:24.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/832: stat dd/d98/db8/dcf/d29/l76 0 2024-09-16T00:50:24.599 INFO:tasks.workunit.client.0.smithi053.stdout:3/475: dread d1/f6d [0,4194304] 0 2024-09-16T00:50:24.600 INFO:tasks.workunit.client.0.smithi053.stdout:3/476: creat d1/d89/d28/f98 x:0 0 0 2024-09-16T00:50:24.617 INFO:tasks.workunit.client.1.smithi152.stdout:8/833: dwrite dd/d15/d69/f87 [0,4194304] 0 2024-09-16T00:50:24.617 INFO:tasks.workunit.client.1.smithi152.stdout:8/834: readlink dd/lb4 0 2024-09-16T00:50:24.618 INFO:tasks.workunit.client.0.smithi053.stdout:3/477: dwrite d1/d5/d11/f55 [0,4194304] 0 2024-09-16T00:50:24.619 INFO:tasks.workunit.client.1.smithi152.stdout:8/835: rename dd/d15/f18 to dd/db9/f110 0 2024-09-16T00:50:24.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/836: write dd/d15/d49/fa0 [146694,24844] 0 2024-09-16T00:50:24.622 INFO:tasks.workunit.client.0.smithi053.stdout:3/478: creat d1/d89/f99 x:0 0 0 2024-09-16T00:50:24.622 INFO:tasks.workunit.client.0.smithi053.stdout:3/479: fsync d1/d5/d31/f3d 0 2024-09-16T00:50:24.623 INFO:tasks.workunit.client.0.smithi053.stdout:3/480: truncate d1/d89/d28/f35 895529 0 2024-09-16T00:50:24.624 INFO:tasks.workunit.client.0.smithi053.stdout:3/481: creat d1/d5/d91/d47/d4c/d5f/f9a x:0 0 0 2024-09-16T00:50:24.627 INFO:tasks.workunit.client.1.smithi152.stdout:8/837: dread dd/d98/db8/dcf/d29/f80 [0,4194304] 0 2024-09-16T00:50:24.629 INFO:tasks.workunit.client.0.smithi053.stdout:3/482: dread d1/d5/d31/f3d [0,4194304] 0 2024-09-16T00:50:24.629 INFO:tasks.workunit.client.0.smithi053.stdout:3/483: readlink d1/d5/l9 0 2024-09-16T00:50:24.629 INFO:tasks.workunit.client.0.smithi053.stdout:3/484: write d1/d89/f2a [970431,28315] 0 2024-09-16T00:50:24.629 INFO:tasks.workunit.client.0.smithi053.stdout:3/485: fdatasync d1/d4e/f82 0 2024-09-16T00:50:24.630 INFO:tasks.workunit.client.1.smithi152.stdout:8/838: mknod dd/d25/c111 0 2024-09-16T00:50:24.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/839: chown dd/d15/d69/f87 1144548336 1 2024-09-16T00:50:24.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/840: mkdir dd/d98/db8/dcf/d29/d2f/d5f/d112 0 2024-09-16T00:50:24.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/841: symlink dd/d98/db8/dcf/d29/l113 0 2024-09-16T00:50:24.632 INFO:tasks.workunit.client.1.smithi152.stdout:8/842: truncate dd/d15/d69/f89 239925 0 2024-09-16T00:50:24.632 INFO:tasks.workunit.client.1.smithi152.stdout:8/843: chown dd/d15/f7a 72 1 2024-09-16T00:50:24.632 INFO:tasks.workunit.client.1.smithi152.stdout:8/844: chown dd/d15/d9b/fda 662 1 2024-09-16T00:50:24.633 INFO:tasks.workunit.client.0.smithi053.stdout:3/486: dread d1/d89/f71 [0,4194304] 0 2024-09-16T00:50:24.633 INFO:tasks.workunit.client.0.smithi053.stdout:3/487: fdatasync d1/d4e/f82 0 2024-09-16T00:50:24.634 INFO:tasks.workunit.client.0.smithi053.stdout:3/488: write d1/f21 [104590,21711] 0 2024-09-16T00:50:24.634 INFO:tasks.workunit.client.0.smithi053.stdout:3/489: rename d1/d5/d11/f25 to d1/d89/d28/d5a/f9b 0 2024-09-16T00:50:24.636 INFO:tasks.workunit.client.0.smithi053.stdout:3/490: mkdir d1/d5/d31/d3b/d9c 0 2024-09-16T00:50:24.649 INFO:tasks.workunit.client.1.smithi152.stdout:8/845: dwrite dd/d98/db8/dcf/d29/f10d [0,4194304] 0 2024-09-16T00:50:24.650 INFO:tasks.workunit.client.0.smithi053.stdout:3/491: dwrite d1/d5/d11/f95 [0,4194304] 0 2024-09-16T00:50:24.652 INFO:tasks.workunit.client.1.smithi152.stdout:8/846: rmdir dd/d98/db8/dee 39 2024-09-16T00:50:24.655 INFO:tasks.workunit.client.1.smithi152.stdout:8/847: creat dd/d98/db8/dcf/d29/d2f/f114 x:0 0 0 2024-09-16T00:50:24.655 INFO:tasks.workunit.client.1.smithi152.stdout:8/848: fsync dd/d98/db8/dcf/d88/fb3 0 2024-09-16T00:50:24.656 INFO:tasks.workunit.client.0.smithi053.stdout:3/492: symlink d1/d89/d28/l9d 0 2024-09-16T00:50:24.656 INFO:tasks.workunit.client.0.smithi053.stdout:8/479: sync 2024-09-16T00:50:24.656 INFO:tasks.workunit.client.0.smithi053.stdout:8/480: creat d10/d1c/d92/fa5 x:0 0 0 2024-09-16T00:50:24.659 INFO:tasks.workunit.client.1.smithi152.stdout:8/849: rename dd/d15/d49/f22 to dd/d15/d49/d10f/f115 0 2024-09-16T00:50:24.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/493: dread d1/d5/d91/d47/f5d [0,4194304] 0 2024-09-16T00:50:24.660 INFO:tasks.workunit.client.1.smithi152.stdout:8/850: creat dd/d15/d1a/f116 x:0 0 0 2024-09-16T00:50:24.660 INFO:tasks.workunit.client.1.smithi152.stdout:8/851: creat dd/d15/d69/f117 x:0 0 0 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/301: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:6/461: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:2/371: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:7/456: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:0/544: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/476: sync 2024-09-16T00:50:24.662 INFO:tasks.workunit.client.0.smithi053.stdout:5/408: sync 2024-09-16T00:50:24.663 INFO:tasks.workunit.client.0.smithi053.stdout:1/443: sync 2024-09-16T00:50:24.663 INFO:tasks.workunit.client.0.smithi053.stdout:1/444: dread - d5/d18/d33/d30/f90 zero size 2024-09-16T00:50:24.663 INFO:tasks.workunit.client.0.smithi053.stdout:1/445: chown d5/d9/d73/d84 136418 1 2024-09-16T00:50:24.663 INFO:tasks.workunit.client.1.smithi152.stdout:8/852: symlink dd/d15/d69/df8/l118 0 2024-09-16T00:50:24.665 INFO:tasks.workunit.client.0.smithi053.stdout:5/409: dread d3/d7/d2b/d37/d58/f4c [0,4194304] 0 2024-09-16T00:50:24.666 INFO:tasks.workunit.client.0.smithi053.stdout:5/410: fdatasync d3/d7/d2b/d2f/f77 0 2024-09-16T00:50:24.666 INFO:tasks.workunit.client.0.smithi053.stdout:9/477: read d8/d1c/d2b/d2c/f41 [111110,105394] 0 2024-09-16T00:50:24.667 INFO:tasks.workunit.client.0.smithi053.stdout:8/481: mkdir d10/d1c/d92/d66/d9d/da6 0 2024-09-16T00:50:24.667 INFO:tasks.workunit.client.0.smithi053.stdout:8/482: fsync d10/f1e 0 2024-09-16T00:50:24.670 INFO:tasks.workunit.client.0.smithi053.stdout:3/494: creat d1/d5/d11/d3a/f9e x:0 0 0 2024-09-16T00:50:24.672 INFO:tasks.workunit.client.1.smithi152.stdout:3/878: sync 2024-09-16T00:50:24.672 INFO:tasks.workunit.client.0.smithi053.stdout:2/372: getdents d6/d9/dd/d3e 0 2024-09-16T00:50:24.675 INFO:tasks.workunit.client.0.smithi053.stdout:4/302: symlink d0/da/l6c 0 2024-09-16T00:50:24.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/853: read dd/d25/f5d [1408323,119208] 0 2024-09-16T00:50:24.678 INFO:tasks.workunit.client.1.smithi152.stdout:3/879: symlink dc/d10/d17/d1c/d50/d55/l116 0 2024-09-16T00:50:24.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/880: chown dc/d10/d17/d5a/db2/d6f/d74/db5/c38 15261260 1 2024-09-16T00:50:24.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/881: write dc/d10/d17/d4f/f115 [105042,65754] 0 2024-09-16T00:50:24.680 INFO:tasks.workunit.client.0.smithi053.stdout:6/462: write d1/f9 [4088990,26958] 0 2024-09-16T00:50:24.680 INFO:tasks.workunit.client.0.smithi053.stdout:5/411: creat d3/d7/d2b/d4b/d51/d53/f88 x:0 0 0 2024-09-16T00:50:24.682 INFO:tasks.workunit.client.0.smithi053.stdout:2/373: symlink d6/d9/dd/d3e/d52/d65/l66 0 2024-09-16T00:50:24.683 INFO:tasks.workunit.client.0.smithi053.stdout:3/495: dread d1/d5/d91/f2b [0,4194304] 0 2024-09-16T00:50:24.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/882: getdents dc/d10/d17/d1c/d8d/d8e/d2f 0 2024-09-16T00:50:24.685 INFO:tasks.workunit.client.0.smithi053.stdout:4/303: creat d0/d2/d1e/f6d x:0 0 0 2024-09-16T00:50:24.685 INFO:tasks.workunit.client.0.smithi053.stdout:4/304: creat d0/d2/dd/f6e x:0 0 0 2024-09-16T00:50:24.686 INFO:tasks.workunit.client.0.smithi053.stdout:4/305: dread - d0/d2/d1e/f6d zero size 2024-09-16T00:50:24.686 INFO:tasks.workunit.client.0.smithi053.stdout:1/446: dwrite d5/d9/d88/f60 [0,4194304] 0 2024-09-16T00:50:24.686 INFO:tasks.workunit.client.0.smithi053.stdout:1/447: dread - d5/d7/d39/f6c zero size 2024-09-16T00:50:24.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/883: rename dc/d5c/dae/fc1 to dc/d10/d47/f117 0 2024-09-16T00:50:24.689 INFO:tasks.workunit.client.0.smithi053.stdout:6/463: rmdir d1/dc/d1e/d65/d81 39 2024-09-16T00:50:24.690 INFO:tasks.workunit.client.0.smithi053.stdout:5/412: symlink d3/d7/d2b/d4b/d51/d53/l89 0 2024-09-16T00:50:24.690 INFO:tasks.workunit.client.0.smithi053.stdout:5/413: write d3/d7/d24/d34/d5b/f7b [441750,121246] 0 2024-09-16T00:50:24.692 INFO:tasks.workunit.client.1.smithi152.stdout:3/884: symlink dc/d10/d47/l118 0 2024-09-16T00:50:24.692 INFO:tasks.workunit.client.0.smithi053.stdout:9/478: dwrite d8/d19/d51/f56 [4194304,4194304] 0 2024-09-16T00:50:24.692 INFO:tasks.workunit.client.0.smithi053.stdout:9/479: write d8/d19/d51/d6d/f7b [1001056,83679] 0 2024-09-16T00:50:24.693 INFO:tasks.workunit.client.0.smithi053.stdout:2/374: getdents d6/d9/dd/d3e/d52 0 2024-09-16T00:50:24.693 INFO:tasks.workunit.client.0.smithi053.stdout:2/375: write d6/d9/f12 [1542495,81276] 0 2024-09-16T00:50:24.693 INFO:tasks.workunit.client.0.smithi053.stdout:2/376: getdents d6/d9/dd/d3e 0 2024-09-16T00:50:24.693 INFO:tasks.workunit.client.0.smithi053.stdout:2/377: truncate d6/d9/d14/f4c 741643 0 2024-09-16T00:50:24.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/496: mkdir d1/d5/d31/d42/d9f 0 2024-09-16T00:50:24.694 INFO:tasks.workunit.client.0.smithi053.stdout:8/483: dwrite d10/f24 [0,4194304] 0 2024-09-16T00:50:24.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/885: creat dc/d10/d17/d1c/d1f/d24/db9/f119 x:0 0 0 2024-09-16T00:50:24.698 INFO:tasks.workunit.client.0.smithi053.stdout:8/484: dread d10/d52/f55 [0,4194304] 0 2024-09-16T00:50:24.699 INFO:tasks.workunit.client.0.smithi053.stdout:6/464: mknod d1/dc/d45/ca3 0 2024-09-16T00:50:24.702 INFO:tasks.workunit.client.0.smithi053.stdout:4/306: write d0/d3c/d48/f4c [4176350,68774] 0 2024-09-16T00:50:24.702 INFO:tasks.workunit.client.0.smithi053.stdout:4/307: chown d0/d2/dd/d25/d41/l54 1832 1 2024-09-16T00:50:24.702 INFO:tasks.workunit.client.0.smithi053.stdout:4/308: write d0/da/f4a [314038,53056] 0 2024-09-16T00:50:24.702 INFO:tasks.workunit.client.0.smithi053.stdout:4/309: dread - d0/da/f69 zero size 2024-09-16T00:50:24.703 INFO:tasks.workunit.client.0.smithi053.stdout:2/378: symlink d6/d9/dd/d3e/d52/l67 0 2024-09-16T00:50:24.703 INFO:tasks.workunit.client.0.smithi053.stdout:3/497: mknod d1/d89/d28/d5a/ca0 0 2024-09-16T00:50:24.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/485: mknod d10/d1c/d92/d66/d9d/ca7 0 2024-09-16T00:50:24.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/486: fdatasync d10/d21/d28/f34 0 2024-09-16T00:50:24.707 INFO:tasks.workunit.client.0.smithi053.stdout:6/465: rename d1/dc/f48 to d1/dc/d3c/d4b/d58/fa4 0 2024-09-16T00:50:24.707 INFO:tasks.workunit.client.0.smithi053.stdout:6/466: stat d1/dc/d3c/d4b/d58 0 2024-09-16T00:50:24.707 INFO:tasks.workunit.client.0.smithi053.stdout:1/448: dwrite d5/d18/f1b [4194304,4194304] 0 2024-09-16T00:50:24.708 INFO:tasks.workunit.client.1.smithi152.stdout:3/886: dread dc/d10/d17/f52 [0,4194304] 0 2024-09-16T00:50:24.711 INFO:tasks.workunit.client.0.smithi053.stdout:4/310: rename d0/d2/dd/d25/d41/l54 to d0/d3c/d48/d58/l6f 0 2024-09-16T00:50:24.715 INFO:tasks.workunit.client.0.smithi053.stdout:3/498: getdents d1/d5/d11 0 2024-09-16T00:50:24.716 INFO:tasks.workunit.client.0.smithi053.stdout:5/414: write d3/f13 [2639464,52113] 0 2024-09-16T00:50:24.720 INFO:tasks.workunit.client.0.smithi053.stdout:9/480: dwrite d8/d1c/d2b/f52 [4194304,4194304] 0 2024-09-16T00:50:24.721 INFO:tasks.workunit.client.0.smithi053.stdout:6/467: rename d1/c38 to d1/d2f/ca5 0 2024-09-16T00:50:24.722 INFO:tasks.workunit.client.1.smithi152.stdout:3/887: write dc/d10/d17/d1c/f7e [707416,112039] 0 2024-09-16T00:50:24.724 INFO:tasks.workunit.client.0.smithi053.stdout:8/487: dread d10/d21/f3e [0,4194304] 0 2024-09-16T00:50:24.729 INFO:tasks.workunit.client.0.smithi053.stdout:2/379: read d6/d9/d14/f1f [5546358,75861] 0 2024-09-16T00:50:24.733 INFO:tasks.workunit.client.0.smithi053.stdout:5/415: rename d3/d7/d24/d3f/l6c to d3/d7/d24/l8a 0 2024-09-16T00:50:24.741 INFO:tasks.workunit.client.0.smithi053.stdout:3/499: dwrite d1/f6d [0,4194304] 0 2024-09-16T00:50:24.741 INFO:tasks.workunit.client.0.smithi053.stdout:4/311: dwrite d0/d2/dd/d25/f5b [0,4194304] 0 2024-09-16T00:50:24.744 INFO:tasks.workunit.client.0.smithi053.stdout:9/481: read d8/f46 [1417047,214] 0 2024-09-16T00:50:24.744 INFO:tasks.workunit.client.0.smithi053.stdout:9/482: readlink d8/d4c/l55 0 2024-09-16T00:50:24.749 INFO:tasks.workunit.client.0.smithi053.stdout:9/483: dread d8/d19/d51/d6d/f7b [0,4194304] 0 2024-09-16T00:50:24.749 INFO:tasks.workunit.client.0.smithi053.stdout:8/488: mknod d10/d1c/d2b/d40/d50/ca8 0 2024-09-16T00:50:24.750 INFO:tasks.workunit.client.0.smithi053.stdout:6/468: mkdir d1/da6 0 2024-09-16T00:50:24.753 INFO:tasks.workunit.client.0.smithi053.stdout:3/500: link d1/d5/d31/f41 d1/d5/d91/d5e/d69/fa1 0 2024-09-16T00:50:24.753 INFO:tasks.workunit.client.0.smithi053.stdout:3/501: readlink d1/d5/l72 0 2024-09-16T00:50:24.753 INFO:tasks.workunit.client.0.smithi053.stdout:3/502: truncate d1/d89/f2a 1250941 0 2024-09-16T00:50:24.755 INFO:tasks.workunit.client.0.smithi053.stdout:4/312: mkdir d0/d3c/d48/d4d/d70 0 2024-09-16T00:50:24.756 INFO:tasks.workunit.client.0.smithi053.stdout:5/416: dwrite d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:24.756 INFO:tasks.workunit.client.0.smithi053.stdout:5/417: creat d3/d7/d24/d34/d5b/f8b x:0 0 0 2024-09-16T00:50:24.757 INFO:tasks.workunit.client.0.smithi053.stdout:2/380: dwrite d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:24.757 INFO:tasks.workunit.client.0.smithi053.stdout:9/484: creat d8/d19/d51/f9e x:0 0 0 2024-09-16T00:50:24.757 INFO:tasks.workunit.client.0.smithi053.stdout:9/485: chown d8/d19/c3e 328 1 2024-09-16T00:50:24.757 INFO:tasks.workunit.client.0.smithi053.stdout:9/486: chown d8/d19/d51/d6d 252 1 2024-09-16T00:50:24.760 INFO:tasks.workunit.client.0.smithi053.stdout:8/489: rename d10/d1c/d2b/d40/f4d to d10/d1c/d92/d66/fa9 0 2024-09-16T00:50:24.760 INFO:tasks.workunit.client.0.smithi053.stdout:8/490: fdatasync d10/d21/f2c 0 2024-09-16T00:50:24.761 INFO:tasks.workunit.client.0.smithi053.stdout:6/469: mknod d1/dc/d1e/ca7 0 2024-09-16T00:50:24.762 INFO:tasks.workunit.client.0.smithi053.stdout:3/503: mkdir d1/d5/d91/d5e/d90/da2 0 2024-09-16T00:50:24.763 INFO:tasks.workunit.client.0.smithi053.stdout:4/313: truncate d0/f38 1966396 0 2024-09-16T00:50:24.763 INFO:tasks.workunit.client.0.smithi053.stdout:4/314: truncate d0/d2/dd/d25/f21 5133843 0 2024-09-16T00:50:24.768 INFO:tasks.workunit.client.0.smithi053.stdout:2/381: creat d6/d9/dd/d3e/d52/f68 x:0 0 0 2024-09-16T00:50:24.772 INFO:tasks.workunit.client.0.smithi053.stdout:9/487: fdatasync d8/f35 0 2024-09-16T00:50:24.773 INFO:tasks.workunit.client.0.smithi053.stdout:5/418: dwrite d3/d7/d2b/d2f/f77 [0,4194304] 0 2024-09-16T00:50:24.773 INFO:tasks.workunit.client.0.smithi053.stdout:8/491: rename d10/d1c/d2b/d40/d50/f7e to d10/d1c/d92/d66/d9d/faa 0 2024-09-16T00:50:24.773 INFO:tasks.workunit.client.0.smithi053.stdout:8/492: creat d10/d21/d28/d3c/d63/fab x:0 0 0 2024-09-16T00:50:24.773 INFO:tasks.workunit.client.0.smithi053.stdout:6/470: unlink d1/dc/d39/f1c 0 2024-09-16T00:50:24.773 INFO:tasks.workunit.client.1.smithi152.stdout:6/945: sync 2024-09-16T00:50:24.774 INFO:tasks.workunit.client.1.smithi152.stdout:0/935: sync 2024-09-16T00:50:24.774 INFO:tasks.workunit.client.1.smithi152.stdout:2/889: sync 2024-09-16T00:50:24.774 INFO:tasks.workunit.client.1.smithi152.stdout:9/971: sync 2024-09-16T00:50:24.774 INFO:tasks.workunit.client.1.smithi152.stdout:6/946: write db/d12/d20/d118/f123 [182890,98153] 0 2024-09-16T00:50:24.774 INFO:tasks.workunit.client.0.smithi053.stdout:3/504: creat d1/d5/d31/d3b/d9c/fa3 x:0 0 0 2024-09-16T00:50:24.776 INFO:tasks.workunit.client.1.smithi152.stdout:9/972: dread d1/d4e/d48/d2b/d7c/f102 [0,4194304] 0 2024-09-16T00:50:24.777 INFO:tasks.workunit.client.0.smithi053.stdout:2/382: unlink d6/c24 0 2024-09-16T00:50:24.779 INFO:tasks.workunit.client.1.smithi152.stdout:6/947: write db/d12/d23/d4a/d43/d48/f4d [620821,101325] 0 2024-09-16T00:50:24.779 INFO:tasks.workunit.client.1.smithi152.stdout:9/973: mkdir d1/d7/ded/d113/d12f/d13b 0 2024-09-16T00:50:24.783 INFO:tasks.workunit.client.1.smithi152.stdout:2/890: dread d4/d44/fd7 [0,4194304] 0 2024-09-16T00:50:24.783 INFO:tasks.workunit.client.1.smithi152.stdout:2/891: truncate d4/d44/df6/f62 4908869 0 2024-09-16T00:50:24.783 INFO:tasks.workunit.client.1.smithi152.stdout:2/892: chown d4/d44/d7a/d9e/da0 528709195 1 2024-09-16T00:50:24.786 INFO:tasks.workunit.client.0.smithi053.stdout:5/419: unlink d3/d7/d2b/d37/d58/f74 0 2024-09-16T00:50:24.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/948: mknod db/da8/db7/c129 0 2024-09-16T00:50:24.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/949: chown db/d28 27 1 2024-09-16T00:50:24.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/950: fdatasync db/d12/d23/d4a/d43/d48/d64/dab/fd1 0 2024-09-16T00:50:24.791 INFO:tasks.workunit.client.1.smithi152.stdout:9/974: rename d1/d4e/d48/d2b/d93/d96/d12b/f39 to d1/d4e/d48/f13c 0 2024-09-16T00:50:24.792 INFO:tasks.workunit.client.0.smithi053.stdout:9/488: dwrite d8/f39 [8388608,4194304] 0 2024-09-16T00:50:24.793 INFO:tasks.workunit.client.1.smithi152.stdout:2/893: truncate d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc 606390 0 2024-09-16T00:50:24.794 INFO:tasks.workunit.client.0.smithi053.stdout:6/471: stat d1/c42 0 2024-09-16T00:50:24.794 INFO:tasks.workunit.client.0.smithi053.stdout:6/472: chown d1/dc/d3c/d4a 317758399 1 2024-09-16T00:50:24.794 INFO:tasks.workunit.client.0.smithi053.stdout:6/473: creat d1/dc/d39/fa8 x:0 0 0 2024-09-16T00:50:24.795 INFO:tasks.workunit.client.1.smithi152.stdout:6/951: getdents db/da8 0 2024-09-16T00:50:24.798 INFO:tasks.workunit.client.0.smithi053.stdout:3/505: mkdir d1/d5/d91/d47/d65/d97/da4 0 2024-09-16T00:50:24.800 INFO:tasks.workunit.client.1.smithi152.stdout:9/975: mkdir d1/d4e/d48/d26/d30/d8f/d13d 0 2024-09-16T00:50:24.800 INFO:tasks.workunit.client.1.smithi152.stdout:9/976: chown d1/d4e/d48/d26/d30/d4f/d50/lf0 1 1 2024-09-16T00:50:24.801 INFO:tasks.workunit.client.0.smithi053.stdout:5/420: rmdir d3/d7/d42 39 2024-09-16T00:50:24.805 INFO:tasks.workunit.client.1.smithi152.stdout:2/894: mknod d4/d44/c12c 0 2024-09-16T00:50:24.809 INFO:tasks.workunit.client.1.smithi152.stdout:9/977: dread d1/d7/d13/d80/f86 [0,4194304] 0 2024-09-16T00:50:24.809 INFO:tasks.workunit.client.0.smithi053.stdout:6/474: dwrite d1/dc/d1e/d41/f69 [4194304,4194304] 0 2024-09-16T00:50:24.809 INFO:tasks.workunit.client.0.smithi053.stdout:6/475: stat d1/dc/d39/f2c 0 2024-09-16T00:50:24.809 INFO:tasks.workunit.client.0.smithi053.stdout:6/476: dread - d1/dc/f3b zero size 2024-09-16T00:50:24.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/952: creat db/d12/d23/d4a/dc5/f12a x:0 0 0 2024-09-16T00:50:24.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/489: symlink d8/d19/d51/l9f 0 2024-09-16T00:50:24.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/490: fdatasync d8/d1c/d2b/f47 0 2024-09-16T00:50:24.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/491: stat d8/d19 0 2024-09-16T00:50:24.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/492: fsync d8/d13/f8a 0 2024-09-16T00:50:24.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/493: truncate d8/d1c/d2b/d5c/f94 321065 0 2024-09-16T00:50:24.813 INFO:tasks.workunit.client.0.smithi053.stdout:5/421: dread d3/d7/d2b/d37/f44 [0,4194304] 0 2024-09-16T00:50:24.815 INFO:tasks.workunit.client.1.smithi152.stdout:9/978: dread d1/d4e/d48/f13c [0,4194304] 0 2024-09-16T00:50:24.815 INFO:tasks.workunit.client.1.smithi152.stdout:9/979: stat d1 0 2024-09-16T00:50:24.818 INFO:tasks.workunit.client.0.smithi053.stdout:3/506: unlink d1/d89/d28/d5a/ca0 0 2024-09-16T00:50:24.818 INFO:tasks.workunit.client.0.smithi053.stdout:3/507: write d1/d5/d11/f12 [4932903,84836] 0 2024-09-16T00:50:24.821 INFO:tasks.workunit.client.0.smithi053.stdout:8/493: rename d10/d1c/d2b/d40/d50 to d10/d4a/dac 0 2024-09-16T00:50:24.821 INFO:tasks.workunit.client.1.smithi152.stdout:0/936: dwrite d3/d6/d8/d1d/d23/d25/d2a/f8d [0,4194304] 0 2024-09-16T00:50:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:6/953: link db/d12/c1d db/d12/d23/d4a/d43/d48/d6a/de0/d11e/c12b 0 2024-09-16T00:50:24.827 INFO:tasks.workunit.client.1.smithi152.stdout:9/980: creat d1/d4e/d48/d26/d30/d8f/dc4/f13e x:0 0 0 2024-09-16T00:50:24.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/981: read - d1/d4e/d48/d2b/f125 zero size 2024-09-16T00:50:24.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/982: fdatasync d1/ff 0 2024-09-16T00:50:24.832 INFO:tasks.workunit.client.0.smithi053.stdout:5/422: unlink d3/d7/d2b/d4b/d4f/l59 0 2024-09-16T00:50:24.832 INFO:tasks.workunit.client.0.smithi053.stdout:5/423: chown d3/d7/d24/d34/l78 3596 1 2024-09-16T00:50:24.835 INFO:tasks.workunit.client.0.smithi053.stdout:3/508: symlink d1/d5/d11/la5 0 2024-09-16T00:50:24.835 INFO:tasks.workunit.client.0.smithi053.stdout:9/494: dwrite d8/f39 [0,4194304] 0 2024-09-16T00:50:24.837 INFO:tasks.workunit.client.0.smithi053.stdout:2/383: rename d6/c4f to d6/d29/d2b/c69 0 2024-09-16T00:50:24.838 INFO:tasks.workunit.client.0.smithi053.stdout:2/384: readlink d6/d29/d2b/l43 0 2024-09-16T00:50:24.839 INFO:tasks.workunit.client.1.smithi152.stdout:6/954: mknod db/d12/d23/d4a/d43/d48/d6a/d116/c12c 0 2024-09-16T00:50:24.839 INFO:tasks.workunit.client.1.smithi152.stdout:6/955: readlink db/d12/d23/d4a/dc5/dd0/l11c 0 2024-09-16T00:50:24.841 INFO:tasks.workunit.client.0.smithi053.stdout:8/494: mknod d10/d9e/cad 0 2024-09-16T00:50:24.841 INFO:tasks.workunit.client.1.smithi152.stdout:8/854: sync 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/937: dwrite d3/d6/d8/d9e/dcb/f111 [0,4194304] 0 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/938: chown d3/d6/d64/f6c 298 1 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/939: truncate d3/d6/d8/d1d/d65/db0/db6/fc3 2470153 0 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/940: fdatasync d3/d6/d8/d1d/d65/db0/db6/fda 0 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/941: write d3/d6/d2e/de9/df6/f124 [254686,91100] 0 2024-09-16T00:50:24.844 INFO:tasks.workunit.client.1.smithi152.stdout:9/983: creat d1/d7/d77/d32/f13f x:0 0 0 2024-09-16T00:50:24.845 INFO:tasks.workunit.client.0.smithi053.stdout:6/477: link d1/c21 d1/dc/d3c/d4b/d58/ca9 0 2024-09-16T00:50:24.845 INFO:tasks.workunit.client.0.smithi053.stdout:6/478: dread - d1/d90/f9f zero size 2024-09-16T00:50:24.848 INFO:tasks.workunit.client.1.smithi152.stdout:8/855: unlink dd/d15/d49/c14 0 2024-09-16T00:50:24.849 INFO:tasks.workunit.client.0.smithi053.stdout:9/495: chown d8/l18 49675234 1 2024-09-16T00:50:24.850 INFO:tasks.workunit.client.0.smithi053.stdout:3/509: write d1/d5/d11/f55 [1924542,48247] 0 2024-09-16T00:50:24.852 INFO:tasks.workunit.client.0.smithi053.stdout:8/495: link d10/d21/d28/d3c/d63/c70 d10/d1c/d92/cae 0 2024-09-16T00:50:24.852 INFO:tasks.workunit.client.0.smithi053.stdout:8/496: truncate d10/d21/f42 805867 0 2024-09-16T00:50:24.852 INFO:tasks.workunit.client.0.smithi053.stdout:8/497: write d10/f1d [81721,65510] 0 2024-09-16T00:50:24.853 INFO:tasks.workunit.client.0.smithi053.stdout:6/479: mknod d1/dc/d3c/d4b/d58/caa 0 2024-09-16T00:50:24.854 INFO:tasks.workunit.client.0.smithi053.stdout:5/424: truncate d3/f9 1224437 0 2024-09-16T00:50:24.856 INFO:tasks.workunit.client.1.smithi152.stdout:0/942: mkdir d3/d6/d8/d1d/d65/d6e/d82/da4/d121/d13b 0 2024-09-16T00:50:24.857 INFO:tasks.workunit.client.0.smithi053.stdout:9/496: symlink d8/d22/d26/d83/la0 0 2024-09-16T00:50:24.858 INFO:tasks.workunit.client.1.smithi152.stdout:9/984: mknod d1/d4e/d48/d26/d30/d8f/dc4/d111/c140 0 2024-09-16T00:50:24.859 INFO:tasks.workunit.client.0.smithi053.stdout:3/510: link d1/d89/f18 d1/d5/d91/d47/fa6 0 2024-09-16T00:50:24.859 INFO:tasks.workunit.client.0.smithi053.stdout:5/425: dread d3/d7/d24/d34/f76 [0,4194304] 0 2024-09-16T00:50:24.861 INFO:tasks.workunit.client.0.smithi053.stdout:3/511: mkdir d1/d89/d28/da7 0 2024-09-16T00:50:24.861 INFO:tasks.workunit.client.1.smithi152.stdout:6/956: dwrite db/d12/d1c/f5c [0,4194304] 0 2024-09-16T00:50:24.861 INFO:tasks.workunit.client.1.smithi152.stdout:6/957: chown db/d12/d23/d4a/d43/d48/d64/dab/feb 185619440 1 2024-09-16T00:50:24.862 INFO:tasks.workunit.client.0.smithi053.stdout:9/497: rename d8/f5e to d8/d1c/d2b/d49/fa1 0 2024-09-16T00:50:24.863 INFO:tasks.workunit.client.0.smithi053.stdout:3/512: truncate d1/d5/f19 363572 0 2024-09-16T00:50:24.866 INFO:tasks.workunit.client.0.smithi053.stdout:9/498: mkdir d8/d1c/d2b/d49/da2 0 2024-09-16T00:50:24.866 INFO:tasks.workunit.client.0.smithi053.stdout:2/385: dwrite d6/d9/f1d [4194304,4194304] 0 2024-09-16T00:50:24.866 INFO:tasks.workunit.client.0.smithi053.stdout:2/386: dread - d6/d9/f56 zero size 2024-09-16T00:50:24.867 INFO:tasks.workunit.client.1.smithi152.stdout:8/856: dread dd/d23/f55 [0,4194304] 0 2024-09-16T00:50:24.870 INFO:tasks.workunit.client.0.smithi053.stdout:3/513: creat d1/d5/d91/d5e/d90/fa8 x:0 0 0 2024-09-16T00:50:24.870 INFO:tasks.workunit.client.0.smithi053.stdout:3/514: readlink d1/d5/d91/d5e/d69/l8b 0 2024-09-16T00:50:24.872 INFO:tasks.workunit.client.0.smithi053.stdout:9/499: creat d8/fa3 x:0 0 0 2024-09-16T00:50:24.872 INFO:tasks.workunit.client.0.smithi053.stdout:9/500: write d8/d4c/d5b/f9c [763176,89858] 0 2024-09-16T00:50:24.874 INFO:tasks.workunit.client.0.smithi053.stdout:2/387: link d6/d9/d14/l19 d6/d9/dd/d28/l6a 0 2024-09-16T00:50:24.875 INFO:tasks.workunit.client.0.smithi053.stdout:9/501: chown d8/d13/f80 1 1 2024-09-16T00:50:24.875 INFO:tasks.workunit.client.0.smithi053.stdout:9/502: stat f6 0 2024-09-16T00:50:24.878 INFO:tasks.workunit.client.1.smithi152.stdout:8/857: dread dd/d15/d49/fa0 [0,4194304] 0 2024-09-16T00:50:24.878 INFO:tasks.workunit.client.1.smithi152.stdout:8/858: creat dd/d23/f119 x:0 0 0 2024-09-16T00:50:24.878 INFO:tasks.workunit.client.1.smithi152.stdout:8/859: creat dd/d15/d9b/f11a x:0 0 0 2024-09-16T00:50:24.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/860: creat dd/d23/f11b x:0 0 0 2024-09-16T00:50:24.879 INFO:tasks.workunit.client.0.smithi053.stdout:2/388: rename d6/d9/dd/d28/c5f to d6/d29/d2b/c6b 0 2024-09-16T00:50:24.881 INFO:tasks.workunit.client.0.smithi053.stdout:3/515: read d1/d5/d91/f4d [1418385,115140] 0 2024-09-16T00:50:24.881 INFO:tasks.workunit.client.0.smithi053.stdout:3/516: dread - d1/d4e/f8d zero size 2024-09-16T00:50:24.881 INFO:tasks.workunit.client.0.smithi053.stdout:9/503: symlink d8/d1c/d2b/d2c/d9b/la4 0 2024-09-16T00:50:24.881 INFO:tasks.workunit.client.0.smithi053.stdout:9/504: fdatasync d8/d19/d51/d6d/f7b 0 2024-09-16T00:50:24.882 INFO:tasks.workunit.client.0.smithi053.stdout:6/480: dwrite d1/dc/d45/f94 [0,4194304] 0 2024-09-16T00:50:24.882 INFO:tasks.workunit.client.0.smithi053.stdout:8/498: dread fb [0,4194304] 0 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.0.smithi053.stdout:8/499: truncate d10/d1c/d92/d66/f7a 586334 0 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.0.smithi053.stdout:8/500: read d10/f3f [1364147,61847] 0 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.0.smithi053.stdout:2/389: creat d6/f6c x:0 0 0 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.0.smithi053.stdout:2/390: creat d6/d9/dd/f6d x:0 0 0 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.1.smithi152.stdout:3/888: sync 2024-09-16T00:50:24.883 INFO:tasks.workunit.client.1.smithi152.stdout:3/889: read dc/d10/d17/d5a/db2/d6f/dbb/f98 [5709788,100751] 0 2024-09-16T00:50:24.885 INFO:tasks.workunit.client.0.smithi053.stdout:3/517: mkdir d1/d5/d11/da9 0 2024-09-16T00:50:24.890 INFO:tasks.workunit.client.0.smithi053.stdout:9/505: symlink d8/d1c/d2b/d2c/d9b/la5 0 2024-09-16T00:50:24.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/861: rmdir dd/d98/db8/dcf/d29/d2f/db6 39 2024-09-16T00:50:24.897 INFO:tasks.workunit.client.0.smithi053.stdout:6/481: symlink d1/dc/d3c/d4b/d75/lab 0 2024-09-16T00:50:24.898 INFO:tasks.workunit.client.1.smithi152.stdout:9/985: dwrite d1/d7/d13/f37 [4194304,4194304] 0 2024-09-16T00:50:24.898 INFO:tasks.workunit.client.1.smithi152.stdout:9/986: write d1/d4e/d48/d26/d30/d8f/fbf [1434136,35406] 0 2024-09-16T00:50:24.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/862: unlink dd/d25/da4/fc2 0 2024-09-16T00:50:24.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/863: creat dd/d15/d1a/f11c x:0 0 0 2024-09-16T00:50:24.900 INFO:tasks.workunit.client.0.smithi053.stdout:8/501: creat d10/d1c/d49/faf x:0 0 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:9/987: creat d1/d7/d77/d3c/dc9/dc3/f141 x:0 0 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/958: dwrite db/d12/d20/d86/d91/fa6 [0,4194304] 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/959: readlink db/d12/d1c/l25 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:0/943: dwrite d3/d6/d64/d6a/f12a [4194304,4194304] 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/960: creat db/d12/d20/d118/f12d x:0 0 0 2024-09-16T00:50:24.902 INFO:tasks.workunit.client.0.smithi053.stdout:5/426: dwrite d3/d7/d24/d3f/f75 [4194304,4194304] 0 2024-09-16T00:50:24.905 INFO:tasks.workunit.client.0.smithi053.stdout:2/391: mknod d6/d9/dd/d28/c6e 0 2024-09-16T00:50:24.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/864: symlink dd/d98/db8/dcf/d29/d2f/d5f/l11d 0 2024-09-16T00:50:24.907 INFO:tasks.workunit.client.0.smithi053.stdout:3/518: mkdir d1/d5/d91/d47/d4c/d5f/daa 0 2024-09-16T00:50:24.908 INFO:tasks.workunit.client.1.smithi152.stdout:3/890: dwrite f2 [0,4194304] 0 2024-09-16T00:50:24.908 INFO:tasks.workunit.client.1.smithi152.stdout:3/891: chown dc/d10/d17/d1c/d8d/d8e/d2f/d46/cb1 546059 1 2024-09-16T00:50:24.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/892: write dc/d10/d17/d5a/db2/d6f/dbb/fad [500138,49159] 0 2024-09-16T00:50:24.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/893: write dc/f15 [13506261,93495] 0 2024-09-16T00:50:24.910 INFO:tasks.workunit.client.1.smithi152.stdout:3/894: dread - dc/d10/d17/d4f/fb0 zero size 2024-09-16T00:50:24.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/944: write d3/d6/d8/d1d/d65/db0/db6/f106 [3873770,34155] 0 2024-09-16T00:50:24.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/945: truncate d3/d6/d64/d6a/fd5 743466 0 2024-09-16T00:50:24.913 INFO:tasks.workunit.client.0.smithi053.stdout:3/519: dread d1/f21 [0,4194304] 0 2024-09-16T00:50:24.913 INFO:tasks.workunit.client.0.smithi053.stdout:3/520: write d1/d5/f70 [455295,11661] 0 2024-09-16T00:50:24.914 INFO:tasks.workunit.client.0.smithi053.stdout:3/521: readlink d1/d5/d91/d47/d64/l81 0 2024-09-16T00:50:24.914 INFO:tasks.workunit.client.0.smithi053.stdout:3/522: truncate d1/d5/d31/f41 1298592 0 2024-09-16T00:50:24.914 INFO:tasks.workunit.client.0.smithi053.stdout:2/392: dread d6/d9/dd/d28/f2f [0,4194304] 0 2024-09-16T00:50:24.914 INFO:tasks.workunit.client.0.smithi053.stdout:6/482: readlink d1/l35 0 2024-09-16T00:50:24.922 INFO:tasks.workunit.client.1.smithi152.stdout:3/895: dread dc/d10/f31 [0,4194304] 0 2024-09-16T00:50:24.922 INFO:tasks.workunit.client.1.smithi152.stdout:3/896: chown dc/d10/d17/d5a/c5b 44 1 2024-09-16T00:50:24.924 INFO:tasks.workunit.client.0.smithi053.stdout:6/483: read d1/dc/d3d/f8c [1445827,47008] 0 2024-09-16T00:50:24.924 INFO:tasks.workunit.client.0.smithi053.stdout:6/484: write d1/f57 [1661481,47461] 0 2024-09-16T00:50:24.925 INFO:tasks.workunit.client.1.smithi152.stdout:0/946: write d3/d6/d8/d1d/d65/d6e/f100 [1483038,75532] 0 2024-09-16T00:50:24.926 INFO:tasks.workunit.client.0.smithi053.stdout:5/427: rmdir d3 39 2024-09-16T00:50:24.933 INFO:tasks.workunit.client.0.smithi053.stdout:8/502: dwrite fb [0,4194304] 0 2024-09-16T00:50:24.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/988: dwrite d1/d7/d77/d3c/dc9/f115 [0,4194304] 0 2024-09-16T00:50:24.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/989: readlink d1/d7/d77/d32/da5/da8/dc5/l120 0 2024-09-16T00:50:24.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/990: dread - d1/d4e/d48/f103 zero size 2024-09-16T00:50:24.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/991: write d1/ff [1591775,78034] 0 2024-09-16T00:50:24.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/992: fsync d1/d7/d77/d32/da5/da8/fdd 0 2024-09-16T00:50:24.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/961: creat db/d12/d23/d4a/d33/dbe/f12e x:0 0 0 2024-09-16T00:50:24.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/962: chown db/d12/d23/f79 2444058 1 2024-09-16T00:50:24.941 INFO:tasks.workunit.client.1.smithi152.stdout:8/865: creat dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc/f11e x:0 0 0 2024-09-16T00:50:24.941 INFO:tasks.workunit.client.1.smithi152.stdout:8/866: dread - dd/d98/db8/dcf/d29/d2f/d53/f10a zero size 2024-09-16T00:50:24.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/897: dwrite dc/d10/d17/d5a/d68/da5/ff3 [0,4194304] 0 2024-09-16T00:50:24.946 INFO:tasks.workunit.client.1.smithi152.stdout:9/993: dread d1/d7/d77/d32/f49 [0,4194304] 0 2024-09-16T00:50:24.946 INFO:tasks.workunit.client.1.smithi152.stdout:9/994: fsync d1/d4e/d48/d66/ff3 0 2024-09-16T00:50:24.950 INFO:tasks.workunit.client.1.smithi152.stdout:0/947: link d3/d6/d8/d1d/d23/d25/l92 d3/d6/d51/l13c 0 2024-09-16T00:50:24.953 INFO:tasks.workunit.client.1.smithi152.stdout:6/963: rename db/d12/d23/d4a/d43/d59/d67/dc2/cf6 to db/d28/c12f 0 2024-09-16T00:50:24.953 INFO:tasks.workunit.client.1.smithi152.stdout:6/964: write db/d12/d23/d4a/d43/f101 [420454,42654] 0 2024-09-16T00:50:24.955 INFO:tasks.workunit.client.0.smithi053.stdout:3/523: symlink d1/d5/d31/d3b/lab 0 2024-09-16T00:50:24.956 INFO:tasks.workunit.client.0.smithi053.stdout:3/524: write d1/d5/d31/d3b/f44 [402837,49306] 0 2024-09-16T00:50:24.958 INFO:tasks.workunit.client.0.smithi053.stdout:2/393: creat d6/d9/dd/d3e/f6f x:0 0 0 2024-09-16T00:50:24.958 INFO:tasks.workunit.client.0.smithi053.stdout:2/394: creat d6/d29/f70 x:0 0 0 2024-09-16T00:50:24.958 INFO:tasks.workunit.client.0.smithi053.stdout:3/525: dread d1/d5/d91/d5e/d69/fa1 [0,4194304] 0 2024-09-16T00:50:24.960 INFO:tasks.workunit.client.1.smithi152.stdout:3/898: mkdir dc/d10/d17/d1c/d50/daa/dfa/d11a 0 2024-09-16T00:50:24.960 INFO:tasks.workunit.client.1.smithi152.stdout:3/899: creat dc/d10/d17/d1c/d8d/d8e/f11b x:0 0 0 2024-09-16T00:50:24.962 INFO:tasks.workunit.client.0.smithi053.stdout:6/485: creat d1/d2f/d9b/fac x:0 0 0 2024-09-16T00:50:24.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/995: mknod d1/d4e/d48/d26/d30/d4f/d50/c142 0 2024-09-16T00:50:24.965 INFO:tasks.workunit.client.0.smithi053.stdout:5/428: rename d3/d7/d2b/d37/d58/f14 to d3/d7/d24/d3f/f8c 0 2024-09-16T00:50:24.965 INFO:tasks.workunit.client.0.smithi053.stdout:5/429: chown d3/d7/d2b/d37/d58/f21 392 1 2024-09-16T00:50:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/948: mknod d3/d6/d8/d1d/d65/d6e/d82/da4/d121/d13b/c13d 0 2024-09-16T00:50:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/949: readlink d3/d6/d8/d1d/d23/d4b/ld9 0 2024-09-16T00:50:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/950: fsync d3/d6/d8/d1d/d65/d6e/d82/fd2 0 2024-09-16T00:50:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:2/895: sync 2024-09-16T00:50:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/951: write d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fb1 [325040,66046] 0 2024-09-16T00:50:24.968 INFO:tasks.workunit.client.0.smithi053.stdout:8/503: link d10/d21/f7f d10/d1c/d92/fb0 0 2024-09-16T00:50:24.968 INFO:tasks.workunit.client.0.smithi053.stdout:8/504: readlink d10/d52/l53 0 2024-09-16T00:50:24.970 INFO:tasks.workunit.client.1.smithi152.stdout:8/867: rename dd/d98/db8/dcf/d29/l113 to dd/d98/l11f 0 2024-09-16T00:50:24.972 INFO:tasks.workunit.client.1.smithi152.stdout:6/965: mknod db/da8/db7/d11b/c130 0 2024-09-16T00:50:24.976 INFO:tasks.workunit.client.1.smithi152.stdout:3/900: mknod dc/d10/d17/d4f/c11c 0 2024-09-16T00:50:24.977 INFO:tasks.workunit.client.1.smithi152.stdout:9/996: getdents d1/d7/d77/d32/da5 0 2024-09-16T00:50:24.977 INFO:tasks.workunit.client.1.smithi152.stdout:9/997: chown d1/d4e/d48/d2b/d93/d96/d12b/c46 32 1 2024-09-16T00:50:24.981 INFO:tasks.workunit.client.1.smithi152.stdout:6/966: dread db/d12/d23/d4a/d43/d48/f4d [0,4194304] 0 2024-09-16T00:50:24.981 INFO:tasks.workunit.client.1.smithi152.stdout:8/868: dread dd/d15/f5a [0,4194304] 0 2024-09-16T00:50:24.981 INFO:tasks.workunit.client.1.smithi152.stdout:8/869: write dd/d23/f119 [163994,10907] 0 2024-09-16T00:50:24.982 INFO:tasks.workunit.client.1.smithi152.stdout:8/870: creat dd/d15/d9b/f120 x:0 0 0 2024-09-16T00:50:24.983 INFO:tasks.workunit.client.0.smithi053.stdout:2/395: link d6/d9/dd/d28/f2f d6/f71 0 2024-09-16T00:50:24.984 INFO:tasks.workunit.client.1.smithi152.stdout:0/952: truncate d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/fa0 142159 0 2024-09-16T00:50:24.985 INFO:tasks.workunit.client.1.smithi152.stdout:0/953: truncate d3/d6/d8/d1d/d65/db0/df0/f10c 394399 0 2024-09-16T00:50:24.986 INFO:tasks.workunit.client.0.smithi053.stdout:3/526: dwrite d1/d5/f68 [0,4194304] 0 2024-09-16T00:50:24.986 INFO:tasks.workunit.client.0.smithi053.stdout:3/527: write d1/d4e/f6b [5795829,9202] 0 2024-09-16T00:50:24.987 INFO:tasks.workunit.client.0.smithi053.stdout:6/486: creat d1/dc/d3c/d4b/d75/fad x:0 0 0 2024-09-16T00:50:24.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/901: mknod dc/d10/d17/d1c/d50/daa/c11d 0 2024-09-16T00:50:24.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/902: truncate dc/d10/d17/d5a/db2/d6f/dbb/f98 14376547 0 2024-09-16T00:50:24.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/903: chown dc/d10/d17/d1c/d50/d55/l116 38409721 1 2024-09-16T00:50:24.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/998: dread d1/d7/ded/d113/d127/fa4 [0,4194304] 0 2024-09-16T00:50:24.993 INFO:tasks.workunit.client.0.smithi053.stdout:0/545: sync 2024-09-16T00:50:24.995 INFO:tasks.workunit.client.0.smithi053.stdout:5/430: truncate d3/f2d 1380443 0 2024-09-16T00:50:24.995 INFO:tasks.workunit.client.0.smithi053.stdout:5/431: readlink d3/d7/l52 0 2024-09-16T00:50:24.997 INFO:tasks.workunit.client.0.smithi053.stdout:8/505: mkdir d10/d1c/d92/d66/db1 0 2024-09-16T00:50:24.997 INFO:tasks.workunit.client.0.smithi053.stdout:5/432: dread d3/d7/d2b/d37/d58/f38 [0,4194304] 0 2024-09-16T00:50:25.002 INFO:tasks.workunit.client.0.smithi053.stdout:2/396: mkdir d6/d9/dd/d3e/d72 0 2024-09-16T00:50:25.003 INFO:tasks.workunit.client.0.smithi053.stdout:2/397: creat d6/f73 x:0 0 0 2024-09-16T00:50:25.004 INFO:tasks.workunit.client.0.smithi053.stdout:0/546: dread d4/dc/d25/d34/f8f [0,4194304] 0 2024-09-16T00:50:25.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/904: dread f2 [0,4194304] 0 2024-09-16T00:50:25.008 INFO:tasks.workunit.client.1.smithi152.stdout:0/954: read d3/d6/d8/d1d/d23/d25/fee [3375361,80439] 0 2024-09-16T00:50:25.010 INFO:tasks.workunit.client.1.smithi152.stdout:9/999: getdents d1/d7/d13/d5d/dbd 0 2024-09-16T00:50:25.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/896: dwrite d4/d44/df6/f33 [4194304,4194304] 0 2024-09-16T00:50:25.013 INFO:tasks.workunit.client.1.smithi152.stdout:8/871: dwrite dd/d98/db8/dcf/fb2 [0,4194304] 0 2024-09-16T00:50:25.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/897: chown d4/d44/d7a/dc7/de4/d94/d93/d120/c12b 38917 1 2024-09-16T00:50:25.013 INFO:tasks.workunit.client.1.smithi152.stdout:8/872: chown dd/db9/fc4 104385459 1 2024-09-16T00:50:25.013 INFO:tasks.workunit.client.0.smithi053.stdout:6/487: creat d1/dc/d1e/d41/fae x:0 0 0 2024-09-16T00:50:25.016 INFO:tasks.workunit.client.1.smithi152.stdout:3/905: mkdir dc/d10/d17/d1c/d50/daa/dfa/d11e 0 2024-09-16T00:50:25.017 INFO:tasks.workunit.client.1.smithi152.stdout:6/967: dwrite db/d12/d23/d4a/d43/d59/fdf [0,4194304] 0 2024-09-16T00:50:25.019 INFO:tasks.workunit.client.0.smithi053.stdout:8/506: mknod d10/d1c/d92/cb2 0 2024-09-16T00:50:25.021 INFO:tasks.workunit.client.1.smithi152.stdout:0/955: mkdir d3/d6/d8/d1d/d23/d25/d45/d6f/d13e 0 2024-09-16T00:50:25.021 INFO:tasks.workunit.client.1.smithi152.stdout:0/956: chown d3/d6/d8/d1d/d23/d25/d45/l104 61200 1 2024-09-16T00:50:25.022 INFO:tasks.workunit.client.0.smithi053.stdout:8/507: dread d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:25.023 INFO:tasks.workunit.client.0.smithi053.stdout:5/433: creat d3/d7/f8d x:0 0 0 2024-09-16T00:50:25.023 INFO:tasks.workunit.client.0.smithi053.stdout:5/434: dread - d3/d7/d2b/d4b/d51/d53/f88 zero size 2024-09-16T00:50:25.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/873: write dd/f38 [456222,33475] 0 2024-09-16T00:50:25.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/874: stat dd/d98/db8/ce9 0 2024-09-16T00:50:25.024 INFO:tasks.workunit.client.0.smithi053.stdout:6/488: dread d1/dc/d1e/d41/f69 [4194304,4194304] 0 2024-09-16T00:50:25.024 INFO:tasks.workunit.client.0.smithi053.stdout:6/489: write d1/dc/d1e/f5d [243024,15151] 0 2024-09-16T00:50:25.025 INFO:tasks.workunit.client.0.smithi053.stdout:8/508: dread d10/d21/d28/f34 [0,4194304] 0 2024-09-16T00:50:25.032 INFO:tasks.workunit.client.0.smithi053.stdout:2/398: mkdir d6/d9/d74 0 2024-09-16T00:50:25.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/898: mknod d4/d44/d7a/dc7/de4/d94/d8f/c12d 0 2024-09-16T00:50:25.039 INFO:tasks.workunit.client.1.smithi152.stdout:8/875: dread dd/d15/d9b/ff1 [0,4194304] 0 2024-09-16T00:50:25.039 INFO:tasks.workunit.client.1.smithi152.stdout:8/876: fdatasync dd/d15/f4a 0 2024-09-16T00:50:25.039 INFO:tasks.workunit.client.1.smithi152.stdout:8/877: chown dd/c90 81819 1 2024-09-16T00:50:25.047 INFO:tasks.workunit.client.1.smithi152.stdout:3/906: dwrite dc/d10/d17/d1c/d1f/d24/db9/fd1 [0,4194304] 0 2024-09-16T00:50:25.049 INFO:tasks.workunit.client.0.smithi053.stdout:6/490: dwrite d1/dc/d43/f83 [0,4194304] 0 2024-09-16T00:50:25.049 INFO:tasks.workunit.client.0.smithi053.stdout:6/491: write d1/dc/d1e/d41/f7e [978466,26992] 0 2024-09-16T00:50:25.049 INFO:tasks.workunit.client.0.smithi053.stdout:6/492: write d1/f9 [1537393,120692] 0 2024-09-16T00:50:25.050 INFO:tasks.workunit.client.1.smithi152.stdout:0/957: dwrite d3/d6/d64/d6a/f4c [0,4194304] 0 2024-09-16T00:50:25.057 INFO:tasks.workunit.client.0.smithi053.stdout:2/399: dwrite d6/d9/f49 [0,4194304] 0 2024-09-16T00:50:25.057 INFO:tasks.workunit.client.0.smithi053.stdout:2/400: read - d6/d9/dd/f6d zero size 2024-09-16T00:50:25.059 INFO:tasks.workunit.client.0.smithi053.stdout:2/401: dread d6/d9/dd/f31 [0,4194304] 0 2024-09-16T00:50:25.067 INFO:tasks.workunit.client.0.smithi053.stdout:2/402: dread d6/f2c [0,4194304] 0 2024-09-16T00:50:25.067 INFO:tasks.workunit.client.0.smithi053.stdout:2/403: write d6/d9/f12 [7596822,96723] 0 2024-09-16T00:50:25.068 INFO:tasks.workunit.client.0.smithi053.stdout:2/404: fdatasync d6/d29/f70 0 2024-09-16T00:50:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:50:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:50:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:50:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:50:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:25 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.085 INFO:tasks.workunit.client.0.smithi053.stdout:2/405: dwrite d6/d9/dd/f5a [0,4194304] 0 2024-09-16T00:50:25.085 INFO:tasks.workunit.client.0.smithi053.stdout:2/406: write d6/d9/d14/f4c [1310405,100238] 0 2024-09-16T00:50:25.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/968: creat db/d12/d23/d4a/d43/d48/d6a/f131 x:0 0 0 2024-09-16T00:50:25.111 INFO:tasks.workunit.client.0.smithi053.stdout:8/509: creat d10/d21/d28/d3c/d63/d6a/fb3 x:0 0 0 2024-09-16T00:50:25.113 INFO:tasks.workunit.client.0.smithi053.stdout:0/547: truncate d4/f69 1720121 0 2024-09-16T00:50:25.113 INFO:tasks.workunit.client.0.smithi053.stdout:0/548: fdatasync d4/dc/d1e/d1f/d40/f8d 0 2024-09-16T00:50:25.115 INFO:tasks.workunit.client.1.smithi152.stdout:2/899: link d4/d44/d7a/d9e/d87/d9c/f108 d4/d44/d7a/dc7/de4/d94/f12e 0 2024-09-16T00:50:25.115 INFO:tasks.workunit.client.1.smithi152.stdout:2/900: truncate d4/d44/d7a/d9e/f11e 101674 0 2024-09-16T00:50:25.115 INFO:tasks.workunit.client.1.smithi152.stdout:2/901: getdents d4/d44/d7a/dc7/de4/d20/d34/dcb 0 2024-09-16T00:50:25.121 INFO:tasks.workunit.client.1.smithi152.stdout:8/878: mknod dd/d98/db8/dcf/d29/dc6/c121 0 2024-09-16T00:50:25.129 INFO:tasks.workunit.client.0.smithi053.stdout:6/493: unlink d1/d2f/d9b/fac 0 2024-09-16T00:50:25.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/879: dread dd/d98/db8/dcf/d29/f10d [0,4194304] 0 2024-09-16T00:50:25.138 INFO:tasks.workunit.client.1.smithi152.stdout:0/958: mkdir d3/d13f 0 2024-09-16T00:50:25.138 INFO:tasks.workunit.client.1.smithi152.stdout:0/959: fdatasync d3/d6/d8/d1d/d23/d4b/d54/ff8 0 2024-09-16T00:50:25.138 INFO:tasks.workunit.client.1.smithi152.stdout:0/960: creat d3/d6/d8/d1d/d65/d6e/f140 x:0 0 0 2024-09-16T00:50:25.177 INFO:tasks.workunit.client.0.smithi053.stdout:2/407: mkdir d6/d9/dd/d3e/d72/d75 0 2024-09-16T00:50:25.239 INFO:tasks.workunit.client.1.smithi152.stdout:3/907: link dc/d10/d17/d4f/c11c dc/d10/d17/d1c/d50/d63/c11f 0 2024-09-16T00:50:25.240 INFO:tasks.workunit.client.1.smithi152.stdout:3/908: write dc/d10/d17/d5a/db2/d6f/ff2 [348365,32165] 0 2024-09-16T00:50:25.305 INFO:tasks.workunit.client.1.smithi152.stdout:6/969: creat db/d12/d1c/d80/f132 x:0 0 0 2024-09-16T00:50:25.305 INFO:tasks.workunit.client.1.smithi152.stdout:6/970: truncate db/d12/d1c/f3f 702765 0 2024-09-16T00:50:25.306 INFO:tasks.workunit.client.0.smithi053.stdout:0/549: symlink d4/dc/d1e/d1f/d40/d9a/lab 0 2024-09-16T00:50:25.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/902: mknod d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/c12f 0 2024-09-16T00:50:25.308 INFO:tasks.workunit.client.1.smithi152.stdout:8/880: mkdir dd/d25/da4/d122 0 2024-09-16T00:50:25.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/903: write d4/d44/df6/d3e/f4b [3195506,67398] 0 2024-09-16T00:50:25.315 INFO:tasks.workunit.client.1.smithi152.stdout:6/971: link db/d12/d1c/ca4 db/d12/d23/d4a/dc5/dd0/c133 0 2024-09-16T00:50:25.317 INFO:tasks.workunit.client.1.smithi152.stdout:8/881: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/d123 0 2024-09-16T00:50:25.317 INFO:tasks.workunit.client.1.smithi152.stdout:8/882: dread - dd/d98/db8/dcf/d29/dc6/de2/f109 zero size 2024-09-16T00:50:25.317 INFO:tasks.workunit.client.1.smithi152.stdout:2/904: write d4/d44/df6/f3a [825976,129727] 0 2024-09-16T00:50:25.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/972: truncate db/d12/d1c/fae 933587 0 2024-09-16T00:50:25.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/973: rename db/d12/d23/d4a/d43/d59/d67/dc2/cf1 to db/d12/d20/d86/d91/dde/c134 0 2024-09-16T00:50:25.325 INFO:tasks.workunit.client.1.smithi152.stdout:2/905: dread d4/d44/d7a/dc7/de4/f27 [0,4194304] 0 2024-09-16T00:50:25.336 INFO:tasks.workunit.client.1.smithi152.stdout:8/883: dwrite dd/d15/d49/fa1 [0,4194304] 0 2024-09-16T00:50:25.337 INFO:tasks.workunit.client.1.smithi152.stdout:8/884: fsync dd/d98/db8/dcf/f107 0 2024-09-16T00:50:25.338 INFO:tasks.workunit.client.1.smithi152.stdout:2/906: dread d4/d44/d7a/d9e/d66/dec/f110 [0,4194304] 0 2024-09-16T00:50:25.341 INFO:tasks.workunit.client.1.smithi152.stdout:8/885: truncate dd/d25/f91 224604 0 2024-09-16T00:50:25.343 INFO:tasks.workunit.client.1.smithi152.stdout:8/886: symlink dd/d98/db8/dcf/d29/d2f/d5f/d112/l124 0 2024-09-16T00:50:25.345 INFO:tasks.workunit.client.1.smithi152.stdout:0/961: unlink d3/d6/d8/d1d/d23/c28 0 2024-09-16T00:50:25.345 INFO:tasks.workunit.client.1.smithi152.stdout:8/887: mkdir dd/d98/db8/d125 0 2024-09-16T00:50:25.346 INFO:tasks.workunit.client.1.smithi152.stdout:6/974: dwrite db/d12/d20/f46 [0,4194304] 0 2024-09-16T00:50:25.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/962: creat d3/d6/d8/d1d/d23/d25/d45/d6f/da7/f141 x:0 0 0 2024-09-16T00:50:25.348 INFO:tasks.workunit.client.1.smithi152.stdout:8/888: rename dd/d98/db8/dcf/d29/d2f/d5f/f6a to dd/d98/db8/dcf/d29/dc6/f126 0 2024-09-16T00:50:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/975: creat db/d28/db3/d100/f135 x:0 0 0 2024-09-16T00:50:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/976: fsync db/d12/d1c/f5c 0 2024-09-16T00:50:25.350 INFO:tasks.workunit.client.1.smithi152.stdout:0/963: mknod d3/d6/d8/d1d/d23/c142 0 2024-09-16T00:50:25.352 INFO:tasks.workunit.client.1.smithi152.stdout:8/889: mknod dd/d98/db8/dcf/d29/dc6/d102/c127 0 2024-09-16T00:50:25.353 INFO:tasks.workunit.client.1.smithi152.stdout:6/977: unlink db/d12/d20/l2f 0 2024-09-16T00:50:25.353 INFO:tasks.workunit.client.1.smithi152.stdout:6/978: creat db/d12/d23/d4a/d43/d48/d6a/de0/d11e/f136 x:0 0 0 2024-09-16T00:50:25.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/964: stat d3/d6/d8/d1d/d23/d25/d2a/l30 0 2024-09-16T00:50:25.359 INFO:tasks.workunit.client.1.smithi152.stdout:2/907: rmdir d4/d44/d7a/dc7/de4/d94 39 2024-09-16T00:50:25.363 INFO:tasks.workunit.client.1.smithi152.stdout:6/979: read db/d12/fe5 [362817,70201] 0 2024-09-16T00:50:25.363 INFO:tasks.workunit.client.1.smithi152.stdout:6/980: getdents db/d12/d23/d4a/d43/d127 0 2024-09-16T00:50:25.366 INFO:tasks.workunit.client.1.smithi152.stdout:6/981: link db/f10c db/d12/d23/d4a/d43/d48/d6a/f137 0 2024-09-16T00:50:25.366 INFO:tasks.workunit.client.1.smithi152.stdout:6/982: fsync db/f18 0 2024-09-16T00:50:25.368 INFO:tasks.workunit.client.1.smithi152.stdout:0/965: dwrite d3/d6/f10e [0,4194304] 0 2024-09-16T00:50:25.369 INFO:tasks.workunit.client.1.smithi152.stdout:0/966: write d3/d6/d2e/fd3 [1422646,77776] 0 2024-09-16T00:50:25.371 INFO:tasks.workunit.client.1.smithi152.stdout:2/908: dread d4/d44/d7a/dc7/de4/d94/d8f/fee [0,4194304] 0 2024-09-16T00:50:25.371 INFO:tasks.workunit.client.1.smithi152.stdout:2/909: write d4/d44/d7a/dc7/de4/d20/d28/d2c/fc4 [491253,115927] 0 2024-09-16T00:50:25.371 INFO:tasks.workunit.client.1.smithi152.stdout:2/910: truncate d4/d44/d7a/dc7/de4/d20/d34/fe0 584007 0 2024-09-16T00:50:25.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/967: unlink d3/d6/d8/c14 0 2024-09-16T00:50:25.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/968: dread d3/d6/f42 [0,4194304] 0 2024-09-16T00:50:25.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/969: creat d3/d6/d8/d1d/d65/d6e/f143 x:0 0 0 2024-09-16T00:50:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/983: dread db/d12/d20/f46 [0,4194304] 0 2024-09-16T00:50:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/984: fsync db/d12/d23/d4a/d43/d48/f7f 0 2024-09-16T00:50:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:0/970: truncate d3/d6/d8/d1d/d23/d25/fee 2158123 0 2024-09-16T00:50:25.379 INFO:tasks.workunit.client.1.smithi152.stdout:8/890: dwrite dd/f1f [0,4194304] 0 2024-09-16T00:50:25.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/911: dread d4/d44/d7a/d9e/f103 [0,4194304] 0 2024-09-16T00:50:25.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/912: chown d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8 122845 1 2024-09-16T00:50:25.380 INFO:tasks.workunit.client.1.smithi152.stdout:6/985: mknod db/d12/d23/d4a/d43/d48/d6a/c138 0 2024-09-16T00:50:25.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/971: truncate d3/d6/d51/f85 3791042 0 2024-09-16T00:50:25.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/972: creat d3/d6/d2e/de9/f144 x:0 0 0 2024-09-16T00:50:25.384 INFO:tasks.workunit.client.1.smithi152.stdout:2/913: dread d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc [0,4194304] 0 2024-09-16T00:50:25.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/986: dread db/f40 [0,4194304] 0 2024-09-16T00:50:25.391 INFO:tasks.workunit.client.1.smithi152.stdout:6/987: write db/d12/d23/d4a/d43/d48/d6a/f131 [958512,850] 0 2024-09-16T00:50:25.391 INFO:tasks.workunit.client.1.smithi152.stdout:6/988: fsync db/da8/db7/f109 0 2024-09-16T00:50:25.392 INFO:tasks.workunit.client.1.smithi152.stdout:6/989: creat db/d28/db3/f139 x:0 0 0 2024-09-16T00:50:25.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/914: dread d4/d44/d7a/dc7/de4/d94/d8f/f91 [0,4194304] 0 2024-09-16T00:50:25.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/990: mkdir db/d28/dd8/d13a 0 2024-09-16T00:50:25.394 INFO:tasks.workunit.client.1.smithi152.stdout:6/991: readlink db/d12/d20/lb5 0 2024-09-16T00:50:25.395 INFO:tasks.workunit.client.1.smithi152.stdout:2/915: mkdir d4/d44/d7a/df8/d130 0 2024-09-16T00:50:25.409 INFO:tasks.workunit.client.0.smithi053.stdout:5/435: rename d3/l1e to d3/d7/d2b/l8e 0 2024-09-16T00:50:25.409 INFO:tasks.workunit.client.0.smithi053.stdout:5/436: chown d3/d7/d24/d34/l69 23679606 1 2024-09-16T00:50:25.409 INFO:tasks.workunit.client.0.smithi053.stdout:5/437: truncate d3/d7/d2b/d4b/d4f/f73 218893 0 2024-09-16T00:50:25.410 INFO:tasks.workunit.client.0.smithi053.stdout:0/550: rename d4/d5a/d82/ca9 to d4/d5a/d68/cac 0 2024-09-16T00:50:25.411 INFO:tasks.workunit.client.0.smithi053.stdout:0/551: getdents d4/dc/d1e/d1f/d40/d44/d49 0 2024-09-16T00:50:25.411 INFO:tasks.workunit.client.0.smithi053.stdout:0/552: truncate d4/dc/d25/d34/d71/d96/f58 1629498 0 2024-09-16T00:50:25.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/973: mknod d3/d6/d8/d1d/c145 0 2024-09-16T00:50:25.429 INFO:tasks.workunit.client.0.smithi053.stdout:5/438: dwrite d3/d7/d2b/d37/d58/d79/f84 [0,4194304] 0 2024-09-16T00:50:25.430 INFO:tasks.workunit.client.1.smithi152.stdout:0/974: creat d3/d6/d8/d1d/d65/f146 x:0 0 0 2024-09-16T00:50:25.430 INFO:tasks.workunit.client.1.smithi152.stdout:0/975: fdatasync d3/d6/d2e/d58/f78 0 2024-09-16T00:50:25.432 INFO:tasks.workunit.client.1.smithi152.stdout:0/976: mknod d3/d6/d8/d1d/d65/db0/c147 0 2024-09-16T00:50:25.433 INFO:tasks.workunit.client.1.smithi152.stdout:0/977: dread d3/d6/d8/d1d/d23/d25/d45/d6f/da7/fb5 [0,4194304] 0 2024-09-16T00:50:25.434 INFO:tasks.workunit.client.1.smithi152.stdout:0/978: creat d3/d6/d64/d6a/d61/f148 x:0 0 0 2024-09-16T00:50:25.436 INFO:tasks.workunit.client.1.smithi152.stdout:0/979: mkdir d3/d6/d8/d9e/d149 0 2024-09-16T00:50:25.438 INFO:tasks.workunit.client.1.smithi152.stdout:0/980: unlink d3/d6/d8/d1d/d23/d25/d45/cbc 0 2024-09-16T00:50:25.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/981: symlink d3/d6/d8/d1d/d23/d25/d45/d6f/l14a 0 2024-09-16T00:50:25.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/982: chown d3/d6/d8/d1d/d23 365538 1 2024-09-16T00:50:25.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/983: write d3/d6/d2e/ff4 [805057,55471] 0 2024-09-16T00:50:25.445 INFO:tasks.workunit.client.1.smithi152.stdout:8/891: symlink dd/d15/l128 0 2024-09-16T00:50:25.445 INFO:tasks.workunit.client.1.smithi152.stdout:8/892: stat dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4 0 2024-09-16T00:50:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:50:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:50:25.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:25 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:25.448 INFO:tasks.workunit.client.1.smithi152.stdout:8/893: symlink dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc/l129 0 2024-09-16T00:50:25.448 INFO:tasks.workunit.client.1.smithi152.stdout:6/992: creat db/d12/d23/d4a/f13b x:0 0 0 2024-09-16T00:50:25.448 INFO:tasks.workunit.client.1.smithi152.stdout:6/993: creat db/da8/db7/f13c x:0 0 0 2024-09-16T00:50:25.450 INFO:tasks.workunit.client.1.smithi152.stdout:6/994: mkdir db/d12/d23/d4a/d43/d48/d64/dab/d13d 0 2024-09-16T00:50:25.452 INFO:tasks.workunit.client.1.smithi152.stdout:8/894: rename dd/d15/d1a to dd/d98/db8/d12a 0 2024-09-16T00:50:25.458 INFO:tasks.workunit.client.1.smithi152.stdout:3/909: rmdir dc/d10/d17/d1c/d1f/d9e 39 2024-09-16T00:50:25.458 INFO:tasks.workunit.client.1.smithi152.stdout:3/910: truncate dc/fbd 301840 0 2024-09-16T00:50:25.463 INFO:tasks.workunit.client.0.smithi053.stdout:2/408: mkdir d6/d9/dd/d76 0 2024-09-16T00:50:25.463 INFO:tasks.workunit.client.0.smithi053.stdout:2/409: creat d6/f77 x:0 0 0 2024-09-16T00:50:25.468 INFO:tasks.workunit.client.0.smithi053.stdout:1/449: sync 2024-09-16T00:50:25.468 INFO:tasks.workunit.client.0.smithi053.stdout:2/410: creat d6/d9/dd/d3e/d72/f78 x:0 0 0 2024-09-16T00:50:25.468 INFO:tasks.workunit.client.0.smithi053.stdout:7/457: sync 2024-09-16T00:50:25.471 INFO:tasks.workunit.client.0.smithi053.stdout:7/458: symlink d1/d60/d70/d92/l9b 0 2024-09-16T00:50:25.471 INFO:tasks.workunit.client.0.smithi053.stdout:7/459: dread - d1/d3/f9a zero size 2024-09-16T00:50:25.473 INFO:tasks.workunit.client.0.smithi053.stdout:7/460: creat d1/d35/d14/d15/f9c x:0 0 0 2024-09-16T00:50:25.475 INFO:tasks.workunit.client.1.smithi152.stdout:6/995: dwrite db/da8/db7/fdb [0,4194304] 0 2024-09-16T00:50:25.475 INFO:tasks.workunit.client.1.smithi152.stdout:6/996: fdatasync db/d12/d23/d4a/d43/d48/d64/dab/feb 0 2024-09-16T00:50:25.475 INFO:tasks.workunit.client.1.smithi152.stdout:6/997: chown db/d12/d23/d4a/d43/d48/d64/dab/de7/c9a 10108 1 2024-09-16T00:50:25.476 INFO:tasks.workunit.client.0.smithi053.stdout:7/461: rmdir d1/d60/d77/d7b 0 2024-09-16T00:50:25.476 INFO:tasks.workunit.client.0.smithi053.stdout:7/462: fsync d1/d3/f5 0 2024-09-16T00:50:25.476 INFO:tasks.workunit.client.0.smithi053.stdout:7/463: chown d1/d3/f5 15 1 2024-09-16T00:50:25.476 INFO:tasks.workunit.client.0.smithi053.stdout:7/464: getdents d1/d2a/d83/d84 0 2024-09-16T00:50:25.477 INFO:tasks.workunit.client.0.smithi053.stdout:0/553: mknod d4/dc/d1e/d1f/d40/cad 0 2024-09-16T00:50:25.479 INFO:tasks.workunit.client.1.smithi152.stdout:6/998: dread db/d12/d1c/f89 [0,4194304] 0 2024-09-16T00:50:25.481 INFO:tasks.workunit.client.1.smithi152.stdout:3/911: dwrite dc/d10/d17/d1c/d8d/d8e/d112/ff5 [0,4194304] 0 2024-09-16T00:50:25.481 INFO:tasks.workunit.client.1.smithi152.stdout:3/912: fdatasync dc/d10/d17/d1c/d50/d55/f96 0 2024-09-16T00:50:25.481 INFO:tasks.workunit.client.1.smithi152.stdout:3/913: write f6 [4535661,72712] 0 2024-09-16T00:50:25.482 INFO:tasks.workunit.client.0.smithi053.stdout:7/465: unlink d1/l13 0 2024-09-16T00:50:25.482 INFO:tasks.workunit.client.0.smithi053.stdout:7/466: fsync d1/d60/d77/d50/f65 0 2024-09-16T00:50:25.482 INFO:tasks.workunit.client.0.smithi053.stdout:2/411: dread d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:25.485 INFO:tasks.workunit.client.0.smithi053.stdout:5/439: link d3/d7/d24/d34/d3e/f64 d3/d7/d24/f8f 0 2024-09-16T00:50:25.485 INFO:tasks.workunit.client.0.smithi053.stdout:5/440: dread - d3/d7/d24/f66 zero size 2024-09-16T00:50:25.486 INFO:tasks.workunit.client.1.smithi152.stdout:2/916: dwrite d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc [0,4194304] 0 2024-09-16T00:50:25.487 INFO:tasks.workunit.client.1.smithi152.stdout:8/895: dwrite dd/d23/f11b [0,4194304] 0 2024-09-16T00:50:25.488 INFO:tasks.workunit.client.0.smithi053.stdout:9/506: sync 2024-09-16T00:50:25.488 INFO:tasks.workunit.client.0.smithi053.stdout:4/315: sync 2024-09-16T00:50:25.490 INFO:tasks.workunit.client.0.smithi053.stdout:7/467: creat d1/d3/d85/f9d x:0 0 0 2024-09-16T00:50:25.490 INFO:tasks.workunit.client.0.smithi053.stdout:5/441: dread d3/f9 [0,4194304] 0 2024-09-16T00:50:25.492 INFO:tasks.workunit.client.0.smithi053.stdout:5/442: dread d3/d7/d2b/d4b/d4f/f73 [0,4194304] 0 2024-09-16T00:50:25.493 INFO:tasks.workunit.client.0.smithi053.stdout:0/554: getdents d4/dc/d25/d34/d71 0 2024-09-16T00:50:25.496 INFO:tasks.workunit.client.0.smithi053.stdout:6/494: creat d1/dc/d1e/faf x:0 0 0 2024-09-16T00:50:25.496 INFO:tasks.workunit.client.0.smithi053.stdout:6/495: chown d1/dc/d1e/d65 3 1 2024-09-16T00:50:25.496 INFO:tasks.workunit.client.0.smithi053.stdout:6/496: creat d1/dc/d45/fb0 x:0 0 0 2024-09-16T00:50:25.497 INFO:tasks.workunit.client.0.smithi053.stdout:6/497: write d1/dc/f3b [133200,92263] 0 2024-09-16T00:50:25.498 INFO:tasks.workunit.client.0.smithi053.stdout:9/507: mknod d8/d1c/d2b/d49/ca6 0 2024-09-16T00:50:25.499 INFO:tasks.workunit.client.0.smithi053.stdout:1/450: write d5/dd/d47/d58/f78 [355282,101275] 0 2024-09-16T00:50:25.500 INFO:tasks.workunit.client.1.smithi152.stdout:3/914: symlink dc/d5c/dae/df1/l120 0 2024-09-16T00:50:25.502 INFO:tasks.workunit.client.0.smithi053.stdout:7/468: unlink d1/d60/d70/c88 0 2024-09-16T00:50:25.502 INFO:tasks.workunit.client.0.smithi053.stdout:7/469: stat d1/d35/d14/c34 0 2024-09-16T00:50:25.504 INFO:tasks.workunit.client.0.smithi053.stdout:4/316: dwrite d0/d2/f23 [0,4194304] 0 2024-09-16T00:50:25.504 INFO:tasks.workunit.client.0.smithi053.stdout:4/317: chown d0/da/l6c 11712203 1 2024-09-16T00:50:25.505 INFO:tasks.workunit.client.0.smithi053.stdout:5/443: mknod d3/d7/d2b/d37/d46/c90 0 2024-09-16T00:50:25.507 INFO:tasks.workunit.client.0.smithi053.stdout:0/555: creat d4/dc/d25/d34/d71/d96/d27/fae x:0 0 0 2024-09-16T00:50:25.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/896: mkdir dd/d12b 0 2024-09-16T00:50:25.511 INFO:tasks.workunit.client.0.smithi053.stdout:9/508: rmdir d8/d1c/d2b/d49/da2 0 2024-09-16T00:50:25.511 INFO:tasks.workunit.client.0.smithi053.stdout:9/509: truncate d8/d1c/d2b/d2c/f85 222216 0 2024-09-16T00:50:25.513 INFO:tasks.workunit.client.1.smithi152.stdout:3/915: creat dc/d10/d17/d5a/db2/d6f/dbb/f121 x:0 0 0 2024-09-16T00:50:25.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/984: write d3/d6/d8/d1d/d65/db0/db6/fc3 [163950,11284] 0 2024-09-16T00:50:25.516 INFO:tasks.workunit.client.0.smithi053.stdout:7/470: mknod d1/d35/d5b/c9e 0 2024-09-16T00:50:25.516 INFO:tasks.workunit.client.0.smithi053.stdout:7/471: chown d1/d60/d62/f69 34100 1 2024-09-16T00:50:25.518 INFO:tasks.workunit.client.1.smithi152.stdout:3/916: creat dc/d10/d17/d1c/d8d/d8e/d112/f122 x:0 0 0 2024-09-16T00:50:25.519 INFO:tasks.workunit.client.0.smithi053.stdout:4/318: mkdir d0/d2/dd/d25/d37/d71 0 2024-09-16T00:50:25.520 INFO:tasks.workunit.client.0.smithi053.stdout:6/498: read d1/dc/d45/f94 [2061826,16373] 0 2024-09-16T00:50:25.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/897: write dd/d15/d49/f6d [3497360,103715] 0 2024-09-16T00:50:25.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/898: stat dd/d98/db8/dcf/d29/dc6/d102/l9a 0 2024-09-16T00:50:25.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/899: chown dd/d98/fbe 122640 1 2024-09-16T00:50:25.522 INFO:tasks.workunit.client.0.smithi053.stdout:5/444: symlink d3/d7/d24/d34/d3e/l91 0 2024-09-16T00:50:25.523 INFO:tasks.workunit.client.0.smithi053.stdout:1/451: write d5/d9/d88/f60 [3494248,35520] 0 2024-09-16T00:50:25.523 INFO:tasks.workunit.client.0.smithi053.stdout:1/452: truncate d5/d9/f44 807041 0 2024-09-16T00:50:25.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/985: truncate d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae 5175161 0 2024-09-16T00:50:25.524 INFO:tasks.workunit.client.0.smithi053.stdout:2/412: dwrite d6/d9/dd/d3e/f42 [0,4194304] 0 2024-09-16T00:50:25.525 INFO:tasks.workunit.client.0.smithi053.stdout:2/413: read d6/f71 [8032029,105667] 0 2024-09-16T00:50:25.525 INFO:tasks.workunit.client.0.smithi053.stdout:2/414: rename d6/d29 to d6/d29/d2b/d79 22 2024-09-16T00:50:25.525 INFO:tasks.workunit.client.0.smithi053.stdout:0/556: read d4/f9 [3092247,41329] 0 2024-09-16T00:50:25.527 INFO:tasks.workunit.client.1.smithi152.stdout:3/917: symlink dc/d10/d47/l123 0 2024-09-16T00:50:25.528 INFO:tasks.workunit.client.1.smithi152.stdout:6/999: dwrite db/d12/d23/d4a/d43/d48/d64/dab/fd1 [0,4194304] 0 2024-09-16T00:50:25.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/917: dwrite d4/d44/d7a/dc7/de4/d20/d28/d2c/fdc [0,4194304] 0 2024-09-16T00:50:25.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/499: rmdir d1/dc/d1e/d65/d81 39 2024-09-16T00:50:25.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/500: write d1/dc/d1e/d65/d81/f84 [285491,17893] 0 2024-09-16T00:50:25.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/900: mkdir dd/d98/db8/dcf/d12c 0 2024-09-16T00:50:25.533 INFO:tasks.workunit.client.0.smithi053.stdout:5/445: creat d3/d7/d24/d34/d80/f92 x:0 0 0 2024-09-16T00:50:25.534 INFO:tasks.workunit.client.0.smithi053.stdout:7/472: write d1/d2a/d4f/f6d [632171,106845] 0 2024-09-16T00:50:25.534 INFO:tasks.workunit.client.0.smithi053.stdout:7/473: chown d1/d2a/d83 3 1 2024-09-16T00:50:25.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/986: creat d3/d6/d2e/de9/dff/f14b x:0 0 0 2024-09-16T00:50:25.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/987: dread - d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/fe1 zero size 2024-09-16T00:50:25.540 INFO:tasks.workunit.client.0.smithi053.stdout:2/415: mknod d6/d9/dd/d3e/c7a 0 2024-09-16T00:50:25.540 INFO:tasks.workunit.client.0.smithi053.stdout:2/416: creat d6/d9/dd/d3e/d52/f7b x:0 0 0 2024-09-16T00:50:25.540 INFO:tasks.workunit.client.0.smithi053.stdout:2/417: chown d6/d29/d2b/d39 166691010 1 2024-09-16T00:50:25.542 INFO:tasks.workunit.client.1.smithi152.stdout:2/918: truncate d4/d44/d7a/dc7/de4/d20/d28/fb1 13429 0 2024-09-16T00:50:25.543 INFO:tasks.workunit.client.0.smithi053.stdout:0/557: rmdir d4/dc/d25/d34/d71/d96 39 2024-09-16T00:50:25.543 INFO:tasks.workunit.client.0.smithi053.stdout:0/558: truncate d4/dc/d25/d34/d71/d96/d5b/f78 301195 0 2024-09-16T00:50:25.543 INFO:tasks.workunit.client.0.smithi053.stdout:0/559: write d4/dc/d25/d34/d71/d96/d27/f33 [599746,85737] 0 2024-09-16T00:50:25.544 INFO:tasks.workunit.client.1.smithi152.stdout:8/901: link dd/d98/db8/d12a/f11c dd/d25/da4/f12d 0 2024-09-16T00:50:25.544 INFO:tasks.workunit.client.1.smithi152.stdout:8/902: write dd/d98/db8/d12a/f11c [691861,92437] 0 2024-09-16T00:50:25.545 INFO:tasks.workunit.client.0.smithi053.stdout:4/319: symlink d0/d2/d1e/d4b/l72 0 2024-09-16T00:50:25.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/988: rmdir d3/d6/d8/d1d/d65/d6e/d82/da4/d121 39 2024-09-16T00:50:25.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/989: truncate d3/d6/d8/d9e/f109 563060 0 2024-09-16T00:50:25.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/990: creat d3/d6/d64/d6a/d61/f14c x:0 0 0 2024-09-16T00:50:25.547 INFO:tasks.workunit.client.0.smithi053.stdout:8/510: sync 2024-09-16T00:50:25.548 INFO:tasks.workunit.client.0.smithi053.stdout:3/528: sync 2024-09-16T00:50:25.548 INFO:tasks.workunit.client.0.smithi053.stdout:3/529: stat d1/d5/d91/c7e 0 2024-09-16T00:50:25.550 INFO:tasks.workunit.client.0.smithi053.stdout:6/501: mkdir d1/dc/d3d/db1 0 2024-09-16T00:50:25.550 INFO:tasks.workunit.client.0.smithi053.stdout:6/502: chown d1/dc/d39/f67 193508 1 2024-09-16T00:50:25.552 INFO:tasks.workunit.client.1.smithi152.stdout:0/991: symlink d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/ddd/dfa/l14d 0 2024-09-16T00:50:25.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/903: dread dd/d98/db8/dcf/d29/d2f/d53/f73 [0,4194304] 0 2024-09-16T00:50:25.553 INFO:tasks.workunit.client.0.smithi053.stdout:5/446: symlink d3/d7/d24/d34/d80/l93 0 2024-09-16T00:50:25.553 INFO:tasks.workunit.client.0.smithi053.stdout:5/447: fdatasync d3/d7/d24/f65 0 2024-09-16T00:50:25.553 INFO:tasks.workunit.client.0.smithi053.stdout:5/448: creat d3/d7/d2b/d37/d58/d79/f94 x:0 0 0 2024-09-16T00:50:25.556 INFO:tasks.workunit.client.0.smithi053.stdout:5/449: read d3/d7/d2b/d37/d58/f4c [984021,52276] 0 2024-09-16T00:50:25.559 INFO:tasks.workunit.client.1.smithi152.stdout:2/919: dread d4/d44/d7a/dc7/de4/d94/f12e [4194304,4194304] 0 2024-09-16T00:50:25.559 INFO:tasks.workunit.client.1.smithi152.stdout:8/904: creat dd/d98/db8/dcf/d29/f12e x:0 0 0 2024-09-16T00:50:25.559 INFO:tasks.workunit.client.0.smithi053.stdout:2/418: link d6/f32 d6/d9/dd/d3e/d52/d65/f7c 0 2024-09-16T00:50:25.562 INFO:tasks.workunit.client.0.smithi053.stdout:0/560: getdents d4/dc/d25/d34/d71/d96/d27/d4a 0 2024-09-16T00:50:25.566 INFO:tasks.workunit.client.0.smithi053.stdout:5/450: dread d3/d7/d2b/d2f/f77 [0,4194304] 0 2024-09-16T00:50:25.566 INFO:tasks.workunit.client.1.smithi152.stdout:8/905: rmdir dd/d98/db8/d125 0 2024-09-16T00:50:25.566 INFO:tasks.workunit.client.1.smithi152.stdout:8/906: fsync dd/d98/db8/dcf/d29/f10d 0 2024-09-16T00:50:25.567 INFO:tasks.workunit.client.0.smithi053.stdout:4/320: creat d0/d3c/d48/d58/f73 x:0 0 0 2024-09-16T00:50:25.568 INFO:tasks.workunit.client.0.smithi053.stdout:4/321: readlink d0/d2/dd/d25/d37/l3a 0 2024-09-16T00:50:25.569 INFO:tasks.workunit.client.0.smithi053.stdout:8/511: mkdir d10/d21/d28/db4 0 2024-09-16T00:50:25.571 INFO:tasks.workunit.client.0.smithi053.stdout:2/419: read d6/d9/dd/d3e/d52/d65/f7c [1854750,121235] 0 2024-09-16T00:50:25.572 INFO:tasks.workunit.client.0.smithi053.stdout:2/420: creat d6/d9/dd/d3e/f7d x:0 0 0 2024-09-16T00:50:25.573 INFO:tasks.workunit.client.0.smithi053.stdout:6/503: rename d1/dc/d1e/faf to d1/dc/d3c/d4b/fb2 0 2024-09-16T00:50:25.575 INFO:tasks.workunit.client.0.smithi053.stdout:6/504: read d1/dc/d3c/d4b/f91 [516437,111969] 0 2024-09-16T00:50:25.577 INFO:tasks.workunit.client.0.smithi053.stdout:0/561: creat d4/dc/d25/faf x:0 0 0 2024-09-16T00:50:25.577 INFO:tasks.workunit.client.0.smithi053.stdout:0/562: truncate d4/dc/d25/f2f 736740 0 2024-09-16T00:50:25.577 INFO:tasks.workunit.client.0.smithi053.stdout:0/563: stat d4/dc/d1e/d1f/d40/d44/d54/f98 0 2024-09-16T00:50:25.577 INFO:tasks.workunit.client.0.smithi053.stdout:0/564: fdatasync d4/dc/d25/d34/d71/d96/d5b/f78 0 2024-09-16T00:50:25.578 INFO:tasks.workunit.client.0.smithi053.stdout:4/322: getdents d0/d2/dd/d25/d41 0 2024-09-16T00:50:25.578 INFO:tasks.workunit.client.0.smithi053.stdout:4/323: readlink d0/d2/d1e/d4b/l72 0 2024-09-16T00:50:25.582 INFO:tasks.workunit.client.0.smithi053.stdout:8/512: creat d10/d52/fb5 x:0 0 0 2024-09-16T00:50:25.583 INFO:tasks.workunit.client.0.smithi053.stdout:0/565: dread d4/f69 [0,4194304] 0 2024-09-16T00:50:25.583 INFO:tasks.workunit.client.0.smithi053.stdout:0/566: fdatasync d4/dc/d1e/d22/f42 0 2024-09-16T00:50:25.583 INFO:tasks.workunit.client.0.smithi053.stdout:8/513: write d10/d1c/d92/d66/f7a [496785,123571] 0 2024-09-16T00:50:25.586 INFO:tasks.workunit.client.0.smithi053.stdout:2/421: truncate d6/d9/f1e 1131536 0 2024-09-16T00:50:25.588 INFO:tasks.workunit.client.1.smithi152.stdout:2/920: dwrite d4/d44/d7a/d9e/d87/d9c/fae [0,4194304] 0 2024-09-16T00:50:25.588 INFO:tasks.workunit.client.1.smithi152.stdout:2/921: write d4/d44/d7a/d9e/f11e [675198,24224] 0 2024-09-16T00:50:25.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/324: mknod d0/d3c/d48/d58/c74 0 2024-09-16T00:50:25.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/325: stat d0/d2/dd/d25/d37/l49 0 2024-09-16T00:50:25.592 INFO:tasks.workunit.client.0.smithi053.stdout:8/514: creat d10/d21/d28/d6f/fb6 x:0 0 0 2024-09-16T00:50:25.592 INFO:tasks.workunit.client.1.smithi152.stdout:8/907: dwrite dd/d23/f60 [0,4194304] 0 2024-09-16T00:50:25.593 INFO:tasks.workunit.client.1.smithi152.stdout:2/922: link d4/d44/d7a/dc7/de4/d94/c6c d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/c131 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:6/505: dwrite d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:6/506: write d1/dc/d45/fb0 [440327,14430] 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:5/451: dwrite d3/d7/d2b/d4b/d4f/f87 [0,4194304] 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:5/452: write d3/d7/d24/d34/f76 [57327,64583] 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:5/453: getdents d3/d7/d2b/d71 0 2024-09-16T00:50:25.595 INFO:tasks.workunit.client.0.smithi053.stdout:5/454: write d3/d7/d2b/d37/d58/f6b [913332,69189] 0 2024-09-16T00:50:25.596 INFO:tasks.workunit.client.0.smithi053.stdout:8/515: link d10/d1c/d92/fb0 d10/d21/d28/fb7 0 2024-09-16T00:50:25.598 INFO:tasks.workunit.client.0.smithi053.stdout:0/567: dread d4/f17 [0,4194304] 0 2024-09-16T00:50:25.598 INFO:tasks.workunit.client.0.smithi053.stdout:0/568: fdatasync d4/d13/f41 0 2024-09-16T00:50:25.598 INFO:tasks.workunit.client.1.smithi152.stdout:2/923: rename d4/d44/d7a/dc7/de4/c58 to d4/d44/d7a/d9e/d66/c132 0 2024-09-16T00:50:25.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/924: stat d4/d44/d7a/dc7/de4/d20/d28/c84 0 2024-09-16T00:50:25.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/925: write d4/d44/d7a/dc7/de4/f5b [2853054,19244] 0 2024-09-16T00:50:25.600 INFO:tasks.workunit.client.0.smithi053.stdout:6/507: mkdir d1/d2f/db3 0 2024-09-16T00:50:25.600 INFO:tasks.workunit.client.0.smithi053.stdout:6/508: stat d1/dc/d45/f59 0 2024-09-16T00:50:25.602 INFO:tasks.workunit.client.0.smithi053.stdout:8/516: unlink d10/d21/f42 0 2024-09-16T00:50:25.603 INFO:tasks.workunit.client.0.smithi053.stdout:6/509: dread d1/dc/d3c/d4b/f91 [0,4194304] 0 2024-09-16T00:50:25.604 INFO:tasks.workunit.client.0.smithi053.stdout:6/510: mknod d1/dc/cb4 0 2024-09-16T00:50:25.605 INFO:tasks.workunit.client.0.smithi053.stdout:8/517: rmdir d10/d21/d28/d3c/d63/d6a 39 2024-09-16T00:50:25.606 INFO:tasks.workunit.client.0.smithi053.stdout:5/455: write d3/f2c [2175838,74720] 0 2024-09-16T00:50:25.607 INFO:tasks.workunit.client.0.smithi053.stdout:6/511: symlink d1/dc/d3c/d4b/d75/lb5 0 2024-09-16T00:50:25.607 INFO:tasks.workunit.client.0.smithi053.stdout:0/569: dread d4/d13/f63 [0,4194304] 0 2024-09-16T00:50:25.608 INFO:tasks.workunit.client.0.smithi053.stdout:5/456: mknod d3/d7/d2b/d37/d58/d79/c95 0 2024-09-16T00:50:25.609 INFO:tasks.workunit.client.0.smithi053.stdout:6/512: mknod d1/dc/d3d/db1/cb6 0 2024-09-16T00:50:25.609 INFO:tasks.workunit.client.0.smithi053.stdout:6/513: chown d1/dc/d45/fb0 840 1 2024-09-16T00:50:25.609 INFO:tasks.workunit.client.0.smithi053.stdout:0/570: creat d4/dc/d25/fb0 x:0 0 0 2024-09-16T00:50:25.610 INFO:tasks.workunit.client.0.smithi053.stdout:4/326: dwrite d0/d2/dd/d25/f24 [4194304,4194304] 0 2024-09-16T00:50:25.610 INFO:tasks.workunit.client.1.smithi152.stdout:2/926: read d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8/fc2 [3876153,75875] 0 2024-09-16T00:50:25.610 INFO:tasks.workunit.client.1.smithi152.stdout:2/927: stat d4/d44/d7a/cbf 0 2024-09-16T00:50:25.611 INFO:tasks.workunit.client.0.smithi053.stdout:5/457: mkdir d3/d7/d2b/d4b/d51/d96 0 2024-09-16T00:50:25.611 INFO:tasks.workunit.client.0.smithi053.stdout:5/458: truncate d3/d7/f8d 518054 0 2024-09-16T00:50:25.611 INFO:tasks.workunit.client.0.smithi053.stdout:5/459: write d3/d7/d24/f66 [402091,34933] 0 2024-09-16T00:50:25.611 INFO:tasks.workunit.client.0.smithi053.stdout:5/460: creat d3/d7/d2b/d2f/f97 x:0 0 0 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.0.smithi053.stdout:5/461: fsync d3/d7/d2b/d4b/d4f/f87 0 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.0.smithi053.stdout:0/571: dread d4/f17 [0,4194304] 0 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.0.smithi053.stdout:0/572: chown d4/dc/d25/d34/d71/d96/d27/d4a/f56 11 1 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.0.smithi053.stdout:6/514: mknod d1/dc/d39/cb7 0 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.0.smithi053.stdout:6/515: write d1/dc/f32 [980400,51383] 0 2024-09-16T00:50:25.612 INFO:tasks.workunit.client.1.smithi152.stdout:2/928: link d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9/ffa d4/d44/d7a/dc7/de4/d94/d8f/f133 0 2024-09-16T00:50:25.616 INFO:tasks.workunit.client.0.smithi053.stdout:5/462: mknod d3/d7/d24/d34/c98 0 2024-09-16T00:50:25.617 INFO:tasks.workunit.client.0.smithi053.stdout:6/516: symlink d1/d2f/lb8 0 2024-09-16T00:50:25.618 INFO:tasks.workunit.client.0.smithi053.stdout:4/327: rename d0/d3c/f5c to d0/da/d42/f75 0 2024-09-16T00:50:25.618 INFO:tasks.workunit.client.0.smithi053.stdout:4/328: stat d0/da/f69 0 2024-09-16T00:50:25.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/463: creat d3/d7/d2b/d37/f99 x:0 0 0 2024-09-16T00:50:25.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/464: chown d3/d7/d24/d34/d80 111266 1 2024-09-16T00:50:25.619 INFO:tasks.workunit.client.0.smithi053.stdout:6/517: mkdir d1/dc/d3c/d4b/d58/db9 0 2024-09-16T00:50:25.621 INFO:tasks.workunit.client.0.smithi053.stdout:4/329: rename d0/d3c/d48/d58/l6f to d0/d3c/d48/l76 0 2024-09-16T00:50:25.621 INFO:tasks.workunit.client.0.smithi053.stdout:4/330: creat d0/d31/f77 x:0 0 0 2024-09-16T00:50:25.621 INFO:tasks.workunit.client.0.smithi053.stdout:0/573: dread d4/dc/d25/d34/d71/d96/d27/f37 [0,4194304] 0 2024-09-16T00:50:25.629 INFO:tasks.workunit.client.0.smithi053.stdout:0/574: dread d4/dc/d1e/d22/f65 [0,4194304] 0 2024-09-16T00:50:25.642 INFO:tasks.workunit.client.0.smithi053.stdout:4/331: dwrite d0/d2/d26/f50 [0,4194304] 0 2024-09-16T00:50:25.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/908: dread dd/d98/db8/dcf/d88/fb3 [0,4194304] 0 2024-09-16T00:50:25.746 INFO:tasks.workunit.client.1.smithi152.stdout:8/909: mkdir dd/d98/db8/dcf/d29/dc6/d102/d12f 0 2024-09-16T00:50:25.746 INFO:tasks.workunit.client.0.smithi053.stdout:7/474: write d1/d2a/d4f/d52/f26 [2664016,89465] 0 2024-09-16T00:50:25.747 INFO:tasks.workunit.client.0.smithi053.stdout:5/465: dread d3/d7/d24/d34/d5b/f7b [0,4194304] 0 2024-09-16T00:50:25.747 INFO:tasks.workunit.client.0.smithi053.stdout:5/466: creat d3/d7/d2b/d37/d58/d79/f9a x:0 0 0 2024-09-16T00:50:25.747 INFO:tasks.workunit.client.0.smithi053.stdout:5/467: stat d3/d7/d42 0 2024-09-16T00:50:25.748 INFO:tasks.workunit.client.1.smithi152.stdout:8/910: dread dd/d25/f70 [0,4194304] 0 2024-09-16T00:50:25.749 INFO:tasks.workunit.client.1.smithi152.stdout:8/911: dread dd/d98/db8/dcf/d29/dc6/f126 [0,4194304] 0 2024-09-16T00:50:25.749 INFO:tasks.workunit.client.1.smithi152.stdout:8/912: fsync dd/d25/f5d 0 2024-09-16T00:50:25.750 INFO:tasks.workunit.client.0.smithi053.stdout:3/530: write d1/d5/d91/f1f [3851718,57601] 0 2024-09-16T00:50:25.753 INFO:tasks.workunit.client.1.smithi152.stdout:8/913: symlink dd/d98/db8/dcf/d88/dd8/l130 0 2024-09-16T00:50:25.755 INFO:tasks.workunit.client.0.smithi053.stdout:0/575: dread d4/dc/d1e/d1f/d40/f7b [0,4194304] 0 2024-09-16T00:50:25.755 INFO:tasks.workunit.client.0.smithi053.stdout:0/576: creat d4/dc/d25/d34/d71/d96/d27/fb1 x:0 0 0 2024-09-16T00:50:25.755 INFO:tasks.workunit.client.0.smithi053.stdout:0/577: chown d4/dc/d25/d34/d71/d96/d27/f37 818543 1 2024-09-16T00:50:25.755 INFO:tasks.workunit.client.0.smithi053.stdout:3/531: creat d1/d5/d91/d47/d65/d66/fac x:0 0 0 2024-09-16T00:50:25.756 INFO:tasks.workunit.client.1.smithi152.stdout:0/992: dwrite d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 [0,4194304] 0 2024-09-16T00:50:25.757 INFO:tasks.workunit.client.1.smithi152.stdout:8/914: getdents dd/d98/db8/dee 0 2024-09-16T00:50:25.757 INFO:tasks.workunit.client.1.smithi152.stdout:8/915: fdatasync dd/ff9 0 2024-09-16T00:50:25.759 INFO:tasks.workunit.client.0.smithi053.stdout:0/578: unlink d4/dc/d25/d34/d71/d96/d27/d4a/f56 0 2024-09-16T00:50:25.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/918: dwrite f6 [0,4194304] 0 2024-09-16T00:50:25.763 INFO:tasks.workunit.client.0.smithi053.stdout:3/532: mknod d1/d5/d91/d47/d4c/d5f/daa/cad 0 2024-09-16T00:50:25.763 INFO:tasks.workunit.client.0.smithi053.stdout:3/533: chown d1/f6f 3604 1 2024-09-16T00:50:25.765 INFO:tasks.workunit.client.1.smithi152.stdout:0/993: getdents d3/d6/d8/d1d/d23/d4b/d54 0 2024-09-16T00:50:25.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/332: getdents d0/d2/d1e/d4b 0 2024-09-16T00:50:25.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/333: chown d0/d2/d1e/d4b 31519 1 2024-09-16T00:50:25.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/334: readlink d0/d2/l2e 0 2024-09-16T00:50:25.771 INFO:tasks.workunit.client.0.smithi053.stdout:3/534: unlink d1/d89/d28/l9d 0 2024-09-16T00:50:25.771 INFO:tasks.workunit.client.0.smithi053.stdout:3/535: readlink d1/l49 0 2024-09-16T00:50:25.771 INFO:tasks.workunit.client.0.smithi053.stdout:5/468: dread d3/f6 [0,4194304] 0 2024-09-16T00:50:25.771 INFO:tasks.workunit.client.1.smithi152.stdout:0/994: symlink d3/d13f/l14e 0 2024-09-16T00:50:25.788 INFO:tasks.workunit.client.0.smithi053.stdout:7/475: dwrite d1/d2a/d4f/f6d [0,4194304] 0 2024-09-16T00:50:25.788 INFO:tasks.workunit.client.0.smithi053.stdout:7/476: truncate d1/d60/d62/f6f 183607 0 2024-09-16T00:50:25.788 INFO:tasks.workunit.client.1.smithi152.stdout:3/919: getdents dc/d10/d17/d5a/db2/d6f 0 2024-09-16T00:50:25.789 INFO:tasks.workunit.client.0.smithi053.stdout:2/422: dwrite d6/f18 [0,4194304] 0 2024-09-16T00:50:25.790 INFO:tasks.workunit.client.1.smithi152.stdout:0/995: symlink d3/d6/d8/d1d/d65/d6e/d82/l14f 0 2024-09-16T00:50:25.790 INFO:tasks.workunit.client.1.smithi152.stdout:0/996: chown d3/d6/d64/de5/l11d 9426589 1 2024-09-16T00:50:25.790 INFO:tasks.workunit.client.0.smithi053.stdout:5/469: dwrite d3/d7/d2b/f3a [0,4194304] 0 2024-09-16T00:50:25.791 INFO:tasks.workunit.client.0.smithi053.stdout:3/536: mknod d1/d5/d91/d5e/cae 0 2024-09-16T00:50:25.791 INFO:tasks.workunit.client.0.smithi053.stdout:3/537: readlink d1/d5/d91/d5e/d69/l8b 0 2024-09-16T00:50:25.792 INFO:tasks.workunit.client.1.smithi152.stdout:8/916: dwrite dd/d98/db8/dcf/d29/f80 [0,4194304] 0 2024-09-16T00:50:25.801 INFO:tasks.workunit.client.0.smithi053.stdout:2/423: dread d6/d9/dd/d3e/f42 [0,4194304] 0 2024-09-16T00:50:25.807 INFO:tasks.workunit.client.0.smithi053.stdout:5/470: dwrite d3/d7/d24/d34/f76 [0,4194304] 0 2024-09-16T00:50:25.812 INFO:tasks.workunit.client.0.smithi053.stdout:3/538: dwrite d1/d5/d91/d47/f5b [0,4194304] 0 2024-09-16T00:50:25.812 INFO:tasks.workunit.client.0.smithi053.stdout:3/539: chown d1/d5/d91/d47/d65/d66 292134 1 2024-09-16T00:50:25.812 INFO:tasks.workunit.client.0.smithi053.stdout:3/540: truncate d1/d5/d31/d3b/f44 1279359 0 2024-09-16T00:50:25.857 INFO:tasks.workunit.client.1.smithi152.stdout:3/920: link dc/d10/d17/d1c/d8d/cef dc/d10/d17/d5a/db2/c124 0 2024-09-16T00:50:25.857 INFO:tasks.workunit.client.1.smithi152.stdout:3/921: chown dc/d10/d17/d5a/db2/d6f/d74/db5 0 1 2024-09-16T00:50:25.862 INFO:tasks.workunit.client.1.smithi152.stdout:8/917: creat dd/d98/db8/dee/f131 x:0 0 0 2024-09-16T00:50:25.863 INFO:tasks.workunit.client.0.smithi053.stdout:7/477: link d1/d2a/d4f/d52/f30 d1/d2a/d4f/f9f 0 2024-09-16T00:50:25.864 INFO:tasks.workunit.client.0.smithi053.stdout:7/478: write d1/d60/d77/f6a [621436,51646] 0 2024-09-16T00:50:25.864 INFO:tasks.workunit.client.0.smithi053.stdout:7/479: chown d1/d2a/d4f/f53 98 1 2024-09-16T00:50:25.864 INFO:tasks.workunit.client.0.smithi053.stdout:7/480: stat d1/d60/d77/d50 0 2024-09-16T00:50:25.864 INFO:tasks.workunit.client.0.smithi053.stdout:7/481: creat d1/d3/d85/fa0 x:0 0 0 2024-09-16T00:50:25.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/922: creat dc/d10/d17/d1c/d8d/d8e/d2f/d46/dce/f125 x:0 0 0 2024-09-16T00:50:25.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/923: write dc/d10/d17/f52 [5039168,93085] 0 2024-09-16T00:50:25.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/924: truncate dc/d10/d17/d1c/f7e 5104122 0 2024-09-16T00:50:25.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/918: creat dd/d98/db8/dcf/d29/dc6/de2/f132 x:0 0 0 2024-09-16T00:50:25.873 INFO:tasks.workunit.client.0.smithi053.stdout:7/482: read d1/d35/d4a/f4c [3171402,2027] 0 2024-09-16T00:50:25.873 INFO:tasks.workunit.client.1.smithi152.stdout:3/925: rename dc/d10/d17/d5a/db2/d6f/f7d to dc/d10/d17/d5a/d68/da5/f126 0 2024-09-16T00:50:25.873 INFO:tasks.workunit.client.1.smithi152.stdout:3/926: creat dc/d10/d17/d1c/d8d/d8e/d2f/d46/dce/f127 x:0 0 0 2024-09-16T00:50:25.876 INFO:tasks.workunit.client.1.smithi152.stdout:8/919: creat dd/d98/db8/dcf/d29/d2f/db6/f133 x:0 0 0 2024-09-16T00:50:25.877 INFO:tasks.workunit.client.1.smithi152.stdout:8/920: fdatasync dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc/f11e 0 2024-09-16T00:50:25.880 INFO:tasks.workunit.client.0.smithi053.stdout:2/424: mkdir d6/d9/dd/d3e/d52/d7e 0 2024-09-16T00:50:25.883 INFO:tasks.workunit.client.1.smithi152.stdout:3/927: symlink dc/d10/d17/d5a/db2/d6f/dbb/l128 0 2024-09-16T00:50:25.885 INFO:tasks.workunit.client.0.smithi053.stdout:5/471: mknod d3/d7/c9b 0 2024-09-16T00:50:25.886 INFO:tasks.workunit.client.0.smithi053.stdout:5/472: readlink d3/d7/d24/d34/d3e/l91 0 2024-09-16T00:50:25.886 INFO:tasks.workunit.client.0.smithi053.stdout:5/473: dread - d3/d7/d2b/d4b/d51/d53/f88 zero size 2024-09-16T00:50:25.886 INFO:tasks.workunit.client.0.smithi053.stdout:3/541: getdents d1/d5/d31/d7c 0 2024-09-16T00:50:25.890 INFO:tasks.workunit.client.1.smithi152.stdout:8/921: dwrite dd/d25/da4/fdd [0,4194304] 0 2024-09-16T00:50:25.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/922: truncate dd/d15/d49/f7b 1684387 0 2024-09-16T00:50:25.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/928: dwrite dc/d10/d17/d1c/d50/d55/f96 [4194304,4194304] 0 2024-09-16T00:50:25.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/929: write dc/d10/d17/d5a/db2/d6f/dbb/f121 [386932,102649] 0 2024-09-16T00:50:25.906 INFO:tasks.workunit.client.1.smithi152.stdout:2/929: write f2 [981218,86301] 0 2024-09-16T00:50:25.906 INFO:tasks.workunit.client.1.smithi152.stdout:2/930: chown d4/d44/d7a/dc7/de4/d20/fd3 12220 1 2024-09-16T00:50:25.906 INFO:tasks.workunit.client.1.smithi152.stdout:2/931: creat d4/d44/d7a/dc7/de4/d94/d8f/f134 x:0 0 0 2024-09-16T00:50:25.906 INFO:tasks.workunit.client.0.smithi053.stdout:3/542: dwrite d1/d5/d91/f4d [4194304,4194304] 0 2024-09-16T00:50:25.907 INFO:tasks.workunit.client.0.smithi053.stdout:3/543: fsync d1/d5/d91/f2b 0 2024-09-16T00:50:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:8/923: write dd/d23/f11b [4131282,102004] 0 2024-09-16T00:50:25.912 INFO:tasks.workunit.client.1.smithi152.stdout:8/924: symlink dd/d98/db8/dcf/d29/d2f/d5f/dd2/d123/l134 0 2024-09-16T00:50:25.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/930: read dc/d10/d17/d5a/d68/f9b [1296718,37480] 0 2024-09-16T00:50:25.915 INFO:tasks.workunit.client.0.smithi053.stdout:4/335: rename d0/d2/d26 to d0/d2/dd/d25/d41/d78 0 2024-09-16T00:50:25.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/931: rmdir dc/d10/d17/d1c/d8d/d8e/d2f 39 2024-09-16T00:50:25.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/932: rename dc/d10/d17/d1c to dc/d10/d17/d1c/d1f/d24/db9/d129 22 2024-09-16T00:50:25.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/933: chown dc/d10/d17/d5a/db2/d6f/d74/db5/de2 0 1 2024-09-16T00:50:25.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/934: fdatasync dc/d10/d17/d5a/d68/f9b 0 2024-09-16T00:50:25.918 INFO:tasks.workunit.client.0.smithi053.stdout:6/518: truncate d1/dc/f3e 2939922 0 2024-09-16T00:50:25.919 INFO:tasks.workunit.client.0.smithi053.stdout:7/483: mkdir d1/d60/d70/d92/da1 0 2024-09-16T00:50:25.920 INFO:tasks.workunit.client.0.smithi053.stdout:6/519: write d1/dc/d3d/f61 [4649,29922] 0 2024-09-16T00:50:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/935: mkdir dc/d10/d17/d1c/d8d/d8e/d2f/d75/d12a 0 2024-09-16T00:50:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/936: chown dc/d10/d47/c71 15707 1 2024-09-16T00:50:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/937: chown dc/d10/d17/d1c/d8d/d107 86904 1 2024-09-16T00:50:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/938: chown dc/d10/d17/d1c/d50/d63/dc4/ce3 387527 1 2024-09-16T00:50:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/939: chown dc/d10/d17/d1c/d1f/d24/f39 2761707 1 2024-09-16T00:50:25.922 INFO:tasks.workunit.client.0.smithi053.stdout:2/425: creat d6/d9/dd/d3e/d52/d65/f7f x:0 0 0 2024-09-16T00:50:25.927 INFO:tasks.workunit.client.0.smithi053.stdout:3/544: creat d1/d89/d28/d5a/faf x:0 0 0 2024-09-16T00:50:25.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/336: rename d0/d2/dd/d25/f35 to d0/d2/d1e/d4b/f79 0 2024-09-16T00:50:25.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/337: creat d0/d31/f7a x:0 0 0 2024-09-16T00:50:25.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/338: chown d0/d2/dd/d25/d37 7388 1 2024-09-16T00:50:25.929 INFO:tasks.workunit.client.1.smithi152.stdout:3/940: dread dc/d10/d17/d1c/d50/fd0 [0,4194304] 0 2024-09-16T00:50:25.930 INFO:tasks.workunit.client.0.smithi053.stdout:7/484: link d1/d35/d5b/c89 d1/ca2 0 2024-09-16T00:50:25.930 INFO:tasks.workunit.client.0.smithi053.stdout:7/485: read d1/d35/f6b [1978164,73994] 0 2024-09-16T00:50:25.932 INFO:tasks.workunit.client.0.smithi053.stdout:6/520: mkdir d1/dc/dba 0 2024-09-16T00:50:25.934 INFO:tasks.workunit.client.0.smithi053.stdout:5/474: mkdir d3/d9c 0 2024-09-16T00:50:25.935 INFO:tasks.workunit.client.0.smithi053.stdout:3/545: mkdir d1/d5/d91/d5e/d90/da2/db0 0 2024-09-16T00:50:25.935 INFO:tasks.workunit.client.0.smithi053.stdout:3/546: chown d1/d4e/f6b 719 1 2024-09-16T00:50:25.937 INFO:tasks.workunit.client.1.smithi152.stdout:0/997: truncate d3/d6/d8/d1d/d65/d6e/d82/da4/fa5 1299481 0 2024-09-16T00:50:25.937 INFO:tasks.workunit.client.0.smithi053.stdout:5/475: dread d3/d7/d2b/d4b/d4f/f73 [0,4194304] 0 2024-09-16T00:50:25.937 INFO:tasks.workunit.client.0.smithi053.stdout:5/476: fsync d3/d7/d24/d34/d5b/f7b 0 2024-09-16T00:50:25.939 INFO:tasks.workunit.client.0.smithi053.stdout:4/339: link d0/d2/dd/l2f d0/d2/d1e/l7b 0 2024-09-16T00:50:25.939 INFO:tasks.workunit.client.0.smithi053.stdout:4/340: readlink d0/d2/dd/d25/d37/l49 0 2024-09-16T00:50:25.941 INFO:tasks.workunit.client.0.smithi053.stdout:6/521: creat d1/dc/d3d/db1/fbb x:0 0 0 2024-09-16T00:50:25.941 INFO:tasks.workunit.client.0.smithi053.stdout:6/522: write d1/dc/d39/f23 [212650,68604] 0 2024-09-16T00:50:25.944 INFO:tasks.workunit.client.0.smithi053.stdout:3/547: rmdir d1/d5/d91/d5e/d90/da2/db0 0 2024-09-16T00:50:25.946 INFO:tasks.workunit.client.0.smithi053.stdout:5/477: symlink d3/d7/d2b/d37/l9d 0 2024-09-16T00:50:25.947 INFO:tasks.workunit.client.0.smithi053.stdout:5/478: creat d3/d7/d24/d3f/f9e x:0 0 0 2024-09-16T00:50:25.949 INFO:tasks.workunit.client.0.smithi053.stdout:7/486: dread d1/d35/d14/f43 [0,4194304] 0 2024-09-16T00:50:25.949 INFO:tasks.workunit.client.0.smithi053.stdout:7/487: write d1/d35/d4a/f4c [712677,90686] 0 2024-09-16T00:50:25.950 INFO:tasks.workunit.client.0.smithi053.stdout:7/488: fdatasync d1/d35/d4a/f56 0 2024-09-16T00:50:25.950 INFO:tasks.workunit.client.0.smithi053.stdout:3/548: unlink d1/d5/d91/d47/d4c/d5f/daa/cad 0 2024-09-16T00:50:25.952 INFO:tasks.workunit.client.1.smithi152.stdout:0/998: dread d3/d6/d8/d1d/d65/db0/df0/f12b [0,4194304] 0 2024-09-16T00:50:25.952 INFO:tasks.workunit.client.1.smithi152.stdout:0/999: fdatasync d3/d6/d8/d1d/d23/d25/d45/d6f/d7e/d98/fae 0 2024-09-16T00:50:25.956 INFO:tasks.workunit.client.0.smithi053.stdout:3/549: symlink d1/d5/lb1 0 2024-09-16T00:50:25.958 INFO:tasks.workunit.client.0.smithi053.stdout:3/550: truncate d1/d5/d31/f39 151068 0 2024-09-16T00:50:25.959 INFO:tasks.workunit.client.1.smithi152.stdout:8/925: dwrite dd/d25/f48 [0,4194304] 0 2024-09-16T00:50:25.960 INFO:tasks.workunit.client.0.smithi053.stdout:3/551: dread d1/d5/d31/f41 [0,4194304] 0 2024-09-16T00:50:25.961 INFO:tasks.workunit.client.0.smithi053.stdout:5/479: rename d3/d7/d2b/d2f to d3/d7/d2b/d37/d58/d9f 0 2024-09-16T00:50:25.966 INFO:tasks.workunit.client.0.smithi053.stdout:5/480: creat d3/d7/d42/d57/fa0 x:0 0 0 2024-09-16T00:50:25.967 INFO:tasks.workunit.client.0.smithi053.stdout:2/426: dwrite d6/d9/f5e [0,4194304] 0 2024-09-16T00:50:25.970 INFO:tasks.workunit.client.1.smithi152.stdout:8/926: creat dd/d98/db8/dcf/d29/dc6/f135 x:0 0 0 2024-09-16T00:50:25.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/941: dwrite dc/d10/d17/d1c/d50/fd0 [0,4194304] 0 2024-09-16T00:50:25.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/927: mknod dd/d98/db8/d10c/dbb/c136 0 2024-09-16T00:50:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:8/928: truncate dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc/f11e 152396 0 2024-09-16T00:50:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:8/929: truncate dd/d98/db8/dcf/fb2 4841462 0 2024-09-16T00:50:25.974 INFO:tasks.workunit.client.1.smithi152.stdout:3/942: mknod dc/d10/d47/c12b 0 2024-09-16T00:50:25.975 INFO:tasks.workunit.client.1.smithi152.stdout:3/943: chown dc/d10/d17/d1c/d8d/d8e/d2f/c4d 644 1 2024-09-16T00:50:25.976 INFO:tasks.workunit.client.0.smithi053.stdout:5/481: mkdir d3/d7/d24/d34/d3e/da1 0 2024-09-16T00:50:25.976 INFO:tasks.workunit.client.0.smithi053.stdout:5/482: truncate d3/d7/d2b/d37/d58/f4e 5159109 0 2024-09-16T00:50:25.976 INFO:tasks.workunit.client.0.smithi053.stdout:6/523: dwrite d1/f86 [0,4194304] 0 2024-09-16T00:50:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:8/930: truncate dd/d25/f5d 468782 0 2024-09-16T00:50:25.977 INFO:tasks.workunit.client.0.smithi053.stdout:3/552: dwrite d1/d5/f22 [0,4194304] 0 2024-09-16T00:50:25.977 INFO:tasks.workunit.client.0.smithi053.stdout:4/341: dwrite d0/da/d42/f51 [0,4194304] 0 2024-09-16T00:50:25.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/944: mkdir dc/d10/d17/d5a/db2/d6f/d74/db5/de2/d12c 0 2024-09-16T00:50:25.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/945: write dc/d10/d17/d1c/d8d/d8e/d112/f122 [868053,56090] 0 2024-09-16T00:50:25.980 INFO:tasks.workunit.client.1.smithi152.stdout:3/946: dread - dc/d10/d17/d5a/db2/d6f/d74/db5/f99 zero size 2024-09-16T00:50:25.980 INFO:tasks.workunit.client.1.smithi152.stdout:3/947: chown dc/d10/d17/d1c/d50/c62 23 1 2024-09-16T00:50:25.980 INFO:tasks.workunit.client.1.smithi152.stdout:3/948: fsync dc/d10/d17/d1c/d8d/d8e/d2f/f48 0 2024-09-16T00:50:25.981 INFO:tasks.workunit.client.1.smithi152.stdout:8/931: symlink dd/l137 0 2024-09-16T00:50:25.981 INFO:tasks.workunit.client.1.smithi152.stdout:8/932: chown dd/d25/f30 1 1 2024-09-16T00:50:25.983 INFO:tasks.workunit.client.0.smithi053.stdout:5/483: link d3/d7/d2b/l50 d3/d7/d42/la2 0 2024-09-16T00:50:25.985 INFO:tasks.workunit.client.1.smithi152.stdout:3/949: mkdir dc/d10/d17/d1c/d50/d63/d12d 0 2024-09-16T00:50:25.986 INFO:tasks.workunit.client.1.smithi152.stdout:8/933: creat dd/d98/db8/dcf/d12c/f138 x:0 0 0 2024-09-16T00:50:25.987 INFO:tasks.workunit.client.0.smithi053.stdout:6/524: unlink d1/c21 0 2024-09-16T00:50:25.987 INFO:tasks.workunit.client.0.smithi053.stdout:6/525: write d1/dc/d45/fb0 [929947,14048] 0 2024-09-16T00:50:25.987 INFO:tasks.workunit.client.0.smithi053.stdout:6/526: chown d1/d2f/l46 56351 1 2024-09-16T00:50:25.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/950: creat dc/d10/d17/d5a/db2/d6f/d74/f12e x:0 0 0 2024-09-16T00:50:25.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/934: mkdir dd/d98/db8/d139 0 2024-09-16T00:50:25.996 INFO:tasks.workunit.client.1.smithi152.stdout:8/935: rename dd/d15/cf6 to dd/d98/db8/d10c/d101/c13a 0 2024-09-16T00:50:25.998 INFO:tasks.workunit.client.0.smithi053.stdout:3/553: link d1/d5/d11/l23 d1/d89/lb2 0 2024-09-16T00:50:25.999 INFO:tasks.workunit.client.1.smithi152.stdout:3/951: dread dc/d10/d17/d5a/d68/da5/f126 [0,4194304] 0 2024-09-16T00:50:26.000 INFO:tasks.workunit.client.0.smithi053.stdout:4/342: unlink d0/d3c/l3f 0 2024-09-16T00:50:26.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/936: unlink dd/d15/d69/ld9 0 2024-09-16T00:50:26.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/937: fdatasync dd/db9/f105 0 2024-09-16T00:50:26.005 INFO:tasks.workunit.client.0.smithi053.stdout:3/554: dread d1/d5/d91/f4d [4194304,4194304] 0 2024-09-16T00:50:26.006 INFO:tasks.workunit.client.1.smithi152.stdout:3/952: link dc/d10/d17/d1c/d8d/d8e/d2f/f7b dc/d10/d17/d1c/d50/d55/d6d/f12f 0 2024-09-16T00:50:26.007 INFO:tasks.workunit.client.0.smithi053.stdout:5/484: symlink d3/d7/d2b/d37/la3 0 2024-09-16T00:50:26.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/932: truncate d4/d44/df6/d3e/f4b 3503756 0 2024-09-16T00:50:26.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/933: chown d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/fea 820419 1 2024-09-16T00:50:26.015 INFO:tasks.workunit.client.0.smithi053.stdout:4/343: mkdir d0/da/d7c 0 2024-09-16T00:50:26.017 INFO:tasks.workunit.client.1.smithi152.stdout:2/934: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/f135 x:0 0 0 2024-09-16T00:50:26.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/953: dread dc/d10/d47/f117 [0,4194304] 0 2024-09-16T00:50:26.018 INFO:tasks.workunit.client.0.smithi053.stdout:3/555: mknod d1/d5/d31/cb3 0 2024-09-16T00:50:26.019 INFO:tasks.workunit.client.0.smithi053.stdout:6/527: rmdir d1/d90 39 2024-09-16T00:50:26.019 INFO:tasks.workunit.client.0.smithi053.stdout:6/528: stat d1/dc/d39 0 2024-09-16T00:50:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:2/935: unlink d4/d44/d7a/dc7/de4/d94/d93/fcc 0 2024-09-16T00:50:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:2/936: chown d4/d44/f48 605 1 2024-09-16T00:50:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:2/937: chown d4/d44/df6 96 1 2024-09-16T00:50:26.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/938: dwrite dd/d15/f5a [4194304,4194304] 0 2024-09-16T00:50:26.023 INFO:tasks.workunit.client.1.smithi152.stdout:8/939: fsync dd/d98/db8/dcf/ff3 0 2024-09-16T00:50:26.023 INFO:tasks.workunit.client.0.smithi053.stdout:5/485: dwrite d3/d7/d2b/d37/d58/d9f/f97 [0,4194304] 0 2024-09-16T00:50:26.023 INFO:tasks.workunit.client.0.smithi053.stdout:5/486: write d3/d7/d2b/d4b/d4f/f54 [547869,125968] 0 2024-09-16T00:50:26.023 INFO:tasks.workunit.client.0.smithi053.stdout:5/487: stat d3/d7/d2b/d37/d58/d79 0 2024-09-16T00:50:26.024 INFO:tasks.workunit.client.0.smithi053.stdout:4/344: link d0/d2/c4f d0/d2/c7d 0 2024-09-16T00:50:26.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/954: rmdir dc/d10/d17/d1c/d1f/d8a 39 2024-09-16T00:50:26.030 INFO:tasks.workunit.client.1.smithi152.stdout:2/938: mknod d4/d44/d7a/c136 0 2024-09-16T00:50:26.032 INFO:tasks.workunit.client.0.smithi053.stdout:3/556: mknod d1/d4e/cb4 0 2024-09-16T00:50:26.032 INFO:tasks.workunit.client.0.smithi053.stdout:3/557: fsync d1/d5/d31/f41 0 2024-09-16T00:50:26.037 INFO:tasks.workunit.client.1.smithi152.stdout:8/940: unlink dd/ff9 0 2024-09-16T00:50:26.040 INFO:tasks.workunit.client.0.smithi053.stdout:6/529: dwrite d1/fd [0,4194304] 0 2024-09-16T00:50:26.040 INFO:tasks.workunit.client.0.smithi053.stdout:5/488: dwrite d3/f4 [0,4194304] 0 2024-09-16T00:50:26.044 INFO:tasks.workunit.client.1.smithi152.stdout:3/955: link dc/d10/d17/d5a/db2/d6f/f83 dc/d10/d17/d5a/db2/d6f/d74/db5/de2/f130 0 2024-09-16T00:50:26.048 INFO:tasks.workunit.client.1.smithi152.stdout:8/941: truncate dd/f4c 418337 0 2024-09-16T00:50:26.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/939: dwrite d4/f5e [0,4194304] 0 2024-09-16T00:50:26.051 INFO:tasks.workunit.client.0.smithi053.stdout:3/558: mkdir d1/d5/d91/d47/d4c/d50/db5 0 2024-09-16T00:50:26.056 INFO:tasks.workunit.client.1.smithi152.stdout:3/956: mknod dc/d5c/dae/df1/d108/c131 0 2024-09-16T00:50:26.060 INFO:tasks.workunit.client.1.smithi152.stdout:2/940: mkdir d4/d44/d7a/dc7/de4/d20/d28/d137 0 2024-09-16T00:50:26.062 INFO:tasks.workunit.client.0.smithi053.stdout:5/489: dwrite d3/f9 [0,4194304] 0 2024-09-16T00:50:26.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/957: rename dc/d10/d17/d5a/db2/d6f/d74/db5/de2/d12c to dc/d10/d17/d1c/d50/d55/d6d/dea/df4/d132 0 2024-09-16T00:50:26.062 INFO:tasks.workunit.client.1.smithi152.stdout:3/958: chown dc/d10/d17/d5a/db2/d6f/d74/db5/f99 27085 1 2024-09-16T00:50:26.068 INFO:tasks.workunit.client.0.smithi053.stdout:6/530: dwrite d1/f15 [0,4194304] 0 2024-09-16T00:50:26.071 INFO:tasks.workunit.client.0.smithi053.stdout:3/559: dwrite d1/d5/d11/f55 [0,4194304] 0 2024-09-16T00:50:26.071 INFO:tasks.workunit.client.0.smithi053.stdout:3/560: stat d1/d5/d91/d47/l56 0 2024-09-16T00:50:26.071 INFO:tasks.workunit.client.0.smithi053.stdout:3/561: fdatasync d1/d89/f99 0 2024-09-16T00:50:26.073 INFO:tasks.workunit.client.0.smithi053.stdout:6/531: link d1/dc/d3d/f40 d1/dc/d3c/d4b/fbc 0 2024-09-16T00:50:26.086 INFO:tasks.workunit.client.0.smithi053.stdout:3/562: dwrite d1/d5/d31/f39 [0,4194304] 0 2024-09-16T00:50:26.087 INFO:tasks.workunit.client.0.smithi053.stdout:3/563: chown d1/d89/c83 0 1 2024-09-16T00:50:26.089 INFO:tasks.workunit.client.0.smithi053.stdout:5/490: dwrite d3/d7/d24/f65 [0,4194304] 0 2024-09-16T00:50:26.092 INFO:tasks.workunit.client.0.smithi053.stdout:6/532: dwrite d1/dc/d3c/d4b/d75/fad [0,4194304] 0 2024-09-16T00:50:26.093 INFO:tasks.workunit.client.0.smithi053.stdout:3/564: symlink d1/d5/d91/d47/d64/lb6 0 2024-09-16T00:50:26.102 INFO:tasks.workunit.client.0.smithi053.stdout:5/491: unlink d3/d7/d24/d3f/c56 0 2024-09-16T00:50:26.105 INFO:tasks.workunit.client.1.smithi152.stdout:2/941: mkdir d4/d44/d7a/d9e/d124/d138 0 2024-09-16T00:50:26.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/959: creat dc/d10/d17/d1c/d8d/d8e/d2f/d75/d12a/f133 x:0 0 0 2024-09-16T00:50:26.113 INFO:tasks.workunit.client.0.smithi053.stdout:6/533: getdents d1/dc/d66 0 2024-09-16T00:50:26.113 INFO:tasks.workunit.client.0.smithi053.stdout:9/510: sync 2024-09-16T00:50:26.114 INFO:tasks.workunit.client.0.smithi053.stdout:6/534: write d1/dc/d45/fb0 [666513,115274] 0 2024-09-16T00:50:26.114 INFO:tasks.workunit.client.0.smithi053.stdout:6/535: truncate d1/dc/d39/f2c 1595980 0 2024-09-16T00:50:26.114 INFO:tasks.workunit.client.0.smithi053.stdout:6/536: fsync d1/dc/d3c/d4b/d75/fad 0 2024-09-16T00:50:26.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/942: truncate d4/d44/d7a/dc7/de4/d20/d28/f68 165107 0 2024-09-16T00:50:26.118 INFO:tasks.workunit.client.0.smithi053.stdout:3/565: rename d1/d89/f99 to d1/fb7 0 2024-09-16T00:50:26.120 INFO:tasks.workunit.client.1.smithi152.stdout:2/943: dread d4/d44/d7a/d9e/f103 [0,4194304] 0 2024-09-16T00:50:26.120 INFO:tasks.workunit.client.1.smithi152.stdout:3/960: symlink dc/d10/d17/d1c/d50/daa/dfa/d11a/l134 0 2024-09-16T00:50:26.120 INFO:tasks.workunit.client.1.smithi152.stdout:2/944: read d4/d44/d7a/d9e/f11e [141144,109537] 0 2024-09-16T00:50:26.129 INFO:tasks.workunit.client.1.smithi152.stdout:3/961: creat dc/d10/d17/d4f/d10b/f135 x:0 0 0 2024-09-16T00:50:26.129 INFO:tasks.workunit.client.0.smithi053.stdout:6/537: dwrite d1/dc/d3c/d4b/d75/f8b [0,4194304] 0 2024-09-16T00:50:26.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/945: link d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/fb0 d4/d44/d7a/d9e/d87/f139 0 2024-09-16T00:50:26.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/946: chown d4/d44/d7a/dc7/de4/d20/d34/f10c 1265381 1 2024-09-16T00:50:26.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/947: dread - d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/fb0 zero size 2024-09-16T00:50:26.139 INFO:tasks.workunit.client.1.smithi152.stdout:3/962: mkdir dc/d10/d17/d1c/dba/d136 0 2024-09-16T00:50:26.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/492: mkdir d3/d7/da4 0 2024-09-16T00:50:26.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/493: read - d3/d7/d24/d3f/f9e zero size 2024-09-16T00:50:26.143 INFO:tasks.workunit.client.0.smithi053.stdout:9/511: readlink d8/d22/d26/l36 0 2024-09-16T00:50:26.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/948: unlink d4/d44/d7a/d9e/da0/lf0 0 2024-09-16T00:50:26.147 INFO:tasks.workunit.client.0.smithi053.stdout:3/566: mkdir d1/d5/d11/da9/db8 0 2024-09-16T00:50:26.147 INFO:tasks.workunit.client.1.smithi152.stdout:3/963: dread f8 [4194304,4194304] 0 2024-09-16T00:50:26.147 INFO:tasks.workunit.client.1.smithi152.stdout:3/964: truncate dc/d10/d17/d1c/d50/d63/fc3 1898993 0 2024-09-16T00:50:26.148 INFO:tasks.workunit.client.0.smithi053.stdout:6/538: dwrite d1/dc/f32 [0,4194304] 0 2024-09-16T00:50:26.149 INFO:tasks.workunit.client.0.smithi053.stdout:6/539: read d1/dc/d1e/d65/d81/f84 [118776,112680] 0 2024-09-16T00:50:26.149 INFO:tasks.workunit.client.1.smithi152.stdout:8/942: rmdir dd 39 2024-09-16T00:50:26.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/949: getdents d4/d44/d7a/dc7 0 2024-09-16T00:50:26.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/950: dread - d4/d44/d7a/dc7/de4/d94/d8f/f11f zero size 2024-09-16T00:50:26.153 INFO:tasks.workunit.client.0.smithi053.stdout:5/494: mkdir d3/d7/d2b/d4b/d51/d53/da5 0 2024-09-16T00:50:26.155 INFO:tasks.workunit.client.0.smithi053.stdout:6/540: dread d1/dc/d45/f94 [0,4194304] 0 2024-09-16T00:50:26.155 INFO:tasks.workunit.client.1.smithi152.stdout:3/965: mknod dc/d10/d17/d1c/d50/d63/d105/c137 0 2024-09-16T00:50:26.158 INFO:tasks.workunit.client.1.smithi152.stdout:2/951: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/f13a x:0 0 0 2024-09-16T00:50:26.161 INFO:tasks.workunit.client.0.smithi053.stdout:3/567: creat d1/d5/d91/d47/fb9 x:0 0 0 2024-09-16T00:50:26.163 INFO:tasks.workunit.client.1.smithi152.stdout:3/966: creat dc/d10/d17/d1c/d50/daa/dee/f138 x:0 0 0 2024-09-16T00:50:26.163 INFO:tasks.workunit.client.1.smithi152.stdout:3/967: chown dc/d10/d17/d1c/d50/d63/d105/c137 3242 1 2024-09-16T00:50:26.167 INFO:tasks.workunit.client.0.smithi053.stdout:6/541: mknod d1/dc/d66/cbd 0 2024-09-16T00:50:26.169 INFO:tasks.workunit.client.0.smithi053.stdout:9/512: truncate d8/f1f 1930143 0 2024-09-16T00:50:26.169 INFO:tasks.workunit.client.0.smithi053.stdout:9/513: dread - d8/d13/f29 zero size 2024-09-16T00:50:26.171 INFO:tasks.workunit.client.1.smithi152.stdout:8/943: dwrite dd/d15/d49/fa0 [0,4194304] 0 2024-09-16T00:50:26.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/944: fsync dd/d15/d69/f89 0 2024-09-16T00:50:26.172 INFO:tasks.workunit.client.1.smithi152.stdout:2/952: dread d4/d44/d7a/dc7/de4/d20/d28/d2c/fc1 [0,4194304] 0 2024-09-16T00:50:26.172 INFO:tasks.workunit.client.0.smithi053.stdout:3/568: unlink d1/d5/d31/f3d 0 2024-09-16T00:50:26.173 INFO:tasks.workunit.client.0.smithi053.stdout:3/569: fsync d1/d5/f22 0 2024-09-16T00:50:26.173 INFO:tasks.workunit.client.0.smithi053.stdout:5/495: dwrite d3/d7/d2b/d37/d58/f38 [0,4194304] 0 2024-09-16T00:50:26.173 INFO:tasks.workunit.client.0.smithi053.stdout:6/542: mknod d1/dc/d54/cbe 0 2024-09-16T00:50:26.177 INFO:tasks.workunit.client.0.smithi053.stdout:3/570: rename d1/d5/l2e to d1/d5/d91/d47/lba 0 2024-09-16T00:50:26.177 INFO:tasks.workunit.client.0.smithi053.stdout:3/571: fsync d1/d5/f19 0 2024-09-16T00:50:26.177 INFO:tasks.workunit.client.1.smithi152.stdout:3/968: read dc/d10/d17/d5a/d68/da1/fc6 [463438,51171] 0 2024-09-16T00:50:26.177 INFO:tasks.workunit.client.1.smithi152.stdout:3/969: chown dc/d10/d17/d1c/d8d/d8e/d2f/c93 1197016262 1 2024-09-16T00:50:26.185 INFO:tasks.workunit.client.1.smithi152.stdout:2/953: dread d4/d44/d7a/dc7/de4/d20/d28/f2a [0,4194304] 0 2024-09-16T00:50:26.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/514: link d8/d1c/d2b/f86 d8/d4c/d5a/fa7 0 2024-09-16T00:50:26.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/515: write d8/f35 [567914,99953] 0 2024-09-16T00:50:26.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/516: write d8/d1c/d2b/f93 [383357,103139] 0 2024-09-16T00:50:26.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/517: write d8/d1c/d2b/d5c/f81 [1033642,53944] 0 2024-09-16T00:50:26.189 INFO:tasks.workunit.client.0.smithi053.stdout:9/518: fsync d8/d4c/d5b/f9c 0 2024-09-16T00:50:26.191 INFO:tasks.workunit.client.1.smithi152.stdout:8/945: dwrite dd/d98/db8/dcf/f28 [4194304,4194304] 0 2024-09-16T00:50:26.191 INFO:tasks.workunit.client.1.smithi152.stdout:8/946: getdents dd/d12b 0 2024-09-16T00:50:26.192 INFO:tasks.workunit.client.0.smithi053.stdout:5/496: write d3/d7/d2b/d37/d58/f23 [1615338,111370] 0 2024-09-16T00:50:26.192 INFO:tasks.workunit.client.0.smithi053.stdout:5/497: write d3/d7/d2b/d37/d58/d9f/f97 [4337376,28930] 0 2024-09-16T00:50:26.192 INFO:tasks.workunit.client.0.smithi053.stdout:5/498: write d3/d7/d24/d34/d3e/f70 [434414,15474] 0 2024-09-16T00:50:26.192 INFO:tasks.workunit.client.0.smithi053.stdout:5/499: chown d3/d7/d2b/d4b/d4f/c5d 5 1 2024-09-16T00:50:26.193 INFO:tasks.workunit.client.0.smithi053.stdout:6/543: dread d1/dc/d39/f13 [4194304,4194304] 0 2024-09-16T00:50:26.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/954: symlink d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/l13b 0 2024-09-16T00:50:26.196 INFO:tasks.workunit.client.0.smithi053.stdout:9/519: link d8/d4c/d5b/f9c d8/d1c/fa8 0 2024-09-16T00:50:26.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/970: dwrite dc/d10/f7a [4194304,4194304] 0 2024-09-16T00:50:26.202 INFO:tasks.workunit.client.1.smithi152.stdout:8/947: rename dd/d98/db8/d12a/l56 to dd/d15/d69/l13b 0 2024-09-16T00:50:26.204 INFO:tasks.workunit.client.1.smithi152.stdout:2/955: mkdir d4/d44/d7a/dc7/d13c 0 2024-09-16T00:50:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/948: mknod dd/d98/db8/dcf/d29/d2f/d5f/dd2/dfc/c13c 0 2024-09-16T00:50:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/949: write dd/d15/d49/fd4 [39458,35562] 0 2024-09-16T00:50:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/950: readlink dd/d23/l2c 0 2024-09-16T00:50:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/951: dread - dd/d15/d9b/fda zero size 2024-09-16T00:50:26.212 INFO:tasks.workunit.client.1.smithi152.stdout:3/971: dwrite dc/d10/d17/d1c/d8d/d8e/d2f/d75/d12a/f133 [0,4194304] 0 2024-09-16T00:50:26.214 INFO:tasks.workunit.client.0.smithi053.stdout:5/500: creat d3/fa6 x:0 0 0 2024-09-16T00:50:26.216 INFO:tasks.workunit.client.1.smithi152.stdout:2/956: link d4/d44/d7a/d9e/d87/d9c/dd9/c10d d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/c13d 0 2024-09-16T00:50:26.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/952: link dd/d98/db8/d12a/fa8 dd/d15/f13d 0 2024-09-16T00:50:26.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/953: truncate dd/d15/d69/f89 912994 0 2024-09-16T00:50:26.226 INFO:tasks.workunit.client.0.smithi053.stdout:5/501: dread d3/d7/d2b/d37/d58/f4e [0,4194304] 0 2024-09-16T00:50:26.234 INFO:tasks.workunit.client.1.smithi152.stdout:8/954: dread dd/d98/db8/dcf/d29/d2f/d53/fc0 [0,4194304] 0 2024-09-16T00:50:26.238 INFO:tasks.workunit.client.0.smithi053.stdout:6/544: dwrite d1/dc/d3c/d4b/d58/fa4 [0,4194304] 0 2024-09-16T00:50:26.238 INFO:tasks.workunit.client.0.smithi053.stdout:3/572: rename d1/d5/d91/d47/d4c/d5f to d1/d5/d31/d7a/dbb 0 2024-09-16T00:50:26.238 INFO:tasks.workunit.client.0.smithi053.stdout:3/573: stat d1/d4e/f82 0 2024-09-16T00:50:26.242 INFO:tasks.workunit.client.0.smithi053.stdout:3/574: creat d1/d5/d11/da9/fbc x:0 0 0 2024-09-16T00:50:26.245 INFO:tasks.workunit.client.0.smithi053.stdout:3/575: mknod d1/d5/d91/d47/d65/d97/cbd 0 2024-09-16T00:50:26.245 INFO:tasks.workunit.client.0.smithi053.stdout:3/576: fdatasync d1/d5/d11/f12 0 2024-09-16T00:50:26.246 INFO:tasks.workunit.client.1.smithi152.stdout:2/957: getdents d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/dc9 0 2024-09-16T00:50:26.247 INFO:tasks.workunit.client.0.smithi053.stdout:3/577: mknod d1/d5/d91/d47/cbe 0 2024-09-16T00:50:26.251 INFO:tasks.workunit.client.1.smithi152.stdout:2/958: rename d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/c13d to d4/d44/d7a/d9e/d87/d9c/c13e 0 2024-09-16T00:50:26.251 INFO:tasks.workunit.client.1.smithi152.stdout:2/959: dread - d4/d44/d7a/dc7/de4/d94/d8f/f11f zero size 2024-09-16T00:50:26.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/960: creat d4/f13f x:0 0 0 2024-09-16T00:50:26.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/961: chown d4/d44/d7a/dc7/de4/d94/d8f/f91 2159786 1 2024-09-16T00:50:26.256 INFO:tasks.workunit.client.1.smithi152.stdout:2/962: mkdir d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/d140 0 2024-09-16T00:50:26.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/963: mknod d4/d44/d7a/dc7/de4/d20/d34/daa/c141 0 2024-09-16T00:50:26.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/964: rename d4/d44/d7a/dc7/de4/d94/d93/da4/fbd to d4/d44/d7a/dc7/de4/d20/d34/daa/f142 0 2024-09-16T00:50:26.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/965: fdatasync d4/d44/d7a/d9e/d87/dd8/fe2 0 2024-09-16T00:50:26.260 INFO:tasks.workunit.client.0.smithi053.stdout:6/545: dwrite d1/dc/d45/f94 [0,4194304] 0 2024-09-16T00:50:26.260 INFO:tasks.workunit.client.0.smithi053.stdout:6/546: creat d1/dc/d3d/db1/fbf x:0 0 0 2024-09-16T00:50:26.264 INFO:tasks.workunit.client.0.smithi053.stdout:6/547: dread d1/dc/d1e/d41/f69 [4194304,4194304] 0 2024-09-16T00:50:26.264 INFO:tasks.workunit.client.0.smithi053.stdout:3/578: dwrite d1/d5/d91/d47/d65/d66/f86 [0,4194304] 0 2024-09-16T00:50:26.265 INFO:tasks.workunit.client.1.smithi152.stdout:2/966: link d4/d44/d7a/dc7/de4/d20/d28/d2c/l88 d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/l143 0 2024-09-16T00:50:26.271 INFO:tasks.workunit.client.1.smithi152.stdout:2/967: creat d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/f144 x:0 0 0 2024-09-16T00:50:26.271 INFO:tasks.workunit.client.1.smithi152.stdout:2/968: truncate d4/d44/d7a/dc7/de4/f72 4558844 0 2024-09-16T00:50:26.274 INFO:tasks.workunit.client.0.smithi053.stdout:3/579: mkdir d1/d5/d31/d7c/dbf 0 2024-09-16T00:50:26.274 INFO:tasks.workunit.client.0.smithi053.stdout:3/580: write d1/d5/d91/d5e/d90/fa8 [550307,12308] 0 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:0/579: sync 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:8/518: sync 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:1/453: sync 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:1/454: chown d5/d9/d77/c9d 25812113 1 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:8/519: truncate d10/d52/f55 1571731 0 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:1/455: write d5/d18/d1f/f35 [1247103,112968] 0 2024-09-16T00:50:26.279 INFO:tasks.workunit.client.0.smithi053.stdout:3/581: link d1/d5/d91/d5e/d69/c92 d1/d5/d31/d7a/dbb/cc0 0 2024-09-16T00:50:26.281 INFO:tasks.workunit.client.0.smithi053.stdout:3/582: write d1/d5/d31/d3b/f44 [1137483,116262] 0 2024-09-16T00:50:26.281 INFO:tasks.workunit.client.0.smithi053.stdout:3/583: write d1/d5/d91/d5e/f63 [488419,39424] 0 2024-09-16T00:50:26.283 INFO:tasks.workunit.client.0.smithi053.stdout:1/456: mknod d5/d9/d88/c9e 0 2024-09-16T00:50:26.284 INFO:tasks.workunit.client.0.smithi053.stdout:1/457: write d5/d7/f86 [410538,51760] 0 2024-09-16T00:50:26.285 INFO:tasks.workunit.client.0.smithi053.stdout:1/458: chown d5/d7/l2f 1 1 2024-09-16T00:50:26.285 INFO:tasks.workunit.client.0.smithi053.stdout:1/459: fsync d5/d9/f4b 0 2024-09-16T00:50:26.288 INFO:tasks.workunit.client.0.smithi053.stdout:3/584: creat d1/d89/d28/d5a/fc1 x:0 0 0 2024-09-16T00:50:26.298 INFO:tasks.workunit.client.0.smithi053.stdout:6/548: dwrite d1/dc/d1e/d41/f69 [4194304,4194304] 0 2024-09-16T00:50:26.300 INFO:tasks.workunit.client.0.smithi053.stdout:1/460: dread d5/dd/d7f/f93 [0,4194304] 0 2024-09-16T00:50:26.300 INFO:tasks.workunit.client.0.smithi053.stdout:1/461: fdatasync d5/d9/d4c/d61/f15 0 2024-09-16T00:50:26.300 INFO:tasks.workunit.client.0.smithi053.stdout:1/462: readlink l4 0 2024-09-16T00:50:26.302 INFO:tasks.workunit.client.0.smithi053.stdout:6/549: link d1/dc/d45/f59 d1/dc/d3c/d4b/d75/fc0 0 2024-09-16T00:50:26.302 INFO:tasks.workunit.client.0.smithi053.stdout:6/550: fdatasync d1/dc/d1e/f7a 0 2024-09-16T00:50:26.304 INFO:tasks.workunit.client.0.smithi053.stdout:5/502: dwrite d3/f2c [0,4194304] 0 2024-09-16T00:50:26.306 INFO:tasks.workunit.client.0.smithi053.stdout:1/463: link d5/d18/f79 d5/d9/d4c/f9f 0 2024-09-16T00:50:26.306 INFO:tasks.workunit.client.0.smithi053.stdout:1/464: dread - d5/f7d zero size 2024-09-16T00:50:26.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/969: link d4/d44/d7a/dc7/de4/f11a d4/d44/d7a/dc7/de4/d20/d28/d2c/f145 0 2024-09-16T00:50:26.311 INFO:tasks.workunit.client.0.smithi053.stdout:5/503: symlink d3/d7/d2b/d37/la7 0 2024-09-16T00:50:26.311 INFO:tasks.workunit.client.1.smithi152.stdout:2/970: truncate d4/d44/d7a/d9e/f7f 258243 0 2024-09-16T00:50:26.311 INFO:tasks.workunit.client.1.smithi152.stdout:2/971: fdatasync d4/d44/d7a/dc7/de4/d94/f69 0 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/504: rmdir d3/d7/d2b/d37/d58 39 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/505: chown d3/d7/d2b/d37/d58/f4c 38605202 1 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/506: chown d3/d7/d2b 3481 1 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/507: write d3/d7/d24/d34/d3e/f64 [760137,48240] 0 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/508: chown d3/d7/d24/d3f/l72 1736 1 2024-09-16T00:50:26.315 INFO:tasks.workunit.client.0.smithi053.stdout:5/509: creat d3/d7/d42/d57/fa8 x:0 0 0 2024-09-16T00:50:26.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:26 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:50:26.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:26 smithi053 ceph-mon[27950]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 205 MiB/s rd, 240 MiB/s wr, 354 op/s 2024-09-16T00:50:26.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:26 smithi053 ceph-mon[27950]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:50:26.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:26 smithi053 ceph-mon[27950]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:50:26.320 INFO:tasks.workunit.client.1.smithi152.stdout:8/955: dwrite dd/d23/f11b [0,4194304] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:8/520: dwrite d10/d1c/d92/f94 [0,4194304] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:1/465: dread d5/d9/d88/f60 [0,4194304] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:1/466: truncate d5/d7/d39/f6c 159544 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:3/585: dwrite d1/f6d [4194304,4194304] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:3/586: write d1/d89/f30 [3857123,105568] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:0/580: dwrite d4/dc/d1e/d1f/da2/fa8 [0,4194304] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:0/581: write d4/dc/d1e/d22/f29 [9353672,31498] 0 2024-09-16T00:50:26.321 INFO:tasks.workunit.client.0.smithi053.stdout:0/582: write d4/dc/d25/f4d [311802,96699] 0 2024-09-16T00:50:26.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/956: rename dd/d98/db8/dcf/d88/l9d to dd/d98/db8/d10c/l13e 0 2024-09-16T00:50:26.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/957: write dd/d98/db8/d12a/f82 [809079,87509] 0 2024-09-16T00:50:26.327 INFO:tasks.workunit.client.0.smithi053.stdout:1/467: dread d5/d9/d4c/d61/f91 [0,4194304] 0 2024-09-16T00:50:26.327 INFO:tasks.workunit.client.0.smithi053.stdout:1/468: truncate d5/d7/f66 885808 0 2024-09-16T00:50:26.327 INFO:tasks.workunit.client.0.smithi053.stdout:1/469: write d5/d9/d4c/f9f [72505,118481] 0 2024-09-16T00:50:26.327 INFO:tasks.workunit.client.0.smithi053.stdout:1/470: chown d5/d9/d4c/d61/f12 269570 1 2024-09-16T00:50:26.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/958: rename dd/d15/d69/lc7 to dd/d98/db8/dee/l13f 0 2024-09-16T00:50:26.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/959: dread - dd/d98/db8/dcf/ffa zero size 2024-09-16T00:50:26.337 INFO:tasks.workunit.client.1.smithi152.stdout:8/960: creat dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4/f140 x:0 0 0 2024-09-16T00:50:26.337 INFO:tasks.workunit.client.1.smithi152.stdout:8/961: write dd/db9/f104 [968021,52050] 0 2024-09-16T00:50:26.339 INFO:tasks.workunit.client.0.smithi053.stdout:0/583: creat d4/dc/d25/d34/d71/d96/fb2 x:0 0 0 2024-09-16T00:50:26.341 INFO:tasks.workunit.client.0.smithi053.stdout:1/471: truncate d5/d18/d33/d30/f9b 5966642 0 2024-09-16T00:50:26.341 INFO:tasks.workunit.client.0.smithi053.stdout:1/472: truncate d5/d9/d4c/d61/f9a 38081 0 2024-09-16T00:50:26.343 INFO:tasks.workunit.client.0.smithi053.stdout:0/584: dread d4/f4b [0,4194304] 0 2024-09-16T00:50:26.344 INFO:tasks.workunit.client.0.smithi053.stdout:0/585: symlink d4/dc/d1e/d1f/d40/d44/lb3 0 2024-09-16T00:50:26.344 INFO:tasks.workunit.client.0.smithi053.stdout:0/586: creat d4/d5a/fb4 x:0 0 0 2024-09-16T00:50:26.352 INFO:tasks.workunit.client.0.smithi053.stdout:1/473: dread d5/dd/d47/d58/f78 [0,4194304] 0 2024-09-16T00:50:26.355 INFO:tasks.workunit.client.0.smithi053.stdout:5/510: dwrite d3/d7/d42/d57/fa8 [0,4194304] 0 2024-09-16T00:50:26.355 INFO:tasks.workunit.client.0.smithi053.stdout:5/511: fsync d3/d7/d2b/d37/d58/f23 0 2024-09-16T00:50:26.355 INFO:tasks.workunit.client.0.smithi053.stdout:1/474: creat d5/d7/d39/d57/d82/fa0 x:0 0 0 2024-09-16T00:50:26.358 INFO:tasks.workunit.client.0.smithi053.stdout:8/521: dwrite d10/d21/d28/d3c/d63/f74 [0,4194304] 0 2024-09-16T00:50:26.361 INFO:tasks.workunit.client.0.smithi053.stdout:5/512: rename d3/d7/da4 to d3/d7/d2b/d4b/d51/d53/da9 0 2024-09-16T00:50:26.361 INFO:tasks.workunit.client.0.smithi053.stdout:1/475: mknod d5/d18/d1f/ca1 0 2024-09-16T00:50:26.362 INFO:tasks.workunit.client.0.smithi053.stdout:1/476: chown d5/d7/d39/f6c 15 1 2024-09-16T00:50:26.363 INFO:tasks.workunit.client.1.smithi152.stdout:8/962: dwrite dd/d15/d49/f6f [0,4194304] 0 2024-09-16T00:50:26.364 INFO:tasks.workunit.client.0.smithi053.stdout:3/587: dwrite d1/d89/f30 [0,4194304] 0 2024-09-16T00:50:26.365 INFO:tasks.workunit.client.0.smithi053.stdout:0/587: dwrite d4/dc/d25/d34/f7f [0,4194304] 0 2024-09-16T00:50:26.367 INFO:tasks.workunit.client.0.smithi053.stdout:1/477: dread d5/d18/d33/d8a/f96 [0,4194304] 0 2024-09-16T00:50:26.367 INFO:tasks.workunit.client.0.smithi053.stdout:1/478: stat d5/d7/d39/f4f 0 2024-09-16T00:50:26.369 INFO:tasks.workunit.client.1.smithi152.stdout:8/963: mkdir dd/d98/db8/dcf/d29/d2f/db6/d141 0 2024-09-16T00:50:26.371 INFO:tasks.workunit.client.0.smithi053.stdout:8/522: link d10/d1c/d92/f7d d10/d52/fb8 0 2024-09-16T00:50:26.373 INFO:tasks.workunit.client.0.smithi053.stdout:5/513: creat d3/d7/d2b/d71/faa x:0 0 0 2024-09-16T00:50:26.373 INFO:tasks.workunit.client.0.smithi053.stdout:5/514: fsync d3/d7/d2b/d37/d58/f23 0 2024-09-16T00:50:26.373 INFO:tasks.workunit.client.0.smithi053.stdout:5/515: chown d3/d7/d24/d34/d3e/c45 0 1 2024-09-16T00:50:26.374 INFO:tasks.workunit.client.1.smithi152.stdout:8/964: link dd/d15/d49/f51 dd/d15/d9b/f142 0 2024-09-16T00:50:26.381 INFO:tasks.workunit.client.0.smithi053.stdout:8/523: write d10/d1c/f26 [2922353,74996] 0 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/588: dwrite d4/d5a/f9e [0,4194304] 0 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/589: chown d4/d5a/d82/f9c 221 1 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/590: readlink d4/dc/d1e/d1f/d40/la5 0 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/591: truncate d4/dc/d87/fa0 215851 0 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/592: creat d4/d5a/fb5 x:0 0 0 2024-09-16T00:50:26.382 INFO:tasks.workunit.client.0.smithi053.stdout:0/593: write d4/dc/d25/d34/d71/d96/d27/fb1 [90711,107768] 0 2024-09-16T00:50:26.383 INFO:tasks.workunit.client.1.smithi152.stdout:8/965: dread dd/d98/db8/dcf/d29/d2f/f4b [0,4194304] 0 2024-09-16T00:50:26.385 INFO:tasks.workunit.client.1.smithi152.stdout:2/972: fsync d4/d44/d7a/dc7/de4/f11a 0 2024-09-16T00:50:26.386 INFO:tasks.workunit.client.0.smithi053.stdout:6/551: write d1/dc/d39/f2c [293462,129072] 0 2024-09-16T00:50:26.402 INFO:tasks.workunit.client.1.smithi152.stdout:2/973: dwrite d4/d44/d7a/dc7/de4/d20/d28/fb1 [0,4194304] 0 2024-09-16T00:50:26.402 INFO:tasks.workunit.client.1.smithi152.stdout:2/974: fsync d4/d44/d7a/dc7/fdf 0 2024-09-16T00:50:26.409 INFO:tasks.workunit.client.0.smithi053.stdout:3/588: truncate d1/d5/d11/f95 2060180 0 2024-09-16T00:50:26.409 INFO:tasks.workunit.client.0.smithi053.stdout:3/589: chown d1/d5/d91/d47/d65/d97 4 1 2024-09-16T00:50:26.409 INFO:tasks.workunit.client.0.smithi053.stdout:3/590: chown d1/d5/d11/f55 7 1 2024-09-16T00:50:26.414 INFO:tasks.workunit.client.0.smithi053.stdout:1/479: symlink d5/d18/d33/d8a/d98/la2 0 2024-09-16T00:50:26.414 INFO:tasks.workunit.client.0.smithi053.stdout:1/480: read - d5/d7/d39/d57/d82/fa0 zero size 2024-09-16T00:50:26.420 INFO:tasks.workunit.client.0.smithi053.stdout:5/516: creat d3/d7/d2b/d4b/d51/fab x:0 0 0 2024-09-16T00:50:26.421 INFO:tasks.workunit.client.0.smithi053.stdout:5/517: dread - d3/d7/d24/d34/d5b/f8b zero size 2024-09-16T00:50:26.422 INFO:tasks.workunit.client.0.smithi053.stdout:8/524: link d10/d52/fb8 d10/d1c/d49/fb9 0 2024-09-16T00:50:26.430 INFO:tasks.workunit.client.0.smithi053.stdout:0/594: mknod d4/dc/d87/cb6 0 2024-09-16T00:50:26.430 INFO:tasks.workunit.client.0.smithi053.stdout:0/595: write d4/dc/d25/f3f [2063685,118903] 0 2024-09-16T00:50:26.430 INFO:tasks.workunit.client.0.smithi053.stdout:0/596: truncate d4/dc/d1e/d22/f42 1197220 0 2024-09-16T00:50:26.430 INFO:tasks.workunit.client.0.smithi053.stdout:0/597: write d4/dc/d25/d34/f9f [4376233,1151] 0 2024-09-16T00:50:26.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/598: chown d4/d5a/d68/l7d 262542678 1 2024-09-16T00:50:26.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/599: fdatasync d4/dc/d25/f4d 0 2024-09-16T00:50:26.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/552: mkdir d1/dc/d3c/d4a/dc1 0 2024-09-16T00:50:26.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/553: readlink d1/l3 0 2024-09-16T00:50:26.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/554: chown d1/dc/d39/l1a 49566 1 2024-09-16T00:50:26.433 INFO:tasks.workunit.client.0.smithi053.stdout:6/555: write d1/dc/d39/fa8 [224917,8260] 0 2024-09-16T00:50:26.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/966: creat dd/d98/db8/d139/f143 x:0 0 0 2024-09-16T00:50:26.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/967: truncate dd/f16 5080623 0 2024-09-16T00:50:26.437 INFO:tasks.workunit.client.0.smithi053.stdout:3/591: creat d1/d5/d91/d47/d65/d66/fc2 x:0 0 0 2024-09-16T00:50:26.439 INFO:tasks.workunit.client.0.smithi053.stdout:5/518: symlink d3/d7/d2b/d4b/d51/d53/lac 0 2024-09-16T00:50:26.439 INFO:tasks.workunit.client.1.smithi152.stdout:8/968: dread dd/d23/f119 [0,4194304] 0 2024-09-16T00:50:26.439 INFO:tasks.workunit.client.1.smithi152.stdout:8/969: write dd/d23/f60 [5122975,127128] 0 2024-09-16T00:50:26.440 INFO:tasks.workunit.client.1.smithi152.stdout:8/970: chown dd/d98/db8/dcf/ff3 128192 1 2024-09-16T00:50:26.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/525: creat d10/d1c/d2b/d40/fba x:0 0 0 2024-09-16T00:50:26.442 INFO:tasks.workunit.client.1.smithi152.stdout:2/975: creat d4/d44/d7a/dc7/de4/f146 x:0 0 0 2024-09-16T00:50:26.443 INFO:tasks.workunit.client.0.smithi053.stdout:0/600: mkdir d4/dc/d25/d34/db7 0 2024-09-16T00:50:26.445 INFO:tasks.workunit.client.0.smithi053.stdout:3/592: rmdir d1/d5/d31/d7c 39 2024-09-16T00:50:26.445 INFO:tasks.workunit.client.0.smithi053.stdout:2/427: sync 2024-09-16T00:50:26.445 INFO:tasks.workunit.client.0.smithi053.stdout:7/489: sync 2024-09-16T00:50:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:26 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:50:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:26 smithi152 ceph-mon[33237]: pgmap v13: 65 pgs: 65 active+clean; 2.5 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 205 MiB/s rd, 240 MiB/s wr, 354 op/s 2024-09-16T00:50:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:26 smithi152 ceph-mon[33237]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:50:26.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:26 smithi152 ceph-mon[33237]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:50:26.449 INFO:tasks.workunit.client.0.smithi053.stdout:6/556: write d1/dc/d66/f93 [1367220,39600] 0 2024-09-16T00:50:26.449 INFO:tasks.workunit.client.0.smithi053.stdout:1/481: dwrite d5/d18/d1f/f3d [0,4194304] 0 2024-09-16T00:50:26.449 INFO:tasks.workunit.client.0.smithi053.stdout:1/482: chown d5/d5a/l92 1510539 1 2024-09-16T00:50:26.449 INFO:tasks.workunit.client.0.smithi053.stdout:1/483: fsync d5/d9/d4c/d61/f85 0 2024-09-16T00:50:26.449 INFO:tasks.workunit.client.0.smithi053.stdout:1/484: chown d5/d18/d1f 3014018 1 2024-09-16T00:50:26.450 INFO:tasks.workunit.client.1.smithi152.stdout:2/976: dread d4/d44/d7a/dc7/de4/f122 [0,4194304] 0 2024-09-16T00:50:26.450 INFO:tasks.workunit.client.0.smithi053.stdout:5/519: link d3/d7/d2b/d37/d58/d9f/f77 d3/d9c/fad 0 2024-09-16T00:50:26.450 INFO:tasks.workunit.client.0.smithi053.stdout:5/520: fdatasync d3/d7/d2b/d37/d58/f19 0 2024-09-16T00:50:26.453 INFO:tasks.workunit.client.1.smithi152.stdout:8/971: creat dd/f144 x:0 0 0 2024-09-16T00:50:26.453 INFO:tasks.workunit.client.1.smithi152.stdout:8/972: fdatasync dd/d15/d49/f6d 0 2024-09-16T00:50:26.453 INFO:tasks.workunit.client.1.smithi152.stdout:8/973: readlink dd/l1d 0 2024-09-16T00:50:26.457 INFO:tasks.workunit.client.0.smithi053.stdout:2/428: mkdir d6/d9/dd/d80 0 2024-09-16T00:50:26.459 INFO:tasks.workunit.client.1.smithi152.stdout:8/974: mkdir dd/d98/db8/dcf/d29/d2f/d5f/d112/d145 0 2024-09-16T00:50:26.459 INFO:tasks.workunit.client.1.smithi152.stdout:8/975: creat dd/d98/db8/d139/f146 x:0 0 0 2024-09-16T00:50:26.460 INFO:tasks.workunit.client.0.smithi053.stdout:8/526: dread d10/d1c/f23 [0,4194304] 0 2024-09-16T00:50:26.460 INFO:tasks.workunit.client.0.smithi053.stdout:7/490: mknod d1/d60/d70/ca3 0 2024-09-16T00:50:26.464 INFO:tasks.workunit.client.1.smithi152.stdout:8/976: rmdir dd/d98/db8/dcf/d29/d2f 39 2024-09-16T00:50:26.465 INFO:tasks.workunit.client.0.smithi053.stdout:5/521: dread d3/d7/d2b/d37/d58/f23 [0,4194304] 0 2024-09-16T00:50:26.469 INFO:tasks.workunit.client.1.smithi152.stdout:8/977: symlink dd/d98/db8/dcf/d12c/l147 0 2024-09-16T00:50:26.475 INFO:tasks.workunit.client.0.smithi053.stdout:6/557: dwrite d1/dc/d3d/f8c [0,4194304] 0 2024-09-16T00:50:26.478 INFO:tasks.workunit.client.0.smithi053.stdout:0/601: getdents d4/d5a 0 2024-09-16T00:50:26.478 INFO:tasks.workunit.client.0.smithi053.stdout:0/602: stat d4/dc/d1e/d1f/d40/d44/d49/l6e 0 2024-09-16T00:50:26.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/977: dwrite d4/d44/d7a/d9e/faf [0,4194304] 0 2024-09-16T00:50:26.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/978: write d4/d44/d7a/d9e/d87/dd8/fe2 [308846,33943] 0 2024-09-16T00:50:26.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/979: chown d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/ce8 7 1 2024-09-16T00:50:26.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/980: creat d4/d44/d7a/dc7/de4/d20/d34/daa/f147 x:0 0 0 2024-09-16T00:50:26.480 INFO:tasks.workunit.client.0.smithi053.stdout:2/429: mkdir d6/d9/d14/d81 0 2024-09-16T00:50:26.480 INFO:tasks.workunit.client.0.smithi053.stdout:2/430: write d6/f32 [4787424,1729] 0 2024-09-16T00:50:26.480 INFO:tasks.workunit.client.0.smithi053.stdout:2/431: chown d6/d9/dd/d28/c35 357971722 1 2024-09-16T00:50:26.480 INFO:tasks.workunit.client.0.smithi053.stdout:8/527: link d10/d21/d28/d3c/f7c d10/d1c/d92/d66/d9d/da6/fbb 0 2024-09-16T00:50:26.484 INFO:tasks.workunit.client.0.smithi053.stdout:7/491: unlink d1/d60/d70/f7f 0 2024-09-16T00:50:26.484 INFO:tasks.workunit.client.0.smithi053.stdout:7/492: dread - d1/d2a/f82 zero size 2024-09-16T00:50:26.485 INFO:tasks.workunit.client.0.smithi053.stdout:6/558: write d1/f86 [832129,61814] 0 2024-09-16T00:50:26.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/978: dwrite dd/d98/db8/dcf/d29/dc6/d102/fa3 [0,4194304] 0 2024-09-16T00:50:26.486 INFO:tasks.workunit.client.0.smithi053.stdout:5/522: rename d3/d7/d42/la2 to d3/d9c/lae 0 2024-09-16T00:50:26.486 INFO:tasks.workunit.client.0.smithi053.stdout:5/523: chown d3/d7/d2b 13792510 1 2024-09-16T00:50:26.487 INFO:tasks.workunit.client.0.smithi053.stdout:6/559: dread d1/dc/d3c/d4b/f91 [0,4194304] 0 2024-09-16T00:50:26.488 INFO:tasks.workunit.client.1.smithi152.stdout:2/981: symlink d4/d44/d7a/dc7/de4/d20/d28/l148 0 2024-09-16T00:50:26.488 INFO:tasks.workunit.client.1.smithi152.stdout:2/982: readlink d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/lc5 0 2024-09-16T00:50:26.492 INFO:tasks.workunit.client.0.smithi053.stdout:1/485: mknod d5/d18/ca3 0 2024-09-16T00:50:26.495 INFO:tasks.workunit.client.0.smithi053.stdout:0/603: mkdir d4/dc/d1e/d1f/d40/d44/d54/db8 0 2024-09-16T00:50:26.496 INFO:tasks.workunit.client.0.smithi053.stdout:0/604: read - d4/dc/d1e/d1f/d40/d9a/fa3 zero size 2024-09-16T00:50:26.496 INFO:tasks.workunit.client.0.smithi053.stdout:5/524: dread d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:26.496 INFO:tasks.workunit.client.0.smithi053.stdout:5/525: truncate d3/d9c/fad 4944038 0 2024-09-16T00:50:26.496 INFO:tasks.workunit.client.0.smithi053.stdout:5/526: write d3/d7/d24/d3f/f9e [526145,36890] 0 2024-09-16T00:50:26.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/979: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/d148 0 2024-09-16T00:50:26.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/980: read - dd/d15/ffd zero size 2024-09-16T00:50:26.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/981: truncate dd/d98/db8/dcf/d12c/f138 755278 0 2024-09-16T00:50:26.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/982: creat dd/d98/db8/dcf/d29/d2f/d5f/dd2/de4/f149 x:0 0 0 2024-09-16T00:50:26.498 INFO:tasks.workunit.client.1.smithi152.stdout:2/983: mknod d4/d44/df6/d10b/c149 0 2024-09-16T00:50:26.501 INFO:tasks.workunit.client.0.smithi053.stdout:0/605: dread d4/dc/d25/d34/d71/d96/f4e [0,4194304] 0 2024-09-16T00:50:26.502 INFO:tasks.workunit.client.0.smithi053.stdout:6/560: dwrite d1/dc/d3d/f9c [0,4194304] 0 2024-09-16T00:50:26.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/606: read d4/d5a/d82/f9c [5069112,23899] 0 2024-09-16T00:50:26.503 INFO:tasks.workunit.client.0.smithi053.stdout:0/607: fsync d4/dc/d1e/d1f/d40/d44/d54/f98 0 2024-09-16T00:50:26.503 INFO:tasks.workunit.client.0.smithi053.stdout:7/493: unlink d1/d3/d85/fa0 0 2024-09-16T00:50:26.503 INFO:tasks.workunit.client.0.smithi053.stdout:7/494: stat d1/d35/d4a/d74/f7e 0 2024-09-16T00:50:26.503 INFO:tasks.workunit.client.0.smithi053.stdout:7/495: write d1/d3/f5 [8574370,7633] 0 2024-09-16T00:50:26.504 INFO:tasks.workunit.client.0.smithi053.stdout:7/496: write d1/d60/d77/d50/f5d [4527653,30716] 0 2024-09-16T00:50:26.504 INFO:tasks.workunit.client.1.smithi152.stdout:3/972: sync 2024-09-16T00:50:26.504 INFO:tasks.workunit.client.1.smithi152.stdout:2/984: symlink d4/d44/d7a/d9e/d87/d9c/l14a 0 2024-09-16T00:50:26.504 INFO:tasks.workunit.client.1.smithi152.stdout:2/985: stat d4/d44/d7a/dc7/de4/d20/d28/d2c/l60 0 2024-09-16T00:50:26.507 INFO:tasks.workunit.client.0.smithi053.stdout:2/432: rename d6/d9/dd/d3e/f42 to d6/d29/d2b/f82 0 2024-09-16T00:50:26.510 INFO:tasks.workunit.client.0.smithi053.stdout:1/486: creat d5/d5a/fa4 x:0 0 0 2024-09-16T00:50:26.510 INFO:tasks.workunit.client.0.smithi053.stdout:1/487: creat d5/d7/fa5 x:0 0 0 2024-09-16T00:50:26.513 INFO:tasks.workunit.client.0.smithi053.stdout:5/527: unlink d3/d7/d2b/d37/la3 0 2024-09-16T00:50:26.515 INFO:tasks.workunit.client.0.smithi053.stdout:5/528: write d3/d7/d2b/d37/d58/f21 [646031,127820] 0 2024-09-16T00:50:26.515 INFO:tasks.workunit.client.1.smithi152.stdout:2/986: dread d4/d44/d7a/dc7/de4/f49 [0,4194304] 0 2024-09-16T00:50:26.518 INFO:tasks.workunit.client.0.smithi053.stdout:6/561: creat d1/dc/d66/fc2 x:0 0 0 2024-09-16T00:50:26.518 INFO:tasks.workunit.client.0.smithi053.stdout:6/562: write d1/dc/d3d/f55 [4206945,120906] 0 2024-09-16T00:50:26.520 INFO:tasks.workunit.client.0.smithi053.stdout:7/497: creat d1/d60/d77/d50/fa4 x:0 0 0 2024-09-16T00:50:26.524 INFO:tasks.workunit.client.0.smithi053.stdout:1/488: unlink d5/d7/d39/l49 0 2024-09-16T00:50:26.524 INFO:tasks.workunit.client.0.smithi053.stdout:1/489: write d5/d9/d4c/d61/f15 [659610,58710] 0 2024-09-16T00:50:26.528 INFO:tasks.workunit.client.0.smithi053.stdout:0/608: dwrite d4/dc/d25/d34/d71/f8c [0,4194304] 0 2024-09-16T00:50:26.528 INFO:tasks.workunit.client.0.smithi053.stdout:5/529: rename d3/d7/d2b/d37/la7 to d3/d7/d2b/d37/d58/d9f/laf 0 2024-09-16T00:50:26.528 INFO:tasks.workunit.client.0.smithi053.stdout:5/530: chown d3/d7/l15 2 1 2024-09-16T00:50:26.529 INFO:tasks.workunit.client.0.smithi053.stdout:5/531: creat d3/d7/d42/d57/fb0 x:0 0 0 2024-09-16T00:50:26.529 INFO:tasks.workunit.client.0.smithi053.stdout:5/532: stat d3/d7/d2b/d71 0 2024-09-16T00:50:26.529 INFO:tasks.workunit.client.0.smithi053.stdout:5/533: creat d3/d7/d24/d3f/fb1 x:0 0 0 2024-09-16T00:50:26.529 INFO:tasks.workunit.client.0.smithi053.stdout:5/534: fdatasync d3/d7/d2b/d4b/d4f/f54 0 2024-09-16T00:50:26.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/563: read d1/dc/d1e/d41/f69 [3116310,23706] 0 2024-09-16T00:50:26.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/564: creat d1/dc/d1e/fc3 x:0 0 0 2024-09-16T00:50:26.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/565: write d1/dc/d1e/d41/f7e [1965929,50103] 0 2024-09-16T00:50:26.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/566: chown d1/dc/d1e/d41/fae 13318111 1 2024-09-16T00:50:26.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/567: chown d1/dc/d1e/c2d 24233 1 2024-09-16T00:50:26.530 INFO:tasks.workunit.client.0.smithi053.stdout:6/568: getdents d1/dc/dba 0 2024-09-16T00:50:26.531 INFO:tasks.workunit.client.0.smithi053.stdout:7/498: write d1/d3/f3c [3793446,33067] 0 2024-09-16T00:50:26.531 INFO:tasks.workunit.client.0.smithi053.stdout:7/499: truncate d1/d60/d77/d50/f75 5096056 0 2024-09-16T00:50:26.535 INFO:tasks.workunit.client.0.smithi053.stdout:2/433: dwrite d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:26.536 INFO:tasks.workunit.client.1.smithi152.stdout:3/973: dwrite dc/d10/d17/d5a/d68/f9b [0,4194304] 0 2024-09-16T00:50:26.536 INFO:tasks.workunit.client.1.smithi152.stdout:3/974: creat dc/d10/d17/d1c/d8d/d8e/d2f/d46/dce/f139 x:0 0 0 2024-09-16T00:50:26.538 INFO:tasks.workunit.client.0.smithi053.stdout:0/609: creat d4/dc/d1e/d1f/d40/d44/d54/fb9 x:0 0 0 2024-09-16T00:50:26.538 INFO:tasks.workunit.client.0.smithi053.stdout:0/610: creat d4/dc/d1e/d22/fba x:0 0 0 2024-09-16T00:50:26.538 INFO:tasks.workunit.client.0.smithi053.stdout:0/611: write d4/dc/d25/f9d [437055,20834] 0 2024-09-16T00:50:26.543 INFO:tasks.workunit.client.1.smithi152.stdout:3/975: symlink dc/d10/d17/d1c/d1f/d24/db9/l13a 0 2024-09-16T00:50:26.543 INFO:tasks.workunit.client.1.smithi152.stdout:3/976: fdatasync dc/ff 0 2024-09-16T00:50:26.543 INFO:tasks.workunit.client.1.smithi152.stdout:3/977: readlink dc/d10/l42 0 2024-09-16T00:50:26.546 INFO:tasks.workunit.client.0.smithi053.stdout:6/569: rmdir d1/dc/d1e/d65/d81 39 2024-09-16T00:50:26.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/978: symlink dc/d10/d17/d5a/db2/d6f/d74/db5/de2/l13b 0 2024-09-16T00:50:26.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/979: fsync dc/d10/f31 0 2024-09-16T00:50:26.552 INFO:tasks.workunit.client.0.smithi053.stdout:1/490: dwrite d5/d7/f52 [0,4194304] 0 2024-09-16T00:50:26.552 INFO:tasks.workunit.client.0.smithi053.stdout:7/500: dwrite d1/d35/d14/f41 [0,4194304] 0 2024-09-16T00:50:26.552 INFO:tasks.workunit.client.1.smithi152.stdout:2/987: dwrite d4/d44/d7a/dc7/de4/d94/fb3 [4194304,4194304] 0 2024-09-16T00:50:26.553 INFO:tasks.workunit.client.0.smithi053.stdout:2/434: rename d6/d9/dd/d28/l36 to d6/d9/d74/l83 0 2024-09-16T00:50:26.553 INFO:tasks.workunit.client.0.smithi053.stdout:2/435: chown d6/d9/dd/d3e/l4d 13041 1 2024-09-16T00:50:26.559 INFO:tasks.workunit.client.0.smithi053.stdout:0/612: creat d4/d13/fbb x:0 0 0 2024-09-16T00:50:26.562 INFO:tasks.workunit.client.0.smithi053.stdout:6/570: symlink d1/dc/d3c/d4b/d75/lc4 0 2024-09-16T00:50:26.567 INFO:tasks.workunit.client.0.smithi053.stdout:7/501: unlink d1/d60/d77/f40 0 2024-09-16T00:50:26.569 INFO:tasks.workunit.client.0.smithi053.stdout:2/436: mkdir d6/d9/dd/d3e/d72/d75/d84 0 2024-09-16T00:50:26.569 INFO:tasks.workunit.client.0.smithi053.stdout:2/437: readlink d6/d9/dd/d3e/l4d 0 2024-09-16T00:50:26.569 INFO:tasks.workunit.client.0.smithi053.stdout:2/438: chown f0 324 1 2024-09-16T00:50:26.570 INFO:tasks.workunit.client.0.smithi053.stdout:0/613: creat d4/d5a/fbc x:0 0 0 2024-09-16T00:50:26.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/980: dwrite dc/d10/d17/d5a/fd7 [0,4194304] 0 2024-09-16T00:50:26.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/981: readlink dc/d10/d17/d1c/d50/daa/le9 0 2024-09-16T00:50:26.574 INFO:tasks.workunit.client.0.smithi053.stdout:7/502: rename d1/d35/l5f to d1/d35/d5b/la5 0 2024-09-16T00:50:26.576 INFO:tasks.workunit.client.0.smithi053.stdout:2/439: dread d6/f2c [0,4194304] 0 2024-09-16T00:50:26.576 INFO:tasks.workunit.client.0.smithi053.stdout:0/614: mkdir d4/dc/dbd 0 2024-09-16T00:50:26.578 INFO:tasks.workunit.client.1.smithi152.stdout:3/982: mknod dc/d10/d17/d1c/d8d/c13c 0 2024-09-16T00:50:26.578 INFO:tasks.workunit.client.1.smithi152.stdout:3/983: readlink dc/d10/d47/l123 0 2024-09-16T00:50:26.579 INFO:tasks.workunit.client.0.smithi053.stdout:6/571: getdents d1/dc/d39 0 2024-09-16T00:50:26.580 INFO:tasks.workunit.client.0.smithi053.stdout:2/440: mknod d6/d9/d14/d81/c85 0 2024-09-16T00:50:26.580 INFO:tasks.workunit.client.0.smithi053.stdout:2/441: truncate d6/f6c 690539 0 2024-09-16T00:50:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:3/984: symlink dc/d10/d17/d5a/d68/da5/l13d 0 2024-09-16T00:50:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:3/985: stat dc/d10/d17/d5a/d68/c73 0 2024-09-16T00:50:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:3/986: chown dc/d10/d17/d4f/f60 43196279 1 2024-09-16T00:50:26.584 INFO:tasks.workunit.client.0.smithi053.stdout:6/572: creat d1/d2f/fc5 x:0 0 0 2024-09-16T00:50:26.585 INFO:tasks.workunit.client.1.smithi152.stdout:3/987: creat dc/d10/d17/d5a/db2/f13e x:0 0 0 2024-09-16T00:50:26.586 INFO:tasks.workunit.client.1.smithi152.stdout:3/988: write dc/d10/d17/d5a/db2/d6f/d74/db5/f72 [119023,50744] 0 2024-09-16T00:50:26.586 INFO:tasks.workunit.client.1.smithi152.stdout:3/989: stat dc/d10/d17/d5a/db2/d6f/d74/db5/de2 0 2024-09-16T00:50:26.587 INFO:tasks.workunit.client.0.smithi053.stdout:2/442: mkdir d6/d29/d86 0 2024-09-16T00:50:26.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/535: fsync d3/d7/d42/d57/fb0 0 2024-09-16T00:50:26.589 INFO:tasks.workunit.client.0.smithi053.stdout:2/443: read d6/d29/d2b/d39/f40 [170931,87068] 0 2024-09-16T00:50:26.589 INFO:tasks.workunit.client.0.smithi053.stdout:2/444: dread - d6/d29/f70 zero size 2024-09-16T00:50:26.590 INFO:tasks.workunit.client.1.smithi152.stdout:3/990: mkdir dc/d5c/dae/df1/d13f 0 2024-09-16T00:50:26.591 INFO:tasks.workunit.client.0.smithi053.stdout:6/573: write d1/dc/f3e [826538,104604] 0 2024-09-16T00:50:26.592 INFO:tasks.workunit.client.0.smithi053.stdout:6/574: write d1/dc/d3c/d4b/fbc [365181,122514] 0 2024-09-16T00:50:26.592 INFO:tasks.workunit.client.0.smithi053.stdout:7/503: dwrite d1/f36 [0,4194304] 0 2024-09-16T00:50:26.592 INFO:tasks.workunit.client.0.smithi053.stdout:6/575: write d1/dc/d66/fc2 [108078,101907] 0 2024-09-16T00:50:26.592 INFO:tasks.workunit.client.0.smithi053.stdout:6/576: chown d1/dc/d43/c4e 10217578 1 2024-09-16T00:50:26.592 INFO:tasks.workunit.client.0.smithi053.stdout:7/504: write d1/d60/d62/f69 [737707,101973] 0 2024-09-16T00:50:26.593 INFO:tasks.workunit.client.0.smithi053.stdout:7/505: truncate d1/d2a/f90 693491 0 2024-09-16T00:50:26.594 INFO:tasks.workunit.client.0.smithi053.stdout:2/445: stat d6/d9/c2d 0 2024-09-16T00:50:26.596 INFO:tasks.workunit.client.1.smithi152.stdout:3/991: mknod dc/d10/d17/d4f/d10b/c140 0 2024-09-16T00:50:26.599 INFO:tasks.workunit.client.0.smithi053.stdout:7/506: mknod d1/d2a/d4f/ca6 0 2024-09-16T00:50:26.599 INFO:tasks.workunit.client.0.smithi053.stdout:7/507: read d1/d60/d77/f6a [464570,54279] 0 2024-09-16T00:50:26.600 INFO:tasks.workunit.client.0.smithi053.stdout:5/536: dwrite d3/fa6 [0,4194304] 0 2024-09-16T00:50:26.600 INFO:tasks.workunit.client.1.smithi152.stdout:3/992: symlink dc/d10/d17/d1c/dba/d136/l141 0 2024-09-16T00:50:26.601 INFO:tasks.workunit.client.1.smithi152.stdout:3/993: fdatasync dc/d10/d47/f117 0 2024-09-16T00:50:26.601 INFO:tasks.workunit.client.0.smithi053.stdout:6/577: dread d1/dc/d39/f23 [0,4194304] 0 2024-09-16T00:50:26.601 INFO:tasks.workunit.client.0.smithi053.stdout:6/578: read - d1/dc/f95 zero size 2024-09-16T00:50:26.601 INFO:tasks.workunit.client.0.smithi053.stdout:6/579: chown d1/dc/dba 11319 1 2024-09-16T00:50:26.602 INFO:tasks.workunit.client.0.smithi053.stdout:0/615: rename d4/dc/d25/d34/d71/d96/d27 to d4/dc/d1e/d1f/d40/d44/d49/dbe 0 2024-09-16T00:50:26.602 INFO:tasks.workunit.client.0.smithi053.stdout:2/446: mkdir d6/d9/dd/d3e/d52/d7e/d87 0 2024-09-16T00:50:26.605 INFO:tasks.workunit.client.0.smithi053.stdout:7/508: mkdir d1/d35/d14/da7 0 2024-09-16T00:50:26.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/994: mknod dc/d10/d17/d1c/d8d/d8e/d2f/c142 0 2024-09-16T00:50:26.609 INFO:tasks.workunit.client.1.smithi152.stdout:3/995: mknod dc/d10/d17/d4f/d10b/c143 0 2024-09-16T00:50:26.609 INFO:tasks.workunit.client.0.smithi053.stdout:5/537: truncate d3/d7/d2b/d4b/d4f/f54 471670 0 2024-09-16T00:50:26.610 INFO:tasks.workunit.client.0.smithi053.stdout:1/491: truncate d5/d18/d1f/f3d 1243967 0 2024-09-16T00:50:26.613 INFO:tasks.workunit.client.0.smithi053.stdout:7/509: dread d1/d2a/d4f/d52/f37 [0,4194304] 0 2024-09-16T00:50:26.613 INFO:tasks.workunit.client.0.smithi053.stdout:6/580: unlink d1/dc/d1e/l9e 0 2024-09-16T00:50:26.614 INFO:tasks.workunit.client.1.smithi152.stdout:3/996: rmdir dc/d10/d17/d1c/d8d 39 2024-09-16T00:50:26.617 INFO:tasks.workunit.client.0.smithi053.stdout:0/616: mkdir d4/dc/d87/dbf 0 2024-09-16T00:50:26.619 INFO:tasks.workunit.client.0.smithi053.stdout:1/492: symlink d5/d9/d4c/la6 0 2024-09-16T00:50:26.620 INFO:tasks.workunit.client.1.smithi152.stdout:3/997: mkdir dc/d10/d17/d1c/d50/daa/dfa/d11e/d144 0 2024-09-16T00:50:26.622 INFO:tasks.workunit.client.0.smithi053.stdout:6/581: mkdir d1/dc/d1e/d65/dc6 0 2024-09-16T00:50:26.622 INFO:tasks.workunit.client.0.smithi053.stdout:6/582: creat d1/dc/d45/fc7 x:0 0 0 2024-09-16T00:50:26.622 INFO:tasks.workunit.client.0.smithi053.stdout:6/583: fdatasync d1/dc/d45/fb0 0 2024-09-16T00:50:26.622 INFO:tasks.workunit.client.0.smithi053.stdout:6/584: dread - d1/dc/d1e/d41/fae zero size 2024-09-16T00:50:26.622 INFO:tasks.workunit.client.0.smithi053.stdout:6/585: fsync d1/dc/d39/f23 0 2024-09-16T00:50:26.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/998: creat dc/d10/d17/d1c/d1f/d8a/f145 x:0 0 0 2024-09-16T00:50:26.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/999: rename dc/d10/d17/d5a/db2/d6f/dbb/ce1 to dc/d10/d17/d1c/d1f/c146 0 2024-09-16T00:50:26.634 INFO:tasks.workunit.client.0.smithi053.stdout:0/617: rename d4/d5a/d68 to d4/dc/dc0 0 2024-09-16T00:50:26.635 INFO:tasks.workunit.client.0.smithi053.stdout:6/586: rename d1/dc to d1/dc/d3c/d4b/d58/db9/dc8 22 2024-09-16T00:50:26.635 INFO:tasks.workunit.client.0.smithi053.stdout:6/587: write d1/dc/d39/f23 [3758623,1639] 0 2024-09-16T00:50:26.635 INFO:tasks.workunit.client.0.smithi053.stdout:0/618: creat d4/dc/d1e/d1f/d40/d44/d54/db8/fc1 x:0 0 0 2024-09-16T00:50:26.636 INFO:tasks.workunit.client.0.smithi053.stdout:6/588: symlink d1/d2f/d9b/lc9 0 2024-09-16T00:50:26.637 INFO:tasks.workunit.client.0.smithi053.stdout:6/589: fsync d1/dc/d39/fa8 0 2024-09-16T00:50:26.637 INFO:tasks.workunit.client.0.smithi053.stdout:6/590: getdents d1/dc/d1e/d65/dc6 0 2024-09-16T00:50:26.638 INFO:tasks.workunit.client.0.smithi053.stdout:0/619: mkdir d4/dc/d1e/d1f/d40/d44/d49/dc2 0 2024-09-16T00:50:26.640 INFO:tasks.workunit.client.0.smithi053.stdout:7/510: dwrite d1/d35/d4a/f5e [0,4194304] 0 2024-09-16T00:50:26.640 INFO:tasks.workunit.client.0.smithi053.stdout:7/511: stat d1/d60/d70/ca3 0 2024-09-16T00:50:26.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/988: dwrite d4/d44/d7a/dc7/de4/d20/d34/fe0 [0,4194304] 0 2024-09-16T00:50:26.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/989: truncate d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/fd1 1256708 0 2024-09-16T00:50:26.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/990: write d4/d44/d7a/dc7/de4/d20/d34/daa/ff5 [558774,130624] 0 2024-09-16T00:50:26.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/991: dread - d4/d44/d7a/dc7/de4/d20/d34/daa/f147 zero size 2024-09-16T00:50:26.642 INFO:tasks.workunit.client.0.smithi053.stdout:0/620: link d4/dc/d1e/d1f/d40/d73/f8e d4/dc/d1e/d1f/d40/d44/d49/fc3 0 2024-09-16T00:50:26.642 INFO:tasks.workunit.client.0.smithi053.stdout:2/447: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:26.642 INFO:tasks.workunit.client.0.smithi053.stdout:1/493: dread d5/dd/f31 [0,4194304] 0 2024-09-16T00:50:26.642 INFO:tasks.workunit.client.0.smithi053.stdout:2/448: fsync d6/d9/dd/f6d 0 2024-09-16T00:50:26.642 INFO:tasks.workunit.client.0.smithi053.stdout:2/449: write d6/f73 [872412,128153] 0 2024-09-16T00:50:26.643 INFO:tasks.workunit.client.0.smithi053.stdout:6/591: dread d1/dc/d3c/d4b/d58/fa4 [0,4194304] 0 2024-09-16T00:50:26.644 INFO:tasks.workunit.client.0.smithi053.stdout:6/592: write d1/f57 [2721792,95402] 0 2024-09-16T00:50:26.644 INFO:tasks.workunit.client.0.smithi053.stdout:6/593: read - d1/dc/d3d/db1/fbf zero size 2024-09-16T00:50:26.647 INFO:tasks.workunit.client.0.smithi053.stdout:2/450: read f0 [779711,68774] 0 2024-09-16T00:50:26.647 INFO:tasks.workunit.client.0.smithi053.stdout:7/512: truncate d1/d35/d4a/d74/f7e 3961562 0 2024-09-16T00:50:26.648 INFO:tasks.workunit.client.0.smithi053.stdout:7/513: read d1/f3a [382261,75152] 0 2024-09-16T00:50:26.649 INFO:tasks.workunit.client.0.smithi053.stdout:0/621: truncate d4/dc/d25/d34/f5e 1132468 0 2024-09-16T00:50:26.653 INFO:tasks.workunit.client.0.smithi053.stdout:1/494: symlink d5/d7/d39/d57/la7 0 2024-09-16T00:50:26.653 INFO:tasks.workunit.client.0.smithi053.stdout:1/495: read - d5/d18/d1f/f8f zero size 2024-09-16T00:50:26.655 INFO:tasks.workunit.client.1.smithi152.stdout:2/992: creat d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/db7/f14b x:0 0 0 2024-09-16T00:50:26.655 INFO:tasks.workunit.client.1.smithi152.stdout:2/993: chown d4/d44/d7a/dc7/de4/d20/d28/d8b/c10f 4 1 2024-09-16T00:50:26.655 INFO:tasks.workunit.client.1.smithi152.stdout:2/994: creat d4/d44/d7a/dc7/de4/d20/d28/d2c/de6/f14c x:0 0 0 2024-09-16T00:50:26.656 INFO:tasks.workunit.client.0.smithi053.stdout:5/538: write d3/d7/d2b/d4b/d4f/f54 [1127265,85169] 0 2024-09-16T00:50:26.656 INFO:tasks.workunit.client.0.smithi053.stdout:5/539: fdatasync d3/d7/d24/d34/f39 0 2024-09-16T00:50:26.657 INFO:tasks.workunit.client.0.smithi053.stdout:2/451: rename d6/d29/d2b/f5c to d6/d9/dd/d76/f88 0 2024-09-16T00:50:26.660 INFO:tasks.workunit.client.0.smithi053.stdout:0/622: creat d4/dc/dbd/fc4 x:0 0 0 2024-09-16T00:50:26.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/345: sync 2024-09-16T00:50:26.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/520: sync 2024-09-16T00:50:26.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/521: write d8/d1c/f33 [1118660,18076] 0 2024-09-16T00:50:26.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/346: write d0/d31/f43 [686808,58346] 0 2024-09-16T00:50:26.662 INFO:tasks.workunit.client.1.smithi152.stdout:2/995: symlink d4/d44/l14d 0 2024-09-16T00:50:26.665 INFO:tasks.workunit.client.0.smithi053.stdout:6/594: link d1/dc/d1e/f7a d1/fca 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/514: dwrite d1/d2a/f99 [0,4194304] 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/515: truncate d1/d2a/d4f/f9f 3702895 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/516: read d1/d2a/d4f/d52/f26 [280604,121874] 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/517: chown d1/d60/d70/d92/da1 439932 1 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:2/452: dread d6/d9/f12 [0,4194304] 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:2/453: fsync d6/d9/dd/d3e/f7d 0 2024-09-16T00:50:26.667 INFO:tasks.workunit.client.0.smithi053.stdout:2/454: chown d6/d9/f56 14423 1 2024-09-16T00:50:26.668 INFO:tasks.workunit.client.0.smithi053.stdout:1/496: dread d5/d9/d4c/d61/f12 [0,4194304] 0 2024-09-16T00:50:26.668 INFO:tasks.workunit.client.0.smithi053.stdout:1/497: dread - d5/dd/d7f/f97 zero size 2024-09-16T00:50:26.668 INFO:tasks.workunit.client.0.smithi053.stdout:1/498: fdatasync d5/dd/f31 0 2024-09-16T00:50:26.671 INFO:tasks.workunit.client.0.smithi053.stdout:0/623: mkdir d4/dc/d1e/d22/dc5 0 2024-09-16T00:50:26.675 INFO:tasks.workunit.client.0.smithi053.stdout:9/522: symlink d8/d22/la9 0 2024-09-16T00:50:26.675 INFO:tasks.workunit.client.0.smithi053.stdout:9/523: creat d8/d19/d51/faa x:0 0 0 2024-09-16T00:50:26.675 INFO:tasks.workunit.client.0.smithi053.stdout:9/524: write d8/d1c/d2b/d5c/f94 [515009,31866] 0 2024-09-16T00:50:26.684 INFO:tasks.workunit.client.0.smithi053.stdout:4/347: dwrite d0/d2/dd/f6e [0,4194304] 0 2024-09-16T00:50:26.684 INFO:tasks.workunit.client.1.smithi152.stdout:2/996: dwrite d4/d44/d7a/dc7/de4/d20/d28/f68 [0,4194304] 0 2024-09-16T00:50:26.685 INFO:tasks.workunit.client.0.smithi053.stdout:7/518: unlink d1/d35/d14/d15/l47 0 2024-09-16T00:50:26.686 INFO:tasks.workunit.client.0.smithi053.stdout:0/624: read d4/dc/d25/d34/d71/f8c [3332929,5684] 0 2024-09-16T00:50:26.686 INFO:tasks.workunit.client.0.smithi053.stdout:0/625: write d4/dc/d87/fa0 [188769,92452] 0 2024-09-16T00:50:26.686 INFO:tasks.workunit.client.0.smithi053.stdout:0/626: dread - d4/fa6 zero size 2024-09-16T00:50:26.687 INFO:tasks.workunit.client.0.smithi053.stdout:2/455: unlink d6/d9/c51 0 2024-09-16T00:50:26.687 INFO:tasks.workunit.client.0.smithi053.stdout:2/456: fdatasync d6/d9/dd/d3e/d52/d65/f7f 0 2024-09-16T00:50:26.689 INFO:tasks.workunit.client.0.smithi053.stdout:1/499: mkdir d5/d9/d77/da8 0 2024-09-16T00:50:26.691 INFO:tasks.workunit.client.1.smithi152.stdout:8/983: sync 2024-09-16T00:50:26.691 INFO:tasks.workunit.client.1.smithi152.stdout:8/984: stat dd/d15/d49/c11 0 2024-09-16T00:50:26.692 INFO:tasks.workunit.client.0.smithi053.stdout:5/540: rename d3/l18 to d3/d7/d42/d57/lb2 0 2024-09-16T00:50:26.693 INFO:tasks.workunit.client.0.smithi053.stdout:7/519: dread d1/d35/f1e [0,4194304] 0 2024-09-16T00:50:26.696 INFO:tasks.workunit.client.1.smithi152.stdout:2/997: link d4/d44/df6/f1d d4/f14e 0 2024-09-16T00:50:26.699 INFO:tasks.workunit.client.1.smithi152.stdout:8/985: symlink dd/d98/db8/dcf/l14a 0 2024-09-16T00:50:26.705 INFO:tasks.workunit.client.1.smithi152.stdout:2/998: rename d4/d44/d7a/dc7/de4/d20/d28/d8b/da9/l10e to d4/d44/d7a/dc7/de4/d20/d28/d2c/d77/da7/db8/l14f 0 2024-09-16T00:50:26.707 INFO:tasks.workunit.client.0.smithi053.stdout:7/520: dwrite d1/d2a/d4f/d52/f26 [0,4194304] 0 2024-09-16T00:50:26.710 INFO:tasks.workunit.client.0.smithi053.stdout:7/521: dread d1/d60/d70/f78 [0,4194304] 0 2024-09-16T00:50:26.710 INFO:tasks.workunit.client.0.smithi053.stdout:7/522: chown d1/ca2 39314 1 2024-09-16T00:50:26.710 INFO:tasks.workunit.client.0.smithi053.stdout:7/523: dread - d1/d2a/f82 zero size 2024-09-16T00:50:26.710 INFO:tasks.workunit.client.0.smithi053.stdout:7/524: fdatasync d1/d35/d4a/d74/f7e 0 2024-09-16T00:50:26.710 INFO:tasks.workunit.client.0.smithi053.stdout:7/525: chown d1/d35/d14/d80 43882 1 2024-09-16T00:50:26.713 INFO:tasks.workunit.client.1.smithi152.stdout:2/999: write d4/d44/d7a/d9e/f103 [2246420,21844] 0 2024-09-16T00:50:26.718 INFO:tasks.workunit.client.0.smithi053.stdout:2/457: symlink d6/d29/d86/l89 0 2024-09-16T00:50:26.718 INFO:tasks.workunit.client.0.smithi053.stdout:7/526: dread d1/d35/d5b/f72 [0,4194304] 0 2024-09-16T00:50:26.718 INFO:tasks.workunit.client.0.smithi053.stdout:7/527: fsync d1/d2a/f82 0 2024-09-16T00:50:26.719 INFO:tasks.workunit.client.1.smithi152.stdout:8/986: dwrite dd/d15/d9b/f11a [0,4194304] 0 2024-09-16T00:50:26.721 INFO:tasks.workunit.client.0.smithi053.stdout:5/541: link d3/d7/lc d3/d7/d2b/d37/d58/d79/lb3 0 2024-09-16T00:50:26.725 INFO:tasks.workunit.client.0.smithi053.stdout:6/595: rename d1/dc/d3c/d4b/d58/ca9 to d1/dc/d3c/d4b/ccb 0 2024-09-16T00:50:26.729 INFO:tasks.workunit.client.0.smithi053.stdout:5/542: unlink d3/d7/d2b/l8e 0 2024-09-16T00:50:26.733 INFO:tasks.workunit.client.1.smithi152.stdout:8/987: unlink dd/d98/db8/dcf/d29/d2f/d5f/dd2/cdc 0 2024-09-16T00:50:26.734 INFO:tasks.workunit.client.1.smithi152.stdout:8/988: write dd/d98/db8/d139/f146 [591795,61700] 0 2024-09-16T00:50:26.734 INFO:tasks.workunit.client.0.smithi053.stdout:2/458: rmdir d6/d9/dd/d3e/d72 39 2024-09-16T00:50:26.737 INFO:tasks.workunit.client.0.smithi053.stdout:0/627: rename d4/dc/d1e/d1f/d40/d44/d49 to d4/dc/d87/dc6 0 2024-09-16T00:50:26.738 INFO:tasks.workunit.client.0.smithi053.stdout:2/459: link d6/d9/d14/f37 d6/d9/dd/d3e/d72/d75/d84/f8a 0 2024-09-16T00:50:26.738 INFO:tasks.workunit.client.0.smithi053.stdout:5/543: dread d3/f4 [0,4194304] 0 2024-09-16T00:50:26.739 INFO:tasks.workunit.client.0.smithi053.stdout:1/500: rename d5/d9/d88/c70 to d5/d9/d73/ca9 0 2024-09-16T00:50:26.741 INFO:tasks.workunit.client.0.smithi053.stdout:7/528: dwrite d1/d35/d5b/f8f [0,4194304] 0 2024-09-16T00:50:26.741 INFO:tasks.workunit.client.0.smithi053.stdout:6/596: dwrite d1/f57 [0,4194304] 0 2024-09-16T00:50:26.742 INFO:tasks.workunit.client.0.smithi053.stdout:2/460: symlink d6/d9/dd/d3e/d52/d7e/l8b 0 2024-09-16T00:50:26.744 INFO:tasks.workunit.client.0.smithi053.stdout:5/544: stat d3/d7/d2b/d37/d58/d79/lb3 0 2024-09-16T00:50:26.744 INFO:tasks.workunit.client.0.smithi053.stdout:5/545: stat d3/d7/d2b/d37/d58/d79/f9a 0 2024-09-16T00:50:26.745 INFO:tasks.workunit.client.0.smithi053.stdout:0/628: rmdir d4/d5a 39 2024-09-16T00:50:26.747 INFO:tasks.workunit.client.1.smithi152.stdout:8/989: dread dd/d23/fa6 [0,4194304] 0 2024-09-16T00:50:26.747 INFO:tasks.workunit.client.1.smithi152.stdout:8/990: write dd/d98/db8/dcf/ffa [974650,106410] 0 2024-09-16T00:50:26.749 INFO:tasks.workunit.client.0.smithi053.stdout:7/529: creat d1/d60/fa8 x:0 0 0 2024-09-16T00:50:26.750 INFO:tasks.workunit.client.1.smithi152.stdout:8/991: truncate dd/d23/f11b 2954098 0 2024-09-16T00:50:26.753 INFO:tasks.workunit.client.0.smithi053.stdout:6/597: rename d1/d2f/d9b/lc9 to d1/dc/d39/lcc 0 2024-09-16T00:50:26.754 INFO:tasks.workunit.client.0.smithi053.stdout:2/461: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:26.754 INFO:tasks.workunit.client.0.smithi053.stdout:5/546: mknod d3/d7/d2b/d37/d58/d79/cb4 0 2024-09-16T00:50:26.755 INFO:tasks.workunit.client.0.smithi053.stdout:5/547: dread - d3/d7/d2b/d37/d58/f82 zero size 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/501: link d5/d9/d4c/la6 d5/d18/laa 0 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/502: chown d5/d18/f7c 801 1 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/503: stat d5/d7/d39 0 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/504: chown d5/d7/d39/d57/d82/c7a 68 1 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/505: stat d5/dd/d47/l74 0 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/506: creat d5/d9/d73/fab x:0 0 0 2024-09-16T00:50:26.756 INFO:tasks.workunit.client.0.smithi053.stdout:1/507: readlink l4 0 2024-09-16T00:50:26.757 INFO:tasks.workunit.client.0.smithi053.stdout:0/629: getdents d4/dc/d1e/d1f/d40/d73 0 2024-09-16T00:50:26.758 INFO:tasks.workunit.client.0.smithi053.stdout:7/530: mkdir d1/d60/d77/da9 0 2024-09-16T00:50:26.761 INFO:tasks.workunit.client.0.smithi053.stdout:6/598: link d1/dc/d3d/l8e d1/dc/d3d/db1/lcd 0 2024-09-16T00:50:26.762 INFO:tasks.workunit.client.0.smithi053.stdout:6/599: write d1/f86 [5217563,24935] 0 2024-09-16T00:50:26.762 INFO:tasks.workunit.client.0.smithi053.stdout:6/600: readlink d1/d2f/l36 0 2024-09-16T00:50:26.762 INFO:tasks.workunit.client.0.smithi053.stdout:6/601: chown d1/dc/d39/c4c 291 1 2024-09-16T00:50:26.764 INFO:tasks.workunit.client.0.smithi053.stdout:2/462: link d6/d9/f1e d6/d9/dd/d28/f8c 0 2024-09-16T00:50:26.765 INFO:tasks.workunit.client.0.smithi053.stdout:6/602: dread d1/d2f/f33 [0,4194304] 0 2024-09-16T00:50:26.765 INFO:tasks.workunit.client.0.smithi053.stdout:5/548: creat d3/fb5 x:0 0 0 2024-09-16T00:50:26.768 INFO:tasks.workunit.client.0.smithi053.stdout:0/630: unlink d4/dc/d87/dc6/fc3 0 2024-09-16T00:50:26.768 INFO:tasks.workunit.client.0.smithi053.stdout:0/631: chown d4/dc/d1e/d1f/c55 685679259 1 2024-09-16T00:50:26.770 INFO:tasks.workunit.client.0.smithi053.stdout:7/531: rename d1/d35/d14/d15/c17 to d1/d35/d4a/caa 0 2024-09-16T00:50:26.770 INFO:tasks.workunit.client.0.smithi053.stdout:7/532: fsync d1/d60/d77/d50/f7c 0 2024-09-16T00:50:26.772 INFO:tasks.workunit.client.0.smithi053.stdout:2/463: link f0 d6/d29/d2b/f8d 0 2024-09-16T00:50:26.775 INFO:tasks.workunit.client.0.smithi053.stdout:6/603: symlink d1/d2f/d9b/lce 0 2024-09-16T00:50:26.775 INFO:tasks.workunit.client.0.smithi053.stdout:6/604: write d1/dc/d3c/d4b/d58/fa4 [4944869,110625] 0 2024-09-16T00:50:26.775 INFO:tasks.workunit.client.0.smithi053.stdout:6/605: chown d1/d2f 6 1 2024-09-16T00:50:26.775 INFO:tasks.workunit.client.0.smithi053.stdout:6/606: creat d1/dc/d45/fcf x:0 0 0 2024-09-16T00:50:26.775 INFO:tasks.workunit.client.1.smithi152.stdout:8/992: dwrite dd/d15/f4d [0,4194304] 0 2024-09-16T00:50:26.776 INFO:tasks.workunit.client.0.smithi053.stdout:1/508: dwrite d5/d5a/fa4 [0,4194304] 0 2024-09-16T00:50:26.777 INFO:tasks.workunit.client.0.smithi053.stdout:7/533: stat d1/d2a/d4f/d52/l44 0 2024-09-16T00:50:26.802 INFO:tasks.workunit.client.0.smithi053.stdout:1/509: dwrite f2 [4194304,4194304] 0 2024-09-16T00:50:26.802 INFO:tasks.workunit.client.0.smithi053.stdout:0/632: dwrite d4/d13/f4f [4194304,4194304] 0 2024-09-16T00:50:26.802 INFO:tasks.workunit.client.1.smithi152.stdout:8/993: dwrite dd/d98/db8/dcf/d29/d2f/f4b [0,4194304] 0 2024-09-16T00:50:26.814 INFO:tasks.workunit.client.0.smithi053.stdout:0/633: dread d4/d5a/d82/f93 [0,4194304] 0 2024-09-16T00:50:26.815 INFO:tasks.workunit.client.0.smithi053.stdout:6/607: mkdir d1/d2f/d9b/dd0 0 2024-09-16T00:50:26.817 INFO:tasks.workunit.client.0.smithi053.stdout:5/549: link d3/d7/f1f d3/fb6 0 2024-09-16T00:50:26.817 INFO:tasks.workunit.client.0.smithi053.stdout:5/550: creat d3/d7/d24/d34/d3e/fb7 x:0 0 0 2024-09-16T00:50:26.817 INFO:tasks.workunit.client.0.smithi053.stdout:5/551: fsync d3/f2d 0 2024-09-16T00:50:26.822 INFO:tasks.workunit.client.0.smithi053.stdout:6/608: dread d1/dc/d39/f13 [4194304,4194304] 0 2024-09-16T00:50:26.822 INFO:tasks.workunit.client.0.smithi053.stdout:6/609: write d1/dc/d3d/db1/fbb [511942,129909] 0 2024-09-16T00:50:26.826 INFO:tasks.workunit.client.0.smithi053.stdout:2/464: getdents d6/d9 0 2024-09-16T00:50:26.828 INFO:tasks.workunit.client.0.smithi053.stdout:1/510: mknod d5/d7/d39/d57/cac 0 2024-09-16T00:50:26.829 INFO:tasks.workunit.client.0.smithi053.stdout:0/634: mknod d4/dc/d1e/d22/dc5/cc7 0 2024-09-16T00:50:26.829 INFO:tasks.workunit.client.0.smithi053.stdout:0/635: chown d4/dc 135 1 2024-09-16T00:50:26.829 INFO:tasks.workunit.client.0.smithi053.stdout:0/636: truncate d4/dc/d1e/d22/f42 2212003 0 2024-09-16T00:50:26.829 INFO:tasks.workunit.client.0.smithi053.stdout:0/637: chown d4/dc/d25/d34/d71/d96/f67 5320704 1 2024-09-16T00:50:26.831 INFO:tasks.workunit.client.0.smithi053.stdout:5/552: mknod d3/d9c/cb8 0 2024-09-16T00:50:26.831 INFO:tasks.workunit.client.0.smithi053.stdout:5/553: stat d3/d7/d2b/d37/d58/d79/f94 0 2024-09-16T00:50:26.841 INFO:tasks.workunit.client.0.smithi053.stdout:6/610: mkdir d1/dc/d54/dd1 0 2024-09-16T00:50:26.842 INFO:tasks.workunit.client.0.smithi053.stdout:5/554: dread d3/f6 [0,4194304] 0 2024-09-16T00:50:26.843 INFO:tasks.workunit.client.0.smithi053.stdout:2/465: creat d6/d9/dd/d76/f8e x:0 0 0 2024-09-16T00:50:26.844 INFO:tasks.workunit.client.0.smithi053.stdout:1/511: creat d5/d18/d33/fad x:0 0 0 2024-09-16T00:50:26.847 INFO:tasks.workunit.client.0.smithi053.stdout:7/534: write d1/d60/d77/d50/f75 [3678416,33664] 0 2024-09-16T00:50:26.848 INFO:tasks.workunit.client.0.smithi053.stdout:0/638: dwrite d4/f69 [0,4194304] 0 2024-09-16T00:50:26.848 INFO:tasks.workunit.client.0.smithi053.stdout:0/639: chown d4/dc/d87/cb6 4 1 2024-09-16T00:50:26.848 INFO:tasks.workunit.client.0.smithi053.stdout:0/640: chown d4/d13 1089 1 2024-09-16T00:50:26.848 INFO:tasks.workunit.client.0.smithi053.stdout:0/641: fsync d4/dc/d25/d34/f7f 0 2024-09-16T00:50:26.848 INFO:tasks.workunit.client.0.smithi053.stdout:6/611: rename d1/l44 to d1/dc/d45/ld2 0 2024-09-16T00:50:26.854 INFO:tasks.workunit.client.0.smithi053.stdout:5/555: symlink d3/d7/d2b/d37/d58/d9f/lb9 0 2024-09-16T00:50:26.857 INFO:tasks.workunit.client.0.smithi053.stdout:0/642: symlink d4/dc/d1e/d1f/d40/d44/lc8 0 2024-09-16T00:50:26.859 INFO:tasks.workunit.client.0.smithi053.stdout:7/535: dread d1/d35/d4a/f4c [0,4194304] 0 2024-09-16T00:50:26.859 INFO:tasks.workunit.client.0.smithi053.stdout:7/536: creat d1/d3/d85/fab x:0 0 0 2024-09-16T00:50:26.859 INFO:tasks.workunit.client.0.smithi053.stdout:6/612: creat d1/dc/d1e/d65/dc6/fd3 x:0 0 0 2024-09-16T00:50:26.859 INFO:tasks.workunit.client.0.smithi053.stdout:6/613: chown d1/dc/d1e/d65/d81/f84 71978362 1 2024-09-16T00:50:26.859 INFO:tasks.workunit.client.0.smithi053.stdout:6/614: getdents d1/da6 0 2024-09-16T00:50:26.860 INFO:tasks.workunit.client.0.smithi053.stdout:5/556: creat d3/d7/d2b/d4b/fba x:0 0 0 2024-09-16T00:50:26.860 INFO:tasks.workunit.client.0.smithi053.stdout:5/557: write d3/d7/d42/d57/f61 [4259284,92099] 0 2024-09-16T00:50:26.862 INFO:tasks.workunit.client.0.smithi053.stdout:6/615: mknod d1/dc/d43/cd4 0 2024-09-16T00:50:26.864 INFO:tasks.workunit.client.0.smithi053.stdout:6/616: creat d1/dc/d1e/d65/fd5 x:0 0 0 2024-09-16T00:50:26.865 INFO:tasks.workunit.client.0.smithi053.stdout:6/617: chown d1/dc/d1e/f5d 3 1 2024-09-16T00:50:26.865 INFO:tasks.workunit.client.0.smithi053.stdout:6/618: truncate d1/d2f/f7d 2195051 0 2024-09-16T00:50:26.865 INFO:tasks.workunit.client.0.smithi053.stdout:6/619: truncate d1/dc/d45/f94 4336480 0 2024-09-16T00:50:26.866 INFO:tasks.workunit.client.0.smithi053.stdout:5/558: dread d3/d7/f1f [0,4194304] 0 2024-09-16T00:50:26.866 INFO:tasks.workunit.client.0.smithi053.stdout:6/620: truncate d1/dc/d3d/f55 2219582 0 2024-09-16T00:50:26.869 INFO:tasks.workunit.client.0.smithi053.stdout:5/559: mknod d3/d7/d42/d57/cbb 0 2024-09-16T00:50:26.869 INFO:tasks.workunit.client.0.smithi053.stdout:5/560: fsync d3/d7/d24/d34/d3e/fb7 0 2024-09-16T00:50:26.873 INFO:tasks.workunit.client.1.smithi152.stdout:8/994: sync 2024-09-16T00:50:26.873 INFO:tasks.workunit.client.1.smithi152.stdout:8/995: write dd/d98/db8/d139/f143 [523509,98630] 0 2024-09-16T00:50:26.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/537: dread d1/f3f [0,4194304] 0 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:6/621: read d1/dc/f32 [429464,55145] 0 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:6/622: read - d1/dc/d3c/d4b/fb2 zero size 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:5/561: dread d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:5/562: stat d3/d7/d2b/d37/d58/d79 0 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:5/563: readlink d3/d7/d2b/d4b/d51/d53/l89 0 2024-09-16T00:50:26.876 INFO:tasks.workunit.client.0.smithi053.stdout:5/564: fsync d3/d7/d2b/d4b/d4f/f73 0 2024-09-16T00:50:26.877 INFO:tasks.workunit.client.1.smithi152.stdout:8/996: rename dd/d98/db8/d12a/f45 to dd/d98/db8/dcf/d29/d2f/db6/d141/f14b 0 2024-09-16T00:50:26.880 INFO:tasks.workunit.client.0.smithi053.stdout:7/538: rename d1/d60/d77/d50 to d1/d60/d70/dac 0 2024-09-16T00:50:26.882 INFO:tasks.workunit.client.0.smithi053.stdout:7/539: symlink d1/d35/d4a/lad 0 2024-09-16T00:50:26.885 INFO:tasks.workunit.client.0.smithi053.stdout:6/623: dread d1/dc/d39/f23 [0,4194304] 0 2024-09-16T00:50:26.886 INFO:tasks.workunit.client.0.smithi053.stdout:1/512: dwrite d5/d9/d4c/f89 [4194304,4194304] 0 2024-09-16T00:50:26.886 INFO:tasks.workunit.client.0.smithi053.stdout:6/624: read - d1/dc/d39/f89 zero size 2024-09-16T00:50:26.886 INFO:tasks.workunit.client.0.smithi053.stdout:1/513: truncate d5/d9/d4c/f9f 554815 0 2024-09-16T00:50:26.886 INFO:tasks.workunit.client.0.smithi053.stdout:1/514: stat d5/d9/d4c/f9f 0 2024-09-16T00:50:26.886 INFO:tasks.workunit.client.1.smithi152.stdout:8/997: dread dd/db9/f110 [0,4194304] 0 2024-09-16T00:50:26.887 INFO:tasks.workunit.client.1.smithi152.stdout:8/998: mkdir dd/d98/db8/dcf/d29/d2f/d5f/dd2/d123/d14c 0 2024-09-16T00:50:26.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/625: mkdir d1/dc/d3c/d4b/d75/dd6 0 2024-09-16T00:50:26.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/626: chown d1/c7c 234 1 2024-09-16T00:50:26.893 INFO:tasks.workunit.client.0.smithi053.stdout:2/466: dwrite d6/d9/dd/d28/f2f [0,4194304] 0 2024-09-16T00:50:26.894 INFO:tasks.workunit.client.0.smithi053.stdout:1/515: dread d5/d9/d4c/d61/f6e [0,4194304] 0 2024-09-16T00:50:26.895 INFO:tasks.workunit.client.0.smithi053.stdout:1/516: mknod d5/d9/d4c/d61/cae 0 2024-09-16T00:50:26.896 INFO:tasks.workunit.client.0.smithi053.stdout:1/517: getdents d5/d18 0 2024-09-16T00:50:26.898 INFO:tasks.workunit.client.0.smithi053.stdout:2/467: dread d6/d9/d14/f4c [0,4194304] 0 2024-09-16T00:50:26.899 INFO:tasks.workunit.client.0.smithi053.stdout:2/468: creat d6/d29/d2b/d39/f8f x:0 0 0 2024-09-16T00:50:26.900 INFO:tasks.workunit.client.0.smithi053.stdout:0/643: dwrite d4/dc/d1e/d22/fba [0,4194304] 0 2024-09-16T00:50:26.901 INFO:tasks.workunit.client.0.smithi053.stdout:5/565: dwrite d3/d7/d2b/d37/d58/d79/f94 [0,4194304] 0 2024-09-16T00:50:26.901 INFO:tasks.workunit.client.0.smithi053.stdout:2/469: unlink d6/d9/d14/f4e 0 2024-09-16T00:50:26.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/999: dwrite dd/d98/db8/dcf/d29/d2f/d5f/feb [0,4194304] 0 2024-09-16T00:50:26.906 INFO:tasks.workunit.client.0.smithi053.stdout:6/627: rmdir d1/d2f 39 2024-09-16T00:50:26.915 INFO:tasks.workunit.client.1.smithi152.stderr:+ rm -rf -- ./tmp.nLu4CAjACW 2024-09-16T00:50:26.917 INFO:tasks.workunit.client.0.smithi053.stdout:2/470: rename d6/d29/d86 to d6/d90 0 2024-09-16T00:50:26.918 INFO:tasks.workunit.client.0.smithi053.stdout:1/518: truncate d5/d5a/f7e 1734784 0 2024-09-16T00:50:26.918 INFO:tasks.workunit.client.0.smithi053.stdout:5/566: rmdir d3/d7/d2b/d71 39 2024-09-16T00:50:26.919 INFO:tasks.workunit.client.0.smithi053.stdout:5/567: write d3/d7/d24/d3f/f8c [106787,66539] 0 2024-09-16T00:50:26.921 INFO:tasks.workunit.client.0.smithi053.stdout:6/628: rename d1/f9 to d1/dc/d1e/d65/dc6/fd7 0 2024-09-16T00:50:26.922 INFO:tasks.workunit.client.0.smithi053.stdout:1/519: mkdir d5/d18/d33/d30/daf 0 2024-09-16T00:50:26.923 INFO:tasks.workunit.client.0.smithi053.stdout:1/520: stat d5/dd/d19/l4d 0 2024-09-16T00:50:26.925 INFO:tasks.workunit.client.0.smithi053.stdout:5/568: rename d3/d7/d2b/d71 to d3/d7/d2b/dbc 0 2024-09-16T00:50:26.926 INFO:tasks.workunit.client.0.smithi053.stdout:5/569: fdatasync d3/d7/d24/d3f/fb1 0 2024-09-16T00:50:26.928 INFO:tasks.workunit.client.0.smithi053.stdout:2/471: rename d6/d29/d2b/f47 to d6/d29/f91 0 2024-09-16T00:50:26.928 INFO:tasks.workunit.client.0.smithi053.stdout:2/472: readlink d6/d29/l45 0 2024-09-16T00:50:26.930 INFO:tasks.workunit.client.0.smithi053.stdout:6/629: symlink d1/dc/d43/ld8 0 2024-09-16T00:50:26.933 INFO:tasks.workunit.client.0.smithi053.stdout:1/521: link d5/d7/f20 d5/dd/fb0 0 2024-09-16T00:50:26.935 INFO:tasks.workunit.client.0.smithi053.stdout:5/570: dread d3/d9c/fad [0,4194304] 0 2024-09-16T00:50:26.935 INFO:tasks.workunit.client.0.smithi053.stdout:5/571: chown d3/f20 1476 1 2024-09-16T00:50:26.937 INFO:tasks.workunit.client.0.smithi053.stdout:1/522: mkdir d5/d7/db1 0 2024-09-16T00:50:26.940 INFO:tasks.workunit.client.0.smithi053.stdout:5/572: rename d3/f4 to d3/d7/d2b/d4b/d51/d53/da5/fbd 0 2024-09-16T00:50:26.940 INFO:tasks.workunit.client.0.smithi053.stdout:5/573: truncate d3/f9 4963716 0 2024-09-16T00:50:26.940 INFO:tasks.workunit.client.0.smithi053.stdout:5/574: chown d3/d7/d2b/dbc 99 1 2024-09-16T00:50:26.945 INFO:tasks.workunit.client.0.smithi053.stdout:6/630: rmdir d1/dc/d1e/d65 39 2024-09-16T00:50:26.946 INFO:tasks.workunit.client.0.smithi053.stdout:1/523: mkdir d5/d9/d73/db2 0 2024-09-16T00:50:26.946 INFO:tasks.workunit.client.0.smithi053.stdout:1/524: creat d5/d7/d39/d57/d82/fb3 x:0 0 0 2024-09-16T00:50:26.946 INFO:tasks.workunit.client.0.smithi053.stdout:1/525: creat d5/dd/d7f/fb4 x:0 0 0 2024-09-16T00:50:26.953 INFO:tasks.workunit.client.0.smithi053.stdout:2/473: dwrite d6/d9/dd/d28/f2f [8388608,4194304] 0 2024-09-16T00:50:26.953 INFO:tasks.workunit.client.0.smithi053.stdout:2/474: stat d6/d9/f49 0 2024-09-16T00:50:26.959 INFO:tasks.workunit.client.0.smithi053.stdout:1/526: dwrite d5/d7/fa5 [0,4194304] 0 2024-09-16T00:50:26.968 INFO:tasks.workunit.client.0.smithi053.stdout:2/475: dwrite d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:26.968 INFO:tasks.workunit.client.0.smithi053.stdout:2/476: chown d6/d9/d14 1 1 2024-09-16T00:50:26.970 INFO:tasks.workunit.client.0.smithi053.stdout:1/527: dread d5/d7/f52 [0,4194304] 0 2024-09-16T00:50:26.970 INFO:tasks.workunit.client.0.smithi053.stdout:1/528: fsync d5/d9/d77/f7b 0 2024-09-16T00:50:26.970 INFO:tasks.workunit.client.0.smithi053.stdout:2/477: mkdir d6/d9/dd/d3e/d52/d65/d92 0 2024-09-16T00:50:26.974 INFO:tasks.workunit.client.0.smithi053.stdout:2/478: mknod d6/d9/dd/d3e/d52/d65/c93 0 2024-09-16T00:50:26.974 INFO:tasks.workunit.client.0.smithi053.stdout:2/479: creat d6/d9/dd/d3e/f94 x:0 0 0 2024-09-16T00:50:26.974 INFO:tasks.workunit.client.0.smithi053.stdout:2/480: dread - d6/d9/dd/d3e/f94 zero size 2024-09-16T00:50:26.977 INFO:tasks.workunit.client.0.smithi053.stdout:2/481: mknod d6/d9/dd/d3e/c95 0 2024-09-16T00:50:26.987 INFO:tasks.workunit.client.0.smithi053.stdout:2/482: dread d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:26.991 INFO:tasks.workunit.client.0.smithi053.stdout:1/529: dwrite d5/d7/f20 [0,4194304] 0 2024-09-16T00:50:26.991 INFO:tasks.workunit.client.0.smithi053.stdout:1/530: chown d5/d18/d1f/f3d 7 1 2024-09-16T00:50:26.991 INFO:tasks.workunit.client.0.smithi053.stdout:1/531: creat d5/dd/fb5 x:0 0 0 2024-09-16T00:50:26.994 INFO:tasks.workunit.client.0.smithi053.stdout:1/532: link d5/d7/c3f d5/d18/d33/d8a/cb6 0 2024-09-16T00:50:26.996 INFO:tasks.workunit.client.0.smithi053.stdout:1/533: creat d5/d18/d33/d8a/d98/fb7 x:0 0 0 2024-09-16T00:50:26.996 INFO:tasks.workunit.client.0.smithi053.stdout:1/534: stat d5/c8c 0 2024-09-16T00:50:27.002 INFO:tasks.workunit.client.0.smithi053.stdout:2/483: dwrite d6/d9/dd/f6d [0,4194304] 0 2024-09-16T00:50:27.003 INFO:tasks.workunit.client.0.smithi053.stdout:2/484: symlink d6/d29/d2b/l96 0 2024-09-16T00:50:27.004 INFO:tasks.workunit.client.0.smithi053.stdout:1/535: dread d5/dd/f1a [0,4194304] 0 2024-09-16T00:50:27.004 INFO:tasks.workunit.client.0.smithi053.stdout:1/536: dread - d5/dd/d7f/fb4 zero size 2024-09-16T00:50:27.004 INFO:tasks.workunit.client.0.smithi053.stdout:1/537: chown d5/d9/d88 25938050 1 2024-09-16T00:50:27.006 INFO:tasks.workunit.client.0.smithi053.stdout:2/485: unlink d6/d9/dd/d3e/d72/d75/d84/f8a 0 2024-09-16T00:50:27.008 INFO:tasks.workunit.client.0.smithi053.stdout:1/538: unlink d5/dd/f59 0 2024-09-16T00:50:27.014 INFO:tasks.workunit.client.0.smithi053.stdout:1/539: dread d5/d7/f52 [0,4194304] 0 2024-09-16T00:50:27.020 INFO:tasks.workunit.client.0.smithi053.stdout:1/540: symlink d5/d9/d88/lb8 0 2024-09-16T00:50:27.030 INFO:tasks.workunit.client.0.smithi053.stdout:1/541: rmdir d5/d9/d77 39 2024-09-16T00:50:27.031 INFO:tasks.workunit.client.0.smithi053.stdout:2/486: rmdir d6/d9/dd/d3e 39 2024-09-16T00:50:27.040 INFO:tasks.workunit.client.0.smithi053.stdout:8/528: sync 2024-09-16T00:50:27.040 INFO:tasks.workunit.client.0.smithi053.stdout:3/593: sync 2024-09-16T00:50:27.042 INFO:tasks.workunit.client.0.smithi053.stdout:8/529: rename d10/c8f to d10/d21/d28/cbc 0 2024-09-16T00:50:27.043 INFO:tasks.workunit.client.0.smithi053.stdout:8/530: write d10/d1c/d2b/d40/f6d [695507,61067] 0 2024-09-16T00:50:27.043 INFO:tasks.workunit.client.0.smithi053.stdout:8/531: chown d10/f14 5608 1 2024-09-16T00:50:27.043 INFO:tasks.workunit.client.0.smithi053.stdout:8/532: chown d10/d1c/d92/d66/db1 115710 1 2024-09-16T00:50:27.043 INFO:tasks.workunit.client.0.smithi053.stdout:8/533: dread - d10/d1c/d49/faf zero size 2024-09-16T00:50:27.045 INFO:tasks.workunit.client.0.smithi053.stdout:3/594: dread d1/d5/d91/f1f [0,4194304] 0 2024-09-16T00:50:27.046 INFO:tasks.workunit.client.0.smithi053.stdout:3/595: creat d1/d5/d31/d7a/dbb/daa/fc3 x:0 0 0 2024-09-16T00:50:27.048 INFO:tasks.workunit.client.0.smithi053.stdout:3/596: symlink d1/d89/d28/da7/lc4 0 2024-09-16T00:50:27.048 INFO:tasks.workunit.client.0.smithi053.stdout:3/597: chown d1/d5/d31/d42/f8c 2944985 1 2024-09-16T00:50:27.048 INFO:tasks.workunit.client.0.smithi053.stdout:3/598: chown d1/d5/d91/d47/d64/l85 331 1 2024-09-16T00:50:27.048 INFO:tasks.workunit.client.0.smithi053.stdout:3/599: mkdir d1/d5/d11/d3a/dc5 0 2024-09-16T00:50:27.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/487: dwrite d6/d9/dd/d3e/f4b [0,4194304] 0 2024-09-16T00:50:27.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/488: chown d6/d29/d2b/f60 424 1 2024-09-16T00:50:27.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/489: chown d6/d9/f1e 953588 1 2024-09-16T00:50:27.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/490: write f0 [1179877,55191] 0 2024-09-16T00:50:27.049 INFO:tasks.workunit.client.0.smithi053.stdout:2/491: truncate d6/f7 5180461 0 2024-09-16T00:50:27.055 INFO:tasks.workunit.client.0.smithi053.stdout:2/492: symlink d6/d9/dd/d3e/d52/d7e/d87/l97 0 2024-09-16T00:50:27.055 INFO:tasks.workunit.client.0.smithi053.stdout:2/493: rename d6 to d6/d9/dd/d3e/d52/d65/d92/d98 22 2024-09-16T00:50:27.055 INFO:tasks.workunit.client.0.smithi053.stdout:2/494: dread - d6/d9/dd/d3e/f94 zero size 2024-09-16T00:50:27.056 INFO:tasks.workunit.client.0.smithi053.stdout:3/600: dread d1/d5/d91/d47/f5b [0,4194304] 0 2024-09-16T00:50:27.056 INFO:tasks.workunit.client.0.smithi053.stdout:2/495: creat d6/d29/d2b/f99 x:0 0 0 2024-09-16T00:50:27.057 INFO:tasks.workunit.client.0.smithi053.stdout:3/601: dread d1/d5/f19 [0,4194304] 0 2024-09-16T00:50:27.059 INFO:tasks.workunit.client.0.smithi053.stdout:8/534: dwrite d10/d21/d28/da2/f9f [0,4194304] 0 2024-09-16T00:50:27.059 INFO:tasks.workunit.client.0.smithi053.stdout:8/535: readlink d10/d21/d28/da2/l75 0 2024-09-16T00:50:27.059 INFO:tasks.workunit.client.0.smithi053.stdout:2/496: creat d6/d29/f9a x:0 0 0 2024-09-16T00:50:27.061 INFO:tasks.workunit.client.0.smithi053.stdout:3/602: mkdir d1/d5/d11/d3a/dc6 0 2024-09-16T00:50:27.067 INFO:tasks.workunit.client.0.smithi053.stdout:2/497: write d6/d9/dd/d28/f2f [3672831,45418] 0 2024-09-16T00:50:27.067 INFO:tasks.workunit.client.0.smithi053.stdout:2/498: creat d6/d29/d2b/d39/f9b x:0 0 0 2024-09-16T00:50:27.072 INFO:tasks.workunit.client.0.smithi053.stdout:2/499: link d6/d9/f25 d6/d9/dd/d3e/d72/f9c 0 2024-09-16T00:50:27.072 INFO:tasks.workunit.client.0.smithi053.stdout:2/500: creat d6/f9d x:0 0 0 2024-09-16T00:50:27.072 INFO:tasks.workunit.client.0.smithi053.stdout:3/603: dread d1/d5/d31/d42/f8c [0,4194304] 0 2024-09-16T00:50:27.072 INFO:tasks.workunit.client.0.smithi053.stdout:3/604: fdatasync d1/d5/d11/d3a/f67 0 2024-09-16T00:50:27.076 INFO:tasks.workunit.client.0.smithi053.stdout:2/501: creat d6/d9/d14/d81/f9e x:0 0 0 2024-09-16T00:50:27.077 INFO:tasks.workunit.client.0.smithi053.stdout:2/502: fsync d6/d9/f56 0 2024-09-16T00:50:27.077 INFO:tasks.workunit.client.0.smithi053.stdout:8/536: dwrite d10/d1c/d92/f7d [0,4194304] 0 2024-09-16T00:50:27.077 INFO:tasks.workunit.client.0.smithi053.stdout:8/537: dread d10/d21/d28/d3c/d63/d6a/f93 [0,4194304] 0 2024-09-16T00:50:27.079 INFO:tasks.workunit.client.0.smithi053.stdout:3/605: unlink d1/d4e/f8d 0 2024-09-16T00:50:27.081 INFO:tasks.workunit.client.0.smithi053.stdout:2/503: getdents d6/d9/dd/d3e/d52/d7e 0 2024-09-16T00:50:27.081 INFO:tasks.workunit.client.0.smithi053.stdout:2/504: truncate d6/f77 292125 0 2024-09-16T00:50:27.081 INFO:tasks.workunit.client.0.smithi053.stdout:2/505: readlink d6/d9/dd/d28/l6a 0 2024-09-16T00:50:27.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/538: rmdir d10/d21/d28/da2 39 2024-09-16T00:50:27.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/539: readlink d10/d21/l48 0 2024-09-16T00:50:27.085 INFO:tasks.workunit.client.0.smithi053.stdout:3/606: symlink d1/d5/d31/d7a/lc7 0 2024-09-16T00:50:27.086 INFO:tasks.workunit.client.0.smithi053.stdout:3/607: fdatasync d1/d89/d28/d5a/fc1 0 2024-09-16T00:50:27.089 INFO:tasks.workunit.client.0.smithi053.stdout:8/540: mknod d10/d21/d28/d3c/d63/d6a/cbd 0 2024-09-16T00:50:27.092 INFO:tasks.workunit.client.0.smithi053.stdout:3/608: rename d1/fb7 to d1/d5/d31/d3b/fc8 0 2024-09-16T00:50:27.101 INFO:tasks.workunit.client.0.smithi053.stdout:2/506: rmdir d6 39 2024-09-16T00:50:27.102 INFO:tasks.workunit.client.0.smithi053.stdout:2/507: write d6/d29/d2b/d39/f9b [351353,12142] 0 2024-09-16T00:50:27.106 INFO:tasks.workunit.client.0.smithi053.stdout:3/609: unlink d1/f21 0 2024-09-16T00:50:27.108 INFO:tasks.workunit.client.0.smithi053.stdout:2/508: unlink d6/d29/d2b/c69 0 2024-09-16T00:50:27.108 INFO:tasks.workunit.client.0.smithi053.stdout:2/509: chown d6/d9/dd/d3e/d52/d7e/l8b 3 1 2024-09-16T00:50:27.111 INFO:tasks.workunit.client.0.smithi053.stdout:8/541: mkdir d10/dbe 0 2024-09-16T00:50:27.113 INFO:tasks.workunit.client.0.smithi053.stdout:3/610: link d1/d5/d91/d5e/d69/c92 d1/d5/d91/d47/d6c/cc9 0 2024-09-16T00:50:27.113 INFO:tasks.workunit.client.0.smithi053.stdout:3/611: write d1/d5/f93 [488450,16673] 0 2024-09-16T00:50:27.113 INFO:tasks.workunit.client.0.smithi053.stdout:3/612: fsync d1/d5/d31/f39 0 2024-09-16T00:50:27.113 INFO:tasks.workunit.client.0.smithi053.stdout:3/613: stat d1/d89/d28/f35 0 2024-09-16T00:50:27.115 INFO:tasks.workunit.client.0.smithi053.stdout:2/510: creat d6/d9/d14/f9f x:0 0 0 2024-09-16T00:50:27.118 INFO:tasks.workunit.client.0.smithi053.stdout:3/614: creat d1/d89/d28/d5a/fca x:0 0 0 2024-09-16T00:50:27.118 INFO:tasks.workunit.client.0.smithi053.stdout:3/615: write d1/d5/d91/d47/fb9 [435806,45212] 0 2024-09-16T00:50:27.119 INFO:tasks.workunit.client.0.smithi053.stdout:2/511: mkdir d6/d29/da0 0 2024-09-16T00:50:27.119 INFO:tasks.workunit.client.0.smithi053.stdout:2/512: chown d6/d29/d2b/d39/f9b 63586 1 2024-09-16T00:50:27.119 INFO:tasks.workunit.client.0.smithi053.stdout:2/513: write d6/d9/dd/d28/f57 [3629698,77024] 0 2024-09-16T00:50:27.120 INFO:tasks.workunit.client.0.smithi053.stdout:2/514: write d6/d29/d2b/d39/f40 [1939293,1107] 0 2024-09-16T00:50:27.120 INFO:tasks.workunit.client.0.smithi053.stdout:2/515: truncate d6/d29/f70 334853 0 2024-09-16T00:50:27.120 INFO:tasks.workunit.client.0.smithi053.stdout:2/516: chown d6/d9/dd/d3e/d52/f68 84851 1 2024-09-16T00:50:27.120 INFO:tasks.workunit.client.0.smithi053.stdout:8/542: write d10/d1c/d92/f7d [2306580,60133] 0 2024-09-16T00:50:27.122 INFO:tasks.workunit.client.0.smithi053.stdout:3/616: link d1/d5/d91/d47/d65/d66/fc2 d1/d5/d31/d7a/dbb/fcb 0 2024-09-16T00:50:27.122 INFO:tasks.workunit.client.0.smithi053.stdout:3/617: chown d1/d5/d91 6514 1 2024-09-16T00:50:27.122 INFO:tasks.workunit.client.0.smithi053.stdout:3/618: fdatasync d1/d89/f30 0 2024-09-16T00:50:27.127 INFO:tasks.workunit.client.0.smithi053.stdout:2/517: unlink d6/d9/l63 0 2024-09-16T00:50:27.134 INFO:tasks.workunit.client.0.smithi053.stdout:2/518: creat d6/d9/dd/d3e/d72/d75/fa1 x:0 0 0 2024-09-16T00:50:27.139 INFO:tasks.workunit.client.0.smithi053.stdout:3/619: dwrite d1/d5/d31/f39 [4194304,4194304] 0 2024-09-16T00:50:27.139 INFO:tasks.workunit.client.0.smithi053.stdout:3/620: write d1/d5/d11/d3a/f67 [4726315,113512] 0 2024-09-16T00:50:27.152 INFO:tasks.workunit.client.0.smithi053.stdout:2/519: creat d6/d9/fa2 x:0 0 0 2024-09-16T00:50:27.156 INFO:tasks.workunit.client.0.smithi053.stdout:3/621: dwrite d1/d5/d91/d47/d65/d66/fc2 [0,4194304] 0 2024-09-16T00:50:27.169 INFO:tasks.workunit.client.0.smithi053.stdout:3/622: mkdir d1/d89/d28/dcc 0 2024-09-16T00:50:27.169 INFO:tasks.workunit.client.0.smithi053.stdout:3/623: chown d1/d5/d11/l20 1 1 2024-09-16T00:50:27.173 INFO:tasks.workunit.client.0.smithi053.stdout:2/520: dread d6/d9/dd/d3e/f4b [0,4194304] 0 2024-09-16T00:50:27.187 INFO:tasks.workunit.client.0.smithi053.stdout:4/348: sync 2024-09-16T00:50:27.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/525: sync 2024-09-16T00:50:27.187 INFO:tasks.workunit.client.0.smithi053.stdout:7/540: sync 2024-09-16T00:50:27.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/526: chown d8/d4c/l55 88 1 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/541: fsync d1/d60/d70/dac/fa4 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/542: chown d1/d35/d14/f64 69788 1 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:9/527: write d8/d1c/d2b/d2c/f85 [1166148,14785] 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/543: creat d1/d60/fae x:0 0 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/544: truncate d1/d2a/f99 4491563 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/545: chown d1/d3/f9a 19 1 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:7/546: creat d1/d60/faf x:0 0 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:3/624: mkdir d1/d5/d31/d7c/dbf/dcd 0 2024-09-16T00:50:27.188 INFO:tasks.workunit.client.0.smithi053.stdout:4/349: dread d0/da/f4a [0,4194304] 0 2024-09-16T00:50:27.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/521: write d6/d9/dd/d3e/d52/d65/f7c [3515120,44598] 0 2024-09-16T00:50:27.192 INFO:tasks.workunit.client.0.smithi053.stdout:7/547: symlink d1/lb0 0 2024-09-16T00:50:27.193 INFO:tasks.workunit.client.0.smithi053.stdout:7/548: write d1/f3a [687401,94818] 0 2024-09-16T00:50:27.193 INFO:tasks.workunit.client.0.smithi053.stdout:7/549: stat d1/d35/l1c 0 2024-09-16T00:50:27.193 INFO:tasks.workunit.client.0.smithi053.stdout:7/550: getdents d1/d60/d77/da9 0 2024-09-16T00:50:27.194 INFO:tasks.workunit.client.0.smithi053.stdout:7/551: fsync d1/d2a/f82 0 2024-09-16T00:50:27.194 INFO:tasks.workunit.client.0.smithi053.stdout:7/552: write d1/f3a [333837,127941] 0 2024-09-16T00:50:27.194 INFO:tasks.workunit.client.0.smithi053.stdout:3/625: mkdir d1/d5/d91/d47/d65/d97/dce 0 2024-09-16T00:50:27.196 INFO:tasks.workunit.client.0.smithi053.stdout:2/522: mknod d6/d9/dd/d3e/d52/d7e/d87/ca3 0 2024-09-16T00:50:27.198 INFO:tasks.workunit.client.0.smithi053.stdout:7/553: mkdir d1/d2a/d83/d84/db1 0 2024-09-16T00:50:27.200 INFO:tasks.workunit.client.0.smithi053.stdout:4/350: symlink d0/da/d42/l7e 0 2024-09-16T00:50:27.201 INFO:tasks.workunit.client.0.smithi053.stdout:9/528: dread d8/fb [0,4194304] 0 2024-09-16T00:50:27.202 INFO:tasks.workunit.client.0.smithi053.stdout:7/554: mknod d1/d35/d4a/d74/cb2 0 2024-09-16T00:50:27.203 INFO:tasks.workunit.client.0.smithi053.stdout:7/555: creat d1/d35/d5b/fb3 x:0 0 0 2024-09-16T00:50:27.203 INFO:tasks.workunit.client.0.smithi053.stdout:4/351: creat d0/d65/f7f x:0 0 0 2024-09-16T00:50:27.204 INFO:tasks.workunit.client.0.smithi053.stdout:3/626: dread d1/d5/d91/d47/fa6 [4194304,4194304] 0 2024-09-16T00:50:27.204 INFO:tasks.workunit.client.0.smithi053.stdout:3/627: fsync d1/d5/d91/d5e/d69/fa1 0 2024-09-16T00:50:27.210 INFO:tasks.workunit.client.0.smithi053.stdout:7/556: creat d1/d35/d4a/d74/fb4 x:0 0 0 2024-09-16T00:50:27.212 INFO:tasks.workunit.client.0.smithi053.stdout:4/352: creat d0/d3c/f80 x:0 0 0 2024-09-16T00:50:27.214 INFO:tasks.workunit.client.0.smithi053.stdout:4/353: read d0/da/d42/f75 [476703,108789] 0 2024-09-16T00:50:27.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/529: rename d8/d4c/d5a/c84 to d8/d1c/d2b/d5c/cab 0 2024-09-16T00:50:27.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/530: write d8/d1c/d2b/f76 [4256252,41800] 0 2024-09-16T00:50:27.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/531: write d8/d22/d26/f61 [1349798,35907] 0 2024-09-16T00:50:27.217 INFO:tasks.workunit.client.0.smithi053.stdout:7/557: mkdir d1/db5 0 2024-09-16T00:50:27.218 INFO:tasks.workunit.client.0.smithi053.stdout:2/523: dwrite d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:27.220 INFO:tasks.workunit.client.0.smithi053.stdout:9/532: unlink d8/d1c/c24 0 2024-09-16T00:50:27.223 INFO:tasks.workunit.client.0.smithi053.stdout:7/558: creat d1/d2a/fb6 x:0 0 0 2024-09-16T00:50:27.223 INFO:tasks.workunit.client.0.smithi053.stdout:7/559: fsync d1/d60/d62/f69 0 2024-09-16T00:50:27.223 INFO:tasks.workunit.client.0.smithi053.stdout:7/560: chown d1/d2a/d83/d84/db1 7953 1 2024-09-16T00:50:27.225 INFO:tasks.workunit.client.0.smithi053.stdout:7/561: getdents d1/d35/d5b/d93 0 2024-09-16T00:50:27.225 INFO:tasks.workunit.client.0.smithi053.stdout:7/562: fsync d1/d2a/d4f/d52/f30 0 2024-09-16T00:50:27.225 INFO:tasks.workunit.client.0.smithi053.stdout:7/563: fsync d1/f36 0 2024-09-16T00:50:27.226 INFO:tasks.workunit.client.0.smithi053.stdout:3/628: dwrite d1/d89/f30 [0,4194304] 0 2024-09-16T00:50:27.226 INFO:tasks.workunit.client.0.smithi053.stdout:3/629: creat d1/d5/d91/d47/fcf x:0 0 0 2024-09-16T00:50:27.226 INFO:tasks.workunit.client.0.smithi053.stdout:9/533: mknod d8/d22/d26/cac 0 2024-09-16T00:50:27.228 INFO:tasks.workunit.client.0.smithi053.stdout:2/524: write d6/d9/dd/d3e/f4b [2123536,86644] 0 2024-09-16T00:50:27.230 INFO:tasks.workunit.client.0.smithi053.stdout:7/564: creat d1/d2a/d4f/fb7 x:0 0 0 2024-09-16T00:50:27.235 INFO:tasks.workunit.client.0.smithi053.stdout:3/630: creat d1/d5/d31/d42/fd0 x:0 0 0 2024-09-16T00:50:27.236 INFO:tasks.workunit.client.0.smithi053.stdout:4/354: dwrite d0/f38 [0,4194304] 0 2024-09-16T00:50:27.237 INFO:tasks.workunit.client.0.smithi053.stdout:9/534: mknod d8/d4c/cad 0 2024-09-16T00:50:27.240 INFO:tasks.workunit.client.0.smithi053.stdout:2/525: mknod d6/d29/d2b/ca4 0 2024-09-16T00:50:27.240 INFO:tasks.workunit.client.0.smithi053.stdout:2/526: truncate f0 2187963 0 2024-09-16T00:50:27.240 INFO:tasks.workunit.client.0.smithi053.stdout:2/527: getdents d6/d9/dd/d80 0 2024-09-16T00:50:27.241 INFO:tasks.workunit.client.0.smithi053.stdout:2/528: truncate d6/f77 209099 0 2024-09-16T00:50:27.245 INFO:tasks.workunit.client.0.smithi053.stdout:3/631: dread d1/d5/d31/d3b/f44 [0,4194304] 0 2024-09-16T00:50:27.250 INFO:tasks.workunit.client.0.smithi053.stdout:3/632: link d1/f6f d1/d5/d91/d47/fd1 0 2024-09-16T00:50:27.251 INFO:tasks.workunit.client.0.smithi053.stdout:9/535: dread d8/d1c/d2b/f47 [0,4194304] 0 2024-09-16T00:50:27.253 INFO:tasks.workunit.client.0.smithi053.stdout:3/633: creat d1/d5/d31/fd2 x:0 0 0 2024-09-16T00:50:27.255 INFO:tasks.workunit.client.0.smithi053.stdout:9/536: truncate d8/f46 2477030 0 2024-09-16T00:50:27.255 INFO:tasks.workunit.client.0.smithi053.stdout:9/537: write d8/d19/d51/d6d/f79 [962288,130166] 0 2024-09-16T00:50:27.256 INFO:tasks.workunit.client.0.smithi053.stdout:7/565: dwrite d1/d35/f1e [0,4194304] 0 2024-09-16T00:50:27.257 INFO:tasks.workunit.client.0.smithi053.stdout:3/634: dread d1/d5/d91/d47/f5d [0,4194304] 0 2024-09-16T00:50:27.258 INFO:tasks.workunit.client.0.smithi053.stdout:2/529: dwrite d6/d29/d2b/f60 [8388608,4194304] 0 2024-09-16T00:50:27.258 INFO:tasks.workunit.client.0.smithi053.stdout:9/538: unlink f4 0 2024-09-16T00:50:27.259 INFO:tasks.workunit.client.0.smithi053.stdout:4/355: dwrite d0/da/d42/f75 [0,4194304] 0 2024-09-16T00:50:27.259 INFO:tasks.workunit.client.0.smithi053.stdout:4/356: dread - d0/d2/d1e/f6d zero size 2024-09-16T00:50:27.259 INFO:tasks.workunit.client.0.smithi053.stdout:4/357: write d0/da/f4a [1341332,7813] 0 2024-09-16T00:50:27.260 INFO:tasks.workunit.client.0.smithi053.stdout:2/530: creat d6/d9/dd/d80/fa5 x:0 0 0 2024-09-16T00:50:27.268 INFO:tasks.workunit.client.0.smithi053.stdout:3/635: write d1/d5/d31/d42/f8c [5422883,92836] 0 2024-09-16T00:50:27.268 INFO:tasks.workunit.client.0.smithi053.stdout:3/636: chown d1/d89/d28/d5a 51461 1 2024-09-16T00:50:27.270 INFO:tasks.workunit.client.0.smithi053.stdout:4/358: dread d0/d2/dd/d25/d41/f64 [0,4194304] 0 2024-09-16T00:50:27.270 INFO:tasks.workunit.client.0.smithi053.stdout:4/359: readlink d0/da/l6c 0 2024-09-16T00:50:27.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/566: dwrite d1/d35/d4a/f4c [0,4194304] 0 2024-09-16T00:50:27.287 INFO:tasks.workunit.client.0.smithi053.stdout:9/539: dwrite d8/d19/d51/f56 [4194304,4194304] 0 2024-09-16T00:50:27.292 INFO:tasks.workunit.client.0.smithi053.stdout:2/531: rename d6/d9/dd/d3e/d52/d65/f7f to d6/d9/dd/d3e/d52/d65/d92/fa6 0 2024-09-16T00:50:27.292 INFO:tasks.workunit.client.0.smithi053.stdout:2/532: write d6/d29/d2b/d39/f9b [1388455,92113] 0 2024-09-16T00:50:27.293 INFO:tasks.workunit.client.0.smithi053.stdout:3/637: link d1/d5/d91/d47/d64/lb6 d1/d5/d91/d47/d65/d66/ld3 0 2024-09-16T00:50:27.294 INFO:tasks.workunit.client.0.smithi053.stdout:3/638: readlink d1/d89/d28/da7/lc4 0 2024-09-16T00:50:27.294 INFO:tasks.workunit.client.0.smithi053.stdout:3/639: fdatasync d1/d5/d31/d3b/d9c/fa3 0 2024-09-16T00:50:27.304 INFO:tasks.workunit.client.0.smithi053.stdout:3/640: write d1/d5/d31/d42/f8c [886939,95644] 0 2024-09-16T00:50:27.304 INFO:tasks.workunit.client.0.smithi053.stdout:3/641: readlink d1/d5/d91/l43 0 2024-09-16T00:50:27.305 INFO:tasks.workunit.client.0.smithi053.stdout:2/533: creat d6/d9/dd/d3e/d52/d65/d92/fa7 x:0 0 0 2024-09-16T00:50:27.305 INFO:tasks.workunit.client.0.smithi053.stdout:7/567: read d1/d35/d14/f43 [2872999,83458] 0 2024-09-16T00:50:27.306 INFO:tasks.workunit.client.0.smithi053.stdout:9/540: write d8/d13/f20 [203111,101421] 0 2024-09-16T00:50:27.307 INFO:tasks.workunit.client.0.smithi053.stdout:3/642: dread d1/d5/d91/f3f [0,4194304] 0 2024-09-16T00:50:27.307 INFO:tasks.workunit.client.0.smithi053.stdout:3/643: truncate d1/d5/d31/d7a/dbb/f9a 28147 0 2024-09-16T00:50:27.308 INFO:tasks.workunit.client.0.smithi053.stdout:3/644: chown d1/d89/d28/l7d 208150 1 2024-09-16T00:50:27.308 INFO:tasks.workunit.client.0.smithi053.stdout:2/534: symlink d6/d9/dd/d28/la8 0 2024-09-16T00:50:27.326 INFO:tasks.workunit.client.0.smithi053.stdout:9/541: creat d8/d13/fae x:0 0 0 2024-09-16T00:50:27.327 INFO:tasks.workunit.client.0.smithi053.stdout:3/645: symlink d1/d5/d31/d42/d9f/ld4 0 2024-09-16T00:50:27.329 INFO:tasks.workunit.client.0.smithi053.stdout:7/568: dwrite d1/f3a [0,4194304] 0 2024-09-16T00:50:27.330 INFO:tasks.workunit.client.0.smithi053.stdout:3/646: readlink d1/d5/l27 0 2024-09-16T00:50:27.334 INFO:tasks.workunit.client.0.smithi053.stdout:2/535: dwrite d6/d9/dd/d28/f5d [0,4194304] 0 2024-09-16T00:50:27.334 INFO:tasks.workunit.client.0.smithi053.stdout:9/542: rmdir d8/d22/d54 39 2024-09-16T00:50:27.334 INFO:tasks.workunit.client.0.smithi053.stdout:3/647: dread d1/d89/f2d [0,4194304] 0 2024-09-16T00:50:27.338 INFO:tasks.workunit.client.0.smithi053.stdout:7/569: link d1/d35/d4a/d74/l8e d1/d2a/d83/lb8 0 2024-09-16T00:50:27.338 INFO:tasks.workunit.client.0.smithi053.stdout:7/570: readlink d1/d2a/d4f/l71 0 2024-09-16T00:50:27.342 INFO:tasks.workunit.client.0.smithi053.stdout:2/536: rename d6/d9/dd/d3e/c4a to d6/d9/dd/ca9 0 2024-09-16T00:50:27.342 INFO:tasks.workunit.client.0.smithi053.stdout:2/537: chown d6/d29/d2b/l43 713695776 1 2024-09-16T00:50:27.343 INFO:tasks.workunit.client.0.smithi053.stdout:7/571: symlink d1/db5/lb9 0 2024-09-16T00:50:27.343 INFO:tasks.workunit.client.0.smithi053.stdout:7/572: creat d1/d3/fba x:0 0 0 2024-09-16T00:50:27.351 INFO:tasks.workunit.client.0.smithi053.stdout:7/573: mkdir d1/d35/d4a/dbb 0 2024-09-16T00:50:27.351 INFO:tasks.workunit.client.0.smithi053.stdout:7/574: fdatasync d1/d3/f5 0 2024-09-16T00:50:27.352 INFO:tasks.workunit.client.0.smithi053.stdout:7/575: stat d1/d35/f46 0 2024-09-16T00:50:27.361 INFO:tasks.workunit.client.0.smithi053.stdout:3/648: rename d1/d5/d31/d42 to d1/d5/d91/d47/dd5 0 2024-09-16T00:50:27.362 INFO:tasks.workunit.client.0.smithi053.stdout:2/538: rmdir d6/d9/d14 39 2024-09-16T00:50:27.364 INFO:tasks.workunit.client.0.smithi053.stdout:7/576: rmdir d1/d60/d62 39 2024-09-16T00:50:27.364 INFO:tasks.workunit.client.0.smithi053.stdout:7/577: chown d1/l8 38588023 1 2024-09-16T00:50:27.364 INFO:tasks.workunit.client.0.smithi053.stdout:7/578: fsync d1/d35/d4a/d74/fb4 0 2024-09-16T00:50:27.365 INFO:tasks.workunit.client.0.smithi053.stdout:2/539: creat d6/d9/dd/d76/faa x:0 0 0 2024-09-16T00:50:27.366 INFO:tasks.workunit.client.0.smithi053.stdout:7/579: link d1/d35/d14/d15/f5a d1/d3/d85/fbc 0 2024-09-16T00:50:27.367 INFO:tasks.workunit.client.0.smithi053.stdout:2/540: rename d6/d9/dd/d3e/f94 to d6/d29/fab 0 2024-09-16T00:50:27.370 INFO:tasks.workunit.client.0.smithi053.stdout:7/580: rename d1/d35/d5b/f72 to d1/d35/d4a/dbb/fbd 0 2024-09-16T00:50:27.370 INFO:tasks.workunit.client.0.smithi053.stdout:7/581: read - d1/d60/faf zero size 2024-09-16T00:50:27.371 INFO:tasks.workunit.client.0.smithi053.stdout:2/541: mknod d6/d9/dd/d76/cac 0 2024-09-16T00:50:27.393 INFO:tasks.workunit.client.0.smithi053.stdout:0/644: sync 2024-09-16T00:50:27.393 INFO:tasks.workunit.client.0.smithi053.stdout:5/575: sync 2024-09-16T00:50:27.393 INFO:tasks.workunit.client.0.smithi053.stdout:8/543: sync 2024-09-16T00:50:27.393 INFO:tasks.workunit.client.0.smithi053.stdout:6/631: sync 2024-09-16T00:50:27.393 INFO:tasks.workunit.client.0.smithi053.stdout:1/542: sync 2024-09-16T00:50:27.394 INFO:tasks.workunit.client.0.smithi053.stdout:0/645: chown d4/dc/d87/dc6/la1 57 1 2024-09-16T00:50:27.394 INFO:tasks.workunit.client.0.smithi053.stdout:0/646: write d4/f4b [285249,39686] 0 2024-09-16T00:50:27.394 INFO:tasks.workunit.client.0.smithi053.stdout:0/647: write d4/dc/d87/f50 [4617641,84993] 0 2024-09-16T00:50:27.394 INFO:tasks.workunit.client.0.smithi053.stdout:1/543: creat d5/d18/d33/d8a/d98/fb9 x:0 0 0 2024-09-16T00:50:27.394 INFO:tasks.workunit.client.0.smithi053.stdout:1/544: dread d5/d9/d4c/d61/f12 [0,4194304] 0 2024-09-16T00:50:27.395 INFO:tasks.workunit.client.0.smithi053.stdout:6/632: symlink d1/dc/d3c/d4b/d58/db9/ld9 0 2024-09-16T00:50:27.398 INFO:tasks.workunit.client.0.smithi053.stdout:2/542: dwrite d6/d29/d2b/f46 [0,4194304] 0 2024-09-16T00:50:27.398 INFO:tasks.workunit.client.0.smithi053.stdout:7/582: dwrite d1/d35/d4a/dbb/fbd [0,4194304] 0 2024-09-16T00:50:27.398 INFO:tasks.workunit.client.0.smithi053.stdout:7/583: write d1/d3/d85/fbc [921207,70751] 0 2024-09-16T00:50:27.399 INFO:tasks.workunit.client.0.smithi053.stdout:7/584: chown d1/d35/d14/d15/c24 19072 1 2024-09-16T00:50:27.399 INFO:tasks.workunit.client.0.smithi053.stdout:7/585: dread d1/d2a/f90 [0,4194304] 0 2024-09-16T00:50:27.403 INFO:tasks.workunit.client.0.smithi053.stdout:0/648: unlink d4/dc/d87/dc6/dbe/l8a 0 2024-09-16T00:50:27.403 INFO:tasks.workunit.client.0.smithi053.stdout:5/576: dread d3/d7/d2b/f3a [0,4194304] 0 2024-09-16T00:50:27.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/633: rmdir d1/dc/d3c/d4a/dc1 0 2024-09-16T00:50:27.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/634: chown d1/dc/d39/fa8 0 1 2024-09-16T00:50:27.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/635: write d1/d2f/f7d [3118688,7007] 0 2024-09-16T00:50:27.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/636: dread - d1/dc/f99 zero size 2024-09-16T00:50:27.408 INFO:tasks.workunit.client.0.smithi053.stdout:2/543: truncate d6/d9/dd/d28/f5d 2144429 0 2024-09-16T00:50:27.410 INFO:tasks.workunit.client.0.smithi053.stdout:7/586: link d1/f3a d1/d60/d77/fbe 0 2024-09-16T00:50:27.411 INFO:tasks.workunit.client.0.smithi053.stdout:7/587: dread - d1/d3/d85/f9d zero size 2024-09-16T00:50:27.411 INFO:tasks.workunit.client.0.smithi053.stdout:8/544: rename d10/d1c/d2b/d58 to d10/d4a/dbf 0 2024-09-16T00:50:27.415 INFO:tasks.workunit.client.0.smithi053.stdout:6/637: mknod d1/d90/cda 0 2024-09-16T00:50:27.415 INFO:tasks.workunit.client.0.smithi053.stdout:6/638: fdatasync d1/dc/d3c/d4b/fbc 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:8/545: dread d10/d1c/d92/d66/fa9 [0,4194304] 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:2/544: dread d6/d9/dd/d28/f57 [0,4194304] 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:2/545: fsync d6/d29/d2b/f99 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:2/546: write d6/f71 [7686896,105487] 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:5/577: dwrite d3/d9c/fad [0,4194304] 0 2024-09-16T00:50:27.421 INFO:tasks.workunit.client.0.smithi053.stdout:5/578: stat d3/d7/d24/d34/d3e/da1 0 2024-09-16T00:50:27.422 INFO:tasks.workunit.client.0.smithi053.stdout:7/588: symlink d1/d2a/d83/d84/db1/lbf 0 2024-09-16T00:50:27.423 INFO:tasks.workunit.client.0.smithi053.stdout:8/546: write d10/d1c/d92/d66/d9d/da6/fbb [613454,60983] 0 2024-09-16T00:50:27.425 INFO:tasks.workunit.client.0.smithi053.stdout:1/545: rename d5/d18/d1f/f35 to d5/fba 0 2024-09-16T00:50:27.435 INFO:tasks.workunit.client.0.smithi053.stdout:5/579: read d3/d7/d2b/f3a [3647921,48770] 0 2024-09-16T00:50:27.435 INFO:tasks.workunit.client.0.smithi053.stdout:5/580: truncate d3/d7/f3b 510984 0 2024-09-16T00:50:27.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/589: dread d1/d2a/f99 [0,4194304] 0 2024-09-16T00:50:27.440 INFO:tasks.workunit.client.0.smithi053.stdout:7/590: creat d1/d3/d85/fc0 x:0 0 0 2024-09-16T00:50:27.442 INFO:tasks.workunit.client.0.smithi053.stdout:6/639: dwrite d1/dc/d1e/d65/fd5 [0,4194304] 0 2024-09-16T00:50:27.445 INFO:tasks.workunit.client.0.smithi053.stdout:8/547: dwrite d10/f1d [0,4194304] 0 2024-09-16T00:50:27.445 INFO:tasks.workunit.client.0.smithi053.stdout:8/548: chown d10/d21/f7f 5 1 2024-09-16T00:50:27.446 INFO:tasks.workunit.client.0.smithi053.stdout:2/547: dwrite d6/f23 [4194304,4194304] 0 2024-09-16T00:50:27.455 INFO:tasks.workunit.client.0.smithi053.stdout:5/581: dwrite d3/d7/f10 [0,4194304] 0 2024-09-16T00:50:27.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/582: creat d3/d7/d42/d57/fbe x:0 0 0 2024-09-16T00:50:27.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/583: stat d3/d7/d2b/d37/c7a 0 2024-09-16T00:50:27.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/584: truncate d3/d7/d42/d57/fbe 754075 0 2024-09-16T00:50:27.466 INFO:tasks.workunit.client.0.smithi053.stdout:6/640: dwrite d1/dc/d54/f64 [0,4194304] 0 2024-09-16T00:50:27.466 INFO:tasks.workunit.client.0.smithi053.stdout:6/641: chown d1/f57 59 1 2024-09-16T00:50:27.472 INFO:tasks.workunit.client.0.smithi053.stdout:5/585: dwrite d3/d7/d2b/d37/d58/f4c [0,4194304] 0 2024-09-16T00:50:27.502 INFO:tasks.workunit.client.0.smithi053.stdout:0/649: rename d4/dc/d1e/d1f/da2/caa to d4/dc/d25/d34/db7/cc9 0 2024-09-16T00:50:27.502 INFO:tasks.workunit.client.0.smithi053.stdout:0/650: truncate d4/dc/d1e/d22/f42 2726178 0 2024-09-16T00:50:27.509 INFO:tasks.workunit.client.0.smithi053.stdout:0/651: dread d4/dc/d87/f50 [0,4194304] 0 2024-09-16T00:50:27.518 INFO:tasks.workunit.client.0.smithi053.stdout:0/652: dread d4/dc/d1e/d1f/da2/fa8 [0,4194304] 0 2024-09-16T00:50:27.528 INFO:tasks.workunit.client.0.smithi053.stdout:7/591: mkdir d1/d3/dc1 0 2024-09-16T00:50:27.543 INFO:tasks.workunit.client.0.smithi053.stdout:5/586: symlink d3/d7/d2b/d37/lbf 0 2024-09-16T00:50:27.543 INFO:tasks.workunit.client.0.smithi053.stdout:5/587: fdatasync d3/d7/f3b 0 2024-09-16T00:50:27.543 INFO:tasks.workunit.client.0.smithi053.stdout:5/588: chown d3/d7/d42/d57/fa0 2392381 1 2024-09-16T00:50:27.543 INFO:tasks.workunit.client.0.smithi053.stdout:2/548: read d6/d9/f5e [1427623,97458] 0 2024-09-16T00:50:27.544 INFO:tasks.workunit.client.0.smithi053.stdout:2/549: write d6/d29/d2b/d39/f8f [246304,80396] 0 2024-09-16T00:50:27.544 INFO:tasks.workunit.client.0.smithi053.stdout:1/546: rmdir d5/d18/d33/d8a/d98 39 2024-09-16T00:50:27.550 INFO:tasks.workunit.client.0.smithi053.stdout:0/653: link d4/d13/f1c d4/dc/d25/d34/d71/fca 0 2024-09-16T00:50:27.551 INFO:tasks.workunit.client.0.smithi053.stdout:5/589: read d3/d7/d2b/d37/d58/f4c [886192,56098] 0 2024-09-16T00:50:27.552 INFO:tasks.workunit.client.0.smithi053.stdout:1/547: dread d5/dd/fb0 [0,4194304] 0 2024-09-16T00:50:27.555 INFO:tasks.workunit.client.0.smithi053.stdout:2/550: mkdir d6/dad 0 2024-09-16T00:50:27.555 INFO:tasks.workunit.client.0.smithi053.stdout:1/548: write d5/d9/d4c/d61/f6e [3992805,40043] 0 2024-09-16T00:50:27.563 INFO:tasks.workunit.client.0.smithi053.stdout:1/549: mkdir d5/dd/dbb 0 2024-09-16T00:50:27.563 INFO:tasks.workunit.client.0.smithi053.stdout:1/550: chown d5/d18/ca3 85 1 2024-09-16T00:50:27.566 INFO:tasks.workunit.client.0.smithi053.stdout:5/590: rmdir d3/d7/d2b/d4b/d51 39 2024-09-16T00:50:27.569 INFO:tasks.workunit.client.0.smithi053.stdout:7/592: rmdir d1/d35/d14/d80 0 2024-09-16T00:50:27.569 INFO:tasks.workunit.client.0.smithi053.stdout:7/593: write d1/d35/d4a/f56 [1438544,1737] 0 2024-09-16T00:50:27.569 INFO:tasks.workunit.client.0.smithi053.stdout:0/654: dwrite d4/dc/d1e/d22/fba [0,4194304] 0 2024-09-16T00:50:27.570 INFO:tasks.workunit.client.0.smithi053.stdout:1/551: rename d5/dd/d19/l4d to d5/dd/lbc 0 2024-09-16T00:50:27.571 INFO:tasks.workunit.client.0.smithi053.stdout:5/591: creat d3/d7/d2b/d4b/d51/fc0 x:0 0 0 2024-09-16T00:50:27.572 INFO:tasks.workunit.client.0.smithi053.stdout:2/551: dwrite d6/d9/dd/d76/f8e [0,4194304] 0 2024-09-16T00:50:27.574 INFO:tasks.workunit.client.0.smithi053.stdout:7/594: symlink d1/d35/d14/da7/lc2 0 2024-09-16T00:50:27.575 INFO:tasks.workunit.client.0.smithi053.stdout:0/655: rename d4/dc/d1e/d1f/d40/d44/lb3 to d4/dc/dc0/lcb 0 2024-09-16T00:50:27.576 INFO:tasks.workunit.client.0.smithi053.stdout:1/552: symlink d5/d7/lbd 0 2024-09-16T00:50:27.576 INFO:tasks.workunit.client.0.smithi053.stdout:1/553: chown d5/d7/d39/d57/d82 7196991 1 2024-09-16T00:50:27.576 INFO:tasks.workunit.client.0.smithi053.stdout:1/554: stat d5/d9/f4b 0 2024-09-16T00:50:27.578 INFO:tasks.workunit.client.0.smithi053.stdout:5/592: dread d3/d7/d2b/f3a [0,4194304] 0 2024-09-16T00:50:27.578 INFO:tasks.workunit.client.0.smithi053.stdout:5/593: creat d3/d7/d2b/d4b/d51/fc1 x:0 0 0 2024-09-16T00:50:27.578 INFO:tasks.workunit.client.0.smithi053.stdout:5/594: dread - d3/d7/d24/d34/d3e/fb7 zero size 2024-09-16T00:50:27.581 INFO:tasks.workunit.client.0.smithi053.stdout:2/552: mkdir d6/dae 0 2024-09-16T00:50:27.581 INFO:tasks.workunit.client.0.smithi053.stdout:7/595: mknod d1/d35/d5b/cc3 0 2024-09-16T00:50:27.581 INFO:tasks.workunit.client.0.smithi053.stdout:7/596: creat d1/d35/d4a/d74/fc4 x:0 0 0 2024-09-16T00:50:27.590 INFO:tasks.workunit.client.0.smithi053.stdout:2/553: creat d6/d90/faf x:0 0 0 2024-09-16T00:50:27.593 INFO:tasks.workunit.client.0.smithi053.stdout:7/597: creat d1/d2a/d83/d84/fc5 x:0 0 0 2024-09-16T00:50:27.594 INFO:tasks.workunit.client.0.smithi053.stdout:7/598: truncate d1/d35/d14/d15/f1d 2129400 0 2024-09-16T00:50:27.594 INFO:tasks.workunit.client.0.smithi053.stdout:7/599: chown d1/d60/d70/dac/fa4 237226 1 2024-09-16T00:50:27.595 INFO:tasks.workunit.client.0.smithi053.stdout:1/555: rmdir d5/d9/d73 39 2024-09-16T00:50:27.595 INFO:tasks.workunit.client.0.smithi053.stdout:1/556: fsync d5/d7/f66 0 2024-09-16T00:50:27.597 INFO:tasks.workunit.client.0.smithi053.stdout:2/554: chown d6/d9/f12 10477 1 2024-09-16T00:50:27.600 INFO:tasks.workunit.client.0.smithi053.stdout:0/656: dwrite d4/dc/d1e/d1f/d40/d44/d54/db8/fc1 [0,4194304] 0 2024-09-16T00:50:27.600 INFO:tasks.workunit.client.0.smithi053.stdout:0/657: fdatasync d4/dc/d87/f50 0 2024-09-16T00:50:27.600 INFO:tasks.workunit.client.0.smithi053.stdout:7/600: truncate d1/d35/d14/f38 76701 0 2024-09-16T00:50:27.603 INFO:tasks.workunit.client.0.smithi053.stdout:5/595: read d3/f35 [8136529,476] 0 2024-09-16T00:50:27.603 INFO:tasks.workunit.client.0.smithi053.stdout:5/596: write d3/d7/d24/d34/d3e/fb7 [576373,46785] 0 2024-09-16T00:50:27.605 INFO:tasks.workunit.client.0.smithi053.stdout:0/658: link d4/dc/l1a d4/dc/d1e/d1f/d40/d73/lcc 0 2024-09-16T00:50:27.606 INFO:tasks.workunit.client.0.smithi053.stdout:0/659: fdatasync d4/d13/f41 0 2024-09-16T00:50:27.607 INFO:tasks.workunit.client.0.smithi053.stdout:7/601: mkdir d1/d60/d70/dc6 0 2024-09-16T00:50:27.609 INFO:tasks.workunit.client.0.smithi053.stdout:0/660: symlink d4/dc/d87/dc6/dbe/d4a/lcd 0 2024-09-16T00:50:27.609 INFO:tasks.workunit.client.0.smithi053.stdout:0/661: write d4/dc/d87/dc6/dbe/fae [811618,87103] 0 2024-09-16T00:50:27.611 INFO:tasks.workunit.client.0.smithi053.stdout:5/597: dread d3/fb6 [0,4194304] 0 2024-09-16T00:50:27.616 INFO:tasks.workunit.client.0.smithi053.stdout:7/602: rmdir d1/d2a/d4f 39 2024-09-16T00:50:27.621 INFO:tasks.workunit.client.0.smithi053.stdout:2/555: dread d6/f7 [0,4194304] 0 2024-09-16T00:50:27.621 INFO:tasks.workunit.client.0.smithi053.stdout:1/557: dwrite d5/d18/d33/d8a/d98/fb7 [0,4194304] 0 2024-09-16T00:50:27.628 INFO:tasks.workunit.client.0.smithi053.stdout:5/598: rmdir d3 39 2024-09-16T00:50:27.629 INFO:tasks.workunit.client.0.smithi053.stdout:0/662: dwrite d4/dc/d25/f2f [0,4194304] 0 2024-09-16T00:50:27.635 INFO:tasks.workunit.client.0.smithi053.stdout:7/603: write d1/d60/d62/f6f [546109,71595] 0 2024-09-16T00:50:27.638 INFO:tasks.workunit.client.0.smithi053.stdout:0/663: write d4/d5a/f7e [2866983,15181] 0 2024-09-16T00:50:27.642 INFO:tasks.workunit.client.0.smithi053.stdout:5/599: dread d3/d7/d24/d3f/f75 [0,4194304] 0 2024-09-16T00:50:27.642 INFO:tasks.workunit.client.0.smithi053.stdout:5/600: write d3/d7/d2b/d37/d58/d79/f9a [1028289,129033] 0 2024-09-16T00:50:27.644 INFO:tasks.workunit.client.0.smithi053.stdout:2/556: rename d6/d29/d2b/f5b to d6/dad/fb0 0 2024-09-16T00:50:27.647 INFO:tasks.workunit.client.0.smithi053.stdout:0/664: dread d4/dc/d87/dc6/f7c [0,4194304] 0 2024-09-16T00:50:27.652 INFO:tasks.workunit.client.0.smithi053.stdout:7/604: creat d1/d60/d70/d92/fc7 x:0 0 0 2024-09-16T00:50:27.654 INFO:tasks.workunit.client.0.smithi053.stdout:5/601: symlink d3/d7/d2b/dbc/lc2 0 2024-09-16T00:50:27.658 INFO:tasks.workunit.client.0.smithi053.stdout:1/558: rename d5/dd/d19/c6b to d5/d18/d1f/cbe 0 2024-09-16T00:50:27.658 INFO:tasks.workunit.client.0.smithi053.stdout:1/559: write d5/d7/d39/f6c [723487,54814] 0 2024-09-16T00:50:27.659 INFO:tasks.workunit.client.0.smithi053.stdout:7/605: creat d1/d35/d14/fc8 x:0 0 0 2024-09-16T00:50:27.659 INFO:tasks.workunit.client.0.smithi053.stdout:7/606: chown d1/d60/d77/fbe 2011 1 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/557: dwrite d6/d29/fab [0,4194304] 0 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/558: fsync d6/d9/dd/d3e/d72/d75/fa1 0 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/559: readlink d6/d9/dd/d28/l55 0 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/560: chown d6/d9/d14/f1f 1 1 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:0/665: rename d4/dc/d1e/d1f/c55 to d4/dc/dbd/cce 0 2024-09-16T00:50:27.661 INFO:tasks.workunit.client.0.smithi053.stdout:0/666: truncate d4/dc/d87/fa0 1190372 0 2024-09-16T00:50:27.662 INFO:tasks.workunit.client.0.smithi053.stdout:5/602: write d3/d7/f10 [833021,40548] 0 2024-09-16T00:50:27.663 INFO:tasks.workunit.client.0.smithi053.stdout:7/607: getdents d1/d35 0 2024-09-16T00:50:27.666 INFO:tasks.workunit.client.0.smithi053.stdout:2/561: mkdir d6/db1 0 2024-09-16T00:50:27.666 INFO:tasks.workunit.client.0.smithi053.stdout:2/562: readlink d6/d9/dd/d3e/d52/l67 0 2024-09-16T00:50:27.666 INFO:tasks.workunit.client.0.smithi053.stdout:2/563: stat d6/d9/dd/d3e/d52/d65/d92 0 2024-09-16T00:50:27.667 INFO:tasks.workunit.client.0.smithi053.stdout:0/667: rename d4/dc/d87/dc6/dbe/fb1 to d4/dc/d87/dc6/dbe/d4a/fcf 0 2024-09-16T00:50:27.674 INFO:tasks.workunit.client.0.smithi053.stdout:7/608: creat d1/d60/d62/fc9 x:0 0 0 2024-09-16T00:50:27.674 INFO:tasks.workunit.client.0.smithi053.stdout:7/609: chown d1/d35/d4a/f56 60 1 2024-09-16T00:50:27.674 INFO:tasks.workunit.client.0.smithi053.stdout:1/560: getdents d5/d18/d1f 0 2024-09-16T00:50:27.677 INFO:tasks.workunit.client.0.smithi053.stdout:2/564: mknod d6/dae/cb2 0 2024-09-16T00:50:27.678 INFO:tasks.workunit.client.0.smithi053.stdout:5/603: dwrite d3/d7/d24/d3f/f86 [0,4194304] 0 2024-09-16T00:50:27.678 INFO:tasks.workunit.client.0.smithi053.stdout:0/668: mknod d4/dc/d87/dc6/dc2/cd0 0 2024-09-16T00:50:27.681 INFO:tasks.workunit.client.0.smithi053.stdout:7/610: rename d1/d35/d4a/f68 to d1/d2a/d83/d84/fca 0 2024-09-16T00:50:27.681 INFO:tasks.workunit.client.0.smithi053.stdout:7/611: creat d1/d35/d4a/d74/fcb x:0 0 0 2024-09-16T00:50:27.682 INFO:tasks.workunit.client.0.smithi053.stdout:1/561: write d5/d9/f3b [291587,39398] 0 2024-09-16T00:50:27.683 INFO:tasks.workunit.client.0.smithi053.stdout:2/565: creat d6/dae/fb3 x:0 0 0 2024-09-16T00:50:27.686 INFO:tasks.workunit.client.0.smithi053.stdout:0/669: dread d4/dc/d25/d34/f88 [0,4194304] 0 2024-09-16T00:50:27.690 INFO:tasks.workunit.client.0.smithi053.stdout:5/604: dread d3/d7/d2b/d37/d58/f19 [4194304,4194304] 0 2024-09-16T00:50:27.693 INFO:tasks.workunit.client.0.smithi053.stdout:5/605: dread d3/d7/d24/d3f/f9e [0,4194304] 0 2024-09-16T00:50:27.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:27 smithi152 ceph-mon[33237]: pgmap v14: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 315 MiB/s rd, 360 MiB/s wr, 544 op/s 2024-09-16T00:50:27.696 INFO:tasks.workunit.client.0.smithi053.stdout:7/612: mkdir d1/d2a/d83/dcc 0 2024-09-16T00:50:27.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/566: mknod d6/d29/d2b/d39/cb4 0 2024-09-16T00:50:27.699 INFO:tasks.workunit.client.0.smithi053.stdout:1/562: dwrite d5/d9/f3b [0,4194304] 0 2024-09-16T00:50:27.701 INFO:tasks.workunit.client.0.smithi053.stdout:0/670: truncate d4/dc/d1e/d22/f29 1508269 0 2024-09-16T00:50:27.702 INFO:tasks.workunit.client.0.smithi053.stdout:5/606: creat d3/d7/d2b/d4b/d51/d96/fc3 x:0 0 0 2024-09-16T00:50:27.706 INFO:tasks.workunit.client.0.smithi053.stdout:7/613: rmdir d1/d35/d4a 39 2024-09-16T00:50:27.708 INFO:tasks.workunit.client.0.smithi053.stdout:2/567: link d6/d9/dd/d3e/d52/d65/d92/fa7 d6/d9/d14/d81/fb5 0 2024-09-16T00:50:27.711 INFO:tasks.workunit.client.0.smithi053.stdout:1/563: rename d5/d7/d39/f4f to d5/dd/d8e/fbf 0 2024-09-16T00:50:27.712 INFO:tasks.workunit.client.0.smithi053.stdout:0/671: creat d4/fd1 x:0 0 0 2024-09-16T00:50:27.713 INFO:tasks.workunit.client.0.smithi053.stdout:5/607: mkdir d3/d9c/dc4 0 2024-09-16T00:50:27.714 INFO:tasks.workunit.client.0.smithi053.stdout:7/614: mknod d1/d60/ccd 0 2024-09-16T00:50:27.716 INFO:tasks.workunit.client.0.smithi053.stdout:2/568: truncate d6/d9/dd/d3e/d52/d65/f7c 7697066 0 2024-09-16T00:50:27.719 INFO:tasks.workunit.client.0.smithi053.stdout:1/564: mknod d5/d9/d77/da8/cc0 0 2024-09-16T00:50:27.720 INFO:tasks.workunit.client.0.smithi053.stdout:5/608: creat d3/d7/d2b/d4b/d4f/fc5 x:0 0 0 2024-09-16T00:50:27.720 INFO:tasks.workunit.client.0.smithi053.stdout:5/609: fsync d3/d7/d24/d3f/f75 0 2024-09-16T00:50:27.721 INFO:tasks.workunit.client.0.smithi053.stdout:7/615: mkdir d1/db5/dce 0 2024-09-16T00:50:27.726 INFO:tasks.workunit.client.0.smithi053.stdout:7/616: rename d1/d35/d14/d15/f1d to d1/d2a/d83/fcf 0 2024-09-16T00:50:27.726 INFO:tasks.workunit.client.0.smithi053.stdout:7/617: write d1/d2a/d83/d84/fca [4855577,106782] 0 2024-09-16T00:50:27.726 INFO:tasks.workunit.client.0.smithi053.stdout:7/618: creat d1/d35/d14/fd0 x:0 0 0 2024-09-16T00:50:27.727 INFO:tasks.workunit.client.0.smithi053.stdout:1/565: rmdir d5/d18/d33/d30 39 2024-09-16T00:50:27.728 INFO:tasks.workunit.client.0.smithi053.stdout:1/566: fsync d5/d18/f79 0 2024-09-16T00:50:27.734 INFO:tasks.workunit.client.0.smithi053.stdout:5/610: write d3/d9c/fad [2977199,78238] 0 2024-09-16T00:50:27.734 INFO:tasks.workunit.client.0.smithi053.stdout:7/619: creat d1/d60/d70/dac/fd1 x:0 0 0 2024-09-16T00:50:27.734 INFO:tasks.workunit.client.0.smithi053.stdout:7/620: chown d1/db5/dce 540337 1 2024-09-16T00:50:27.737 INFO:tasks.workunit.client.0.smithi053.stdout:1/567: link d5/d18/f1b d5/d18/fc1 0 2024-09-16T00:50:27.742 INFO:tasks.workunit.client.0.smithi053.stdout:5/611: creat d3/fc6 x:0 0 0 2024-09-16T00:50:27.743 INFO:tasks.workunit.client.0.smithi053.stdout:5/612: chown d3/d7/d24/l8a 8982 1 2024-09-16T00:50:27.743 INFO:tasks.workunit.client.0.smithi053.stdout:5/613: write d3/d7/d2b/d37/d58/f6b [1044736,88705] 0 2024-09-16T00:50:27.743 INFO:tasks.workunit.client.0.smithi053.stdout:5/614: truncate d3/d7/d2b/d37/d58/f4c 4782565 0 2024-09-16T00:50:27.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/672: dwrite d4/dc/d1e/d1f/da2/fa8 [0,4194304] 0 2024-09-16T00:50:27.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/673: fdatasync d4/d5a/f94 0 2024-09-16T00:50:27.744 INFO:tasks.workunit.client.0.smithi053.stdout:2/569: dwrite f0 [0,4194304] 0 2024-09-16T00:50:27.745 INFO:tasks.workunit.client.0.smithi053.stdout:2/570: chown d6/d29/c27 3599195 1 2024-09-16T00:50:27.745 INFO:tasks.workunit.client.0.smithi053.stdout:5/615: mkdir d3/d7/d24/d34/d5b/dc7 0 2024-09-16T00:50:27.745 INFO:tasks.workunit.client.0.smithi053.stdout:5/616: fdatasync d3/d7/d24/d34/d3e/f70 0 2024-09-16T00:50:27.749 INFO:tasks.workunit.client.0.smithi053.stdout:0/674: chown d4/cf 600183843 1 2024-09-16T00:50:27.749 INFO:tasks.workunit.client.0.smithi053.stdout:7/621: read d1/f3f [2501998,74141] 0 2024-09-16T00:50:27.750 INFO:tasks.workunit.client.0.smithi053.stdout:7/622: chown d1/d60/ccd 45707279 1 2024-09-16T00:50:27.752 INFO:tasks.workunit.client.0.smithi053.stdout:4/360: sync 2024-09-16T00:50:27.753 INFO:tasks.workunit.client.0.smithi053.stdout:4/361: creat d0/d31/f81 x:0 0 0 2024-09-16T00:50:27.753 INFO:tasks.workunit.client.0.smithi053.stdout:4/362: truncate d0/f38 4245026 0 2024-09-16T00:50:27.753 INFO:tasks.workunit.client.0.smithi053.stdout:4/363: dread - d0/d31/f7a zero size 2024-09-16T00:50:27.753 INFO:tasks.workunit.client.0.smithi053.stdout:2/571: truncate d6/d9/dd/d76/f8e 839440 0 2024-09-16T00:50:27.755 INFO:tasks.workunit.client.0.smithi053.stdout:1/568: dwrite d5/d9/f17 [4194304,4194304] 0 2024-09-16T00:50:27.755 INFO:tasks.workunit.client.0.smithi053.stdout:5/617: unlink d3/d7/d24/d34/c98 0 2024-09-16T00:50:27.764 INFO:tasks.workunit.client.0.smithi053.stdout:1/569: symlink d5/d9/d88/lc2 0 2024-09-16T00:50:27.766 INFO:tasks.workunit.client.0.smithi053.stdout:5/618: creat d3/d7/d24/fc8 x:0 0 0 2024-09-16T00:50:27.767 INFO:tasks.workunit.client.0.smithi053.stdout:2/572: write d6/d9/dd/d28/f5d [350869,84370] 0 2024-09-16T00:50:27.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/364: symlink d0/l82 0 2024-09-16T00:50:27.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/365: write d0/d31/f43 [993832,27675] 0 2024-09-16T00:50:27.771 INFO:tasks.workunit.client.0.smithi053.stdout:5/619: creat d3/d7/d24/d34/d3e/da1/fc9 x:0 0 0 2024-09-16T00:50:27.773 INFO:tasks.workunit.client.0.smithi053.stdout:1/570: read d5/d9/f17 [6515124,64337] 0 2024-09-16T00:50:27.777 INFO:tasks.workunit.client.0.smithi053.stdout:5/620: symlink d3/d7/d2b/d37/d58/lca 0 2024-09-16T00:50:27.778 INFO:tasks.workunit.client.0.smithi053.stdout:0/675: dwrite d4/d5a/f7e [0,4194304] 0 2024-09-16T00:50:27.779 INFO:tasks.workunit.client.0.smithi053.stdout:2/573: mkdir d6/d9/db6 0 2024-09-16T00:50:27.781 INFO:tasks.workunit.client.0.smithi053.stdout:7/623: dwrite d1/d3/d85/fbc [0,4194304] 0 2024-09-16T00:50:27.783 INFO:tasks.workunit.client.0.smithi053.stdout:0/676: mkdir d4/dc/d1e/d22/dc5/dd2 0 2024-09-16T00:50:27.784 INFO:tasks.workunit.client.0.smithi053.stdout:2/574: mkdir d6/d29/db7 0 2024-09-16T00:50:27.784 INFO:tasks.workunit.client.0.smithi053.stdout:2/575: write d6/f77 [1108283,73228] 0 2024-09-16T00:50:27.790 INFO:tasks.workunit.client.0.smithi053.stdout:4/366: dwrite d0/d2/dd/d25/d41/d78/f6a [0,4194304] 0 2024-09-16T00:50:27.793 INFO:tasks.workunit.client.0.smithi053.stdout:0/677: write d4/d5a/f7e [774886,39989] 0 2024-09-16T00:50:27.796 INFO:tasks.workunit.client.0.smithi053.stdout:7/624: getdents d1/d35/d4a/dbb 0 2024-09-16T00:50:27.796 INFO:tasks.workunit.client.0.smithi053.stdout:7/625: truncate d1/d2a/d4f/fb7 441893 0 2024-09-16T00:50:27.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/576: mknod d6/d9/dd/d3e/d52/cb8 0 2024-09-16T00:50:27.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/577: chown d6/dae/fb3 0 1 2024-09-16T00:50:27.797 INFO:tasks.workunit.client.0.smithi053.stdout:2/578: readlink d6/d9/dd/d3e/d52/d65/l66 0 2024-09-16T00:50:27.798 INFO:tasks.workunit.client.0.smithi053.stdout:5/621: dwrite d3/d7/d24/d3f/f8c [0,4194304] 0 2024-09-16T00:50:27.801 INFO:tasks.workunit.client.0.smithi053.stdout:4/367: creat d0/d3c/d48/d53/f83 x:0 0 0 2024-09-16T00:50:27.802 INFO:tasks.workunit.client.0.smithi053.stdout:0/678: symlink d4/dc/d1e/d1f/ld3 0 2024-09-16T00:50:27.802 INFO:tasks.workunit.client.0.smithi053.stdout:0/679: write d4/d13/f41 [2948863,45664] 0 2024-09-16T00:50:27.803 INFO:tasks.workunit.client.0.smithi053.stdout:7/626: mknod d1/d60/d70/cd2 0 2024-09-16T00:50:27.803 INFO:tasks.workunit.client.0.smithi053.stdout:2/579: symlink d6/d29/d2b/lb9 0 2024-09-16T00:50:27.809 INFO:tasks.workunit.client.0.smithi053.stdout:4/368: symlink d0/d2/dd/d25/d41/d78/l84 0 2024-09-16T00:50:27.809 INFO:tasks.workunit.client.0.smithi053.stdout:4/369: fdatasync d0/f38 0 2024-09-16T00:50:27.809 INFO:tasks.workunit.client.0.smithi053.stdout:9/543: sync 2024-09-16T00:50:27.810 INFO:tasks.workunit.client.0.smithi053.stdout:0/680: mkdir d4/dc/d1e/d1f/dd4 0 2024-09-16T00:50:27.810 INFO:tasks.workunit.client.0.smithi053.stdout:0/681: dread - d4/d13/fbb zero size 2024-09-16T00:50:27.812 INFO:tasks.workunit.client.0.smithi053.stdout:7/627: truncate d1/d60/d70/dac/f5d 3230600 0 2024-09-16T00:50:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:27 smithi053 ceph-mon[27950]: pgmap v14: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 315 MiB/s rd, 360 MiB/s wr, 544 op/s 2024-09-16T00:50:27.819 INFO:tasks.workunit.client.0.smithi053.stdout:0/682: rename d4/dc/d1e/d22/c64 to d4/dc/d25/d34/d71/d96/d5b/cd5 0 2024-09-16T00:50:27.820 INFO:tasks.workunit.client.0.smithi053.stdout:0/683: fdatasync d4/dc/d87/fa0 0 2024-09-16T00:50:27.822 INFO:tasks.workunit.client.0.smithi053.stdout:2/580: getdents d6/d9/dd/d76 0 2024-09-16T00:50:27.823 INFO:tasks.workunit.client.0.smithi053.stdout:9/544: truncate d8/fc 4485148 0 2024-09-16T00:50:27.826 INFO:tasks.workunit.client.0.smithi053.stdout:0/684: mkdir d4/dc/d1e/d1f/d40/d73/dd6 0 2024-09-16T00:50:27.826 INFO:tasks.workunit.client.0.smithi053.stdout:0/685: fdatasync d4/dc/d1e/d1f/d40/d44/d54/f98 0 2024-09-16T00:50:27.827 INFO:tasks.workunit.client.0.smithi053.stdout:4/370: dwrite d0/f5 [0,4194304] 0 2024-09-16T00:50:27.828 INFO:tasks.workunit.client.0.smithi053.stdout:2/581: mkdir d6/d90/dba 0 2024-09-16T00:50:27.828 INFO:tasks.workunit.client.0.smithi053.stdout:7/628: dwrite d1/d35/f1e [8388608,4194304] 0 2024-09-16T00:50:27.829 INFO:tasks.workunit.client.0.smithi053.stdout:8/549: sync 2024-09-16T00:50:27.829 INFO:tasks.workunit.client.0.smithi053.stdout:3/649: sync 2024-09-16T00:50:27.829 INFO:tasks.workunit.client.0.smithi053.stdout:6/642: sync 2024-09-16T00:50:27.831 INFO:tasks.workunit.client.0.smithi053.stdout:9/545: creat d8/d19/d51/d6d/d7a/faf x:0 0 0 2024-09-16T00:50:27.839 INFO:tasks.workunit.client.0.smithi053.stdout:4/371: unlink d0/d31/f43 0 2024-09-16T00:50:27.839 INFO:tasks.workunit.client.0.smithi053.stdout:4/372: fdatasync d0/da/f69 0 2024-09-16T00:50:27.841 INFO:tasks.workunit.client.0.smithi053.stdout:2/582: mkdir d6/d9/dd/dbb 0 2024-09-16T00:50:27.841 INFO:tasks.workunit.client.0.smithi053.stdout:2/583: stat d6/dad/fb0 0 2024-09-16T00:50:27.841 INFO:tasks.workunit.client.0.smithi053.stdout:6/643: dwrite d1/dc/d1e/d41/f7e [0,4194304] 0 2024-09-16T00:50:27.847 INFO:tasks.workunit.client.0.smithi053.stdout:7/629: mknod d1/d2a/d83/d84/db1/cd3 0 2024-09-16T00:50:27.849 INFO:tasks.workunit.client.0.smithi053.stdout:3/650: link d1/d89/f71 d1/d5/d91/d5e/d90/fd6 0 2024-09-16T00:50:27.854 INFO:tasks.workunit.client.0.smithi053.stdout:7/630: write d1/d35/d14/f2f [2664998,198] 0 2024-09-16T00:50:27.855 INFO:tasks.workunit.client.0.smithi053.stdout:4/373: creat d0/d3c/d48/d4d/d70/f85 x:0 0 0 2024-09-16T00:50:27.860 INFO:tasks.workunit.client.0.smithi053.stdout:2/584: mkdir d6/d9/db6/dbc 0 2024-09-16T00:50:27.861 INFO:tasks.workunit.client.0.smithi053.stdout:9/546: dread d8/d13/f66 [0,4194304] 0 2024-09-16T00:50:27.863 INFO:tasks.workunit.client.0.smithi053.stdout:6/644: creat d1/dc/d3c/d4a/fdb x:0 0 0 2024-09-16T00:50:27.863 INFO:tasks.workunit.client.0.smithi053.stdout:6/645: write d1/d90/f9f [206198,107767] 0 2024-09-16T00:50:27.868 INFO:tasks.workunit.client.0.smithi053.stdout:3/651: stat d1/d5/l72 0 2024-09-16T00:50:27.869 INFO:tasks.workunit.client.0.smithi053.stdout:8/550: getdents d10/d21/d28/d3c/d63 0 2024-09-16T00:50:27.870 INFO:tasks.workunit.client.0.smithi053.stdout:8/551: read d10/d52/f55 [176641,94159] 0 2024-09-16T00:50:27.871 INFO:tasks.workunit.client.0.smithi053.stdout:7/631: mknod d1/d35/d14/d15/cd4 0 2024-09-16T00:50:27.871 INFO:tasks.workunit.client.0.smithi053.stdout:7/632: write d1/d2a/f79 [3733872,27441] 0 2024-09-16T00:50:27.871 INFO:tasks.workunit.client.0.smithi053.stdout:0/686: rename d4/dc/d1e/d1f/da2 to d4/dc/d1e/d1f/d40/d73/dd7 0 2024-09-16T00:50:27.873 INFO:tasks.workunit.client.0.smithi053.stdout:2/585: dwrite d6/d29/d2b/d39/f9b [0,4194304] 0 2024-09-16T00:50:27.874 INFO:tasks.workunit.client.0.smithi053.stdout:4/374: mknod d0/d2/dd/d25/d39/c86 0 2024-09-16T00:50:27.874 INFO:tasks.workunit.client.0.smithi053.stdout:4/375: write d0/da/f69 [724588,60838] 0 2024-09-16T00:50:27.877 INFO:tasks.workunit.client.0.smithi053.stdout:8/552: creat d10/d1c/d2b/d40/d76/fc0 x:0 0 0 2024-09-16T00:50:27.879 INFO:tasks.workunit.client.0.smithi053.stdout:7/633: dread d1/d2a/d83/d84/fca [0,4194304] 0 2024-09-16T00:50:27.879 INFO:tasks.workunit.client.0.smithi053.stdout:7/634: dread - d1/d3/d85/fc0 zero size 2024-09-16T00:50:27.879 INFO:tasks.workunit.client.0.smithi053.stdout:7/635: fsync d1/d35/d4a/d74/fb4 0 2024-09-16T00:50:27.879 INFO:tasks.workunit.client.0.smithi053.stdout:0/687: creat d4/dc/d87/dc6/fd8 x:0 0 0 2024-09-16T00:50:27.884 INFO:tasks.workunit.client.0.smithi053.stdout:9/547: symlink d8/d19/d31/lb0 0 2024-09-16T00:50:27.884 INFO:tasks.workunit.client.0.smithi053.stdout:3/652: dread d1/d5/f68 [0,4194304] 0 2024-09-16T00:50:27.886 INFO:tasks.workunit.client.0.smithi053.stdout:4/376: mkdir d0/d2/dd/d25/d37/d71/d87 0 2024-09-16T00:50:27.886 INFO:tasks.workunit.client.0.smithi053.stdout:4/377: stat d0/d2/dd/d25/d37/l3a 0 2024-09-16T00:50:27.887 INFO:tasks.workunit.client.0.smithi053.stdout:8/553: dread d10/f20 [4194304,4194304] 0 2024-09-16T00:50:27.887 INFO:tasks.workunit.client.0.smithi053.stdout:8/554: fsync d10/f24 0 2024-09-16T00:50:27.887 INFO:tasks.workunit.client.0.smithi053.stdout:8/555: stat l5 0 2024-09-16T00:50:27.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/646: rename d1/c7c to d1/cdc 0 2024-09-16T00:50:27.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/647: write d1/dc/d3d/f61 [484191,122990] 0 2024-09-16T00:50:27.889 INFO:tasks.workunit.client.0.smithi053.stdout:6/648: write d1/dc/d3c/d4b/d75/fc0 [157035,100754] 0 2024-09-16T00:50:27.900 INFO:tasks.workunit.client.0.smithi053.stdout:0/688: stat d4/dc/dc0/lcb 0 2024-09-16T00:50:27.901 INFO:tasks.workunit.client.0.smithi053.stdout:9/548: symlink d8/d19/lb1 0 2024-09-16T00:50:27.902 INFO:tasks.workunit.client.0.smithi053.stdout:4/378: chown d0/l18 3882914 1 2024-09-16T00:50:27.904 INFO:tasks.workunit.client.0.smithi053.stdout:7/636: link d1/d2a/f99 d1/d2a/d4f/d52/fd5 0 2024-09-16T00:50:27.905 INFO:tasks.workunit.client.0.smithi053.stdout:0/689: creat d4/dc/d87/dbf/fd9 x:0 0 0 2024-09-16T00:50:27.906 INFO:tasks.workunit.client.0.smithi053.stdout:9/549: mkdir d8/d19/d51/d6d/d7a/db2 0 2024-09-16T00:50:27.907 INFO:tasks.workunit.client.0.smithi053.stdout:4/379: mknod d0/d2/d1e/c88 0 2024-09-16T00:50:27.909 INFO:tasks.workunit.client.0.smithi053.stdout:0/690: dread d4/dc/d1e/d22/f29 [0,4194304] 0 2024-09-16T00:50:27.909 INFO:tasks.workunit.client.0.smithi053.stdout:7/637: symlink d1/d35/d14/d15/ld6 0 2024-09-16T00:50:27.910 INFO:tasks.workunit.client.0.smithi053.stdout:4/380: link d0/d3c/l5a d0/d3c/d48/d53/l89 0 2024-09-16T00:50:27.912 INFO:tasks.workunit.client.0.smithi053.stdout:6/649: dwrite d1/dc/d1e/d65/dc6/fd7 [4194304,4194304] 0 2024-09-16T00:50:27.912 INFO:tasks.workunit.client.0.smithi053.stdout:0/691: unlink d4/dc/d25/d34/d71/d96/d5b/f78 0 2024-09-16T00:50:27.913 INFO:tasks.workunit.client.0.smithi053.stdout:8/556: dwrite d10/d1c/d92/fb0 [0,4194304] 0 2024-09-16T00:50:27.915 INFO:tasks.workunit.client.0.smithi053.stdout:9/550: dread d8/d1c/d2b/f96 [0,4194304] 0 2024-09-16T00:50:27.916 INFO:tasks.workunit.client.0.smithi053.stdout:6/650: mkdir d1/dc/d3c/ddd 0 2024-09-16T00:50:27.918 INFO:tasks.workunit.client.0.smithi053.stdout:0/692: creat d4/dc/d1e/d22/dc5/dd2/fda x:0 0 0 2024-09-16T00:50:27.918 INFO:tasks.workunit.client.0.smithi053.stdout:0/693: chown d4/dc/d87/dc6/dbe/l7a 0 1 2024-09-16T00:50:27.919 INFO:tasks.workunit.client.0.smithi053.stdout:4/381: mkdir d0/da/d42/d8a 0 2024-09-16T00:50:27.919 INFO:tasks.workunit.client.0.smithi053.stdout:4/382: chown d0/d3c 6037854 1 2024-09-16T00:50:27.922 INFO:tasks.workunit.client.0.smithi053.stdout:9/551: creat d8/fb3 x:0 0 0 2024-09-16T00:50:27.924 INFO:tasks.workunit.client.0.smithi053.stdout:8/557: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:27.927 INFO:tasks.workunit.client.0.smithi053.stdout:6/651: dread d1/dc/d1e/d41/f7e [0,4194304] 0 2024-09-16T00:50:27.927 INFO:tasks.workunit.client.0.smithi053.stdout:9/552: creat d8/d4c/d5a/d99/fb4 x:0 0 0 2024-09-16T00:50:27.927 INFO:tasks.workunit.client.0.smithi053.stdout:9/553: chown d8/f35 142977057 1 2024-09-16T00:50:27.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/383: rename d0/d2/dd/d25/d37/d71 to d0/da/d42/d8b 0 2024-09-16T00:50:27.934 INFO:tasks.workunit.client.0.smithi053.stdout:7/638: dwrite d1/d60/d62/fc9 [0,4194304] 0 2024-09-16T00:50:27.934 INFO:tasks.workunit.client.0.smithi053.stdout:9/554: dread d8/f35 [0,4194304] 0 2024-09-16T00:50:27.935 INFO:tasks.workunit.client.0.smithi053.stdout:0/694: dwrite d4/dc/d1e/d1f/d40/f7b [0,4194304] 0 2024-09-16T00:50:27.935 INFO:tasks.workunit.client.0.smithi053.stdout:4/384: truncate d0/d2/dd/d25/d41/d78/f2b 249469 0 2024-09-16T00:50:27.935 INFO:tasks.workunit.client.0.smithi053.stdout:0/695: write d4/dc/dc0/f75 [342314,20314] 0 2024-09-16T00:50:27.935 INFO:tasks.workunit.client.0.smithi053.stdout:0/696: readlink d4/dc/d1e/d1f/ld3 0 2024-09-16T00:50:27.943 INFO:tasks.workunit.client.0.smithi053.stdout:6/652: dwrite d1/dc/d1e/d65/dc6/fd3 [0,4194304] 0 2024-09-16T00:50:27.944 INFO:tasks.workunit.client.0.smithi053.stdout:7/639: rename d1/d2a/d83/d84/db1/lbf to d1/d35/d14/d15/ld7 0 2024-09-16T00:50:27.944 INFO:tasks.workunit.client.0.smithi053.stdout:7/640: chown d1/d3/c57 15452 1 2024-09-16T00:50:27.944 INFO:tasks.workunit.client.0.smithi053.stdout:7/641: creat d1/d35/d14/fd8 x:0 0 0 2024-09-16T00:50:27.944 INFO:tasks.workunit.client.0.smithi053.stdout:7/642: dread d1/d35/d14/d15/f48 [0,4194304] 0 2024-09-16T00:50:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:4/385: mkdir d0/d3c/d48/d4d/d8c 0 2024-09-16T00:50:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:4/386: read d0/d2/f1b [3362009,54026] 0 2024-09-16T00:50:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:4/387: write d0/d3c/d48/f67 [976283,91303] 0 2024-09-16T00:50:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:0/697: dwrite d4/dc/d25/d34/d71/d96/fb2 [0,4194304] 0 2024-09-16T00:50:27.958 INFO:tasks.workunit.client.0.smithi053.stdout:6/653: dwrite d1/dc/d1e/fc3 [0,4194304] 0 2024-09-16T00:50:27.958 INFO:tasks.workunit.client.0.smithi053.stdout:9/555: rename d8/d19/c2e to d8/d1c/d2b/d8b/cb5 0 2024-09-16T00:50:27.960 INFO:tasks.workunit.client.0.smithi053.stdout:7/643: truncate d1/d60/d77/f6a 482460 0 2024-09-16T00:50:27.962 INFO:tasks.workunit.client.0.smithi053.stdout:4/388: unlink d0/d3c/d48/d53/l89 0 2024-09-16T00:50:27.965 INFO:tasks.workunit.client.0.smithi053.stdout:0/698: creat d4/dc/d25/d34/d71/fdb x:0 0 0 2024-09-16T00:50:27.969 INFO:tasks.workunit.client.0.smithi053.stdout:6/654: mknod d1/dc/cde 0 2024-09-16T00:50:27.970 INFO:tasks.workunit.client.0.smithi053.stdout:9/556: mkdir d8/d1c/d2b/db6 0 2024-09-16T00:50:27.971 INFO:tasks.workunit.client.0.smithi053.stdout:9/557: chown d8/d13/l97 11588625 1 2024-09-16T00:50:27.972 INFO:tasks.workunit.client.0.smithi053.stdout:7/644: mkdir d1/dd9 0 2024-09-16T00:50:27.973 INFO:tasks.workunit.client.0.smithi053.stdout:4/389: unlink d0/d31/l3b 0 2024-09-16T00:50:27.973 INFO:tasks.workunit.client.0.smithi053.stdout:4/390: fsync d0/d3c/d48/d4d/d70/f85 0 2024-09-16T00:50:27.980 INFO:tasks.workunit.client.0.smithi053.stdout:9/558: write f6 [2449639,38891] 0 2024-09-16T00:50:27.980 INFO:tasks.workunit.client.0.smithi053.stdout:4/391: mknod d0/d3c/d48/d58/c8d 0 2024-09-16T00:50:27.984 INFO:tasks.workunit.client.0.smithi053.stdout:6/655: link d1/dc/c26 d1/cdf 0 2024-09-16T00:50:27.989 INFO:tasks.workunit.client.0.smithi053.stdout:9/559: getdents d8/d4c 0 2024-09-16T00:50:27.991 INFO:tasks.workunit.client.0.smithi053.stdout:6/656: creat d1/dc/d3c/d4b/d58/db9/fe0 x:0 0 0 2024-09-16T00:50:27.994 INFO:tasks.workunit.client.0.smithi053.stdout:9/560: creat d8/d1c/d2b/d2c/d9b/fb7 x:0 0 0 2024-09-16T00:50:27.994 INFO:tasks.workunit.client.0.smithi053.stdout:9/561: creat d8/d1c/d2b/d5c/fb8 x:0 0 0 2024-09-16T00:50:27.994 INFO:tasks.workunit.client.0.smithi053.stdout:9/562: getdents d8/d19/d51/d6d/d7a/db2 0 2024-09-16T00:50:27.995 INFO:tasks.workunit.client.0.smithi053.stdout:4/392: read d0/f5 [1846983,10359] 0 2024-09-16T00:50:27.996 INFO:tasks.workunit.client.0.smithi053.stdout:7/645: dwrite d1/d35/d5b/d93/f96 [0,4194304] 0 2024-09-16T00:50:28.001 INFO:tasks.workunit.client.0.smithi053.stdout:9/563: dread d8/d1c/d2b/f52 [4194304,4194304] 0 2024-09-16T00:50:28.003 INFO:tasks.workunit.client.0.smithi053.stdout:7/646: mkdir d1/d3/dda 0 2024-09-16T00:50:28.007 INFO:tasks.workunit.client.0.smithi053.stdout:7/647: mknod d1/dd9/cdb 0 2024-09-16T00:50:28.011 INFO:tasks.workunit.client.0.smithi053.stdout:9/564: rename d8/d1c/d2b/d49/l4e to d8/d13/lb9 0 2024-09-16T00:50:28.020 INFO:tasks.workunit.client.0.smithi053.stdout:7/648: write d1/d35/d5b/f8f [424552,56665] 0 2024-09-16T00:50:28.021 INFO:tasks.workunit.client.0.smithi053.stdout:7/649: mkdir d1/d35/d4a/dbb/ddc 0 2024-09-16T00:50:28.021 INFO:tasks.workunit.client.0.smithi053.stdout:7/650: write d1/d35/d4a/d74/fcb [807413,91107] 0 2024-09-16T00:50:28.022 INFO:tasks.workunit.client.0.smithi053.stdout:7/651: link d1/d2a/d4f/l8b d1/d35/d14/d15/ldd 0 2024-09-16T00:50:28.022 INFO:tasks.workunit.client.0.smithi053.stdout:7/652: creat d1/d3/fde x:0 0 0 2024-09-16T00:50:28.024 INFO:tasks.workunit.client.0.smithi053.stdout:7/653: mkdir d1/d35/d5b/ddf 0 2024-09-16T00:50:28.026 INFO:tasks.workunit.client.0.smithi053.stdout:9/565: dread d8/d19/d51/f56 [0,4194304] 0 2024-09-16T00:50:28.028 INFO:tasks.workunit.client.0.smithi053.stdout:6/657: dwrite d1/dc/d66/f93 [0,4194304] 0 2024-09-16T00:50:28.028 INFO:tasks.workunit.client.0.smithi053.stdout:6/658: chown d1/dc/d1e/l20 10322 1 2024-09-16T00:50:28.028 INFO:tasks.workunit.client.0.smithi053.stdout:6/659: write d1/dc/d1e/d41/fae [617848,54097] 0 2024-09-16T00:50:28.028 INFO:tasks.workunit.client.0.smithi053.stdout:4/393: dwrite d0/da/d42/f51 [0,4194304] 0 2024-09-16T00:50:28.030 INFO:tasks.workunit.client.0.smithi053.stdout:4/394: write d0/da/f4a [768652,23878] 0 2024-09-16T00:50:28.030 INFO:tasks.workunit.client.0.smithi053.stdout:4/395: stat d0/d2/d1e/f6d 0 2024-09-16T00:50:28.030 INFO:tasks.workunit.client.0.smithi053.stdout:4/396: chown d0/d2/dd/d25/d39/c86 550244 1 2024-09-16T00:50:28.030 INFO:tasks.workunit.client.0.smithi053.stdout:4/397: write d0/d2/d1e/d4b/f62 [719529,21761] 0 2024-09-16T00:50:28.030 INFO:tasks.workunit.client.0.smithi053.stdout:4/398: creat d0/d65/f8e x:0 0 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/660: mkdir d1/dc/d3c/d4b/d75/de1 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/661: truncate d1/dc/d3c/d4b/fbc 1045092 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/662: creat d1/dc/d1e/fe2 x:0 0 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:6/663: truncate d1/dc/d3d/db1/fbb 1665834 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:7/654: dread d1/d3/f3c [0,4194304] 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:9/566: rename d8/l3b to d8/d1c/d2b/db6/lba 0 2024-09-16T00:50:28.031 INFO:tasks.workunit.client.0.smithi053.stdout:9/567: readlink d8/d4c/d5a/l95 0 2024-09-16T00:50:28.033 INFO:tasks.workunit.client.0.smithi053.stdout:4/399: symlink d0/da/d42/d8b/l8f 0 2024-09-16T00:50:28.036 INFO:tasks.workunit.client.0.smithi053.stdout:6/664: creat d1/dc/d3c/fe3 x:0 0 0 2024-09-16T00:50:28.037 INFO:tasks.workunit.client.0.smithi053.stdout:4/400: creat d0/d2/dd/d25/d41/d78/f90 x:0 0 0 2024-09-16T00:50:28.042 INFO:tasks.workunit.client.0.smithi053.stdout:7/655: write d1/d35/d5b/d93/f96 [3898080,41478] 0 2024-09-16T00:50:28.042 INFO:tasks.workunit.client.0.smithi053.stdout:7/656: chown d1/d35/d14/f43 3902 1 2024-09-16T00:50:28.043 INFO:tasks.workunit.client.0.smithi053.stdout:9/568: write d8/d1c/d2b/f52 [428023,83887] 0 2024-09-16T00:50:28.046 INFO:tasks.workunit.client.0.smithi053.stdout:4/401: dread d0/d2/d1e/d4b/f57 [0,4194304] 0 2024-09-16T00:50:28.049 INFO:tasks.workunit.client.0.smithi053.stdout:7/657: link d1/d2a/c94 d1/d35/d14/ce0 0 2024-09-16T00:50:28.049 INFO:tasks.workunit.client.0.smithi053.stdout:7/658: write d1/d3/fde [801370,23220] 0 2024-09-16T00:50:28.049 INFO:tasks.workunit.client.0.smithi053.stdout:7/659: truncate d1/d3/d85/fc0 1012356 0 2024-09-16T00:50:28.049 INFO:tasks.workunit.client.0.smithi053.stdout:7/660: fdatasync d1/d35/d4a/f4c 0 2024-09-16T00:50:28.051 INFO:tasks.workunit.client.0.smithi053.stdout:9/569: readlink d8/d13/l53 0 2024-09-16T00:50:28.054 INFO:tasks.workunit.client.0.smithi053.stdout:4/402: rename d0/d65/f7f to d0/d3c/d48/f91 0 2024-09-16T00:50:28.055 INFO:tasks.workunit.client.0.smithi053.stdout:7/661: creat d1/d35/fe1 x:0 0 0 2024-09-16T00:50:28.055 INFO:tasks.workunit.client.0.smithi053.stdout:7/662: write d1/d2a/d4f/d52/f37 [5116036,31084] 0 2024-09-16T00:50:28.057 INFO:tasks.workunit.client.0.smithi053.stdout:7/663: mkdir d1/d2a/d83/d84/de2 0 2024-09-16T00:50:28.059 INFO:tasks.workunit.client.0.smithi053.stdout:7/664: dread d1/d60/d70/f78 [0,4194304] 0 2024-09-16T00:50:28.059 INFO:tasks.workunit.client.0.smithi053.stdout:7/665: chown d1/d60/d70/dac/f7c 243 1 2024-09-16T00:50:28.060 INFO:tasks.workunit.client.0.smithi053.stdout:9/570: write d8/d19/f4a [1900870,56914] 0 2024-09-16T00:50:28.061 INFO:tasks.workunit.client.0.smithi053.stdout:4/403: dread d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:28.064 INFO:tasks.workunit.client.0.smithi053.stdout:9/571: mkdir d8/d1c/d2b/d2c/dbb 0 2024-09-16T00:50:28.064 INFO:tasks.workunit.client.0.smithi053.stdout:9/572: creat d8/d1c/d2b/d8b/fbc x:0 0 0 2024-09-16T00:50:28.076 INFO:tasks.workunit.client.0.smithi053.stdout:7/666: dwrite d1/d60/d77/f6a [0,4194304] 0 2024-09-16T00:50:28.077 INFO:tasks.workunit.client.0.smithi053.stdout:7/667: symlink d1/d60/d77/le3 0 2024-09-16T00:50:28.078 INFO:tasks.workunit.client.0.smithi053.stdout:7/668: getdents d1/d3/dda 0 2024-09-16T00:50:28.098 INFO:tasks.workunit.client.0.smithi053.stdout:9/573: dwrite d8/f1d [0,4194304] 0 2024-09-16T00:50:28.099 INFO:tasks.workunit.client.0.smithi053.stdout:7/669: dwrite d1/d35/d14/d15/f48 [0,4194304] 0 2024-09-16T00:50:28.179 INFO:tasks.workunit.client.0.smithi053.stdout:9/574: rename f6 to d8/d19/d31/fbd 0 2024-09-16T00:50:28.180 INFO:tasks.workunit.client.0.smithi053.stdout:1/571: sync 2024-09-16T00:50:28.181 INFO:tasks.workunit.client.0.smithi053.stdout:9/575: dread d8/d1c/d2b/f93 [0,4194304] 0 2024-09-16T00:50:28.182 INFO:tasks.workunit.client.0.smithi053.stdout:7/670: rename d1/d2a/d4f/f9f to d1/db5/fe4 0 2024-09-16T00:50:28.183 INFO:tasks.workunit.client.0.smithi053.stdout:1/572: unlink d5/d7/d39/d57/d82/f8b 0 2024-09-16T00:50:28.185 INFO:tasks.workunit.client.0.smithi053.stdout:9/576: symlink d8/d4c/d5b/lbe 0 2024-09-16T00:50:28.189 INFO:tasks.workunit.client.0.smithi053.stdout:7/671: creat d1/d2a/d83/fe5 x:0 0 0 2024-09-16T00:50:28.190 INFO:tasks.workunit.client.0.smithi053.stdout:1/573: rmdir d5/d7/db1 0 2024-09-16T00:50:28.193 INFO:tasks.workunit.client.0.smithi053.stdout:1/574: getdents d5/d9/d4c/d61 0 2024-09-16T00:50:28.195 INFO:tasks.workunit.client.0.smithi053.stdout:7/672: dread d1/f3f [0,4194304] 0 2024-09-16T00:50:28.196 INFO:tasks.workunit.client.0.smithi053.stdout:7/673: readlink d1/d35/d14/l4e 0 2024-09-16T00:50:28.199 INFO:tasks.workunit.client.0.smithi053.stdout:9/577: dwrite d8/f35 [0,4194304] 0 2024-09-16T00:50:28.207 INFO:tasks.workunit.client.0.smithi053.stdout:9/578: rmdir d8/d19 39 2024-09-16T00:50:28.211 INFO:tasks.workunit.client.0.smithi053.stdout:9/579: unlink d8/ce 0 2024-09-16T00:50:28.211 INFO:tasks.workunit.client.0.smithi053.stdout:9/580: fdatasync d8/d22/d54/f7f 0 2024-09-16T00:50:28.213 INFO:tasks.workunit.client.0.smithi053.stdout:9/581: creat d8/d1c/d2b/db6/fbf x:0 0 0 2024-09-16T00:50:28.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/582: mknod d8/d19/d31/cc0 0 2024-09-16T00:50:28.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/583: chown d8/d22/d26/d83 1 1 2024-09-16T00:50:28.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/584: fsync d8/f35 0 2024-09-16T00:50:28.217 INFO:tasks.workunit.client.0.smithi053.stdout:9/585: mkdir d8/d22/d26/d83/dc1 0 2024-09-16T00:50:28.217 INFO:tasks.workunit.client.0.smithi053.stdout:1/575: dwrite d5/d7/f76 [4194304,4194304] 0 2024-09-16T00:50:28.218 INFO:tasks.workunit.client.0.smithi053.stdout:7/674: dwrite d1/d3/f5 [8388608,4194304] 0 2024-09-16T00:50:28.219 INFO:tasks.workunit.client.0.smithi053.stdout:9/586: mkdir d8/d22/dc2 0 2024-09-16T00:50:28.220 INFO:tasks.workunit.client.0.smithi053.stdout:1/576: symlink d5/d9/d73/db2/lc3 0 2024-09-16T00:50:28.222 INFO:tasks.workunit.client.0.smithi053.stdout:7/675: mkdir d1/d60/d77/da9/de6 0 2024-09-16T00:50:28.222 INFO:tasks.workunit.client.0.smithi053.stdout:9/587: chown d8/d19/d31/f71 50610552 1 2024-09-16T00:50:28.225 INFO:tasks.workunit.client.0.smithi053.stdout:1/577: rename d5/d7/l62 to d5/d18/d33/d30/daf/lc4 0 2024-09-16T00:50:28.225 INFO:tasks.workunit.client.0.smithi053.stdout:7/676: creat d1/d35/d4a/dbb/ddc/fe7 x:0 0 0 2024-09-16T00:50:28.226 INFO:tasks.workunit.client.0.smithi053.stdout:9/588: mknod d8/d22/dc2/cc3 0 2024-09-16T00:50:28.229 INFO:tasks.workunit.client.0.smithi053.stdout:7/677: mkdir d1/d2a/d83/d84/db1/de8 0 2024-09-16T00:50:28.229 INFO:tasks.workunit.client.0.smithi053.stdout:7/678: write d1/d2a/fb6 [568421,22751] 0 2024-09-16T00:50:28.235 INFO:tasks.workunit.client.0.smithi053.stdout:1/578: dwrite d5/dd/d7f/f93 [4194304,4194304] 0 2024-09-16T00:50:28.238 INFO:tasks.workunit.client.0.smithi053.stdout:7/679: dread d1/d35/d4a/d74/f7e [0,4194304] 0 2024-09-16T00:50:28.238 INFO:tasks.workunit.client.0.smithi053.stdout:7/680: fsync d1/d60/d62/fc9 0 2024-09-16T00:50:28.239 INFO:tasks.workunit.client.0.smithi053.stdout:1/579: unlink d5/d7/d39/d57/f95 0 2024-09-16T00:50:28.245 INFO:tasks.workunit.client.0.smithi053.stdout:1/580: creat d5/d9/d73/d84/fc5 x:0 0 0 2024-09-16T00:50:28.246 INFO:tasks.workunit.client.0.smithi053.stdout:1/581: mkdir d5/d7/d39/dc6 0 2024-09-16T00:50:28.246 INFO:tasks.workunit.client.0.smithi053.stdout:1/582: write d5/d7/d39/d57/d82/fa0 [877452,99106] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/583: write d5/d18/d33/f63 [1221259,100462] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/584: dread d5/d7/f66 [0,4194304] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/585: write d5/d9/d77/f7b [272888,50775] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/586: write d5/d9/d4c/d61/f9a [535039,26608] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/587: chown d5/d18 1082303 1 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:7/681: dwrite d1/d60/d70/f78 [0,4194304] 0 2024-09-16T00:50:28.256 INFO:tasks.workunit.client.0.smithi053.stdout:1/588: creat d5/d5a/fc7 x:0 0 0 2024-09-16T00:50:28.262 INFO:tasks.workunit.client.0.smithi053.stdout:7/682: mkdir d1/d3/de9 0 2024-09-16T00:50:28.262 INFO:tasks.workunit.client.0.smithi053.stdout:7/683: fsync d1/d35/d14/d15/f9c 0 2024-09-16T00:50:28.275 INFO:tasks.workunit.client.0.smithi053.stdout:1/589: getdents d5/d9/d73/d84 0 2024-09-16T00:50:28.277 INFO:tasks.workunit.client.0.smithi053.stdout:1/590: creat d5/d9/d73/d84/fc8 x:0 0 0 2024-09-16T00:50:28.279 INFO:tasks.workunit.client.0.smithi053.stdout:1/591: dread d5/d7/d39/f6c [0,4194304] 0 2024-09-16T00:50:28.280 INFO:tasks.workunit.client.0.smithi053.stdout:1/592: creat d5/fc9 x:0 0 0 2024-09-16T00:50:28.288 INFO:tasks.workunit.client.0.smithi053.stdout:1/593: mkdir d5/d7/dca 0 2024-09-16T00:50:28.288 INFO:tasks.workunit.client.0.smithi053.stdout:1/594: creat d5/d18/d33/fcb x:0 0 0 2024-09-16T00:50:28.294 INFO:tasks.workunit.client.0.smithi053.stdout:5/622: sync 2024-09-16T00:50:28.294 INFO:tasks.workunit.client.0.smithi053.stdout:5/623: chown d3/d7/d24/d34/d3e/da1 374 1 2024-09-16T00:50:28.294 INFO:tasks.workunit.client.0.smithi053.stdout:5/624: chown d3/c7c 874 1 2024-09-16T00:50:28.297 INFO:tasks.workunit.client.0.smithi053.stdout:5/625: creat d3/d7/d42/fcb x:0 0 0 2024-09-16T00:50:28.297 INFO:tasks.workunit.client.0.smithi053.stdout:1/595: dread d5/fba [4194304,4194304] 0 2024-09-16T00:50:28.297 INFO:tasks.workunit.client.0.smithi053.stdout:1/596: fsync d5/d9/d4c/f89 0 2024-09-16T00:50:28.297 INFO:tasks.workunit.client.0.smithi053.stdout:1/597: mknod d5/d9/d77/ccc 0 2024-09-16T00:50:28.328 INFO:tasks.workunit.client.0.smithi053.stdout:1/598: dwrite d5/dd/d7f/f93 [0,4194304] 0 2024-09-16T00:50:28.335 INFO:tasks.workunit.client.0.smithi053.stdout:5/626: dwrite d3/fb6 [0,4194304] 0 2024-09-16T00:50:28.337 INFO:tasks.workunit.client.0.smithi053.stdout:5/627: creat d3/d7/d2b/d37/d58/fcc x:0 0 0 2024-09-16T00:50:28.339 INFO:tasks.workunit.client.0.smithi053.stdout:5/628: creat d3/d7/d42/d57/fcd x:0 0 0 2024-09-16T00:50:28.339 INFO:tasks.workunit.client.0.smithi053.stdout:5/629: fsync d3/d9c/fad 0 2024-09-16T00:50:28.350 INFO:tasks.workunit.client.0.smithi053.stdout:1/599: dwrite d5/d7/f76 [4194304,4194304] 0 2024-09-16T00:50:28.350 INFO:tasks.workunit.client.0.smithi053.stdout:1/600: write d5/d9/f4b [3926761,38048] 0 2024-09-16T00:50:28.352 INFO:tasks.workunit.client.0.smithi053.stdout:1/601: mkdir d5/d9/d4c/dcd 0 2024-09-16T00:50:28.352 INFO:tasks.workunit.client.0.smithi053.stdout:1/602: chown d5/d18/d33/fcb 85549 1 2024-09-16T00:50:28.354 INFO:tasks.workunit.client.0.smithi053.stdout:5/630: dwrite d3/d7/f5c [0,4194304] 0 2024-09-16T00:50:28.354 INFO:tasks.workunit.client.0.smithi053.stdout:1/603: symlink d5/dd/d19/lce 0 2024-09-16T00:50:28.358 INFO:tasks.workunit.client.0.smithi053.stdout:5/631: mkdir d3/d7/d2b/d37/d58/d9f/dce 0 2024-09-16T00:50:28.358 INFO:tasks.workunit.client.0.smithi053.stdout:5/632: fdatasync d3/d7/f8d 0 2024-09-16T00:50:28.359 INFO:tasks.workunit.client.0.smithi053.stdout:5/633: chown d3/d7/d2b/d37/d58/d9f/lb9 6 1 2024-09-16T00:50:28.360 INFO:tasks.workunit.client.0.smithi053.stdout:1/604: mkdir d5/dd/d8e/dcf 0 2024-09-16T00:50:28.364 INFO:tasks.workunit.client.0.smithi053.stdout:5/634: creat d3/d7/d2b/d4b/d51/d53/da5/fcf x:0 0 0 2024-09-16T00:50:28.365 INFO:tasks.workunit.client.0.smithi053.stdout:5/635: dread d3/d7/d2b/d4b/d4f/f73 [0,4194304] 0 2024-09-16T00:50:28.365 INFO:tasks.workunit.client.0.smithi053.stdout:5/636: readlink d3/d7/d24/d34/d3e/l91 0 2024-09-16T00:50:28.371 INFO:tasks.workunit.client.0.smithi053.stdout:5/637: creat d3/d7/d24/d3f/fd0 x:0 0 0 2024-09-16T00:50:28.371 INFO:tasks.workunit.client.0.smithi053.stdout:5/638: chown d3/d7/d2b/d37/d46/c90 5095621 1 2024-09-16T00:50:28.373 INFO:tasks.workunit.client.0.smithi053.stdout:1/605: rename d5/d9/d4c/d61 to d5/d18/d33/d8a/d98/dd0 0 2024-09-16T00:50:28.375 INFO:tasks.workunit.client.0.smithi053.stdout:5/639: symlink d3/d7/d42/d57/ld1 0 2024-09-16T00:50:28.375 INFO:tasks.workunit.client.0.smithi053.stdout:5/640: chown d3/d7/d24/l81 434784 1 2024-09-16T00:50:28.377 INFO:tasks.workunit.client.0.smithi053.stdout:1/606: dread d5/d18/d33/d8a/d98/dd0/f6e [0,4194304] 0 2024-09-16T00:50:28.378 INFO:tasks.workunit.client.0.smithi053.stdout:1/607: creat d5/d7/d39/dc6/fd1 x:0 0 0 2024-09-16T00:50:28.381 INFO:tasks.workunit.client.0.smithi053.stdout:1/608: unlink d5/d18/d33/d8a/d98/dd0/f9a 0 2024-09-16T00:50:28.381 INFO:tasks.workunit.client.0.smithi053.stdout:1/609: truncate d5/d9/d88/f60 4747762 0 2024-09-16T00:50:28.384 INFO:tasks.workunit.client.0.smithi053.stdout:5/641: dread d3/d7/f5c [0,4194304] 0 2024-09-16T00:50:28.388 INFO:tasks.workunit.client.0.smithi053.stdout:1/610: mkdir d5/d18/d33/d8a/d98/dd0/dd2 0 2024-09-16T00:50:28.391 INFO:tasks.workunit.client.0.smithi053.stdout:5/642: rename d3/f6 to d3/d7/d2b/dbc/fd2 0 2024-09-16T00:50:28.397 INFO:tasks.workunit.client.0.smithi053.stdout:1/611: rename d5/d7/d39/c99 to d5/d18/d33/d8a/d98/dd0/dd2/cd3 0 2024-09-16T00:50:28.397 INFO:tasks.workunit.client.0.smithi053.stdout:1/612: truncate d5/d18/d33/d8a/d98/dd0/f91 1096122 0 2024-09-16T00:50:28.403 INFO:tasks.workunit.client.0.smithi053.stdout:5/643: rmdir d3/d7/d24/d34/d3e/da1 39 2024-09-16T00:50:28.403 INFO:tasks.workunit.client.0.smithi053.stdout:5/644: write d3/d7/f8d [1180304,53547] 0 2024-09-16T00:50:28.431 INFO:tasks.workunit.client.0.smithi053.stdout:5/645: dwrite d3/d7/d24/d34/d80/f92 [0,4194304] 0 2024-09-16T00:50:28.431 INFO:tasks.workunit.client.0.smithi053.stdout:1/613: dwrite d5/d18/d33/d8a/f96 [0,4194304] 0 2024-09-16T00:50:28.431 INFO:tasks.workunit.client.0.smithi053.stdout:1/614: dread - d5/d18/d33/fad zero size 2024-09-16T00:50:28.441 INFO:tasks.workunit.client.0.smithi053.stdout:2/586: sync 2024-09-16T00:50:28.441 INFO:tasks.workunit.client.0.smithi053.stdout:3/653: sync 2024-09-16T00:50:28.441 INFO:tasks.workunit.client.0.smithi053.stdout:3/654: chown d1/d5/d91/d47/d65/d97/d7f 8175243 1 2024-09-16T00:50:28.443 INFO:tasks.workunit.client.0.smithi053.stdout:3/655: mknod d1/d5/cd7 0 2024-09-16T00:50:28.447 INFO:tasks.workunit.client.0.smithi053.stdout:3/656: dread d1/d5/d11/d3a/f6e [0,4194304] 0 2024-09-16T00:50:28.454 INFO:tasks.workunit.client.0.smithi053.stdout:2/587: write d6/f2c [5476799,98264] 0 2024-09-16T00:50:28.454 INFO:tasks.workunit.client.0.smithi053.stdout:2/588: write d6/f73 [1648139,128142] 0 2024-09-16T00:50:28.455 INFO:tasks.workunit.client.0.smithi053.stdout:2/589: dread - d6/d9/dd/d80/fa5 zero size 2024-09-16T00:50:28.455 INFO:tasks.workunit.client.0.smithi053.stdout:2/590: mknod d6/d9/dd/d76/cbd 0 2024-09-16T00:50:28.456 INFO:tasks.workunit.client.0.smithi053.stdout:2/591: mknod d6/d29/cbe 0 2024-09-16T00:50:28.458 INFO:tasks.workunit.client.0.smithi053.stdout:5/646: dwrite d3/d7/d42/d57/fcd [0,4194304] 0 2024-09-16T00:50:28.458 INFO:tasks.workunit.client.0.smithi053.stdout:5/647: fdatasync d3/d7/d2b/d4b/fba 0 2024-09-16T00:50:28.458 INFO:tasks.workunit.client.0.smithi053.stdout:1/615: dwrite d5/dd/d47/d58/f71 [0,4194304] 0 2024-09-16T00:50:28.465 INFO:tasks.workunit.client.0.smithi053.stdout:5/648: rmdir d3/d7/d24/d34/d5b/dc7 0 2024-09-16T00:50:28.465 INFO:tasks.workunit.client.0.smithi053.stdout:5/649: chown d3/d7/d24/d3f/f5e 4031634 1 2024-09-16T00:50:28.465 INFO:tasks.workunit.client.0.smithi053.stdout:5/650: fsync d3/d7/d2b/d4b/d51/d96/fc3 0 2024-09-16T00:50:28.478 INFO:tasks.workunit.client.0.smithi053.stdout:5/651: creat d3/fd3 x:0 0 0 2024-09-16T00:50:28.485 INFO:tasks.workunit.client.0.smithi053.stdout:5/652: write d3/d7/d24/d34/f76 [2853687,50526] 0 2024-09-16T00:50:28.486 INFO:tasks.workunit.client.0.smithi053.stdout:2/592: dwrite d6/d9/dd/f6d [0,4194304] 0 2024-09-16T00:50:28.486 INFO:tasks.workunit.client.0.smithi053.stdout:1/616: dwrite d5/d18/d33/d8a/d98/dd0/f91 [0,4194304] 0 2024-09-16T00:50:28.488 INFO:tasks.workunit.client.0.smithi053.stdout:2/593: creat d6/d90/dba/fbf x:0 0 0 2024-09-16T00:50:28.489 INFO:tasks.workunit.client.0.smithi053.stdout:1/617: dread d5/dd/fb0 [0,4194304] 0 2024-09-16T00:50:28.490 INFO:tasks.workunit.client.0.smithi053.stdout:1/618: dread - d5/d18/d33/fad zero size 2024-09-16T00:50:28.493 INFO:tasks.workunit.client.0.smithi053.stdout:1/619: rmdir d5/d7/d39/dc6 39 2024-09-16T00:50:28.493 INFO:tasks.workunit.client.0.smithi053.stdout:1/620: mknod d5/d5a/cd4 0 2024-09-16T00:50:28.494 INFO:tasks.workunit.client.0.smithi053.stdout:1/621: mkdir d5/dd/dd5 0 2024-09-16T00:50:28.496 INFO:tasks.workunit.client.0.smithi053.stdout:2/594: write d6/d29/d2b/f60 [11080500,120057] 0 2024-09-16T00:50:28.497 INFO:tasks.workunit.client.0.smithi053.stdout:5/653: dread d3/d7/d2b/d4b/d4f/f87 [0,4194304] 0 2024-09-16T00:50:28.497 INFO:tasks.workunit.client.0.smithi053.stdout:5/654: write d3/d7/d2b/d37/d58/f6b [1680814,24415] 0 2024-09-16T00:50:28.497 INFO:tasks.workunit.client.0.smithi053.stdout:2/595: rename d6/d9/dd/d28/l55 to d6/d29/db7/lc0 0 2024-09-16T00:50:28.497 INFO:tasks.workunit.client.0.smithi053.stdout:2/596: readlink d6/d9/d14/l21 0 2024-09-16T00:50:28.499 INFO:tasks.workunit.client.0.smithi053.stdout:5/655: rmdir d3/d7/d24/d34/d3e/da1 39 2024-09-16T00:50:28.499 INFO:tasks.workunit.client.0.smithi053.stdout:5/656: chown d3/d7/d2b/dbc/lc2 170059 1 2024-09-16T00:50:28.499 INFO:tasks.workunit.client.0.smithi053.stdout:2/597: write d6/d9/d14/f4c [971344,36015] 0 2024-09-16T00:50:28.501 INFO:tasks.workunit.client.0.smithi053.stdout:5/657: symlink d3/d7/d2b/d37/d46/ld4 0 2024-09-16T00:50:28.502 INFO:tasks.workunit.client.0.smithi053.stdout:1/622: dread d5/d5a/fa4 [0,4194304] 0 2024-09-16T00:50:28.503 INFO:tasks.workunit.client.0.smithi053.stdout:1/623: write d5/d7/d39/f6c [403315,126664] 0 2024-09-16T00:50:28.505 INFO:tasks.workunit.client.0.smithi053.stdout:5/658: mknod d3/d7/d2b/d4b/d51/d96/cd5 0 2024-09-16T00:50:28.508 INFO:tasks.workunit.client.0.smithi053.stdout:1/624: creat d5/d18/d33/d8a/d98/dd0/fd6 x:0 0 0 2024-09-16T00:50:28.508 INFO:tasks.workunit.client.0.smithi053.stdout:1/625: truncate d5/f7d 9538 0 2024-09-16T00:50:28.508 INFO:tasks.workunit.client.0.smithi053.stdout:1/626: fsync d5/d5a/fc7 0 2024-09-16T00:50:28.509 INFO:tasks.workunit.client.0.smithi053.stdout:2/598: write d6/d29/d2b/d39/f9b [1525569,90042] 0 2024-09-16T00:50:28.510 INFO:tasks.workunit.client.0.smithi053.stdout:1/627: creat d5/d9/d73/d84/fd7 x:0 0 0 2024-09-16T00:50:28.510 INFO:tasks.workunit.client.0.smithi053.stdout:1/628: fdatasync d5/d5a/f7e 0 2024-09-16T00:50:28.511 INFO:tasks.workunit.client.0.smithi053.stdout:1/629: write d5/d9/f56 [5761353,20428] 0 2024-09-16T00:50:28.518 INFO:tasks.workunit.client.0.smithi053.stdout:1/630: write d5/dd/d7f/f93 [2478056,14486] 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:2/599: dread d6/d29/fab [0,4194304] 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:2/600: write d6/d9/fa2 [359960,83347] 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:2/601: readlink d6/d29/d2b/lb9 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:1/631: mkdir d5/d9/d73/db2/dd8 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:1/632: fdatasync d5/dd/f1a 0 2024-09-16T00:50:28.521 INFO:tasks.workunit.client.0.smithi053.stdout:1/633: chown d5/dd/d47/d58/f71 5 1 2024-09-16T00:50:28.522 INFO:tasks.workunit.client.0.smithi053.stdout:5/659: dwrite d3/d7/d24/fc8 [0,4194304] 0 2024-09-16T00:50:28.524 INFO:tasks.workunit.client.0.smithi053.stdout:1/634: link d5/d7/f52 d5/d9/d4c/dcd/fd9 0 2024-09-16T00:50:28.531 INFO:tasks.workunit.client.0.smithi053.stdout:2/602: dread d6/d9/f1d [4194304,4194304] 0 2024-09-16T00:50:28.533 INFO:tasks.workunit.client.0.smithi053.stdout:2/603: chown d6/d9/f56 214130244 1 2024-09-16T00:50:28.537 INFO:tasks.workunit.client.0.smithi053.stdout:2/604: mknod d6/d9/dd/d3e/d52/d65/cc1 0 2024-09-16T00:50:28.537 INFO:tasks.workunit.client.0.smithi053.stdout:2/605: creat d6/d9/dd/d3e/d72/d75/fc2 x:0 0 0 2024-09-16T00:50:28.537 INFO:tasks.workunit.client.0.smithi053.stdout:2/606: stat d6/d29/f91 0 2024-09-16T00:50:28.539 INFO:tasks.workunit.client.0.smithi053.stdout:2/607: creat d6/d9/dd/d3e/d52/fc3 x:0 0 0 2024-09-16T00:50:28.541 INFO:tasks.workunit.client.0.smithi053.stdout:2/608: unlink d6/d9/d14/f15 0 2024-09-16T00:50:28.544 INFO:tasks.workunit.client.0.smithi053.stdout:1/635: dwrite d5/d7/f66 [0,4194304] 0 2024-09-16T00:50:28.545 INFO:tasks.workunit.client.0.smithi053.stdout:5/660: dwrite d3/d7/d42/d57/fbe [0,4194304] 0 2024-09-16T00:50:28.547 INFO:tasks.workunit.client.0.smithi053.stdout:1/636: unlink d5/dd/d7f/f97 0 2024-09-16T00:50:28.558 INFO:tasks.workunit.client.0.smithi053.stdout:5/661: dread d3/d7/d2b/d37/d58/f4c [0,4194304] 0 2024-09-16T00:50:28.558 INFO:tasks.workunit.client.0.smithi053.stdout:5/662: chown d3/d7/d2b/d37/d58/f23 7325 1 2024-09-16T00:50:28.558 INFO:tasks.workunit.client.0.smithi053.stdout:5/663: stat d3/d7/d2b/d4b/d51/d53/da5 0 2024-09-16T00:50:28.558 INFO:tasks.workunit.client.0.smithi053.stdout:5/664: write d3/d7/d2b/d4b/d4f/f54 [4877456,100849] 0 2024-09-16T00:50:28.564 INFO:tasks.workunit.client.0.smithi053.stdout:2/609: dwrite d6/d9/d14/f37 [4194304,4194304] 0 2024-09-16T00:50:28.566 INFO:tasks.workunit.client.0.smithi053.stdout:1/637: rename d5/c8c to d5/cda 0 2024-09-16T00:50:28.566 INFO:tasks.workunit.client.0.smithi053.stdout:1/638: readlink d5/d9/d88/lb8 0 2024-09-16T00:50:28.566 INFO:tasks.workunit.client.0.smithi053.stdout:1/639: dread - d5/d18/d33/fcb zero size 2024-09-16T00:50:28.566 INFO:tasks.workunit.client.0.smithi053.stdout:1/640: chown d5/d18/d33/d8a/d98/dd0/f72 742 1 2024-09-16T00:50:28.566 INFO:tasks.workunit.client.0.smithi053.stdout:1/641: stat d5/d9/d77/c9d 0 2024-09-16T00:50:28.570 INFO:tasks.workunit.client.0.smithi053.stdout:5/665: unlink d3/d7/d2b/d4b/d51/d96/cd5 0 2024-09-16T00:50:28.573 INFO:tasks.workunit.client.0.smithi053.stdout:1/642: creat d5/dd/dbb/fdb x:0 0 0 2024-09-16T00:50:28.579 INFO:tasks.workunit.client.0.smithi053.stdout:1/643: truncate d5/d18/d33/d30/f9b 739614 0 2024-09-16T00:50:28.581 INFO:tasks.workunit.client.0.smithi053.stdout:1/644: symlink d5/d9/d73/db2/dd8/ldc 0 2024-09-16T00:50:28.584 INFO:tasks.workunit.client.0.smithi053.stdout:1/645: unlink d5/d18/ca3 0 2024-09-16T00:50:28.584 INFO:tasks.workunit.client.0.smithi053.stdout:1/646: write d5/d7/fa5 [5223600,66809] 0 2024-09-16T00:50:28.584 INFO:tasks.workunit.client.0.smithi053.stdout:1/647: readlink d5/d9/d88/lb8 0 2024-09-16T00:50:28.584 INFO:tasks.workunit.client.0.smithi053.stdout:1/648: write d5/d9/d73/fab [89544,12660] 0 2024-09-16T00:50:28.599 INFO:tasks.workunit.client.0.smithi053.stdout:1/649: dwrite d5/d18/d33/d8a/d98/fb9 [0,4194304] 0 2024-09-16T00:50:28.610 INFO:tasks.workunit.client.0.smithi053.stdout:8/558: sync 2024-09-16T00:50:28.616 INFO:tasks.workunit.client.0.smithi053.stdout:1/650: dwrite d5/d7/f76 [4194304,4194304] 0 2024-09-16T00:50:28.628 INFO:tasks.workunit.client.0.smithi053.stdout:8/559: dwrite d10/d1c/d92/d66/d9d/faa [0,4194304] 0 2024-09-16T00:50:28.628 INFO:tasks.workunit.client.0.smithi053.stdout:1/651: dread d5/d5a/f7e [0,4194304] 0 2024-09-16T00:50:28.638 INFO:tasks.workunit.client.0.smithi053.stdout:1/652: read d5/dd/d7f/f83 [1696389,106852] 0 2024-09-16T00:50:28.638 INFO:tasks.workunit.client.0.smithi053.stdout:1/653: getdents d5/d18/d1f 0 2024-09-16T00:50:28.664 INFO:tasks.workunit.client.0.smithi053.stdout:1/654: dwrite d5/dd/f6f [0,4194304] 0 2024-09-16T00:50:28.668 INFO:tasks.workunit.client.0.smithi053.stdout:1/655: getdents d5/dd/d7f 0 2024-09-16T00:50:28.685 INFO:tasks.workunit.client.0.smithi053.stdout:1/656: dwrite d5/d5a/f7e [0,4194304] 0 2024-09-16T00:50:28.687 INFO:tasks.workunit.client.0.smithi053.stdout:1/657: dread d5/d9/d73/fab [0,4194304] 0 2024-09-16T00:50:28.687 INFO:tasks.workunit.client.0.smithi053.stdout:1/658: write d5/d9/d73/d84/fd7 [843848,49256] 0 2024-09-16T00:50:28.687 INFO:tasks.workunit.client.0.smithi053.stdout:1/659: readlink d5/d5a/l92 0 2024-09-16T00:50:28.687 INFO:tasks.workunit.client.0.smithi053.stdout:1/660: write d5/d18/d1f/f8f [1024612,49217] 0 2024-09-16T00:50:28.688 INFO:tasks.workunit.client.0.smithi053.stdout:1/661: fsync d5/dd/d7f/f83 0 2024-09-16T00:50:28.692 INFO:tasks.workunit.client.0.smithi053.stdout:1/662: unlink d5/dd/l64 0 2024-09-16T00:50:28.698 INFO:tasks.workunit.client.0.smithi053.stdout:1/663: unlink d5/d18/d33/d8a/d98/dd0/c29 0 2024-09-16T00:50:28.705 INFO:tasks.workunit.client.0.smithi053.stdout:0/699: sync 2024-09-16T00:50:28.710 INFO:tasks.workunit.client.0.smithi053.stdout:1/664: rename d5/dd/d47/d58 to d5/d18/d33/d8a/ddd 0 2024-09-16T00:50:28.710 INFO:tasks.workunit.client.0.smithi053.stdout:1/665: chown d5/d9/d73/ca9 87 1 2024-09-16T00:50:28.710 INFO:tasks.workunit.client.0.smithi053.stdout:1/666: fdatasync d5/d18/d33/d8a/ddd/f78 0 2024-09-16T00:50:28.720 INFO:tasks.workunit.client.0.smithi053.stdout:1/667: rmdir d5/d7 39 2024-09-16T00:50:28.726 INFO:tasks.workunit.client.0.smithi053.stdout:0/700: dwrite d4/dc/d1e/d22/dc5/dd2/fda [0,4194304] 0 2024-09-16T00:50:28.727 INFO:tasks.workunit.client.0.smithi053.stdout:1/668: write d5/d18/d33/d8a/d98/dd0/f12 [902571,118454] 0 2024-09-16T00:50:28.729 INFO:tasks.workunit.client.0.smithi053.stdout:0/701: mknod d4/dc/d25/d34/db7/cdc 0 2024-09-16T00:50:28.730 INFO:tasks.workunit.client.0.smithi053.stdout:0/702: read d4/dc/d25/d34/f5e [581691,70743] 0 2024-09-16T00:50:28.730 INFO:tasks.workunit.client.0.smithi053.stdout:1/669: creat d5/d9/d4c/fde x:0 0 0 2024-09-16T00:50:28.732 INFO:tasks.workunit.client.0.smithi053.stdout:1/670: rename d5/d18/d33/d8a/d98/dd0/dd2 to d5/dd/d7f/ddf 0 2024-09-16T00:50:28.733 INFO:tasks.workunit.client.0.smithi053.stdout:1/671: mknod d5/dd/ce0 0 2024-09-16T00:50:28.739 INFO:tasks.workunit.client.0.smithi053.stdout:0/703: write d4/d5a/d82/f93 [1750342,120333] 0 2024-09-16T00:50:28.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/704: getdents d4/dc/d25/d34/d71/d96 0 2024-09-16T00:50:28.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/705: chown d4/d5a/f9e 1077072 1 2024-09-16T00:50:28.744 INFO:tasks.workunit.client.0.smithi053.stdout:0/706: creat d4/dc/d1e/d1f/d40/d44/d54/db8/fdd x:0 0 0 2024-09-16T00:50:28.747 INFO:tasks.workunit.client.0.smithi053.stdout:0/707: rename d4/d5a/fb5 to d4/d13/fde 0 2024-09-16T00:50:28.749 INFO:tasks.workunit.client.0.smithi053.stdout:0/708: creat d4/dc/d1e/d1f/d40/fdf x:0 0 0 2024-09-16T00:50:28.749 INFO:tasks.workunit.client.0.smithi053.stdout:0/709: write d4/d13/f1c [2040401,54781] 0 2024-09-16T00:50:28.768 INFO:tasks.workunit.client.0.smithi053.stdout:0/710: dwrite d4/d13/f8b [0,4194304] 0 2024-09-16T00:50:28.779 INFO:tasks.workunit.client.0.smithi053.stdout:0/711: dread d4/dc/d87/dc6/dbe/f37 [0,4194304] 0 2024-09-16T00:50:28.780 INFO:tasks.workunit.client.0.smithi053.stdout:0/712: mknod d4/dc/d1e/d1f/dd4/ce0 0 2024-09-16T00:50:28.789 INFO:tasks.workunit.client.0.smithi053.stdout:0/713: write d4/dc/d25/d34/f7f [3601668,35628] 0 2024-09-16T00:50:28.789 INFO:tasks.workunit.client.0.smithi053.stdout:0/714: fdatasync d4/d5a/fbc 0 2024-09-16T00:50:28.789 INFO:tasks.workunit.client.0.smithi053.stdout:0/715: readlink d4/dc/dc0/lcb 0 2024-09-16T00:50:28.789 INFO:tasks.workunit.client.0.smithi053.stdout:0/716: creat d4/dc/d87/dbf/fe1 x:0 0 0 2024-09-16T00:50:28.797 INFO:tasks.workunit.client.0.smithi053.stdout:0/717: dread d4/dc/d25/d34/f8f [0,4194304] 0 2024-09-16T00:50:28.876 INFO:tasks.workunit.client.0.smithi053.stdout:0/718: getdents d4/d5a 0 2024-09-16T00:50:28.879 INFO:tasks.workunit.client.0.smithi053.stdout:0/719: rename d4/dc/d87/dc6/dbe/d4a to d4/dc/d1e/d22/de2 0 2024-09-16T00:50:28.880 INFO:tasks.workunit.client.0.smithi053.stdout:0/720: getdents d4/dc/dc0 0 2024-09-16T00:50:28.889 INFO:tasks.workunit.client.0.smithi053.stdout:0/721: dread d4/f69 [0,4194304] 0 2024-09-16T00:50:28.891 INFO:tasks.workunit.client.0.smithi053.stdout:0/722: creat d4/dc/d1e/d1f/d40/d73/dd7/fe3 x:0 0 0 2024-09-16T00:50:28.892 INFO:tasks.workunit.client.0.smithi053.stdout:0/723: fdatasync d4/dc/d25/f2f 0 2024-09-16T00:50:28.893 INFO:tasks.workunit.client.0.smithi053.stdout:0/724: mknod d4/dc/d25/ce4 0 2024-09-16T00:50:28.901 INFO:tasks.workunit.client.0.smithi053.stdout:0/725: dread d4/dc/d25/d34/f74 [0,4194304] 0 2024-09-16T00:50:28.903 INFO:tasks.workunit.client.0.smithi053.stdout:0/726: dread d4/dc/d25/f9d [0,4194304] 0 2024-09-16T00:50:28.904 INFO:tasks.workunit.client.0.smithi053.stdout:0/727: creat d4/dc/d1e/d22/fe5 x:0 0 0 2024-09-16T00:50:28.905 INFO:tasks.workunit.client.0.smithi053.stdout:0/728: link d4/dc/d25/d34/c77 d4/dc/d25/d34/d71/ce6 0 2024-09-16T00:50:28.905 INFO:tasks.workunit.client.0.smithi053.stdout:0/729: truncate d4/dc/d25/d34/d71/fdb 36655 0 2024-09-16T00:50:28.906 INFO:tasks.workunit.client.0.smithi053.stdout:0/730: symlink d4/dc/d87/dc6/dbe/le7 0 2024-09-16T00:50:28.908 INFO:tasks.workunit.client.0.smithi053.stdout:0/731: mkdir d4/d13/de8 0 2024-09-16T00:50:28.909 INFO:tasks.workunit.client.0.smithi053.stdout:0/732: dread - d4/dc/d87/dbf/fd9 zero size 2024-09-16T00:50:28.909 INFO:tasks.workunit.client.0.smithi053.stdout:0/733: creat d4/dc/d1e/d22/fe9 x:0 0 0 2024-09-16T00:50:28.910 INFO:tasks.workunit.client.0.smithi053.stdout:0/734: symlink d4/dc/d25/d34/lea 0 2024-09-16T00:50:28.914 INFO:tasks.workunit.client.0.smithi053.stdout:6/665: sync 2024-09-16T00:50:28.915 INFO:tasks.workunit.client.0.smithi053.stdout:6/666: creat d1/dc/d1e/d65/d81/fe4 x:0 0 0 2024-09-16T00:50:28.915 INFO:tasks.workunit.client.0.smithi053.stdout:6/667: dread - d1/dc/d45/fcf zero size 2024-09-16T00:50:28.920 INFO:tasks.workunit.client.0.smithi053.stdout:0/735: write d4/dc/d1e/d1f/d40/d44/f76 [252588,82510] 0 2024-09-16T00:50:28.939 INFO:tasks.workunit.client.0.smithi053.stdout:6/668: dwrite d1/dc/d39/f89 [0,4194304] 0 2024-09-16T00:50:28.939 INFO:tasks.workunit.client.0.smithi053.stdout:6/669: chown d1/dc/d3c/d4b/d75/dd6 0 1 2024-09-16T00:50:28.942 INFO:tasks.workunit.client.0.smithi053.stdout:0/736: dwrite d4/dc/d25/d34/f5e [0,4194304] 0 2024-09-16T00:50:28.943 INFO:tasks.workunit.client.0.smithi053.stdout:6/670: mkdir d1/dc/d54/dd1/de5 0 2024-09-16T00:50:28.943 INFO:tasks.workunit.client.0.smithi053.stdout:6/671: fsync d1/dc/d39/f23 0 2024-09-16T00:50:28.955 INFO:tasks.workunit.client.0.smithi053.stdout:6/672: write d1/dc/d45/f94 [2870242,87940] 0 2024-09-16T00:50:28.956 INFO:tasks.workunit.client.0.smithi053.stdout:6/673: mkdir d1/d2f/d9b/dd0/de6 0 2024-09-16T00:50:28.974 INFO:tasks.workunit.client.0.smithi053.stdout:6/674: dwrite d1/dc/d1e/d41/f69 [0,4194304] 0 2024-09-16T00:50:28.974 INFO:tasks.workunit.client.0.smithi053.stdout:6/675: creat d1/fe7 x:0 0 0 2024-09-16T00:50:28.975 INFO:tasks.workunit.client.0.smithi053.stdout:6/676: creat d1/dc/d54/fe8 x:0 0 0 2024-09-16T00:50:28.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/677: dread d1/dc/d45/f59 [0,4194304] 0 2024-09-16T00:50:28.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/678: chown d1/dc/d1e/fe2 2838 1 2024-09-16T00:50:28.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/679: stat d1/dc/d3c/fe3 0 2024-09-16T00:50:28.981 INFO:tasks.workunit.client.0.smithi053.stdout:6/680: write d1/dc/d54/fe8 [925774,71308] 0 2024-09-16T00:50:29.084 INFO:tasks.workunit.client.0.smithi053.stdout:4/404: sync 2024-09-16T00:50:29.084 INFO:tasks.workunit.client.0.smithi053.stdout:9/589: sync 2024-09-16T00:50:29.084 INFO:tasks.workunit.client.0.smithi053.stdout:9/590: write d8/d22/d54/f7f [415930,30394] 0 2024-09-16T00:50:29.084 INFO:tasks.workunit.client.0.smithi053.stdout:9/591: chown d8/d13/l97 4008 1 2024-09-16T00:50:29.089 INFO:tasks.workunit.client.0.smithi053.stdout:9/592: rmdir d8/d4c/d5a/d99 39 2024-09-16T00:50:29.089 INFO:tasks.workunit.client.0.smithi053.stdout:9/593: write d8/d1c/f63 [680783,124231] 0 2024-09-16T00:50:29.089 INFO:tasks.workunit.client.0.smithi053.stdout:9/594: fdatasync d8/d13/f20 0 2024-09-16T00:50:29.090 INFO:tasks.workunit.client.0.smithi053.stdout:9/595: stat d8/d19/f3f 0 2024-09-16T00:50:29.096 INFO:tasks.workunit.client.0.smithi053.stdout:9/596: rmdir d8/d1c/d2b/d2c 39 2024-09-16T00:50:29.106 INFO:tasks.workunit.client.0.smithi053.stdout:4/405: dwrite d0/d3c/d48/f4c [4194304,4194304] 0 2024-09-16T00:50:29.113 INFO:tasks.workunit.client.0.smithi053.stdout:4/406: mknod d0/d2/d1e/c92 0 2024-09-16T00:50:29.116 INFO:tasks.workunit.client.0.smithi053.stdout:4/407: truncate d0/f5 2276977 0 2024-09-16T00:50:29.116 INFO:tasks.workunit.client.0.smithi053.stdout:4/408: write d0/d2/f1b [1559490,11900] 0 2024-09-16T00:50:29.118 INFO:tasks.workunit.client.0.smithi053.stdout:9/597: dwrite d8/f1d [0,4194304] 0 2024-09-16T00:50:29.118 INFO:tasks.workunit.client.0.smithi053.stdout:9/598: chown d8/d1c/f63 446300 1 2024-09-16T00:50:29.120 INFO:tasks.workunit.client.0.smithi053.stdout:4/409: rename d0/d2/d1e/l7b to d0/d3c/l93 0 2024-09-16T00:50:29.120 INFO:tasks.workunit.client.0.smithi053.stdout:4/410: write d0/d31/f7a [331796,7183] 0 2024-09-16T00:50:29.128 INFO:tasks.workunit.client.0.smithi053.stdout:9/599: chown d8/c4d 491 1 2024-09-16T00:50:29.128 INFO:tasks.workunit.client.0.smithi053.stdout:9/600: creat d8/d19/d51/d6d/fc4 x:0 0 0 2024-09-16T00:50:29.128 INFO:tasks.workunit.client.0.smithi053.stdout:9/601: write d8/d22/d26/f68 [1372283,28118] 0 2024-09-16T00:50:29.132 INFO:tasks.workunit.client.0.smithi053.stdout:4/411: dread d0/d2/f34 [0,4194304] 0 2024-09-16T00:50:29.132 INFO:tasks.workunit.client.0.smithi053.stdout:4/412: chown d0/d2/dd/d25/d41 77 1 2024-09-16T00:50:29.132 INFO:tasks.workunit.client.0.smithi053.stdout:4/413: write d0/d3c/d48/f4c [8518063,54835] 0 2024-09-16T00:50:29.164 INFO:tasks.workunit.client.0.smithi053.stdout:9/602: dwrite d8/f1d [0,4194304] 0 2024-09-16T00:50:29.164 INFO:tasks.workunit.client.0.smithi053.stdout:9/603: truncate d8/d1c/d2b/d5c/f94 1585126 0 2024-09-16T00:50:29.164 INFO:tasks.workunit.client.0.smithi053.stdout:4/414: dwrite d0/da/d42/f75 [0,4194304] 0 2024-09-16T00:50:29.164 INFO:tasks.workunit.client.0.smithi053.stdout:4/415: truncate d0/d2/dd/f40 1625907 0 2024-09-16T00:50:29.164 INFO:tasks.workunit.client.0.smithi053.stdout:4/416: chown d0/d31/f77 2776231 1 2024-09-16T00:50:29.167 INFO:tasks.workunit.client.0.smithi053.stdout:9/604: dread d8/d19/d51/d6d/f7b [0,4194304] 0 2024-09-16T00:50:29.169 INFO:tasks.workunit.client.0.smithi053.stdout:9/605: dread d8/d22/d54/f7f [0,4194304] 0 2024-09-16T00:50:29.184 INFO:tasks.workunit.client.0.smithi053.stdout:4/417: getdents d0/d31 0 2024-09-16T00:50:29.184 INFO:tasks.workunit.client.0.smithi053.stdout:4/418: fsync d0/d31/f63 0 2024-09-16T00:50:29.184 INFO:tasks.workunit.client.0.smithi053.stdout:4/419: truncate d0/d2/dd/d25/d41/d78/f6a 4199427 0 2024-09-16T00:50:29.186 INFO:tasks.workunit.client.0.smithi053.stdout:9/606: dwrite d8/d1c/d2b/f76 [0,4194304] 0 2024-09-16T00:50:29.186 INFO:tasks.workunit.client.0.smithi053.stdout:9/607: creat d8/d1c/d2b/d8b/fc5 x:0 0 0 2024-09-16T00:50:29.186 INFO:tasks.workunit.client.0.smithi053.stdout:9/608: readlink d8/d13/l8c 0 2024-09-16T00:50:29.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/609: chown d8/d1c/d2b 901 1 2024-09-16T00:50:29.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/610: dread - d8/d22/d26/d83/f88 zero size 2024-09-16T00:50:29.187 INFO:tasks.workunit.client.0.smithi053.stdout:4/420: mknod d0/c94 0 2024-09-16T00:50:29.192 INFO:tasks.workunit.client.0.smithi053.stdout:9/611: symlink d8/d19/d31/lc6 0 2024-09-16T00:50:29.196 INFO:tasks.workunit.client.0.smithi053.stdout:4/421: write d0/d3c/d48/f4c [5757332,43978] 0 2024-09-16T00:50:29.196 INFO:tasks.workunit.client.0.smithi053.stdout:4/422: chown d0/l18 3506683 1 2024-09-16T00:50:29.197 INFO:tasks.workunit.client.0.smithi053.stdout:4/423: getdents d0/da/d42 0 2024-09-16T00:50:29.197 INFO:tasks.workunit.client.0.smithi053.stdout:4/424: chown d0/d3c/f80 1 1 2024-09-16T00:50:29.199 INFO:tasks.workunit.client.0.smithi053.stdout:4/425: mkdir d0/d3c/d48/d95 0 2024-09-16T00:50:29.200 INFO:tasks.workunit.client.0.smithi053.stdout:4/426: creat d0/d2/dd/f96 x:0 0 0 2024-09-16T00:50:29.200 INFO:tasks.workunit.client.0.smithi053.stdout:4/427: chown d0/d31/f63 1035382836 1 2024-09-16T00:50:29.201 INFO:tasks.workunit.client.0.smithi053.stdout:9/612: dread d8/d1c/d2b/d49/fa1 [0,4194304] 0 2024-09-16T00:50:29.203 INFO:tasks.workunit.client.0.smithi053.stdout:9/613: dread d8/d1c/d2b/d5c/f94 [0,4194304] 0 2024-09-16T00:50:29.209 INFO:tasks.workunit.client.0.smithi053.stdout:3/657: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:8/560: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:2/610: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:1/672: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/666: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:7/684: sync 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:7/685: fdatasync d1/d60/d70/dac/fd1 0 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/667: write d3/d7/d2b/d37/d58/f82 [656102,67669] 0 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/668: readlink d3/d7/d2b/d37/d46/ld4 0 2024-09-16T00:50:29.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/669: dread - d3/fb5 zero size 2024-09-16T00:50:29.211 INFO:tasks.workunit.client.0.smithi053.stdout:3/658: getdents d1/d5/d31/d7c/dbf 0 2024-09-16T00:50:29.215 INFO:tasks.workunit.client.0.smithi053.stdout:2/611: getdents d6/d9/dd/d3e/d52/d7e/d87 0 2024-09-16T00:50:29.218 INFO:tasks.workunit.client.0.smithi053.stdout:8/561: symlink d10/d21/d28/da2/lc1 0 2024-09-16T00:50:29.221 INFO:tasks.workunit.client.0.smithi053.stdout:5/670: creat d3/d7/d2b/d37/d58/d79/fd6 x:0 0 0 2024-09-16T00:50:29.224 INFO:tasks.workunit.client.0.smithi053.stdout:3/659: fdatasync d1/d5/f19 0 2024-09-16T00:50:29.224 INFO:tasks.workunit.client.0.smithi053.stdout:3/660: write d1/d5/f19 [142136,67175] 0 2024-09-16T00:50:29.228 INFO:tasks.workunit.client.0.smithi053.stdout:8/562: rename d10/d21/d28/d3c/d63/d6a/d88 to d10/d4a/dc2 0 2024-09-16T00:50:29.228 INFO:tasks.workunit.client.0.smithi053.stdout:8/563: getdents d10/d21/d28/db4 0 2024-09-16T00:50:29.229 INFO:tasks.workunit.client.0.smithi053.stdout:2/612: write d6/d29/d2b/f46 [5902131,18441] 0 2024-09-16T00:50:29.229 INFO:tasks.workunit.client.0.smithi053.stdout:2/613: rename d6/d9/db6 to d6/d9/db6/dc4 22 2024-09-16T00:50:29.232 INFO:tasks.workunit.client.0.smithi053.stdout:5/671: unlink d3/d7/d2b/d4b/d51/d53/l83 0 2024-09-16T00:50:29.232 INFO:tasks.workunit.client.0.smithi053.stdout:5/672: truncate d3/d7/d24/d34/d3e/f70 1035730 0 2024-09-16T00:50:29.233 INFO:tasks.workunit.client.0.smithi053.stdout:3/661: creat d1/d5/d11/d3a/dc6/fd8 x:0 0 0 2024-09-16T00:50:29.233 INFO:tasks.workunit.client.0.smithi053.stdout:9/614: dwrite d8/d19/d31/fbd [0,4194304] 0 2024-09-16T00:50:29.234 INFO:tasks.workunit.client.0.smithi053.stdout:2/614: getdents d6/dad 0 2024-09-16T00:50:29.238 INFO:tasks.workunit.client.0.smithi053.stdout:3/662: symlink d1/d5/d91/d5e/d90/da2/ld9 0 2024-09-16T00:50:29.238 INFO:tasks.workunit.client.0.smithi053.stdout:2/615: dread d6/f73 [0,4194304] 0 2024-09-16T00:50:29.238 INFO:tasks.workunit.client.0.smithi053.stdout:2/616: fdatasync d6/d9/dd/d28/f3f 0 2024-09-16T00:50:29.240 INFO:tasks.workunit.client.0.smithi053.stdout:9/615: creat d8/fc7 x:0 0 0 2024-09-16T00:50:29.241 INFO:tasks.workunit.client.0.smithi053.stdout:7/686: dwrite d1/d60/d70/dac/f65 [0,4194304] 0 2024-09-16T00:50:29.241 INFO:tasks.workunit.client.0.smithi053.stdout:7/687: write d1/d60/fa8 [877422,96745] 0 2024-09-16T00:50:29.243 INFO:tasks.workunit.client.0.smithi053.stdout:1/673: dwrite d5/d7/d39/d57/d82/fb3 [0,4194304] 0 2024-09-16T00:50:29.248 INFO:tasks.workunit.client.0.smithi053.stdout:3/663: mknod d1/d5/d11/d3a/dc5/cda 0 2024-09-16T00:50:29.249 INFO:tasks.workunit.client.0.smithi053.stdout:3/664: stat d1/d5/d91/d47/cbe 0 2024-09-16T00:50:29.249 INFO:tasks.workunit.client.0.smithi053.stdout:8/564: dwrite d10/f20 [4194304,4194304] 0 2024-09-16T00:50:29.252 INFO:tasks.workunit.client.0.smithi053.stdout:4/428: write d0/d2/dd/f40 [2012985,67981] 0 2024-09-16T00:50:29.255 INFO:tasks.workunit.client.0.smithi053.stdout:1/674: mknod d5/dd/d19/ce1 0 2024-09-16T00:50:29.255 INFO:tasks.workunit.client.0.smithi053.stdout:3/665: truncate d1/d4e/f6b 3756440 0 2024-09-16T00:50:29.257 INFO:tasks.workunit.client.0.smithi053.stdout:9/616: getdents d8/d22/d26 0 2024-09-16T00:50:29.258 INFO:tasks.workunit.client.0.smithi053.stdout:7/688: dwrite d1/d2a/d83/d84/fc5 [0,4194304] 0 2024-09-16T00:50:29.259 INFO:tasks.workunit.client.0.smithi053.stdout:8/565: getdents d10/d1c 0 2024-09-16T00:50:29.260 INFO:tasks.workunit.client.0.smithi053.stdout:4/429: unlink d0/d3c/l93 0 2024-09-16T00:50:29.260 INFO:tasks.workunit.client.0.smithi053.stdout:4/430: chown d0/f38 88757865 1 2024-09-16T00:50:29.261 INFO:tasks.workunit.client.0.smithi053.stdout:1/675: mkdir d5/d18/d33/d8a/d98/dd0/de2 0 2024-09-16T00:50:29.264 INFO:tasks.workunit.client.0.smithi053.stdout:3/666: symlink d1/d5/d11/d3a/dc6/ldb 0 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:9/617: write d8/d1c/d2b/d49/f8d [690508,47700] 0 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:7/689: dread d1/d35/d5b/d93/f96 [0,4194304] 0 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:9/618: fdatasync d8/d19/f7d 0 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:9/619: chown d8/f39 707525 1 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:7/690: readlink d1/d35/d4a/d74/l8e 0 2024-09-16T00:50:29.266 INFO:tasks.workunit.client.0.smithi053.stdout:7/691: fsync d1/d3/f3c 0 2024-09-16T00:50:29.275 INFO:tasks.workunit.client.0.smithi053.stdout:8/566: link d10/d21/d28/l69 d10/d21/d28/d3c/d84/lc3 0 2024-09-16T00:50:29.276 INFO:tasks.workunit.client.0.smithi053.stdout:4/431: mknod d0/d2/dd/d25/d39/c97 0 2024-09-16T00:50:29.278 INFO:tasks.workunit.client.0.smithi053.stdout:3/667: rename d1/d5/d91/c7e to d1/d89/cdc 0 2024-09-16T00:50:29.278 INFO:tasks.workunit.client.0.smithi053.stdout:3/668: truncate d1/d89/d28/f7b 839578 0 2024-09-16T00:50:29.279 INFO:tasks.workunit.client.0.smithi053.stdout:1/676: dwrite d5/d9/d73/f81 [0,4194304] 0 2024-09-16T00:50:29.280 INFO:tasks.workunit.client.0.smithi053.stdout:1/677: readlink d5/d18/d33/d8a/d98/dd0/l9c 0 2024-09-16T00:50:29.280 INFO:tasks.workunit.client.0.smithi053.stdout:9/620: mkdir d8/d4c/d5a/d99/dc8 0 2024-09-16T00:50:29.283 INFO:tasks.workunit.client.0.smithi053.stdout:8/567: creat d10/d1c/d2b/fc4 x:0 0 0 2024-09-16T00:50:29.284 INFO:tasks.workunit.client.0.smithi053.stdout:8/568: stat d10/d52/fb5 0 2024-09-16T00:50:29.284 INFO:tasks.workunit.client.0.smithi053.stdout:8/569: readlink d10/d1c/d2b/d40/d76/l81 0 2024-09-16T00:50:29.284 INFO:tasks.workunit.client.0.smithi053.stdout:9/621: read d8/d1c/d2b/d8b/f8f [408396,13803] 0 2024-09-16T00:50:29.284 INFO:tasks.workunit.client.0.smithi053.stdout:4/432: mkdir d0/d31/d98 0 2024-09-16T00:50:29.290 INFO:tasks.workunit.client.0.smithi053.stdout:7/692: rename d1/d3/c57 to d1/d60/d77/da9/de6/cea 0 2024-09-16T00:50:29.292 INFO:tasks.workunit.client.0.smithi053.stdout:7/693: dread d1/d2a/d4f/fb7 [0,4194304] 0 2024-09-16T00:50:29.292 INFO:tasks.workunit.client.0.smithi053.stdout:7/694: readlink d1/d35/d14/d15/l28 0 2024-09-16T00:50:29.292 INFO:tasks.workunit.client.0.smithi053.stdout:7/695: chown d1/d35/d5b/f8f 1556841 1 2024-09-16T00:50:29.300 INFO:tasks.workunit.client.0.smithi053.stdout:7/696: link d1/d35/d5b/la5 d1/d2a/d83/leb 0 2024-09-16T00:50:29.301 INFO:tasks.workunit.client.0.smithi053.stdout:3/669: getdents d1/d4e 0 2024-09-16T00:50:29.303 INFO:tasks.workunit.client.0.smithi053.stdout:5/673: rmdir d3 39 2024-09-16T00:50:29.307 INFO:tasks.workunit.client.0.smithi053.stdout:8/570: dwrite d10/d21/d28/d3c/f7c [0,4194304] 0 2024-09-16T00:50:29.308 INFO:tasks.workunit.client.0.smithi053.stdout:9/622: dwrite d8/d1c/d2b/d5c/f81 [0,4194304] 0 2024-09-16T00:50:29.308 INFO:tasks.workunit.client.0.smithi053.stdout:7/697: symlink d1/d60/d70/d92/lec 0 2024-09-16T00:50:29.308 INFO:tasks.workunit.client.0.smithi053.stdout:7/698: fsync d1/d35/fe1 0 2024-09-16T00:50:29.311 INFO:tasks.workunit.client.0.smithi053.stdout:3/670: mkdir d1/d5/d91/d5e/d69/ddd 0 2024-09-16T00:50:29.313 INFO:tasks.workunit.client.0.smithi053.stdout:5/674: mknod d3/d7/d2b/d4b/cd7 0 2024-09-16T00:50:29.317 INFO:tasks.workunit.client.0.smithi053.stdout:7/699: write d1/d2a/d83/d84/fc5 [1819314,92623] 0 2024-09-16T00:50:29.318 INFO:tasks.workunit.client.0.smithi053.stdout:7/700: read d1/d35/d4a/d74/fcb [738812,16390] 0 2024-09-16T00:50:29.318 INFO:tasks.workunit.client.0.smithi053.stdout:7/701: write d1/d3/f5 [5997497,57068] 0 2024-09-16T00:50:29.321 INFO:tasks.workunit.client.0.smithi053.stdout:9/623: chown d8/f30 87 1 2024-09-16T00:50:29.321 INFO:tasks.workunit.client.0.smithi053.stdout:8/571: dwrite d10/d1c/f7b [0,4194304] 0 2024-09-16T00:50:29.324 INFO:tasks.workunit.client.0.smithi053.stdout:3/671: unlink d1/d5/d91/d47/d4c/d50/c78 0 2024-09-16T00:50:29.325 INFO:tasks.workunit.client.0.smithi053.stdout:5/675: symlink d3/d7/d2b/d4b/d51/d53/da5/ld8 0 2024-09-16T00:50:29.328 INFO:tasks.workunit.client.0.smithi053.stdout:7/702: creat d1/d3/dc1/fed x:0 0 0 2024-09-16T00:50:29.337 INFO:tasks.workunit.client.0.smithi053.stdout:5/676: unlink d3/d7/d2b/d37/c7a 0 2024-09-16T00:50:29.337 INFO:tasks.workunit.client.0.smithi053.stdout:5/677: write d3/d7/f3b [1310201,41739] 0 2024-09-16T00:50:29.337 INFO:tasks.workunit.client.0.smithi053.stdout:9/624: dread d8/d1c/d2b/d2c/f48 [0,4194304] 0 2024-09-16T00:50:29.338 INFO:tasks.workunit.client.0.smithi053.stdout:7/703: getdents d1/d35/d4a 0 2024-09-16T00:50:29.346 INFO:tasks.workunit.client.0.smithi053.stdout:9/625: symlink d8/d1c/d2b/d2c/lc9 0 2024-09-16T00:50:29.347 INFO:tasks.workunit.client.0.smithi053.stdout:7/704: dread d1/d2a/d83/d84/fc5 [0,4194304] 0 2024-09-16T00:50:29.347 INFO:tasks.workunit.client.0.smithi053.stdout:5/678: dread d3/d7/f2a [0,4194304] 0 2024-09-16T00:50:29.348 INFO:tasks.workunit.client.0.smithi053.stdout:8/572: dwrite d10/f14 [0,4194304] 0 2024-09-16T00:50:29.348 INFO:tasks.workunit.client.0.smithi053.stdout:8/573: chown d10/d9e 475 1 2024-09-16T00:50:29.348 INFO:tasks.workunit.client.0.smithi053.stdout:8/574: write d10/d1c/d2b/fc4 [1046298,5641] 0 2024-09-16T00:50:29.348 INFO:tasks.workunit.client.0.smithi053.stdout:8/575: stat d10/d21/d28/fa1 0 2024-09-16T00:50:29.348 INFO:tasks.workunit.client.0.smithi053.stdout:8/576: creat d10/d1c/d2b/d40/d76/fc5 x:0 0 0 2024-09-16T00:50:29.360 INFO:tasks.workunit.client.0.smithi053.stdout:9/626: mknod d8/d4c/d5b/cca 0 2024-09-16T00:50:29.361 INFO:tasks.workunit.client.0.smithi053.stdout:7/705: creat d1/d2a/d83/dcc/fee x:0 0 0 2024-09-16T00:50:29.366 INFO:tasks.workunit.client.0.smithi053.stdout:8/577: truncate d10/f39 1915766 0 2024-09-16T00:50:29.366 INFO:tasks.workunit.client.0.smithi053.stdout:8/578: chown d10/d21/d28/da2/lc1 3691 1 2024-09-16T00:50:29.369 INFO:tasks.workunit.client.0.smithi053.stdout:5/679: dwrite d3/d7/d24/f8f [0,4194304] 0 2024-09-16T00:50:29.370 INFO:tasks.workunit.client.0.smithi053.stdout:5/680: chown d3/d7/d42 34 1 2024-09-16T00:50:29.370 INFO:tasks.workunit.client.0.smithi053.stdout:5/681: chown d3/d7/d2b/d37/l9d 0 1 2024-09-16T00:50:29.370 INFO:tasks.workunit.client.0.smithi053.stdout:7/706: creat d1/d2a/d83/d84/db1/fef x:0 0 0 2024-09-16T00:50:29.373 INFO:tasks.workunit.client.0.smithi053.stdout:7/707: dread d1/d2a/d4f/d52/f26 [4194304,4194304] 0 2024-09-16T00:50:29.376 INFO:tasks.workunit.client.0.smithi053.stdout:8/579: unlink d10/d1c/d92/d66/d9d/ca0 0 2024-09-16T00:50:29.378 INFO:tasks.workunit.client.0.smithi053.stdout:3/672: write d1/d4e/f6b [1437216,16121] 0 2024-09-16T00:50:29.378 INFO:tasks.workunit.client.0.smithi053.stdout:1/678: rmdir d5/d18/d33/d8a/d98/dd0 39 2024-09-16T00:50:29.393 INFO:tasks.workunit.client.0.smithi053.stdout:1/679: write d5/d5a/f7e [3183324,82733] 0 2024-09-16T00:50:29.393 INFO:tasks.workunit.client.0.smithi053.stdout:1/680: readlink d5/d18/d33/d30/l4e 0 2024-09-16T00:50:29.393 INFO:tasks.workunit.client.0.smithi053.stdout:1/681: read d5/d9/d4c/f89 [2606214,8552] 0 2024-09-16T00:50:29.394 INFO:tasks.workunit.client.0.smithi053.stdout:5/682: creat d3/fd9 x:0 0 0 2024-09-16T00:50:29.397 INFO:tasks.workunit.client.0.smithi053.stdout:7/708: unlink d1/d2a/d4f/f53 0 2024-09-16T00:50:29.401 INFO:tasks.workunit.client.0.smithi053.stdout:0/737: sync 2024-09-16T00:50:29.401 INFO:tasks.workunit.client.0.smithi053.stdout:6/681: sync 2024-09-16T00:50:29.401 INFO:tasks.workunit.client.0.smithi053.stdout:8/580: dwrite d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:29.401 INFO:tasks.workunit.client.0.smithi053.stdout:8/581: fdatasync d10/d1c/d92/d66/f7a 0 2024-09-16T00:50:29.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/673: creat d1/d5/d91/d47/d65/fde x:0 0 0 2024-09-16T00:50:29.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/674: creat d1/d89/fdf x:0 0 0 2024-09-16T00:50:29.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/675: creat d1/d89/d28/fe0 x:0 0 0 2024-09-16T00:50:29.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/676: write d1/d89/f2d [2737414,89762] 0 2024-09-16T00:50:29.404 INFO:tasks.workunit.client.0.smithi053.stdout:5/683: write d3/fb6 [1784272,31470] 0 2024-09-16T00:50:29.404 INFO:tasks.workunit.client.0.smithi053.stdout:5/684: fsync d3/d7/d24/d3f/f86 0 2024-09-16T00:50:29.404 INFO:tasks.workunit.client.0.smithi053.stdout:5/685: readlink d3/d7/d2b/d37/d58/d79/lb3 0 2024-09-16T00:50:29.405 INFO:tasks.workunit.client.0.smithi053.stdout:1/682: truncate d5/d18/d33/d8a/d98/dd0/f6e 870702 0 2024-09-16T00:50:29.413 INFO:tasks.workunit.client.0.smithi053.stdout:7/709: symlink d1/d35/lf0 0 2024-09-16T00:50:29.413 INFO:tasks.workunit.client.0.smithi053.stdout:3/677: dread d1/d5/d91/f4d [0,4194304] 0 2024-09-16T00:50:29.417 INFO:tasks.workunit.client.0.smithi053.stdout:0/738: mkdir d4/dc/d1e/d1f/d40/d44/d54/deb 0 2024-09-16T00:50:29.418 INFO:tasks.workunit.client.0.smithi053.stdout:8/582: dread d10/f14 [0,4194304] 0 2024-09-16T00:50:29.424 INFO:tasks.workunit.client.0.smithi053.stdout:6/682: symlink d1/dc/d54/le9 0 2024-09-16T00:50:29.425 INFO:tasks.workunit.client.0.smithi053.stdout:7/710: write d1/d2a/d4f/d52/f26 [103710,2073] 0 2024-09-16T00:50:29.431 INFO:tasks.workunit.client.0.smithi053.stdout:5/686: dwrite d3/d7/d24/d3f/f9e [0,4194304] 0 2024-09-16T00:50:29.442 INFO:tasks.workunit.client.0.smithi053.stdout:1/683: rename d5/d18/d33/d8a/ddd to d5/de3 0 2024-09-16T00:50:29.442 INFO:tasks.workunit.client.0.smithi053.stdout:1/684: write d5/d18/d1f/f8f [1822586,120200] 0 2024-09-16T00:50:29.447 INFO:tasks.workunit.client.0.smithi053.stdout:0/739: mkdir d4/dc/d1e/d22/dc5/dd2/dec 0 2024-09-16T00:50:29.451 INFO:tasks.workunit.client.0.smithi053.stdout:8/583: truncate d10/d21/f7f 1777465 0 2024-09-16T00:50:29.456 INFO:tasks.workunit.client.0.smithi053.stdout:6/683: dwrite d1/dc/f3b [0,4194304] 0 2024-09-16T00:50:29.457 INFO:tasks.workunit.client.0.smithi053.stdout:7/711: dwrite d1/d35/d4a/d74/fc4 [0,4194304] 0 2024-09-16T00:50:29.462 INFO:tasks.workunit.client.0.smithi053.stdout:5/687: truncate d3/d7/d2b/d37/d58/f21 270376 0 2024-09-16T00:50:29.462 INFO:tasks.workunit.client.0.smithi053.stdout:5/688: chown d3/d7/d24/f66 705 1 2024-09-16T00:50:29.462 INFO:tasks.workunit.client.0.smithi053.stdout:5/689: fdatasync d3/d7/d24/d3f/f8c 0 2024-09-16T00:50:29.477 INFO:tasks.workunit.client.0.smithi053.stdout:8/584: dwrite d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:29.488 INFO:tasks.workunit.client.0.smithi053.stdout:3/678: rename d1/f6d to d1/d89/fe1 0 2024-09-16T00:50:29.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/740: link d4/dc/d25/d34/db7/cdc d4/dc/d1e/d1f/d40/d44/d54/ced 0 2024-09-16T00:50:29.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/741: write d4/dc/dc0/f75 [1273193,85323] 0 2024-09-16T00:50:29.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/742: chown d4/dc/d25 71 1 2024-09-16T00:50:29.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/743: write d4/dc/d1e/d1f/d40/d44/f76 [2452113,1703] 0 2024-09-16T00:50:29.500 INFO:tasks.workunit.client.0.smithi053.stdout:6/684: mkdir d1/da6/dea 0 2024-09-16T00:50:29.500 INFO:tasks.workunit.client.0.smithi053.stdout:6/685: truncate d1/dc/d3c/d4b/f73 378153 0 2024-09-16T00:50:29.500 INFO:tasks.workunit.client.0.smithi053.stdout:6/686: creat d1/dc/feb x:0 0 0 2024-09-16T00:50:29.500 INFO:tasks.workunit.client.0.smithi053.stdout:6/687: write d1/dc/d45/f59 [1298532,112409] 0 2024-09-16T00:50:29.501 INFO:tasks.workunit.client.0.smithi053.stdout:6/688: write d1/dc/d3d/db1/fbb [1010701,69285] 0 2024-09-16T00:50:29.501 INFO:tasks.workunit.client.0.smithi053.stdout:0/744: write d4/dc/d87/dc6/f7c [2619513,108995] 0 2024-09-16T00:50:29.502 INFO:tasks.workunit.client.0.smithi053.stdout:8/585: dwrite d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:29.502 INFO:tasks.workunit.client.0.smithi053.stdout:8/586: chown d10/d21 5985 1 2024-09-16T00:50:29.502 INFO:tasks.workunit.client.0.smithi053.stdout:8/587: write d10/d1c/d49/f89 [1364393,127667] 0 2024-09-16T00:50:29.511 INFO:tasks.workunit.client.0.smithi053.stdout:5/690: creat d3/d7/d2b/d37/d58/d9f/fda x:0 0 0 2024-09-16T00:50:29.517 INFO:tasks.workunit.client.0.smithi053.stdout:3/679: rename d1/d4e/c74 to d1/d5/d31/d7a/ce2 0 2024-09-16T00:50:29.517 INFO:tasks.workunit.client.0.smithi053.stdout:3/680: write d1/d5/d31/d3b/fc8 [698306,74822] 0 2024-09-16T00:50:29.518 INFO:tasks.workunit.client.0.smithi053.stdout:5/691: write d3/d7/d24/d3f/f8c [1471022,116167] 0 2024-09-16T00:50:29.521 INFO:tasks.workunit.client.0.smithi053.stdout:6/689: mkdir d1/dc/d3c/d4a/dec 0 2024-09-16T00:50:29.524 INFO:tasks.workunit.client.0.smithi053.stdout:0/745: creat d4/dc/d1e/d1f/d40/d44/fee x:0 0 0 2024-09-16T00:50:29.524 INFO:tasks.workunit.client.0.smithi053.stdout:0/746: creat d4/dc/d1e/d1f/d40/d73/dd7/fef x:0 0 0 2024-09-16T00:50:29.524 INFO:tasks.workunit.client.0.smithi053.stdout:0/747: truncate d4/d5a/f9e 4451793 0 2024-09-16T00:50:29.525 INFO:tasks.workunit.client.0.smithi053.stdout:7/712: rename d1/d2a/d83/d84/de2 to d1/df1 0 2024-09-16T00:50:29.528 INFO:tasks.workunit.client.0.smithi053.stdout:3/681: mkdir d1/d5/d31/d7c/dbf/de3 0 2024-09-16T00:50:29.528 INFO:tasks.workunit.client.0.smithi053.stdout:3/682: write d1/d5/d91/d47/fcf [670869,87654] 0 2024-09-16T00:50:29.530 INFO:tasks.workunit.client.0.smithi053.stdout:5/692: mknod d3/d7/d42/cdb 0 2024-09-16T00:50:29.533 INFO:tasks.workunit.client.0.smithi053.stdout:8/588: dwrite d10/d21/d28/fa1 [0,4194304] 0 2024-09-16T00:50:29.535 INFO:tasks.workunit.client.0.smithi053.stdout:0/748: getdents d4/dc/d87/dc6/dc2 0 2024-09-16T00:50:29.536 INFO:tasks.workunit.client.0.smithi053.stdout:9/627: write d8/fc [4831544,8738] 0 2024-09-16T00:50:29.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/713: truncate d1/d35/d4a/dbb/fbd 746853 0 2024-09-16T00:50:29.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/714: write d1/d60/d70/dac/f7c [4131087,10619] 0 2024-09-16T00:50:29.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/715: dread - d1/d60/d70/dac/fd1 zero size 2024-09-16T00:50:29.539 INFO:tasks.workunit.client.0.smithi053.stdout:7/716: write d1/d35/d14/f38 [386085,89686] 0 2024-09-16T00:50:29.543 INFO:tasks.workunit.client.0.smithi053.stdout:3/683: creat d1/d5/d91/d47/d65/d97/d7f/fe4 x:0 0 0 2024-09-16T00:50:29.543 INFO:tasks.workunit.client.0.smithi053.stdout:3/684: stat d1/d5/d91/d47/d65/d97 0 2024-09-16T00:50:29.543 INFO:tasks.workunit.client.0.smithi053.stdout:5/693: write d3/f2c [2539681,75300] 0 2024-09-16T00:50:29.545 INFO:tasks.workunit.client.0.smithi053.stdout:9/628: write d8/f1d [2119860,88943] 0 2024-09-16T00:50:29.545 INFO:tasks.workunit.client.0.smithi053.stdout:9/629: write d8/d4c/d5a/d99/fb4 [190148,14455] 0 2024-09-16T00:50:29.548 INFO:tasks.workunit.client.0.smithi053.stdout:9/630: fsync d8/d4c/d5a/d99/fb4 0 2024-09-16T00:50:29.569 INFO:tasks.workunit.client.0.smithi053.stdout:5/694: dwrite d3/d7/d24/f65 [0,4194304] 0 2024-09-16T00:50:29.569 INFO:tasks.workunit.client.0.smithi053.stdout:5/695: chown d3/d7/d2b/d37/d58/f19 41711996 1 2024-09-16T00:50:29.638 INFO:tasks.workunit.client.0.smithi053.stdout:8/589: creat d10/d1c/d92/d66/d9d/fc6 x:0 0 0 2024-09-16T00:50:29.646 INFO:tasks.workunit.client.0.smithi053.stdout:8/590: write d10/d1c/d2b/f4e [1499359,75539] 0 2024-09-16T00:50:29.648 INFO:tasks.workunit.client.0.smithi053.stdout:7/717: rename d1/d60/c98 to d1/d35/d14/cf2 0 2024-09-16T00:50:29.648 INFO:tasks.workunit.client.0.smithi053.stdout:7/718: chown d1/d35/d14/d15/cd4 1 1 2024-09-16T00:50:29.654 INFO:tasks.workunit.client.0.smithi053.stdout:3/685: symlink d1/d5/d31/d7a/le5 0 2024-09-16T00:50:29.654 INFO:tasks.workunit.client.0.smithi053.stdout:3/686: dread - d1/d5/d91/d47/dd5/fd0 zero size 2024-09-16T00:50:29.658 INFO:tasks.workunit.client.0.smithi053.stdout:9/631: mknod d8/d1c/d2b/d2c/d9b/ccb 0 2024-09-16T00:50:29.659 INFO:tasks.workunit.client.0.smithi053.stdout:5/696: mkdir d3/d7/d2b/d4b/d51/ddc 0 2024-09-16T00:50:29.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/591: rmdir d10/d1c 39 2024-09-16T00:50:29.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/592: chown d10/d1c/d49/f89 12 1 2024-09-16T00:50:29.664 INFO:tasks.workunit.client.0.smithi053.stdout:7/719: mkdir d1/d3/df3 0 2024-09-16T00:50:29.666 INFO:tasks.workunit.client.0.smithi053.stdout:9/632: symlink d8/d22/d54/lcc 0 2024-09-16T00:50:29.666 INFO:tasks.workunit.client.0.smithi053.stdout:9/633: fdatasync d8/d19/d51/d6d/f7b 0 2024-09-16T00:50:29.666 INFO:tasks.workunit.client.0.smithi053.stdout:9/634: truncate d8/d13/fae 935208 0 2024-09-16T00:50:29.667 INFO:tasks.workunit.client.0.smithi053.stdout:5/697: mkdir d3/d7/d42/ddd 0 2024-09-16T00:50:29.667 INFO:tasks.workunit.client.0.smithi053.stdout:8/593: mknod d10/d1c/d92/cc7 0 2024-09-16T00:50:29.670 INFO:tasks.workunit.client.0.smithi053.stdout:9/635: creat d8/d22/dc2/fcd x:0 0 0 2024-09-16T00:50:29.670 INFO:tasks.workunit.client.0.smithi053.stdout:9/636: write d8/d13/f29 [281379,100851] 0 2024-09-16T00:50:29.671 INFO:tasks.workunit.client.0.smithi053.stdout:5/698: creat d3/d7/d2b/d4b/d51/d96/fde x:0 0 0 2024-09-16T00:50:29.675 INFO:tasks.workunit.client.0.smithi053.stdout:9/637: rename d8/d13/l23 to d8/d19/d51/lce 0 2024-09-16T00:50:29.677 INFO:tasks.workunit.client.0.smithi053.stdout:3/687: dwrite d1/d89/f18 [0,4194304] 0 2024-09-16T00:50:29.697 INFO:tasks.workunit.client.0.smithi053.stdout:6/690: rmdir d1/dc/d3c/d4a 39 2024-09-16T00:50:29.706 INFO:tasks.workunit.client.0.smithi053.stdout:6/691: read d1/f15 [77429,2341] 0 2024-09-16T00:50:29.706 INFO:tasks.workunit.client.0.smithi053.stdout:6/692: write d1/dc/d39/f89 [4915197,4250] 0 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/693: link d1/dc/d54/cbe d1/dc/d3c/d4b/d75/dd6/ced 0 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/694: write d1/dc/d1e/fe2 [663084,7802] 0 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/695: chown d1/dc/d66/c71 2820815 1 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/696: write d1/dc/d1e/d65/d81/f84 [575159,101080] 0 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/697: dread - d1/dc/feb zero size 2024-09-16T00:50:29.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/698: chown d1/dc/d43/c9d 1 1 2024-09-16T00:50:29.714 INFO:tasks.workunit.client.0.smithi053.stdout:6/699: symlink d1/da6/dea/lee 0 2024-09-16T00:50:29.714 INFO:tasks.workunit.client.0.smithi053.stdout:6/700: fdatasync d1/dc/d45/fb0 0 2024-09-16T00:50:29.714 INFO:tasks.workunit.client.0.smithi053.stdout:6/701: chown d1/dc/d3c/d4b/d58/db9 2 1 2024-09-16T00:50:29.714 INFO:tasks.workunit.client.0.smithi053.stdout:6/702: write d1/dc/d39/f23 [4177794,123593] 0 2024-09-16T00:50:29.715 INFO:tasks.workunit.client.0.smithi053.stdout:6/703: mknod d1/dc/d3c/d4b/d75/dd6/cef 0 2024-09-16T00:50:29.718 INFO:tasks.workunit.client.0.smithi053.stdout:6/704: rename d1/dc/d3d/f7b to d1/d2f/db3/ff0 0 2024-09-16T00:50:29.718 INFO:tasks.workunit.client.0.smithi053.stdout:8/594: dwrite d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:29.721 INFO:tasks.workunit.client.0.smithi053.stdout:8/595: unlink d10/d21/d28/d3c/f7c 0 2024-09-16T00:50:29.722 INFO:tasks.workunit.client.0.smithi053.stdout:8/596: mkdir d10/d1c/d2b/d40/dc8 0 2024-09-16T00:50:29.723 INFO:tasks.workunit.client.0.smithi053.stdout:8/597: rename d10/d52/f9c to d10/d21/d28/fc9 0 2024-09-16T00:50:29.725 INFO:tasks.workunit.client.0.smithi053.stdout:6/705: dread d1/dc/d45/f59 [0,4194304] 0 2024-09-16T00:50:29.726 INFO:tasks.workunit.client.0.smithi053.stdout:5/699: dwrite d3/d7/d24/d34/f39 [0,4194304] 0 2024-09-16T00:50:29.726 INFO:tasks.workunit.client.0.smithi053.stdout:8/598: fdatasync f8 0 2024-09-16T00:50:29.726 INFO:tasks.workunit.client.0.smithi053.stdout:8/599: readlink d10/d1c/l36 0 2024-09-16T00:50:29.727 INFO:tasks.workunit.client.0.smithi053.stdout:6/706: mknod d1/dc/d3c/ddd/cf1 0 2024-09-16T00:50:29.727 INFO:tasks.workunit.client.0.smithi053.stdout:9/638: dwrite d8/d19/d31/f71 [0,4194304] 0 2024-09-16T00:50:29.729 INFO:tasks.workunit.client.0.smithi053.stdout:5/700: creat d3/d7/fdf x:0 0 0 2024-09-16T00:50:29.729 INFO:tasks.workunit.client.0.smithi053.stdout:3/688: dwrite d1/d5/d91/d47/fb9 [0,4194304] 0 2024-09-16T00:50:29.730 INFO:tasks.workunit.client.0.smithi053.stdout:8/600: creat d10/d1c/d92/d66/d9d/da6/fca x:0 0 0 2024-09-16T00:50:29.730 INFO:tasks.workunit.client.0.smithi053.stdout:7/720: dwrite d1/d35/d4a/dbb/fbd [0,4194304] 0 2024-09-16T00:50:29.730 INFO:tasks.workunit.client.0.smithi053.stdout:7/721: truncate d1/d3/fba 777651 0 2024-09-16T00:50:29.734 INFO:tasks.workunit.client.0.smithi053.stdout:5/701: symlink d3/d7/d42/le0 0 2024-09-16T00:50:29.753 INFO:tasks.workunit.client.0.smithi053.stdout:3/689: rename d1/d89/d28/da7 to d1/d5/d31/d7c/dbf/dcd/de6 0 2024-09-16T00:50:29.756 INFO:tasks.workunit.client.0.smithi053.stdout:7/722: link d1/f3a d1/d2a/d83/d84/ff4 0 2024-09-16T00:50:29.761 INFO:tasks.workunit.client.0.smithi053.stdout:7/723: link d1/d3/fba d1/d2a/d83/dcc/ff5 0 2024-09-16T00:50:29.765 INFO:tasks.workunit.client.0.smithi053.stdout:7/724: getdents d1/d35/d4a/dbb/ddc 0 2024-09-16T00:50:29.765 INFO:tasks.workunit.client.0.smithi053.stdout:6/707: dwrite d1/dc/d54/f64 [0,4194304] 0 2024-09-16T00:50:29.765 INFO:tasks.workunit.client.0.smithi053.stdout:6/708: chown d1/l24 30317253 1 2024-09-16T00:50:29.765 INFO:tasks.workunit.client.0.smithi053.stdout:6/709: truncate d1/dc/d45/f76 627215 0 2024-09-16T00:50:29.766 INFO:tasks.workunit.client.0.smithi053.stdout:3/690: dread d1/d5/d91/d47/d65/d66/fc2 [0,4194304] 0 2024-09-16T00:50:29.766 INFO:tasks.workunit.client.0.smithi053.stdout:3/691: chown d1/d5/d31/d7a/le5 72 1 2024-09-16T00:50:29.766 INFO:tasks.workunit.client.0.smithi053.stdout:3/692: stat d1/d89/d28/d5a 0 2024-09-16T00:50:29.766 INFO:tasks.workunit.client.0.smithi053.stdout:7/725: unlink d1/d60/d70/dac/f65 0 2024-09-16T00:50:29.772 INFO:tasks.workunit.client.0.smithi053.stdout:3/693: link d1/d5/d91/f1f d1/d5/d31/d3b/d9c/fe7 0 2024-09-16T00:50:29.777 INFO:tasks.workunit.client.0.smithi053.stdout:9/639: dwrite d8/d1c/d2b/f76 [0,4194304] 0 2024-09-16T00:50:29.780 INFO:tasks.workunit.client.0.smithi053.stdout:3/694: dread d1/d5/d91/d47/f5b [0,4194304] 0 2024-09-16T00:50:29.784 INFO:tasks.workunit.client.0.smithi053.stdout:6/710: dread d1/dc/d39/f34 [0,4194304] 0 2024-09-16T00:50:29.785 INFO:tasks.workunit.client.0.smithi053.stdout:3/695: mkdir d1/d5/d11/d3a/dc6/de8 0 2024-09-16T00:50:29.786 INFO:tasks.workunit.client.0.smithi053.stdout:3/696: chown d1/d5/d31/d3b/d9c 9 1 2024-09-16T00:50:29.786 INFO:tasks.workunit.client.0.smithi053.stdout:3/697: chown d1/d5/d91/d47/c60 625757189 1 2024-09-16T00:50:29.788 INFO:tasks.workunit.client.0.smithi053.stdout:5/702: dwrite d3/f20 [0,4194304] 0 2024-09-16T00:50:29.790 INFO:tasks.workunit.client.0.smithi053.stdout:8/601: rename d10/d21/d28/fc9 to d10/d21/d28/d3c/d84/fcb 0 2024-09-16T00:50:29.790 INFO:tasks.workunit.client.0.smithi053.stdout:8/602: truncate d10/f1e 4510598 0 2024-09-16T00:50:29.791 INFO:tasks.workunit.client.0.smithi053.stdout:7/726: dwrite d1/d2a/d4f/f6d [4194304,4194304] 0 2024-09-16T00:50:29.792 INFO:tasks.workunit.client.0.smithi053.stdout:6/711: truncate d1/dc/d1e/d65/dc6/fd3 2152042 0 2024-09-16T00:50:29.796 INFO:tasks.workunit.client.0.smithi053.stdout:9/640: write d8/d13/f66 [6496311,117989] 0 2024-09-16T00:50:29.801 INFO:tasks.workunit.client.0.smithi053.stdout:8/603: write d10/d21/d28/fa1 [3172728,23751] 0 2024-09-16T00:50:29.811 INFO:tasks.workunit.client.0.smithi053.stdout:9/641: dread d8/d1c/d2b/d5c/f70 [0,4194304] 0 2024-09-16T00:50:29.812 INFO:tasks.workunit.client.0.smithi053.stdout:9/642: dread - d8/fb3 zero size 2024-09-16T00:50:29.812 INFO:tasks.workunit.client.0.smithi053.stdout:8/604: rename d10/f1e to d10/d21/d28/d3c/d63/d6a/fcc 0 2024-09-16T00:50:29.813 INFO:tasks.workunit.client.0.smithi053.stdout:7/727: getdents d1/d2a/d83 0 2024-09-16T00:50:29.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/605: write d10/d1c/d2b/d40/f6d [584950,58918] 0 2024-09-16T00:50:29.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/606: truncate d10/d1c/d92/f7d 5235674 0 2024-09-16T00:50:29.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/607: stat d10/d4a/d54 0 2024-09-16T00:50:29.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/608: fdatasync d10/d1c/d92/fa5 0 2024-09-16T00:50:29.823 INFO:tasks.workunit.client.0.smithi053.stdout:2/617: sync 2024-09-16T00:50:29.823 INFO:tasks.workunit.client.0.smithi053.stdout:4/433: sync 2024-09-16T00:50:29.823 INFO:tasks.workunit.client.0.smithi053.stdout:9/643: write d8/d1c/d2b/f76 [1094583,43495] 0 2024-09-16T00:50:29.823 INFO:tasks.workunit.client.0.smithi053.stdout:9/644: write d8/d1c/d2b/d2c/f41 [1712173,12997] 0 2024-09-16T00:50:29.823 INFO:tasks.workunit.client.0.smithi053.stdout:9/645: chown d8/d1c/d2b/d49/l82 16340 1 2024-09-16T00:50:29.826 INFO:tasks.workunit.client.0.smithi053.stdout:2/618: creat d6/d9/dd/d3e/d72/d75/d84/fc5 x:0 0 0 2024-09-16T00:50:29.827 INFO:tasks.workunit.client.0.smithi053.stdout:3/698: dwrite d1/d5/d11/f55 [0,4194304] 0 2024-09-16T00:50:29.828 INFO:tasks.workunit.client.0.smithi053.stdout:5/703: dwrite d3/d7/d2b/d4b/d51/fc1 [0,4194304] 0 2024-09-16T00:50:29.828 INFO:tasks.workunit.client.0.smithi053.stdout:5/704: creat d3/d7/d2b/d4b/d51/d96/fe1 x:0 0 0 2024-09-16T00:50:29.828 INFO:tasks.workunit.client.0.smithi053.stdout:7/728: dread d1/d35/f1e [4194304,4194304] 0 2024-09-16T00:50:29.829 INFO:tasks.workunit.client.0.smithi053.stdout:8/609: dwrite d10/d21/d28/f32 [0,4194304] 0 2024-09-16T00:50:29.832 INFO:tasks.workunit.client.0.smithi053.stdout:2/619: link d6/f77 d6/d9/db6/fc6 0 2024-09-16T00:50:29.833 INFO:tasks.workunit.client.0.smithi053.stdout:9/646: getdents d8/d1c 0 2024-09-16T00:50:29.837 INFO:tasks.workunit.client.0.smithi053.stdout:3/699: mknod d1/d5/d91/d47/d6c/ce9 0 2024-09-16T00:50:29.837 INFO:tasks.workunit.client.0.smithi053.stdout:3/700: truncate d1/d5/d91/d5e/f63 1896513 0 2024-09-16T00:50:29.848 INFO:tasks.workunit.client.0.smithi053.stdout:2/620: dwrite d6/d9/dd/d3e/d52/d65/d92/fa7 [0,4194304] 0 2024-09-16T00:50:29.848 INFO:tasks.workunit.client.0.smithi053.stdout:2/621: write d6/d9/dd/d3e/f6f [567429,27415] 0 2024-09-16T00:50:29.849 INFO:tasks.workunit.client.0.smithi053.stdout:5/705: truncate d3/f32 1990725 0 2024-09-16T00:50:29.853 INFO:tasks.workunit.client.0.smithi053.stdout:7/729: unlink d1/d35/d14/cf2 0 2024-09-16T00:50:29.853 INFO:tasks.workunit.client.0.smithi053.stdout:7/730: stat d1/d35/d14/d15/cd4 0 2024-09-16T00:50:29.862 INFO:tasks.workunit.client.0.smithi053.stdout:8/610: mkdir d10/d4a/dc2/dcd 0 2024-09-16T00:50:29.863 INFO:tasks.workunit.client.0.smithi053.stdout:4/434: rename d0/d3c/d48/d53 to d0/da/d42/d8b/d87/d99 0 2024-09-16T00:50:29.863 INFO:tasks.workunit.client.0.smithi053.stdout:4/435: write d0/d2/dd/d25/d41/d78/f90 [495995,13927] 0 2024-09-16T00:50:29.864 INFO:tasks.workunit.client.0.smithi053.stdout:5/706: dwrite d3/fa6 [0,4194304] 0 2024-09-16T00:50:29.864 INFO:tasks.workunit.client.0.smithi053.stdout:5/707: fsync d3/f2c 0 2024-09-16T00:50:29.865 INFO:tasks.workunit.client.0.smithi053.stdout:9/647: mknod d8/d22/d26/ccf 0 2024-09-16T00:50:29.866 INFO:tasks.workunit.client.0.smithi053.stdout:3/701: unlink d1/d5/d11/da9/fbc 0 2024-09-16T00:50:29.871 INFO:tasks.workunit.client.0.smithi053.stdout:7/731: dwrite d1/d35/d4a/d74/fc4 [0,4194304] 0 2024-09-16T00:50:29.871 INFO:tasks.workunit.client.0.smithi053.stdout:2/622: mknod d6/d9/dd/d3e/d72/d75/cc7 0 2024-09-16T00:50:29.871 INFO:tasks.workunit.client.0.smithi053.stdout:2/623: chown d6/d29/f9a 1 1 2024-09-16T00:50:29.871 INFO:tasks.workunit.client.0.smithi053.stdout:6/712: truncate d1/dc/d1e/d65/dc6/fd3 1294834 0 2024-09-16T00:50:29.875 INFO:tasks.workunit.client.0.smithi053.stdout:8/611: creat d10/d1c/fce x:0 0 0 2024-09-16T00:50:29.877 INFO:tasks.workunit.client.0.smithi053.stdout:4/436: rename d0/d2/f28 to d0/d2/dd/d25/d41/f9a 0 2024-09-16T00:50:29.878 INFO:tasks.workunit.client.0.smithi053.stdout:4/437: creat d0/d2/dd/f9b x:0 0 0 2024-09-16T00:50:29.882 INFO:tasks.workunit.client.0.smithi053.stdout:5/708: mkdir d3/d7/d2b/d4b/d51/de2 0 2024-09-16T00:50:29.884 INFO:tasks.workunit.client.0.smithi053.stdout:9/648: creat d8/d4c/d5a/fd0 x:0 0 0 2024-09-16T00:50:29.887 INFO:tasks.workunit.client.0.smithi053.stdout:3/702: symlink d1/d5/d91/d47/d65/d97/d7f/lea 0 2024-09-16T00:50:29.887 INFO:tasks.workunit.client.0.smithi053.stdout:3/703: chown d1/d5/d31/f38 0 1 2024-09-16T00:50:29.887 INFO:tasks.workunit.client.0.smithi053.stdout:3/704: truncate d1/d5/d11/d3a/dc6/fd8 734883 0 2024-09-16T00:50:29.891 INFO:tasks.workunit.client.0.smithi053.stdout:7/732: creat d1/d60/d77/da9/ff6 x:0 0 0 2024-09-16T00:50:29.891 INFO:tasks.workunit.client.0.smithi053.stdout:7/733: fsync d1/d2a/d4f/d52/f37 0 2024-09-16T00:50:29.893 INFO:tasks.workunit.client.0.smithi053.stdout:2/624: creat d6/d9/d14/d81/fc8 x:0 0 0 2024-09-16T00:50:29.893 INFO:tasks.workunit.client.0.smithi053.stdout:2/625: chown d6/d9/dd/d3e/d52/d65/l66 2674711 1 2024-09-16T00:50:29.894 INFO:tasks.workunit.client.0.smithi053.stdout:6/713: mknod d1/dc/dba/cf2 0 2024-09-16T00:50:29.901 INFO:tasks.workunit.client.0.smithi053.stdout:5/709: creat d3/d9c/fe3 x:0 0 0 2024-09-16T00:50:29.903 INFO:tasks.workunit.client.0.smithi053.stdout:9/649: creat d8/d13/fd1 x:0 0 0 2024-09-16T00:50:29.905 INFO:tasks.workunit.client.0.smithi053.stdout:3/705: unlink d1/d5/d91/d47/d64/l85 0 2024-09-16T00:50:29.908 INFO:tasks.workunit.client.0.smithi053.stdout:7/734: mknod d1/d2a/d83/dcc/cf7 0 2024-09-16T00:50:29.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/626: link d6/d9/dd/d3e/d72/f78 d6/d9/dd/d3e/d52/d65/d92/fc9 0 2024-09-16T00:50:29.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/627: chown d6/d9/dd/d3e/d72/d75/fc2 2633723 1 2024-09-16T00:50:29.910 INFO:tasks.workunit.client.0.smithi053.stdout:9/650: dread d8/d19/d51/f56 [4194304,4194304] 0 2024-09-16T00:50:29.910 INFO:tasks.workunit.client.0.smithi053.stdout:6/714: mknod d1/dc/d3c/d4b/cf3 0 2024-09-16T00:50:29.911 INFO:tasks.workunit.client.0.smithi053.stdout:6/715: truncate d1/d2f/fc5 511952 0 2024-09-16T00:50:29.912 INFO:tasks.workunit.client.0.smithi053.stdout:8/612: dwrite d10/d21/d28/d3c/d84/fcb [0,4194304] 0 2024-09-16T00:50:29.912 INFO:tasks.workunit.client.0.smithi053.stdout:5/710: truncate d3/d7/d24/fc8 762214 0 2024-09-16T00:50:29.912 INFO:tasks.workunit.client.0.smithi053.stdout:5/711: write d3/d7/d2b/d37/d58/f82 [1156020,20862] 0 2024-09-16T00:50:29.914 INFO:tasks.workunit.client.0.smithi053.stdout:4/438: dwrite d0/d3c/d48/f91 [0,4194304] 0 2024-09-16T00:50:29.922 INFO:tasks.workunit.client.0.smithi053.stdout:9/651: creat d8/d22/d54/fd2 x:0 0 0 2024-09-16T00:50:29.923 INFO:tasks.workunit.client.0.smithi053.stdout:9/652: creat d8/d22/d26/d83/fd3 x:0 0 0 2024-09-16T00:50:29.923 INFO:tasks.workunit.client.0.smithi053.stdout:8/613: dread d10/d21/d28/d3c/f3d [0,4194304] 0 2024-09-16T00:50:29.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/716: write d1/dc/d54/f64 [82263,74274] 0 2024-09-16T00:50:29.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/717: dread - d1/dc/d3c/fe3 zero size 2024-09-16T00:50:29.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/718: chown d1/dc/d43/cd4 24 1 2024-09-16T00:50:29.930 INFO:tasks.workunit.client.0.smithi053.stdout:5/712: dwrite d3/d7/d24/d34/d5b/f7b [0,4194304] 0 2024-09-16T00:50:29.933 INFO:tasks.workunit.client.0.smithi053.stdout:5/713: dread d3/fb6 [0,4194304] 0 2024-09-16T00:50:29.935 INFO:tasks.workunit.client.0.smithi053.stdout:8/614: dread d10/d1c/d92/f94 [0,4194304] 0 2024-09-16T00:50:29.935 INFO:tasks.workunit.client.0.smithi053.stdout:8/615: write d10/d21/f2c [4785026,71304] 0 2024-09-16T00:50:29.935 INFO:tasks.workunit.client.0.smithi053.stdout:8/616: fdatasync fb 0 2024-09-16T00:50:29.935 INFO:tasks.workunit.client.0.smithi053.stdout:8/617: write d10/d1c/d92/d66/f7a [1246000,46137] 0 2024-09-16T00:50:29.935 INFO:tasks.workunit.client.0.smithi053.stdout:8/618: write d10/d21/f7f [2652547,126028] 0 2024-09-16T00:50:29.937 INFO:tasks.workunit.client.0.smithi053.stdout:1/685: sync 2024-09-16T00:50:29.937 INFO:tasks.workunit.client.0.smithi053.stdout:0/749: sync 2024-09-16T00:50:29.938 INFO:tasks.workunit.client.0.smithi053.stdout:0/750: creat d4/dc/d1e/d1f/d40/d44/d54/db8/ff0 x:0 0 0 2024-09-16T00:50:29.938 INFO:tasks.workunit.client.0.smithi053.stdout:0/751: readlink d4/dc/d25/l86 0 2024-09-16T00:50:29.938 INFO:tasks.workunit.client.0.smithi053.stdout:4/439: creat d0/d3c/d48/d95/f9c x:0 0 0 2024-09-16T00:50:29.941 INFO:tasks.workunit.client.0.smithi053.stdout:3/706: getdents d1 0 2024-09-16T00:50:29.945 INFO:tasks.workunit.client.0.smithi053.stdout:7/735: getdents d1/d35 0 2024-09-16T00:50:29.946 INFO:tasks.workunit.client.0.smithi053.stdout:8/619: write d10/d21/d28/d3c/d84/fcb [2710033,55184] 0 2024-09-16T00:50:29.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:29 smithi152 ceph-mon[33237]: pgmap v15: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 218 MiB/s rd, 241 MiB/s wr, 370 op/s 2024-09-16T00:50:29.946 INFO:tasks.workunit.client.0.smithi053.stdout:2/628: symlink d6/d9/lca 0 2024-09-16T00:50:29.948 INFO:tasks.workunit.client.0.smithi053.stdout:9/653: mkdir d8/d19/dd4 0 2024-09-16T00:50:29.953 INFO:tasks.workunit.client.0.smithi053.stdout:6/719: rmdir d1/dc/d3c/d4b/d75/de1 0 2024-09-16T00:50:29.953 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:29 smithi053 ceph-mon[27950]: pgmap v15: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 218 MiB/s rd, 241 MiB/s wr, 370 op/s 2024-09-16T00:50:29.954 INFO:tasks.workunit.client.0.smithi053.stdout:7/736: dread d1/d2a/f99 [0,4194304] 0 2024-09-16T00:50:29.959 INFO:tasks.workunit.client.0.smithi053.stdout:5/714: mknod d3/d7/ce4 0 2024-09-16T00:50:29.961 INFO:tasks.workunit.client.0.smithi053.stdout:4/440: dwrite d0/d2/dd/f9b [0,4194304] 0 2024-09-16T00:50:29.961 INFO:tasks.workunit.client.0.smithi053.stdout:4/441: write d0/d2/f34 [3473047,66103] 0 2024-09-16T00:50:29.963 INFO:tasks.workunit.client.0.smithi053.stdout:1/686: rename d5/d18/d33/d30/f90 to d5/d9/d73/fe4 0 2024-09-16T00:50:29.963 INFO:tasks.workunit.client.0.smithi053.stdout:1/687: chown d5/dd/d7f/fb4 814 1 2024-09-16T00:50:29.963 INFO:tasks.workunit.client.0.smithi053.stdout:1/688: fdatasync d5/d18/d33/f63 0 2024-09-16T00:50:29.966 INFO:tasks.workunit.client.0.smithi053.stdout:0/752: mknod d4/d5a/d82/cf1 0 2024-09-16T00:50:29.969 INFO:tasks.workunit.client.0.smithi053.stdout:4/442: dread d0/d2/f23 [0,4194304] 0 2024-09-16T00:50:29.970 INFO:tasks.workunit.client.0.smithi053.stdout:4/443: write d0/d2/dd/f13 [115286,12779] 0 2024-09-16T00:50:29.970 INFO:tasks.workunit.client.0.smithi053.stdout:3/707: creat d1/d5/d31/d7c/dbf/de3/feb x:0 0 0 2024-09-16T00:50:29.972 INFO:tasks.workunit.client.0.smithi053.stdout:0/753: dread d4/dc/d87/fa0 [0,4194304] 0 2024-09-16T00:50:29.972 INFO:tasks.workunit.client.0.smithi053.stdout:8/620: stat d10/c17 0 2024-09-16T00:50:29.973 INFO:tasks.workunit.client.0.smithi053.stdout:7/737: dwrite d1/d35/d14/d15/f9c [0,4194304] 0 2024-09-16T00:50:29.975 INFO:tasks.workunit.client.0.smithi053.stdout:2/629: link d6/d9/dd/d3e/d52/cb8 d6/d9/dd/d3e/d52/d7e/ccb 0 2024-09-16T00:50:29.977 INFO:tasks.workunit.client.0.smithi053.stdout:9/654: mkdir d8/d22/d54/dd5 0 2024-09-16T00:50:29.977 INFO:tasks.workunit.client.0.smithi053.stdout:9/655: chown d8/d1c/d2b/f47 0 1 2024-09-16T00:50:29.978 INFO:tasks.workunit.client.0.smithi053.stdout:6/720: truncate d1/f57 3115262 0 2024-09-16T00:50:29.979 INFO:tasks.workunit.client.0.smithi053.stdout:6/721: readlink d1/l3 0 2024-09-16T00:50:29.979 INFO:tasks.workunit.client.0.smithi053.stdout:6/722: chown d1/dc/c26 3913 1 2024-09-16T00:50:29.980 INFO:tasks.workunit.client.0.smithi053.stdout:5/715: symlink d3/d9c/dc4/le5 0 2024-09-16T00:50:29.982 INFO:tasks.workunit.client.0.smithi053.stdout:6/723: write d1/dc/d1e/d65/dc6/fd3 [365838,38202] 0 2024-09-16T00:50:29.983 INFO:tasks.workunit.client.0.smithi053.stdout:6/724: write d1/fca [147193,70118] 0 2024-09-16T00:50:29.983 INFO:tasks.workunit.client.0.smithi053.stdout:6/725: write d1/dc/d3c/d4b/fb2 [639484,111195] 0 2024-09-16T00:50:29.988 INFO:tasks.workunit.client.0.smithi053.stdout:1/689: mkdir d5/d9/d4c/de5 0 2024-09-16T00:50:29.993 INFO:tasks.workunit.client.0.smithi053.stdout:4/444: dwrite d0/d3c/d48/f67 [0,4194304] 0 2024-09-16T00:50:29.993 INFO:tasks.workunit.client.0.smithi053.stdout:4/445: creat d0/d3c/d48/d95/f9d x:0 0 0 2024-09-16T00:50:29.993 INFO:tasks.workunit.client.0.smithi053.stdout:4/446: chown d0/d2/dd/d25/d37/l47 95132 1 2024-09-16T00:50:29.993 INFO:tasks.workunit.client.0.smithi053.stdout:8/621: link d10/d21/f33 d10/d1c/d2b/d40/d76/fcf 0 2024-09-16T00:50:29.993 INFO:tasks.workunit.client.0.smithi053.stdout:8/622: write d10/d1c/d2b/d40/d76/fc5 [234811,105822] 0 2024-09-16T00:50:29.997 INFO:tasks.workunit.client.0.smithi053.stdout:7/738: mkdir d1/d60/d62/df8 0 2024-09-16T00:50:29.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/708: dwrite d1/d5/d91/d47/fd1 [0,4194304] 0 2024-09-16T00:50:29.999 INFO:tasks.workunit.client.0.smithi053.stdout:3/709: write d1/d5/d31/d3b/d9c/fe7 [1954239,7795] 0 2024-09-16T00:50:30.001 INFO:tasks.workunit.client.0.smithi053.stdout:2/630: chown d6/d9/c64 742 1 2024-09-16T00:50:30.001 INFO:tasks.workunit.client.0.smithi053.stdout:2/631: write d6/d9/dd/d28/f57 [1569550,100980] 0 2024-09-16T00:50:30.001 INFO:tasks.workunit.client.0.smithi053.stdout:2/632: chown d6/d9/dd/d3e/d52/f68 5986997 1 2024-09-16T00:50:30.003 INFO:tasks.workunit.client.0.smithi053.stdout:9/656: mknod d8/d1c/d2b/db6/cd6 0 2024-09-16T00:50:30.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/716: creat d3/d7/d2b/d4b/d51/d53/da9/fe6 x:0 0 0 2024-09-16T00:50:30.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/717: fdatasync d3/f27 0 2024-09-16T00:50:30.011 INFO:tasks.workunit.client.0.smithi053.stdout:1/690: link d5/d7/f76 d5/d18/d33/d8a/d98/dd0/de2/fe6 0 2024-09-16T00:50:30.011 INFO:tasks.workunit.client.0.smithi053.stdout:9/657: dread d8/d1c/d2b/d5c/f81 [0,4194304] 0 2024-09-16T00:50:30.019 INFO:tasks.workunit.client.0.smithi053.stdout:0/754: rename d4/d13/f8b to d4/ff2 0 2024-09-16T00:50:30.024 INFO:tasks.workunit.client.0.smithi053.stdout:4/447: creat d0/da/d7c/f9e x:0 0 0 2024-09-16T00:50:30.029 INFO:tasks.workunit.client.0.smithi053.stdout:8/623: unlink d10/d21/d28/da2/lc1 0 2024-09-16T00:50:30.030 INFO:tasks.workunit.client.0.smithi053.stdout:8/624: creat d10/d52/fd0 x:0 0 0 2024-09-16T00:50:30.031 INFO:tasks.workunit.client.0.smithi053.stdout:7/739: mknod d1/df1/cf9 0 2024-09-16T00:50:30.034 INFO:tasks.workunit.client.0.smithi053.stdout:3/710: creat d1/d5/fec x:0 0 0 2024-09-16T00:50:30.035 INFO:tasks.workunit.client.0.smithi053.stdout:3/711: fdatasync d1/d5/d91/d47/f4b 0 2024-09-16T00:50:30.039 INFO:tasks.workunit.client.0.smithi053.stdout:0/755: dwrite d4/ff2 [4194304,4194304] 0 2024-09-16T00:50:30.041 INFO:tasks.workunit.client.0.smithi053.stdout:4/448: dwrite d0/d2/dd/f40 [0,4194304] 0 2024-09-16T00:50:30.126 INFO:tasks.workunit.client.0.smithi053.stdout:2/633: symlink d6/d9/dd/d3e/d72/d75/lcc 0 2024-09-16T00:50:30.126 INFO:tasks.workunit.client.0.smithi053.stdout:5/718: stat d3/la 0 2024-09-16T00:50:30.126 INFO:tasks.workunit.client.0.smithi053.stdout:5/719: chown d3/d7/d2b/d4b/d51/d53/da5/fcf 91741378 1 2024-09-16T00:50:30.133 INFO:tasks.workunit.client.0.smithi053.stdout:1/691: creat d5/d7/d39/dc6/fe7 x:0 0 0 2024-09-16T00:50:30.135 INFO:tasks.workunit.client.0.smithi053.stdout:1/692: dread d5/d7/f86 [0,4194304] 0 2024-09-16T00:50:30.149 INFO:tasks.workunit.client.0.smithi053.stdout:5/720: dwrite d3/d7/d2b/d37/d58/f19 [4194304,4194304] 0 2024-09-16T00:50:30.167 INFO:tasks.workunit.client.0.smithi053.stdout:5/721: dwrite d3/d7/d2b/d37/d58/f6b [0,4194304] 0 2024-09-16T00:50:30.177 INFO:tasks.workunit.client.0.smithi053.stdout:5/722: dread d3/d7/d2b/d4b/d4f/f87 [0,4194304] 0 2024-09-16T00:50:30.177 INFO:tasks.workunit.client.0.smithi053.stdout:5/723: write d3/d7/d2b/d4b/d51/fc0 [464468,9729] 0 2024-09-16T00:50:30.198 INFO:tasks.workunit.client.0.smithi053.stdout:8/625: rmdir d10/d1c/d2b/d40/d76/d97 0 2024-09-16T00:50:30.202 INFO:tasks.workunit.client.0.smithi053.stdout:7/740: creat d1/db5/ffa x:0 0 0 2024-09-16T00:50:30.205 INFO:tasks.workunit.client.0.smithi053.stdout:8/626: dread d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:30.205 INFO:tasks.workunit.client.0.smithi053.stdout:8/627: stat d10/d21/d28/c41 0 2024-09-16T00:50:30.213 INFO:tasks.workunit.client.0.smithi053.stdout:0/756: creat d4/dc/d1e/d22/dc5/ff3 x:0 0 0 2024-09-16T00:50:30.214 INFO:tasks.workunit.client.0.smithi053.stdout:0/757: dread - d4/dc/d1e/d1f/d40/d73/dd7/fe3 zero size 2024-09-16T00:50:30.216 INFO:tasks.workunit.client.0.smithi053.stdout:8/628: write d10/d21/d28/d3c/d63/f74 [305679,27883] 0 2024-09-16T00:50:30.222 INFO:tasks.workunit.client.0.smithi053.stdout:4/449: unlink d0/d2/dd/d25/l56 0 2024-09-16T00:50:30.231 INFO:tasks.workunit.client.0.smithi053.stdout:4/450: dread d0/da/d42/f75 [0,4194304] 0 2024-09-16T00:50:30.311 INFO:tasks.workunit.client.0.smithi053.stdout:2/634: rename d6/d9/dd/f5a to d6/dae/fcd 0 2024-09-16T00:50:30.313 INFO:tasks.workunit.client.0.smithi053.stdout:1/693: rmdir d5/d7/d39/d57/d82 39 2024-09-16T00:50:30.313 INFO:tasks.workunit.client.0.smithi053.stdout:1/694: readlink d5/d18/d33/d8a/d98/dd0/l23 0 2024-09-16T00:50:30.321 INFO:tasks.workunit.client.0.smithi053.stdout:5/724: symlink d3/d7/d2b/dbc/le7 0 2024-09-16T00:50:30.322 INFO:tasks.workunit.client.0.smithi053.stdout:1/695: dread d5/d7/f52 [0,4194304] 0 2024-09-16T00:50:30.322 INFO:tasks.workunit.client.0.smithi053.stdout:1/696: write d5/d18/d33/d8a/d98/dd0/f72 [753362,64395] 0 2024-09-16T00:50:30.324 INFO:tasks.workunit.client.0.smithi053.stdout:7/741: creat d1/dd9/ffb x:0 0 0 2024-09-16T00:50:30.324 INFO:tasks.workunit.client.0.smithi053.stdout:7/742: creat d1/dd9/ffc x:0 0 0 2024-09-16T00:50:30.324 INFO:tasks.workunit.client.0.smithi053.stdout:7/743: fdatasync d1/d2a/d83/d84/fca 0 2024-09-16T00:50:30.324 INFO:tasks.workunit.client.0.smithi053.stdout:7/744: truncate d1/d2a/d83/d84/ff4 4590791 0 2024-09-16T00:50:30.326 INFO:tasks.workunit.client.0.smithi053.stdout:8/629: mkdir d10/d4a/dc2/dd1 0 2024-09-16T00:50:30.333 INFO:tasks.workunit.client.0.smithi053.stdout:7/745: dread d1/d35/d5b/d93/f96 [0,4194304] 0 2024-09-16T00:50:30.333 INFO:tasks.workunit.client.0.smithi053.stdout:7/746: read - d1/d2a/d4f/f81 zero size 2024-09-16T00:50:30.346 INFO:tasks.workunit.client.0.smithi053.stdout:5/725: unlink d3/d7/d24/l81 0 2024-09-16T00:50:30.346 INFO:tasks.workunit.client.0.smithi053.stdout:1/697: creat d5/d18/d1f/fe8 x:0 0 0 2024-09-16T00:50:30.348 INFO:tasks.workunit.client.0.smithi053.stdout:4/451: mkdir d0/d9f 0 2024-09-16T00:50:30.348 INFO:tasks.workunit.client.0.smithi053.stdout:4/452: chown d0/d2/dd/d25/d37/l49 1699811 1 2024-09-16T00:50:30.351 INFO:tasks.workunit.client.0.smithi053.stdout:2/635: link d6/d9/dd/d28/f3f d6/d9/d74/fce 0 2024-09-16T00:50:30.352 INFO:tasks.workunit.client.0.smithi053.stdout:5/726: symlink d3/d7/d2b/d37/d58/d79/le8 0 2024-09-16T00:50:30.356 INFO:tasks.workunit.client.0.smithi053.stdout:2/636: creat d6/d29/db7/fcf x:0 0 0 2024-09-16T00:50:30.357 INFO:tasks.workunit.client.0.smithi053.stdout:5/727: symlink d3/d7/d42/ddd/le9 0 2024-09-16T00:50:30.378 INFO:tasks.workunit.client.0.smithi053.stdout:0/758: creat d4/dc/ff4 x:0 0 0 2024-09-16T00:50:30.387 INFO:tasks.workunit.client.0.smithi053.stdout:7/747: dwrite d1/d60/d62/f69 [0,4194304] 0 2024-09-16T00:50:30.395 INFO:tasks.workunit.client.0.smithi053.stdout:4/453: dwrite d0/d31/f81 [0,4194304] 0 2024-09-16T00:50:30.401 INFO:tasks.workunit.client.0.smithi053.stdout:4/454: dread d0/d2/dd/d25/f5b [0,4194304] 0 2024-09-16T00:50:30.402 INFO:tasks.workunit.client.0.smithi053.stdout:4/455: dread - d0/d65/f8e zero size 2024-09-16T00:50:30.402 INFO:tasks.workunit.client.0.smithi053.stdout:4/456: fsync d0/d2/dd/d25/d41/d78/f2c 0 2024-09-16T00:50:30.403 INFO:tasks.workunit.client.0.smithi053.stdout:4/457: link d0/d2/dd/d25/d41/d78/f2c d0/d3c/d48/d4d/fa0 0 2024-09-16T00:50:30.403 INFO:tasks.workunit.client.0.smithi053.stdout:4/458: write d0/d3c/f80 [730838,112158] 0 2024-09-16T00:50:30.485 INFO:tasks.workunit.client.0.smithi053.stdout:7/748: dwrite d1/d2a/d4f/d52/fd5 [0,4194304] 0 2024-09-16T00:50:30.485 INFO:tasks.workunit.client.0.smithi053.stdout:7/749: chown d1/d35/d4a/dbb/fbd 370373 1 2024-09-16T00:50:30.485 INFO:tasks.workunit.client.0.smithi053.stdout:7/750: stat d1/d35/d14/d15/f1a 0 2024-09-16T00:50:30.489 INFO:tasks.workunit.client.0.smithi053.stdout:1/698: write d5/d9/f44 [1365745,60345] 0 2024-09-16T00:50:30.489 INFO:tasks.workunit.client.0.smithi053.stdout:1/699: write d5/d18/d1f/f87 [578388,33512] 0 2024-09-16T00:50:30.493 INFO:tasks.workunit.client.0.smithi053.stdout:1/700: mknod d5/d7/d39/d57/d82/ce9 0 2024-09-16T00:50:30.495 INFO:tasks.workunit.client.0.smithi053.stdout:7/751: write d1/d35/d4a/dbb/fbd [1280914,11526] 0 2024-09-16T00:50:30.495 INFO:tasks.workunit.client.0.smithi053.stdout:7/752: dread - d1/d3/d85/fab zero size 2024-09-16T00:50:30.495 INFO:tasks.workunit.client.0.smithi053.stdout:1/701: mkdir d5/d9/d88/dea 0 2024-09-16T00:50:30.495 INFO:tasks.workunit.client.0.smithi053.stdout:1/702: read d5/de3/f78 [2096446,22561] 0 2024-09-16T00:50:30.503 INFO:tasks.workunit.client.0.smithi053.stdout:2/637: dwrite d6/d9/d14/d81/fc8 [0,4194304] 0 2024-09-16T00:50:30.504 INFO:tasks.workunit.client.0.smithi053.stdout:1/703: write d5/d7/fa5 [1338558,97889] 0 2024-09-16T00:50:30.505 INFO:tasks.workunit.client.0.smithi053.stdout:7/753: write d1/d35/d14/d15/f9c [3807664,78317] 0 2024-09-16T00:50:30.505 INFO:tasks.workunit.client.0.smithi053.stdout:7/754: dread - d1/d3/dc1/fed zero size 2024-09-16T00:50:30.510 INFO:tasks.workunit.client.0.smithi053.stdout:2/638: unlink d6/d9/dd/d76/cac 0 2024-09-16T00:50:30.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/704: unlink d5/d7/l2f 0 2024-09-16T00:50:30.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/705: write d5/d18/d33/d8a/d98/dd0/f5c [848049,97733] 0 2024-09-16T00:50:30.518 INFO:tasks.workunit.client.0.smithi053.stdout:7/755: creat d1/d35/d5b/ffd x:0 0 0 2024-09-16T00:50:30.518 INFO:tasks.workunit.client.0.smithi053.stdout:2/639: mkdir d6/d29/d2b/dd0 0 2024-09-16T00:50:30.518 INFO:tasks.workunit.client.0.smithi053.stdout:7/756: write d1/d3/f3c [2889086,60058] 0 2024-09-16T00:50:30.520 INFO:tasks.workunit.client.0.smithi053.stdout:6/726: link d1/dc/d3d/db1/cb6 d1/cf4 0 2024-09-16T00:50:30.524 INFO:tasks.workunit.client.0.smithi053.stdout:2/640: truncate d6/f73 270139 0 2024-09-16T00:50:30.524 INFO:tasks.workunit.client.0.smithi053.stdout:6/727: mkdir d1/dc/d3c/d4a/dec/df5 0 2024-09-16T00:50:30.524 INFO:tasks.workunit.client.0.smithi053.stdout:6/728: chown d1/dc/d45 158503296 1 2024-09-16T00:50:30.529 INFO:tasks.workunit.client.0.smithi053.stdout:2/641: getdents d6/d9/d14/d81 0 2024-09-16T00:50:30.532 INFO:tasks.workunit.client.0.smithi053.stdout:7/757: write d1/d60/d70/dac/f5d [685578,112393] 0 2024-09-16T00:50:30.533 INFO:tasks.workunit.client.0.smithi053.stdout:2/642: mknod d6/d90/dba/cd1 0 2024-09-16T00:50:30.534 INFO:tasks.workunit.client.0.smithi053.stdout:2/643: readlink d6/d9/d14/l3d 0 2024-09-16T00:50:30.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/758: truncate d1/d35/d14/d15/f1a 2901451 0 2024-09-16T00:50:30.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/759: chown d1/db5/lb9 1 1 2024-09-16T00:50:30.535 INFO:tasks.workunit.client.0.smithi053.stdout:7/760: fdatasync d1/f3a 0 2024-09-16T00:50:30.536 INFO:tasks.workunit.client.0.smithi053.stdout:7/761: readlink d1/d2a/d4f/l61 0 2024-09-16T00:50:30.536 INFO:tasks.workunit.client.0.smithi053.stdout:1/706: dwrite d5/d18/d1f/f8f [0,4194304] 0 2024-09-16T00:50:30.537 INFO:tasks.workunit.client.0.smithi053.stdout:2/644: creat d6/d9/db6/fd2 x:0 0 0 2024-09-16T00:50:30.543 INFO:tasks.workunit.client.0.smithi053.stdout:1/707: mknod d5/d7/d39/ceb 0 2024-09-16T00:50:30.545 INFO:tasks.workunit.client.0.smithi053.stdout:2/645: truncate d6/d9/f5e 3016958 0 2024-09-16T00:50:30.546 INFO:tasks.workunit.client.0.smithi053.stdout:6/729: dwrite d1/dc/d3d/f55 [0,4194304] 0 2024-09-16T00:50:30.546 INFO:tasks.workunit.client.0.smithi053.stdout:6/730: chown d1/dc/d45/c47 183812402 1 2024-09-16T00:50:30.546 INFO:tasks.workunit.client.0.smithi053.stdout:1/708: mknod d5/d5a/cec 0 2024-09-16T00:50:30.548 INFO:tasks.workunit.client.0.smithi053.stdout:6/731: creat d1/d2f/d9b/dd0/de6/ff6 x:0 0 0 2024-09-16T00:50:30.548 INFO:tasks.workunit.client.0.smithi053.stdout:6/732: dread - d1/dc/d3c/fe3 zero size 2024-09-16T00:50:30.550 INFO:tasks.workunit.client.0.smithi053.stdout:1/709: symlink d5/d18/d33/d8a/d98/dd0/led 0 2024-09-16T00:50:30.551 INFO:tasks.workunit.client.0.smithi053.stdout:3/712: mknod d1/d5/d31/ced 0 2024-09-16T00:50:30.551 INFO:tasks.workunit.client.0.smithi053.stdout:3/713: creat d1/d5/d91/d47/d65/d97/d7f/fee x:0 0 0 2024-09-16T00:50:30.554 INFO:tasks.workunit.client.0.smithi053.stdout:6/733: getdents d1/dc 0 2024-09-16T00:50:30.554 INFO:tasks.workunit.client.0.smithi053.stdout:6/734: chown d1/dc/d1e/d41/c87 52 1 2024-09-16T00:50:30.554 INFO:tasks.workunit.client.0.smithi053.stdout:6/735: truncate d1/dc/d54/f64 4287977 0 2024-09-16T00:50:30.554 INFO:tasks.workunit.client.0.smithi053.stdout:1/710: chown d5/d9/l24 32652157 1 2024-09-16T00:50:30.557 INFO:tasks.workunit.client.0.smithi053.stdout:4/459: unlink d0/d3c/d48/f67 0 2024-09-16T00:50:30.557 INFO:tasks.workunit.client.0.smithi053.stdout:4/460: fdatasync d0/d3c/d48/d4d/d70/f85 0 2024-09-16T00:50:30.557 INFO:tasks.workunit.client.0.smithi053.stdout:4/461: readlink d0/l18 0 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/646: dread d6/d29/d2b/d39/f9b [0,4194304] 0 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/647: stat d6/f71 0 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/648: chown d6/d29/d2b/f8d 1720305134 1 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/649: fdatasync d6/d9/f1d 0 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/650: chown d6/d9/dd/d28/l6a 0 1 2024-09-16T00:50:30.560 INFO:tasks.workunit.client.0.smithi053.stdout:2/651: creat d6/d90/fd3 x:0 0 0 2024-09-16T00:50:30.562 INFO:tasks.workunit.client.0.smithi053.stdout:3/714: mkdir d1/d5/d11/d3a/dc6/de8/def 0 2024-09-16T00:50:30.564 INFO:tasks.workunit.client.0.smithi053.stdout:6/736: rmdir d1/dc/dba 39 2024-09-16T00:50:30.568 INFO:tasks.workunit.client.0.smithi053.stdout:1/711: symlink d5/d18/d1f/lee 0 2024-09-16T00:50:30.576 INFO:tasks.workunit.client.0.smithi053.stdout:2/652: creat d6/d9/d14/fd4 x:0 0 0 2024-09-16T00:50:30.576 INFO:tasks.workunit.client.0.smithi053.stdout:3/715: rmdir d1/d5/d31/d7c/dbf/dcd 39 2024-09-16T00:50:30.576 INFO:tasks.workunit.client.0.smithi053.stdout:3/716: fsync d1/d5/d91/d47/fa6 0 2024-09-16T00:50:30.580 INFO:tasks.workunit.client.0.smithi053.stdout:6/737: dread - d1/dc/d3c/d4b/d58/db9/fe0 zero size 2024-09-16T00:50:30.583 INFO:tasks.workunit.client.0.smithi053.stdout:1/712: rmdir d5/dd/d7f 39 2024-09-16T00:50:30.584 INFO:tasks.workunit.client.0.smithi053.stdout:4/462: dwrite d0/d3c/f80 [0,4194304] 0 2024-09-16T00:50:30.585 INFO:tasks.workunit.client.0.smithi053.stdout:4/463: stat d0/da/d42/d8b/l8f 0 2024-09-16T00:50:30.585 INFO:tasks.workunit.client.0.smithi053.stdout:4/464: write d0/d3c/d48/d95/f9d [301750,25562] 0 2024-09-16T00:50:30.588 INFO:tasks.workunit.client.0.smithi053.stdout:2/653: truncate d6/d9/dd/f31 289834 0 2024-09-16T00:50:30.588 INFO:tasks.workunit.client.0.smithi053.stdout:2/654: fsync d6/d29/f3b 0 2024-09-16T00:50:30.589 INFO:tasks.workunit.client.0.smithi053.stdout:3/717: write d1/d5/f40 [464043,115479] 0 2024-09-16T00:50:30.589 INFO:tasks.workunit.client.0.smithi053.stdout:3/718: readlink d1/l51 0 2024-09-16T00:50:30.593 INFO:tasks.workunit.client.0.smithi053.stdout:6/738: creat d1/dc/d3c/ddd/ff7 x:0 0 0 2024-09-16T00:50:30.593 INFO:tasks.workunit.client.0.smithi053.stdout:6/739: chown d1/d2f/db3 670 1 2024-09-16T00:50:30.595 INFO:tasks.workunit.client.0.smithi053.stdout:1/713: mkdir d5/d7/d39/dc6/def 0 2024-09-16T00:50:30.596 INFO:tasks.workunit.client.0.smithi053.stdout:1/714: chown d5/d18 162 1 2024-09-16T00:50:30.596 INFO:tasks.workunit.client.0.smithi053.stdout:7/762: fsync d1/d35/d14/d15/f1a 0 2024-09-16T00:50:30.602 INFO:tasks.workunit.client.0.smithi053.stdout:4/465: mkdir d0/d2/da1 0 2024-09-16T00:50:30.605 INFO:tasks.workunit.client.0.smithi053.stdout:3/719: dwrite d1/d5/d91/d47/f5b [4194304,4194304] 0 2024-09-16T00:50:30.610 INFO:tasks.workunit.client.0.smithi053.stdout:2/655: link d6/d29/f91 d6/d9/dd/d3e/fd5 0 2024-09-16T00:50:30.610 INFO:tasks.workunit.client.0.smithi053.stdout:2/656: fdatasync d6/d9/dd/d76/f88 0 2024-09-16T00:50:30.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/740: fdatasync d1/dc/f32 0 2024-09-16T00:50:30.615 INFO:tasks.workunit.client.0.smithi053.stdout:7/763: unlink d1/d2a/c33 0 2024-09-16T00:50:30.615 INFO:tasks.workunit.client.0.smithi053.stdout:7/764: write d1/d2a/f90 [738481,107351] 0 2024-09-16T00:50:30.615 INFO:tasks.workunit.client.0.smithi053.stdout:7/765: write d1/d2a/d4f/f81 [216727,117871] 0 2024-09-16T00:50:30.625 INFO:tasks.workunit.client.0.smithi053.stdout:3/720: dread d1/d89/d28/f7b [0,4194304] 0 2024-09-16T00:50:30.631 INFO:tasks.workunit.client.0.smithi053.stdout:2/657: link d6/d29/l45 d6/d9/dd/d3e/d52/ld6 0 2024-09-16T00:50:30.631 INFO:tasks.workunit.client.0.smithi053.stdout:1/715: dwrite d5/d9/f56 [4194304,4194304] 0 2024-09-16T00:50:30.632 INFO:tasks.workunit.client.0.smithi053.stdout:4/466: dwrite d0/d2/d1e/d4b/f62 [0,4194304] 0 2024-09-16T00:50:30.639 INFO:tasks.workunit.client.0.smithi053.stdout:2/658: dread d6/d29/d2b/f46 [0,4194304] 0 2024-09-16T00:50:30.641 INFO:tasks.workunit.client.0.smithi053.stdout:7/766: creat d1/d35/d4a/dbb/ffe x:0 0 0 2024-09-16T00:50:30.641 INFO:tasks.workunit.client.0.smithi053.stdout:6/741: dread d1/dc/d39/f2c [0,4194304] 0 2024-09-16T00:50:30.644 INFO:tasks.workunit.client.0.smithi053.stdout:3/721: mknod d1/d5/d91/d47/d65/d66/cf0 0 2024-09-16T00:50:30.651 INFO:tasks.workunit.client.0.smithi053.stdout:7/767: dread d1/d60/d70/f78 [0,4194304] 0 2024-09-16T00:50:30.652 INFO:tasks.workunit.client.0.smithi053.stdout:1/716: dwrite d5/fba [4194304,4194304] 0 2024-09-16T00:50:30.656 INFO:tasks.workunit.client.0.smithi053.stdout:2/659: mknod d6/d9/dd/dbb/cd7 0 2024-09-16T00:50:30.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/722: dwrite d1/d5/d11/f95 [0,4194304] 0 2024-09-16T00:50:30.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/723: truncate d1/d5/d31/d3b/fc8 973953 0 2024-09-16T00:50:30.659 INFO:tasks.workunit.client.0.smithi053.stdout:3/724: chown d1/d5/d91/d47/d6c/ce9 1 1 2024-09-16T00:50:30.659 INFO:tasks.workunit.client.0.smithi053.stdout:7/768: creat d1/d35/fff x:0 0 0 2024-09-16T00:50:30.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/467: rename d0/l4 to d0/d2/dd/d25/d41/la2 0 2024-09-16T00:50:30.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/468: chown d0/d2/da1 7084 1 2024-09-16T00:50:30.665 INFO:tasks.workunit.client.0.smithi053.stdout:2/660: read d6/d9/f1d [3660425,123631] 0 2024-09-16T00:50:30.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/769: creat d1/df1/f100 x:0 0 0 2024-09-16T00:50:30.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/770: readlink d1/d2a/d4f/d52/l49 0 2024-09-16T00:50:30.667 INFO:tasks.workunit.client.0.smithi053.stdout:7/771: chown d1/d2a/d4f/f81 356566192 1 2024-09-16T00:50:30.669 INFO:tasks.workunit.client.0.smithi053.stdout:4/469: link d0/da/f4a d0/d3c/d48/d95/fa3 0 2024-09-16T00:50:30.669 INFO:tasks.workunit.client.0.smithi053.stdout:4/470: creat d0/d65/fa4 x:0 0 0 2024-09-16T00:50:30.672 INFO:tasks.workunit.client.0.smithi053.stdout:7/772: dread d1/d35/d14/f64 [0,4194304] 0 2024-09-16T00:50:30.672 INFO:tasks.workunit.client.0.smithi053.stdout:7/773: chown d1/d2a/d4f/c66 113 1 2024-09-16T00:50:30.672 INFO:tasks.workunit.client.0.smithi053.stdout:7/774: dread - d1/db5/ffa zero size 2024-09-16T00:50:30.676 INFO:tasks.workunit.client.0.smithi053.stdout:4/471: creat d0/da/fa5 x:0 0 0 2024-09-16T00:50:30.676 INFO:tasks.workunit.client.0.smithi053.stdout:4/472: write d0/d2/dd/d25/f5b [4333724,114930] 0 2024-09-16T00:50:30.676 INFO:tasks.workunit.client.0.smithi053.stdout:4/473: fdatasync d0/d3c/d48/f5f 0 2024-09-16T00:50:30.676 INFO:tasks.workunit.client.0.smithi053.stdout:4/474: chown d0/c30 231 1 2024-09-16T00:50:30.679 INFO:tasks.workunit.client.0.smithi053.stdout:1/717: dwrite d5/d18/d33/fad [0,4194304] 0 2024-09-16T00:50:30.679 INFO:tasks.workunit.client.0.smithi053.stdout:1/718: write d5/dd/dbb/fdb [605035,15840] 0 2024-09-16T00:50:30.679 INFO:tasks.workunit.client.0.smithi053.stdout:1/719: readlink d5/d18/d1f/l36 0 2024-09-16T00:50:30.679 INFO:tasks.workunit.client.0.smithi053.stdout:6/742: dwrite d1/dc/d45/f94 [0,4194304] 0 2024-09-16T00:50:30.680 INFO:tasks.workunit.client.0.smithi053.stdout:7/775: mknod d1/d2a/c101 0 2024-09-16T00:50:30.680 INFO:tasks.workunit.client.0.smithi053.stdout:2/661: dread d6/d9/dd/d3e/f4b [0,4194304] 0 2024-09-16T00:50:30.681 INFO:tasks.workunit.client.0.smithi053.stdout:9/658: sync 2024-09-16T00:50:30.681 INFO:tasks.workunit.client.0.smithi053.stdout:9/659: chown d8/d4c/d5a/fa7 343 1 2024-09-16T00:50:30.683 INFO:tasks.workunit.client.0.smithi053.stdout:4/475: symlink d0/d3c/la6 0 2024-09-16T00:50:30.683 INFO:tasks.workunit.client.0.smithi053.stdout:4/476: chown d0/d2/dd/d25/d37 37567 1 2024-09-16T00:50:30.692 INFO:tasks.workunit.client.0.smithi053.stdout:1/720: unlink d5/d7/f66 0 2024-09-16T00:50:30.693 INFO:tasks.workunit.client.0.smithi053.stdout:6/743: readlink d1/dc/d43/ld8 0 2024-09-16T00:50:30.695 INFO:tasks.workunit.client.0.smithi053.stdout:7/776: mkdir d1/d102 0 2024-09-16T00:50:30.696 INFO:tasks.workunit.client.0.smithi053.stdout:2/662: symlink d6/d9/db6/dbc/ld8 0 2024-09-16T00:50:30.698 INFO:tasks.workunit.client.0.smithi053.stdout:1/721: dread d5/d9/d4c/f89 [0,4194304] 0 2024-09-16T00:50:30.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/660: rename d8/d19/d31/fbd to d8/d19/d51/d6d/fd7 0 2024-09-16T00:50:30.701 INFO:tasks.workunit.client.0.smithi053.stdout:9/661: read - d8/d19/d51/faa zero size 2024-09-16T00:50:30.701 INFO:tasks.workunit.client.0.smithi053.stdout:4/477: creat d0/da/d42/fa7 x:0 0 0 2024-09-16T00:50:30.704 INFO:tasks.workunit.client.0.smithi053.stdout:6/744: creat d1/d90/ff8 x:0 0 0 2024-09-16T00:50:30.704 INFO:tasks.workunit.client.0.smithi053.stdout:9/662: dread d8/d1c/d2b/d49/f6b [0,4194304] 0 2024-09-16T00:50:30.704 INFO:tasks.workunit.client.0.smithi053.stdout:9/663: chown d8/d1c/d2b/d2c/d9b/la5 12 1 2024-09-16T00:50:30.710 INFO:tasks.workunit.client.0.smithi053.stdout:1/722: creat d5/dd/d8e/dcf/ff0 x:0 0 0 2024-09-16T00:50:30.712 INFO:tasks.workunit.client.0.smithi053.stdout:1/723: read d5/d18/d33/d8a/d98/dd0/f5c [182163,67879] 0 2024-09-16T00:50:30.712 INFO:tasks.workunit.client.0.smithi053.stdout:1/724: creat d5/dd/d19/ff1 x:0 0 0 2024-09-16T00:50:30.712 INFO:tasks.workunit.client.0.smithi053.stdout:7/777: dwrite d1/d2a/f99 [0,4194304] 0 2024-09-16T00:50:30.712 INFO:tasks.workunit.client.0.smithi053.stdout:4/478: link d0/d2/dd/d25/d41/f5d d0/da/d42/d8b/fa8 0 2024-09-16T00:50:30.719 INFO:tasks.workunit.client.0.smithi053.stdout:1/725: dread d5/fba [0,4194304] 0 2024-09-16T00:50:30.720 INFO:tasks.workunit.client.0.smithi053.stdout:7/778: unlink d1/d2a/d4f/l6e 0 2024-09-16T00:50:30.721 INFO:tasks.workunit.client.0.smithi053.stdout:4/479: creat d0/d2/dd/d25/d41/fa9 x:0 0 0 2024-09-16T00:50:30.723 INFO:tasks.workunit.client.0.smithi053.stdout:6/745: mknod d1/dc/d3d/cf9 0 2024-09-16T00:50:30.723 INFO:tasks.workunit.client.0.smithi053.stdout:4/480: write d0/da/f4a [1210208,22853] 0 2024-09-16T00:50:30.723 INFO:tasks.workunit.client.0.smithi053.stdout:4/481: chown d0/d3c/d48/d4d/fa0 3439 1 2024-09-16T00:50:30.724 INFO:tasks.workunit.client.0.smithi053.stdout:1/726: mkdir d5/d18/d33/d8a/d98/dd0/df2 0 2024-09-16T00:50:30.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/779: truncate d1/d35/d5b/d93/f96 2631797 0 2024-09-16T00:50:30.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/780: readlink d1/d35/d4a/l51 0 2024-09-16T00:50:30.725 INFO:tasks.workunit.client.0.smithi053.stdout:2/663: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:30.725 INFO:tasks.workunit.client.0.smithi053.stdout:6/746: truncate d1/dc/d3d/f61 50569 0 2024-09-16T00:50:30.726 INFO:tasks.workunit.client.0.smithi053.stdout:4/482: mknod d0/d9f/caa 0 2024-09-16T00:50:30.727 INFO:tasks.workunit.client.0.smithi053.stdout:1/727: creat d5/dd/dd5/ff3 x:0 0 0 2024-09-16T00:50:30.729 INFO:tasks.workunit.client.0.smithi053.stdout:7/781: mknod d1/db5/dce/c103 0 2024-09-16T00:50:30.729 INFO:tasks.workunit.client.0.smithi053.stdout:7/782: write d1/d35/fff [202393,21892] 0 2024-09-16T00:50:30.732 INFO:tasks.workunit.client.0.smithi053.stdout:6/747: unlink d1/d2f/ca5 0 2024-09-16T00:50:30.736 INFO:tasks.workunit.client.0.smithi053.stdout:4/483: unlink d0/d2/f23 0 2024-09-16T00:50:30.736 INFO:tasks.workunit.client.0.smithi053.stdout:4/484: fdatasync d0/d2/dd/d25/f5b 0 2024-09-16T00:50:30.736 INFO:tasks.workunit.client.0.smithi053.stdout:4/485: write d0/d2/dd/d25/d41/d78/f90 [1235332,8763] 0 2024-09-16T00:50:30.736 INFO:tasks.workunit.client.0.smithi053.stdout:7/783: write d1/d2a/d83/d84/fca [3950672,29851] 0 2024-09-16T00:50:30.738 INFO:tasks.workunit.client.0.smithi053.stdout:6/748: rename d1/dc/d3d/c6c to d1/dc/d3c/d4b/d58/db9/cfa 0 2024-09-16T00:50:30.740 INFO:tasks.workunit.client.0.smithi053.stdout:4/486: truncate d0/d2/d1e/d4b/f57 3344145 0 2024-09-16T00:50:30.742 INFO:tasks.workunit.client.0.smithi053.stdout:7/784: link d1/d2a/d4f/d52/fd5 d1/d2a/d83/dcc/f104 0 2024-09-16T00:50:30.742 INFO:tasks.workunit.client.0.smithi053.stdout:7/785: dread - d1/d3/dc1/fed zero size 2024-09-16T00:50:30.742 INFO:tasks.workunit.client.0.smithi053.stdout:7/786: dread - d1/d35/d5b/ffd zero size 2024-09-16T00:50:30.743 INFO:tasks.workunit.client.0.smithi053.stdout:6/749: rename d1/dc/d3c/d4b/ccb to d1/dc/d3c/d4a/dec/df5/cfb 0 2024-09-16T00:50:30.744 INFO:tasks.workunit.client.0.smithi053.stdout:7/787: mkdir d1/d35/d4a/dbb/ddc/d105 0 2024-09-16T00:50:30.746 INFO:tasks.workunit.client.0.smithi053.stdout:2/664: dwrite d6/d9/dd/d28/f2f [4194304,4194304] 0 2024-09-16T00:50:30.747 INFO:tasks.workunit.client.0.smithi053.stdout:4/487: rename d0/d3c/d48/d4d/d8c to d0/d2/d1e/dab 0 2024-09-16T00:50:30.747 INFO:tasks.workunit.client.0.smithi053.stdout:4/488: stat d0/d2/dd/d25/d39 0 2024-09-16T00:50:30.749 INFO:tasks.workunit.client.0.smithi053.stdout:6/750: write d1/dc/d54/fe8 [416055,43511] 0 2024-09-16T00:50:30.751 INFO:tasks.workunit.client.0.smithi053.stdout:7/788: rename d1/d2a/d4f/d52/l49 to d1/d35/d5b/ddf/l106 0 2024-09-16T00:50:30.753 INFO:tasks.workunit.client.0.smithi053.stdout:4/489: unlink d0/d2/f34 0 2024-09-16T00:50:30.757 INFO:tasks.workunit.client.0.smithi053.stdout:2/665: dread d6/d9/dd/d3e/f59 [4194304,4194304] 0 2024-09-16T00:50:30.759 INFO:tasks.workunit.client.0.smithi053.stdout:7/789: truncate d1/d35/f6b 1675944 0 2024-09-16T00:50:30.763 INFO:tasks.workunit.client.0.smithi053.stdout:4/490: mkdir d0/d2/dd/d25/d41/d78/dac 0 2024-09-16T00:50:30.764 INFO:tasks.workunit.client.0.smithi053.stdout:2/666: mknod d6/d90/cd9 0 2024-09-16T00:50:30.764 INFO:tasks.workunit.client.0.smithi053.stdout:2/667: chown d6/f18 0 1 2024-09-16T00:50:30.766 INFO:tasks.workunit.client.0.smithi053.stdout:7/790: mkdir d1/d35/d5b/ddf/d107 0 2024-09-16T00:50:30.767 INFO:tasks.workunit.client.0.smithi053.stdout:4/491: mknod d0/da/d42/d8b/d87/d99/cad 0 2024-09-16T00:50:30.768 INFO:tasks.workunit.client.0.smithi053.stdout:6/751: dwrite d1/dc/d1e/fc3 [0,4194304] 0 2024-09-16T00:50:30.769 INFO:tasks.workunit.client.0.smithi053.stdout:2/668: getdents d6/d9/db6/dbc 0 2024-09-16T00:50:30.770 INFO:tasks.workunit.client.0.smithi053.stdout:7/791: symlink d1/d2a/l108 0 2024-09-16T00:50:30.778 INFO:tasks.workunit.client.0.smithi053.stdout:2/669: truncate d6/d9/dd/d3e/d72/f9c 2602429 0 2024-09-16T00:50:30.781 INFO:tasks.workunit.client.0.smithi053.stdout:7/792: link d1/d2a/d83/fcf d1/d60/d62/f109 0 2024-09-16T00:50:30.782 INFO:tasks.workunit.client.0.smithi053.stdout:6/752: rmdir d1/dc/d45 39 2024-09-16T00:50:30.783 INFO:tasks.workunit.client.0.smithi053.stdout:2/670: rmdir d6/d9/d74 39 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/753: mkdir d1/dc/d3d/db1/dfc 0 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/754: read d1/f15 [3008731,42483] 0 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/755: chown d1/l24 13853 1 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/756: chown d1/c42 1 1 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/757: read - d1/dc/d3c/ddd/ff7 zero size 2024-09-16T00:50:30.788 INFO:tasks.workunit.client.0.smithi053.stdout:6/758: stat d1/d2f/f7d 0 2024-09-16T00:50:30.789 INFO:tasks.workunit.client.0.smithi053.stdout:2/671: symlink d6/d90/dba/lda 0 2024-09-16T00:50:30.789 INFO:tasks.workunit.client.0.smithi053.stdout:2/672: readlink d6/d29/d2b/l62 0 2024-09-16T00:50:30.793 INFO:tasks.workunit.client.0.smithi053.stdout:2/673: creat d6/d9/dd/d3e/d52/d65/fdb x:0 0 0 2024-09-16T00:50:30.793 INFO:tasks.workunit.client.0.smithi053.stdout:4/492: dwrite d0/d2/dd/d25/d41/d78/f50 [0,4194304] 0 2024-09-16T00:50:30.794 INFO:tasks.workunit.client.0.smithi053.stdout:7/793: dwrite d1/d35/d5b/ffd [0,4194304] 0 2024-09-16T00:50:30.795 INFO:tasks.workunit.client.0.smithi053.stdout:6/759: rename d1/dc/d1e/d65 to d1/dc/d1e/d41/dfd 0 2024-09-16T00:50:30.796 INFO:tasks.workunit.client.0.smithi053.stdout:4/493: symlink d0/d3c/d48/lae 0 2024-09-16T00:50:30.800 INFO:tasks.workunit.client.0.smithi053.stdout:4/494: creat d0/d3c/d48/faf x:0 0 0 2024-09-16T00:50:30.800 INFO:tasks.workunit.client.0.smithi053.stdout:4/495: chown d0/d2/dd/l2f 64816036 1 2024-09-16T00:50:30.802 INFO:tasks.workunit.client.0.smithi053.stdout:6/760: getdents d1/d90 0 2024-09-16T00:50:30.802 INFO:tasks.workunit.client.0.smithi053.stdout:6/761: stat d1/dc/d3c/d4b/d75/lc4 0 2024-09-16T00:50:30.803 INFO:tasks.workunit.client.0.smithi053.stdout:6/762: truncate d1/dc/d3d/f9c 2238470 0 2024-09-16T00:50:30.809 INFO:tasks.workunit.client.0.smithi053.stdout:6/763: mknod d1/d2f/d9b/cfe 0 2024-09-16T00:50:30.809 INFO:tasks.workunit.client.0.smithi053.stdout:7/794: write d1/f36 [204246,69667] 0 2024-09-16T00:50:30.812 INFO:tasks.workunit.client.0.smithi053.stdout:7/795: creat d1/d35/d14/f10a x:0 0 0 2024-09-16T00:50:30.813 INFO:tasks.workunit.client.0.smithi053.stdout:7/796: readlink d1/d35/d14/d15/ldd 0 2024-09-16T00:50:30.813 INFO:tasks.workunit.client.0.smithi053.stdout:2/674: dwrite d6/d29/d2b/f99 [0,4194304] 0 2024-09-16T00:50:30.828 INFO:tasks.workunit.client.0.smithi053.stdout:4/496: dwrite d0/d3c/d48/f5f [0,4194304] 0 2024-09-16T00:50:30.828 INFO:tasks.workunit.client.0.smithi053.stdout:4/497: dread - d0/d31/f77 zero size 2024-09-16T00:50:30.828 INFO:tasks.workunit.client.0.smithi053.stdout:4/498: chown d0/f38 1 1 2024-09-16T00:50:30.828 INFO:tasks.workunit.client.0.smithi053.stdout:4/499: readlink d0/d2/dd/d25/d37/l3a 0 2024-09-16T00:50:30.828 INFO:tasks.workunit.client.0.smithi053.stdout:4/500: read - d0/d2/dd/f96 zero size 2024-09-16T00:50:30.833 INFO:tasks.workunit.client.0.smithi053.stdout:7/797: dwrite d1/d3/fba [0,4194304] 0 2024-09-16T00:50:30.838 INFO:tasks.workunit.client.0.smithi053.stdout:2/675: dwrite d6/dad/fb0 [0,4194304] 0 2024-09-16T00:50:30.838 INFO:tasks.workunit.client.0.smithi053.stdout:6/764: dwrite d1/dc/d3c/f70 [0,4194304] 0 2024-09-16T00:50:30.839 INFO:tasks.workunit.client.0.smithi053.stdout:6/765: dread d1/dc/d1e/f7a [0,4194304] 0 2024-09-16T00:50:30.840 INFO:tasks.workunit.client.0.smithi053.stdout:7/798: symlink d1/d60/d70/d92/l10b 0 2024-09-16T00:50:30.840 INFO:tasks.workunit.client.0.smithi053.stdout:7/799: write d1/d35/d4a/d74/fcb [692818,60178] 0 2024-09-16T00:50:30.840 INFO:tasks.workunit.client.0.smithi053.stdout:7/800: creat d1/db5/f10c x:0 0 0 2024-09-16T00:50:30.849 INFO:tasks.workunit.client.0.smithi053.stdout:7/801: write d1/d60/d62/fc9 [1586689,47150] 0 2024-09-16T00:50:30.850 INFO:tasks.workunit.client.0.smithi053.stdout:4/501: dwrite d0/d3c/d48/f5f [0,4194304] 0 2024-09-16T00:50:30.855 INFO:tasks.workunit.client.0.smithi053.stdout:2/676: unlink d6/d9/dd/d3e/d52/f7b 0 2024-09-16T00:50:30.866 INFO:tasks.workunit.client.0.smithi053.stdout:6/766: truncate d1/dc/d39/f23 158779 0 2024-09-16T00:50:30.868 INFO:tasks.workunit.client.0.smithi053.stdout:7/802: rmdir d1/db5/dce 39 2024-09-16T00:50:30.870 INFO:tasks.workunit.client.0.smithi053.stdout:4/502: dwrite d0/d2/d1e/f6d [0,4194304] 0 2024-09-16T00:50:30.871 INFO:tasks.workunit.client.0.smithi053.stdout:2/677: rename d6/d9/dd/d3e/f4b to d6/d9/dd/d3e/d52/d65/d92/fdc 0 2024-09-16T00:50:30.878 INFO:tasks.workunit.client.0.smithi053.stdout:4/503: creat d0/d31/fb0 x:0 0 0 2024-09-16T00:50:30.878 INFO:tasks.workunit.client.0.smithi053.stdout:4/504: write d0/d3c/d48/f4c [138279,38998] 0 2024-09-16T00:50:30.881 INFO:tasks.workunit.client.0.smithi053.stdout:7/803: dread d1/d2a/d4f/d52/fd5 [0,4194304] 0 2024-09-16T00:50:30.883 INFO:tasks.workunit.client.0.smithi053.stdout:4/505: dread d0/d2/dd/d25/d41/d78/f90 [0,4194304] 0 2024-09-16T00:50:30.885 INFO:tasks.workunit.client.0.smithi053.stdout:2/678: write d6/f23 [4751026,24457] 0 2024-09-16T00:50:30.887 INFO:tasks.workunit.client.0.smithi053.stdout:4/506: truncate d0/d2/dd/d25/d41/d78/f2c 639621 0 2024-09-16T00:50:30.888 INFO:tasks.workunit.client.0.smithi053.stdout:6/767: dwrite d1/dc/d1e/d41/fae [0,4194304] 0 2024-09-16T00:50:30.888 INFO:tasks.workunit.client.0.smithi053.stdout:7/804: dread d1/d2a/d83/dcc/f104 [0,4194304] 0 2024-09-16T00:50:30.890 INFO:tasks.workunit.client.0.smithi053.stdout:2/679: link d6/d9/dd/d28/f3f d6/d9/db6/dbc/fdd 0 2024-09-16T00:50:30.890 INFO:tasks.workunit.client.0.smithi053.stdout:2/680: fdatasync d6/d9/dd/d3e/d72/d75/fa1 0 2024-09-16T00:50:30.890 INFO:tasks.workunit.client.0.smithi053.stdout:2/681: creat d6/d9/dd/d3e/d52/d65/fde x:0 0 0 2024-09-16T00:50:30.891 INFO:tasks.workunit.client.0.smithi053.stdout:4/507: creat d0/d2/dd/d25/d39/fb1 x:0 0 0 2024-09-16T00:50:30.891 INFO:tasks.workunit.client.0.smithi053.stdout:4/508: dread - d0/d3c/d48/d4d/d70/f85 zero size 2024-09-16T00:50:30.894 INFO:tasks.workunit.client.0.smithi053.stdout:7/805: creat d1/d35/d5b/ddf/f10d x:0 0 0 2024-09-16T00:50:30.895 INFO:tasks.workunit.client.0.smithi053.stdout:6/768: mkdir d1/da6/dea/dff 0 2024-09-16T00:50:30.895 INFO:tasks.workunit.client.0.smithi053.stdout:6/769: fsync d1/dc/d1e/f30 0 2024-09-16T00:50:30.898 INFO:tasks.workunit.client.0.smithi053.stdout:4/509: link d0/da/d42/l7e d0/d3c/d48/d4d/lb2 0 2024-09-16T00:50:30.900 INFO:tasks.workunit.client.0.smithi053.stdout:2/682: dread d6/d9/d14/f37 [4194304,4194304] 0 2024-09-16T00:50:30.900 INFO:tasks.workunit.client.0.smithi053.stdout:2/683: truncate d6/f23 8225925 0 2024-09-16T00:50:30.900 INFO:tasks.workunit.client.0.smithi053.stdout:7/806: creat d1/d3/f10e x:0 0 0 2024-09-16T00:50:30.900 INFO:tasks.workunit.client.0.smithi053.stdout:7/807: creat d1/d3/f10f x:0 0 0 2024-09-16T00:50:30.901 INFO:tasks.workunit.client.0.smithi053.stdout:7/808: fdatasync d1/d2a/d4f/fb7 0 2024-09-16T00:50:30.901 INFO:tasks.workunit.client.0.smithi053.stdout:7/809: truncate d1/d3/d85/fab 668637 0 2024-09-16T00:50:30.902 INFO:tasks.workunit.client.0.smithi053.stdout:6/770: symlink d1/dc/d1e/l100 0 2024-09-16T00:50:30.903 INFO:tasks.workunit.client.0.smithi053.stdout:2/684: link d6/d29/d2b/c6b d6/d90/cdf 0 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:7/810: link d1/d35/d4a/l51 d1/d35/d4a/l110 0 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:7/811: write d1/d3/d85/fc0 [1593354,91404] 0 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:7/812: dread - d1/d60/d77/da9/ff6 zero size 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:7/813: chown d1/d35/d5b/d93/c95 1939 1 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:4/510: read d0/d3c/d48/f91 [88611,77684] 0 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:4/511: dread - d0/d31/fb0 zero size 2024-09-16T00:50:30.909 INFO:tasks.workunit.client.0.smithi053.stdout:4/512: chown d0/d3c/d48/d95/fa3 2581949 1 2024-09-16T00:50:30.911 INFO:tasks.workunit.client.0.smithi053.stdout:2/685: mknod d6/dad/ce0 0 2024-09-16T00:50:30.912 INFO:tasks.workunit.client.0.smithi053.stdout:2/686: write d6/d9/d14/f4c [182829,53682] 0 2024-09-16T00:50:30.916 INFO:tasks.workunit.client.0.smithi053.stdout:4/513: rename d0/d2/d1e/c46 to d0/da/cb3 0 2024-09-16T00:50:30.918 INFO:tasks.workunit.client.0.smithi053.stdout:7/814: getdents d1/db5 0 2024-09-16T00:50:30.918 INFO:tasks.workunit.client.0.smithi053.stdout:7/815: write d1/d35/d5b/f8f [939118,113585] 0 2024-09-16T00:50:30.918 INFO:tasks.workunit.client.0.smithi053.stdout:6/771: dread d1/dc/d66/f93 [0,4194304] 0 2024-09-16T00:50:30.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/687: dread d6/f71 [0,4194304] 0 2024-09-16T00:50:30.919 INFO:tasks.workunit.client.0.smithi053.stdout:2/688: fsync d6/d9/dd/d3e/d52/fc3 0 2024-09-16T00:50:30.920 INFO:tasks.workunit.client.0.smithi053.stdout:2/689: creat d6/d29/db7/fe1 x:0 0 0 2024-09-16T00:50:30.920 INFO:tasks.workunit.client.0.smithi053.stdout:4/514: unlink d0/c94 0 2024-09-16T00:50:30.923 INFO:tasks.workunit.client.0.smithi053.stdout:6/772: creat d1/dc/d3c/d4a/f101 x:0 0 0 2024-09-16T00:50:30.930 INFO:tasks.workunit.client.0.smithi053.stdout:4/515: link d0/d2/dd/d25/f24 d0/d31/d98/fb4 0 2024-09-16T00:50:30.931 INFO:tasks.workunit.client.0.smithi053.stdout:6/773: write d1/dc/d3d/f55 [390139,6673] 0 2024-09-16T00:50:30.936 INFO:tasks.workunit.client.0.smithi053.stdout:2/690: getdents d6/d90 0 2024-09-16T00:50:30.937 INFO:tasks.workunit.client.0.smithi053.stdout:2/691: dread d6/d9/db6/fc6 [0,4194304] 0 2024-09-16T00:50:30.937 INFO:tasks.workunit.client.0.smithi053.stdout:2/692: read - d6/d9/dd/d3e/d72/f78 zero size 2024-09-16T00:50:30.943 INFO:tasks.workunit.client.0.smithi053.stdout:7/816: truncate d1/d35/d5b/f8f 1780418 0 2024-09-16T00:50:30.943 INFO:tasks.workunit.client.0.smithi053.stdout:7/817: write d1/d2a/f79 [3906343,72755] 0 2024-09-16T00:50:30.943 INFO:tasks.workunit.client.0.smithi053.stdout:7/818: dread - d1/d60/d70/dac/fa4 zero size 2024-09-16T00:50:30.943 INFO:tasks.workunit.client.0.smithi053.stdout:7/819: dread - d1/d35/d5b/ddf/f10d zero size 2024-09-16T00:50:30.944 INFO:tasks.workunit.client.0.smithi053.stdout:4/516: truncate d0/d3c/d48/f91 3128899 0 2024-09-16T00:50:30.944 INFO:tasks.workunit.client.0.smithi053.stdout:4/517: truncate d0/da/d42/d8b/d87/d99/f83 774603 0 2024-09-16T00:50:30.945 INFO:tasks.workunit.client.0.smithi053.stdout:6/774: unlink d1/d2f/f7d 0 2024-09-16T00:50:30.953 INFO:tasks.workunit.client.0.smithi053.stdout:6/775: dread d1/dc/d1e/d41/dfd/dc6/fd7 [0,4194304] 0 2024-09-16T00:50:30.966 INFO:tasks.workunit.client.0.smithi053.stdout:7/820: symlink d1/d60/d62/l111 0 2024-09-16T00:50:30.966 INFO:tasks.workunit.client.0.smithi053.stdout:4/518: rmdir d0/d2/d1e/d4b 39 2024-09-16T00:50:30.968 INFO:tasks.workunit.client.0.smithi053.stdout:6/776: dread - d1/dc/feb zero size 2024-09-16T00:50:30.977 INFO:tasks.workunit.client.0.smithi053.stdout:7/821: rmdir d1/d60/d70/d92 39 2024-09-16T00:50:30.979 INFO:tasks.workunit.client.0.smithi053.stdout:7/822: unlink d1/d35/d4a/f5e 0 2024-09-16T00:50:30.979 INFO:tasks.workunit.client.0.smithi053.stdout:7/823: truncate d1/d60/d62/f109 2450991 0 2024-09-16T00:50:30.979 INFO:tasks.workunit.client.0.smithi053.stdout:7/824: write d1/d35/d4a/dbb/fbd [568463,49648] 0 2024-09-16T00:50:30.991 INFO:tasks.workunit.client.0.smithi053.stdout:4/519: dwrite d0/d3c/d48/d95/f9c [0,4194304] 0 2024-09-16T00:50:30.992 INFO:tasks.workunit.client.0.smithi053.stdout:6/777: dwrite d1/dc/d3d/db1/fbf [0,4194304] 0 2024-09-16T00:50:30.995 INFO:tasks.workunit.client.0.smithi053.stdout:4/520: symlink d0/d3c/lb5 0 2024-09-16T00:50:31.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/521: symlink d0/d2/da1/lb6 0 2024-09-16T00:50:31.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/522: stat d0/d3c/d48/d4d/d70 0 2024-09-16T00:50:31.012 INFO:tasks.workunit.client.0.smithi053.stdout:4/523: write d0/d2/dd/f40 [4175497,64527] 0 2024-09-16T00:50:31.015 INFO:tasks.workunit.client.0.smithi053.stdout:6/778: dwrite d1/dc/d3c/d4b/d75/f8b [0,4194304] 0 2024-09-16T00:50:31.015 INFO:tasks.workunit.client.0.smithi053.stdout:6/779: write d1/dc/d39/f23 [1116126,105532] 0 2024-09-16T00:50:31.016 INFO:tasks.workunit.client.0.smithi053.stdout:4/524: symlink d0/d2/dd/lb7 0 2024-09-16T00:50:31.016 INFO:tasks.workunit.client.0.smithi053.stdout:6/780: dread d1/dc/d1e/f7a [0,4194304] 0 2024-09-16T00:50:31.023 INFO:tasks.workunit.client.0.smithi053.stdout:4/525: mknod d0/d3c/d48/cb8 0 2024-09-16T00:50:31.025 INFO:tasks.workunit.client.0.smithi053.stdout:6/781: symlink d1/dc/d3c/d4b/l102 0 2024-09-16T00:50:31.028 INFO:tasks.workunit.client.0.smithi053.stdout:6/782: unlink d1/dc/d39/f2c 0 2024-09-16T00:50:31.032 INFO:tasks.workunit.client.0.smithi053.stdout:6/783: mkdir d1/d2f/d9b/dd0/d103 0 2024-09-16T00:50:31.041 INFO:tasks.workunit.client.0.smithi053.stdout:4/526: dwrite d0/f38 [0,4194304] 0 2024-09-16T00:50:31.041 INFO:tasks.workunit.client.0.smithi053.stdout:6/784: dread d1/d2f/f33 [0,4194304] 0 2024-09-16T00:50:31.041 INFO:tasks.workunit.client.0.smithi053.stdout:4/527: creat d0/d3c/d48/d4d/d70/fb9 x:0 0 0 2024-09-16T00:50:31.044 INFO:tasks.workunit.client.0.smithi053.stdout:4/528: link d0/d2/f1b d0/da/d42/d8b/fba 0 2024-09-16T00:50:31.053 INFO:tasks.workunit.client.0.smithi053.stdout:6/785: dwrite d1/dc/d3c/d4a/fdb [0,4194304] 0 2024-09-16T00:50:31.056 INFO:tasks.workunit.client.0.smithi053.stdout:6/786: creat d1/dc/d1e/d41/dfd/dc6/f104 x:0 0 0 2024-09-16T00:50:31.058 INFO:tasks.workunit.client.0.smithi053.stdout:4/529: dwrite d0/d3c/d48/d4d/fa0 [0,4194304] 0 2024-09-16T00:50:31.058 INFO:tasks.workunit.client.0.smithi053.stdout:6/787: unlink d1/dc/d3d/f61 0 2024-09-16T00:50:31.058 INFO:tasks.workunit.client.0.smithi053.stdout:6/788: chown d1/dc/d1e/d41/c87 23671 1 2024-09-16T00:50:31.062 INFO:tasks.workunit.client.0.smithi053.stdout:6/789: write d1/dc/d1e/d41/f7e [772666,48718] 0 2024-09-16T00:50:31.074 INFO:tasks.workunit.client.0.smithi053.stdout:4/530: dwrite d0/d3c/d48/d4d/fa0 [4194304,4194304] 0 2024-09-16T00:50:31.076 INFO:tasks.workunit.client.0.smithi053.stdout:4/531: mkdir d0/d2/d1e/dbb 0 2024-09-16T00:50:31.077 INFO:tasks.workunit.client.0.smithi053.stdout:4/532: mknod d0/d2/d1e/dbb/cbc 0 2024-09-16T00:50:31.077 INFO:tasks.workunit.client.0.smithi053.stdout:4/533: chown d0/da/l6c 189648 1 2024-09-16T00:50:31.078 INFO:tasks.workunit.client.0.smithi053.stdout:4/534: mkdir d0/d9f/dbd 0 2024-09-16T00:50:31.088 INFO:tasks.workunit.client.0.smithi053.stdout:4/535: dread d0/d31/f81 [0,4194304] 0 2024-09-16T00:50:31.091 INFO:tasks.workunit.client.0.smithi053.stdout:0/759: sync 2024-09-16T00:50:31.092 INFO:tasks.workunit.client.0.smithi053.stdout:8/630: sync 2024-09-16T00:50:31.092 INFO:tasks.workunit.client.0.smithi053.stdout:5/728: sync 2024-09-16T00:50:31.092 INFO:tasks.workunit.client.0.smithi053.stdout:0/760: stat d4/dc/d1e/d22/dc5 0 2024-09-16T00:50:31.092 INFO:tasks.workunit.client.0.smithi053.stdout:0/761: stat d4/d13/f63 0 2024-09-16T00:50:31.093 INFO:tasks.workunit.client.0.smithi053.stdout:4/536: dread d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:31.094 INFO:tasks.workunit.client.0.smithi053.stdout:8/631: rename d10/d21/d28/d3c/d84/lc3 to d10/d21/d28/d3c/d84/ld2 0 2024-09-16T00:50:31.096 INFO:tasks.workunit.client.0.smithi053.stdout:5/729: rename d3/d7/d2b/dbc to d3/d7/d2b/d4b/d51/ddc/dea 0 2024-09-16T00:50:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:0/762: unlink d4/dc/d25/d34/f5e 0 2024-09-16T00:50:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:0/763: readlink d4/dc/d25/d34/lea 0 2024-09-16T00:50:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:0/764: fsync d4/f9 0 2024-09-16T00:50:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:4/537: getdents d0/d2/dd/d25 0 2024-09-16T00:50:31.102 INFO:tasks.workunit.client.0.smithi053.stdout:8/632: link d10/d21/d28/l2e d10/d21/d28/d3c/ld3 0 2024-09-16T00:50:31.102 INFO:tasks.workunit.client.0.smithi053.stdout:8/633: chown d10/d1c/d92/fb0 41 1 2024-09-16T00:50:31.105 INFO:tasks.workunit.client.0.smithi053.stdout:5/730: rename d3/d7/d42/le0 to d3/d7/d2b/d37/d58/d9f/leb 0 2024-09-16T00:50:31.105 INFO:tasks.workunit.client.0.smithi053.stdout:4/538: rename d0/d9f/dbd to d0/d9f/dbd/dbe 22 2024-09-16T00:50:31.106 INFO:tasks.workunit.client.0.smithi053.stdout:0/765: truncate d4/dc/d87/f50 2933348 0 2024-09-16T00:50:31.109 INFO:tasks.workunit.client.0.smithi053.stdout:5/731: symlink d3/d7/d2b/d4b/d51/d53/da5/lec 0 2024-09-16T00:50:31.113 INFO:tasks.workunit.client.0.smithi053.stdout:4/539: getdents d0/da/d42/d8b/d87 0 2024-09-16T00:50:31.113 INFO:tasks.workunit.client.0.smithi053.stdout:0/766: chown d4/l84 123858 1 2024-09-16T00:50:31.113 INFO:tasks.workunit.client.0.smithi053.stdout:0/767: truncate d4/fa6 9366 0 2024-09-16T00:50:31.113 INFO:tasks.workunit.client.0.smithi053.stdout:5/732: truncate d3/d7/f10 2623686 0 2024-09-16T00:50:31.115 INFO:tasks.workunit.client.0.smithi053.stdout:8/634: dwrite d10/d1c/d49/f89 [0,4194304] 0 2024-09-16T00:50:31.115 INFO:tasks.workunit.client.0.smithi053.stdout:8/635: fsync d10/d1c/d2b/d40/d76/fc5 0 2024-09-16T00:50:31.116 INFO:tasks.workunit.client.0.smithi053.stdout:4/540: mkdir d0/da/dbf 0 2024-09-16T00:50:31.116 INFO:tasks.workunit.client.0.smithi053.stdout:4/541: truncate d0/d31/fb0 417689 0 2024-09-16T00:50:31.117 INFO:tasks.workunit.client.0.smithi053.stdout:0/768: unlink d4/dc/d25/f4d 0 2024-09-16T00:50:31.117 INFO:tasks.workunit.client.0.smithi053.stdout:0/769: chown d4/dc/d1e/d1f/d40/d73/dd6 24 1 2024-09-16T00:50:31.117 INFO:tasks.workunit.client.0.smithi053.stdout:0/770: chown d4/dc/d25 122 1 2024-09-16T00:50:31.121 INFO:tasks.workunit.client.0.smithi053.stdout:5/733: truncate d3/d7/d2b/d37/d58/d9f/f97 997011 0 2024-09-16T00:50:31.127 INFO:tasks.workunit.client.0.smithi053.stdout:0/771: dread d4/dc/d25/d34/f74 [0,4194304] 0 2024-09-16T00:50:31.128 INFO:tasks.workunit.client.0.smithi053.stdout:8/636: rmdir d10/d21/d28 39 2024-09-16T00:50:31.132 INFO:tasks.workunit.client.0.smithi053.stdout:4/542: symlink d0/d2/dd/d25/lc0 0 2024-09-16T00:50:31.135 INFO:tasks.workunit.client.0.smithi053.stdout:8/637: getdents d10/d1c/d92/d66 0 2024-09-16T00:50:31.138 INFO:tasks.workunit.client.0.smithi053.stdout:4/543: truncate d0/d2/dd/d25/f21 5629378 0 2024-09-16T00:50:31.140 INFO:tasks.workunit.client.0.smithi053.stdout:4/544: creat d0/da/d42/d8a/fc1 x:0 0 0 2024-09-16T00:50:31.142 INFO:tasks.workunit.client.0.smithi053.stdout:8/638: rmdir d10/d1c/d2b/d40 39 2024-09-16T00:50:31.143 INFO:tasks.workunit.client.0.smithi053.stdout:8/639: write d10/d1c/d2b/f5d [290546,84535] 0 2024-09-16T00:50:31.143 INFO:tasks.workunit.client.0.smithi053.stdout:8/640: write d10/d21/d28/d3c/d84/fcb [5130653,99038] 0 2024-09-16T00:50:31.143 INFO:tasks.workunit.client.0.smithi053.stdout:8/641: chown d10/d52/fd0 408431 1 2024-09-16T00:50:31.143 INFO:tasks.workunit.client.0.smithi053.stdout:5/734: dwrite d3/d7/d2b/d4b/d51/fab [0,4194304] 0 2024-09-16T00:50:31.143 INFO:tasks.workunit.client.0.smithi053.stdout:0/772: dwrite d4/dc/d1e/d22/dc5/ff3 [0,4194304] 0 2024-09-16T00:50:31.147 INFO:tasks.workunit.client.0.smithi053.stdout:4/545: unlink d0/d2/dd/d25/d41/f9a 0 2024-09-16T00:50:31.150 INFO:tasks.workunit.client.0.smithi053.stdout:8/642: mknod d10/d4a/dbf/cd4 0 2024-09-16T00:50:31.150 INFO:tasks.workunit.client.0.smithi053.stdout:8/643: readlink d10/d1c/d92/l82 0 2024-09-16T00:50:31.152 INFO:tasks.workunit.client.0.smithi053.stdout:5/735: mknod d3/d7/d2b/ced 0 2024-09-16T00:50:31.152 INFO:tasks.workunit.client.0.smithi053.stdout:5/736: chown d3/d7/d2b/d4b/d51/ddc/dea 1902 1 2024-09-16T00:50:31.156 INFO:tasks.workunit.client.0.smithi053.stdout:0/773: link d4/dc/d1e/d1f/d40/l51 d4/dc/d1e/d1f/d40/lf5 0 2024-09-16T00:50:31.158 INFO:tasks.workunit.client.0.smithi053.stdout:4/546: getdents d0/da/d42/d8b/d87/d99 0 2024-09-16T00:50:31.160 INFO:tasks.workunit.client.0.smithi053.stdout:8/644: rmdir d10/d4a/dc2/dd1 0 2024-09-16T00:50:31.161 INFO:tasks.workunit.client.0.smithi053.stdout:5/737: mkdir d3/d7/d24/d34/d3e/da1/dee 0 2024-09-16T00:50:31.162 INFO:tasks.workunit.client.0.smithi053.stdout:0/774: mkdir d4/dc/d1e/d22/dc5/dd2/df6 0 2024-09-16T00:50:31.163 INFO:tasks.workunit.client.0.smithi053.stdout:4/547: creat d0/d2/dd/d25/fc2 x:0 0 0 2024-09-16T00:50:31.165 INFO:tasks.workunit.client.0.smithi053.stdout:8/645: rmdir d10/d1c/d92 39 2024-09-16T00:50:31.165 INFO:tasks.workunit.client.0.smithi053.stdout:8/646: chown d10/d1c/d2b/d40/f8d 70 1 2024-09-16T00:50:31.165 INFO:tasks.workunit.client.0.smithi053.stdout:5/738: creat d3/d7/d2b/d37/d58/fef x:0 0 0 2024-09-16T00:50:31.167 INFO:tasks.workunit.client.0.smithi053.stdout:0/775: mkdir d4/dc/d1e/d1f/d40/d73/dd6/df7 0 2024-09-16T00:50:31.168 INFO:tasks.workunit.client.0.smithi053.stdout:4/548: rename d0/da/d42/f51 to d0/da/fc3 0 2024-09-16T00:50:31.168 INFO:tasks.workunit.client.0.smithi053.stdout:4/549: creat d0/da/fc4 x:0 0 0 2024-09-16T00:50:31.171 INFO:tasks.workunit.client.0.smithi053.stdout:8/647: mknod d10/d21/d28/d3c/cd5 0 2024-09-16T00:50:31.171 INFO:tasks.workunit.client.0.smithi053.stdout:8/648: truncate d10/d1c/d92/d66/d9d/fc6 935590 0 2024-09-16T00:50:31.173 INFO:tasks.workunit.client.0.smithi053.stdout:5/739: rename d3/d7/d2b/d37/d46/c90 to d3/d7/d24/d34/d3e/da1/cf0 0 2024-09-16T00:50:31.176 INFO:tasks.workunit.client.0.smithi053.stdout:8/649: rename d10/d1c/d92/l82 to d10/d21/d28/d3c/d63/ld6 0 2024-09-16T00:50:31.177 INFO:tasks.workunit.client.0.smithi053.stdout:5/740: mkdir d3/d7/d2b/d4b/d51/ddc/dea/df1 0 2024-09-16T00:50:31.179 INFO:tasks.workunit.client.0.smithi053.stdout:8/650: mknod d10/d21/d28/d3c/d63/cd7 0 2024-09-16T00:50:31.181 INFO:tasks.workunit.client.0.smithi053.stdout:8/651: unlink d10/d21/d28/d3c/d63/c70 0 2024-09-16T00:50:31.182 INFO:tasks.workunit.client.0.smithi053.stdout:8/652: mknod d10/d21/d28/d3c/d63/d6a/cd8 0 2024-09-16T00:50:31.184 INFO:tasks.workunit.client.0.smithi053.stdout:8/653: truncate d10/d1c/d92/d66/d9d/da6/fbb 2507662 0 2024-09-16T00:50:31.187 INFO:tasks.workunit.client.0.smithi053.stdout:8/654: rename d10/d21/d28/fa1 to d10/d1c/d92/d66/d9d/da6/fd9 0 2024-09-16T00:50:31.190 INFO:tasks.workunit.client.0.smithi053.stdout:8/655: creat d10/d1c/d2b/d40/d76/fda x:0 0 0 2024-09-16T00:50:31.190 INFO:tasks.workunit.client.0.smithi053.stdout:8/656: chown d10/d21/d28/l71 668 1 2024-09-16T00:50:31.190 INFO:tasks.workunit.client.0.smithi053.stdout:8/657: fsync d10/f1d 0 2024-09-16T00:50:31.191 INFO:tasks.workunit.client.0.smithi053.stdout:8/658: link d10/d21/d28/fb7 d10/d4a/dc2/fdb 0 2024-09-16T00:50:31.191 INFO:tasks.workunit.client.0.smithi053.stdout:8/659: chown d10/f1d 1069537139 1 2024-09-16T00:50:31.191 INFO:tasks.workunit.client.0.smithi053.stdout:8/660: write d10/d21/f4b [886588,58474] 0 2024-09-16T00:50:31.196 INFO:tasks.workunit.client.0.smithi053.stdout:0/776: dwrite d4/dc/d1e/d1f/d40/d73/dd7/fa8 [0,4194304] 0 2024-09-16T00:50:31.196 INFO:tasks.workunit.client.0.smithi053.stdout:4/550: dwrite d0/da/d42/d8b/fba [4194304,4194304] 0 2024-09-16T00:50:31.197 INFO:tasks.workunit.client.0.smithi053.stdout:5/741: dwrite d3/d7/d2b/d37/f99 [0,4194304] 0 2024-09-16T00:50:31.197 INFO:tasks.workunit.client.0.smithi053.stdout:5/742: fdatasync d3/d7/d2b/d4b/fba 0 2024-09-16T00:50:31.197 INFO:tasks.workunit.client.0.smithi053.stdout:5/743: truncate d3/d7/d2b/d4b/d51/fc0 679178 0 2024-09-16T00:50:31.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/777: mknod d4/dc/d1e/d22/dc5/dd2/df6/cf8 0 2024-09-16T00:50:31.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/778: write d4/dc/d87/fa0 [685585,5765] 0 2024-09-16T00:50:31.198 INFO:tasks.workunit.client.0.smithi053.stdout:0/779: dread - d4/dc/d1e/d1f/d40/fdf zero size 2024-09-16T00:50:31.211 INFO:tasks.workunit.client.0.smithi053.stdout:5/744: symlink d3/d7/d2b/d37/d58/lf2 0 2024-09-16T00:50:31.211 INFO:tasks.workunit.client.0.smithi053.stdout:5/745: truncate d3/d7/d2b/d4b/fba 327531 0 2024-09-16T00:50:31.214 INFO:tasks.workunit.client.0.smithi053.stdout:8/661: dwrite d10/f3a [0,4194304] 0 2024-09-16T00:50:31.214 INFO:tasks.workunit.client.0.smithi053.stdout:4/551: getdents d0 0 2024-09-16T00:50:31.216 INFO:tasks.workunit.client.0.smithi053.stdout:5/746: mknod d3/d7/d2b/d4b/d51/de2/cf3 0 2024-09-16T00:50:31.256 INFO:tasks.workunit.client.0.smithi053.stdout:0/780: getdents d4/dc/d1e/d1f/d40/d44/d54/db8 0 2024-09-16T00:50:31.259 INFO:tasks.workunit.client.0.smithi053.stdout:8/662: mkdir d10/d1c/d2b/d40/ddc 0 2024-09-16T00:50:31.262 INFO:tasks.workunit.client.0.smithi053.stdout:4/552: mkdir d0/d2/dd/d25/d37/dc5 0 2024-09-16T00:50:31.262 INFO:tasks.workunit.client.0.smithi053.stdout:4/553: chown d0/d2/c7d 831803 1 2024-09-16T00:50:31.262 INFO:tasks.workunit.client.0.smithi053.stdout:8/663: dread d10/d1c/d92/d66/f7a [0,4194304] 0 2024-09-16T00:50:31.264 INFO:tasks.workunit.client.0.smithi053.stdout:0/781: dread d4/ff2 [4194304,4194304] 0 2024-09-16T00:50:31.267 INFO:tasks.workunit.client.0.smithi053.stdout:5/747: mkdir d3/d7/d2b/d4b/d51/d53/da5/df4 0 2024-09-16T00:50:31.269 INFO:tasks.workunit.client.0.smithi053.stdout:0/782: dread d4/d13/f1c [0,4194304] 0 2024-09-16T00:50:31.281 INFO:tasks.workunit.client.0.smithi053.stdout:5/748: mknod d3/d7/d2b/d4b/d51/cf5 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:0/783: truncate d4/dc/d1e/d1f/d40/f7b 298271 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:0/784: truncate d4/dc/d1e/d1f/d40/d44/d54/f98 4920035 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:8/664: dwrite d10/d1c/d92/d66/f7a [0,4194304] 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:0/785: getdents d4/dc/d25/d34/d71/d96 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:0/786: chown d4/dc/d87/dc6/dbe/fae 8227758 1 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:8/665: write d10/d4a/dc2/fdb [2875030,103274] 0 2024-09-16T00:50:31.283 INFO:tasks.workunit.client.0.smithi053.stdout:8/666: write d10/d21/d28/d3c/d63/d6a/fb3 [568792,45155] 0 2024-09-16T00:50:31.284 INFO:tasks.workunit.client.0.smithi053.stdout:4/554: dwrite d0/d3c/d48/d95/f9c [0,4194304] 0 2024-09-16T00:50:31.284 INFO:tasks.workunit.client.0.smithi053.stdout:5/749: mknod d3/d7/d42/d57/cf6 0 2024-09-16T00:50:31.288 INFO:tasks.workunit.client.0.smithi053.stdout:0/787: readlink d4/l6d 0 2024-09-16T00:50:31.290 INFO:tasks.workunit.client.0.smithi053.stdout:8/667: rename d10/d4a/d54/l99 to d10/d4a/dc2/dcd/ldd 0 2024-09-16T00:50:31.291 INFO:tasks.workunit.client.0.smithi053.stdout:4/555: rmdir d0/d2/d1e 39 2024-09-16T00:50:31.291 INFO:tasks.workunit.client.0.smithi053.stdout:4/556: truncate d0/d3c/d48/d58/f73 679307 0 2024-09-16T00:50:31.296 INFO:tasks.workunit.client.0.smithi053.stdout:8/668: symlink d10/d1c/d92/d66/db1/lde 0 2024-09-16T00:50:31.302 INFO:tasks.workunit.client.0.smithi053.stdout:0/788: dread d4/dc/d1e/d1f/d40/d44/d54/db8/fc1 [0,4194304] 0 2024-09-16T00:50:31.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/669: dread d10/d52/f55 [0,4194304] 0 2024-09-16T00:50:31.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/670: write d10/d1c/d2b/f5d [607740,1317] 0 2024-09-16T00:50:31.307 INFO:tasks.workunit.client.0.smithi053.stdout:5/750: dwrite d3/d7/d2b/d4b/d51/d53/da5/fcf [0,4194304] 0 2024-09-16T00:50:31.308 INFO:tasks.workunit.client.0.smithi053.stdout:5/751: chown d3/d7/l52 179766442 1 2024-09-16T00:50:31.308 INFO:tasks.workunit.client.0.smithi053.stdout:0/789: rename d4/dc/d25/d34/d71/f8c to d4/dc/d87/dbf/ff9 0 2024-09-16T00:50:31.308 INFO:tasks.workunit.client.0.smithi053.stdout:0/790: chown d4/d5a/d82 13970215 1 2024-09-16T00:50:31.308 INFO:tasks.workunit.client.0.smithi053.stdout:0/791: write d4/d5a/d82/f93 [4296987,87356] 0 2024-09-16T00:50:31.313 INFO:tasks.workunit.client.0.smithi053.stdout:4/557: dwrite d0/d2/dd/d25/d41/fa9 [0,4194304] 0 2024-09-16T00:50:31.316 INFO:tasks.workunit.client.0.smithi053.stdout:0/792: unlink d4/d13/f4f 0 2024-09-16T00:50:31.321 INFO:tasks.workunit.client.0.smithi053.stdout:8/671: dwrite d10/d1c/d92/d66/f7a [0,4194304] 0 2024-09-16T00:50:31.323 INFO:tasks.workunit.client.0.smithi053.stdout:4/558: truncate d0/d2/dd/d25/d41/d78/f90 468321 0 2024-09-16T00:50:31.323 INFO:tasks.workunit.client.0.smithi053.stdout:3/725: sync 2024-09-16T00:50:31.326 INFO:tasks.workunit.client.0.smithi053.stdout:0/793: mkdir d4/dc/d1e/d22/dc5/dd2/df6/dfa 0 2024-09-16T00:50:31.327 INFO:tasks.workunit.client.0.smithi053.stdout:4/559: mkdir d0/da/d7c/dc6 0 2024-09-16T00:50:31.329 INFO:tasks.workunit.client.0.smithi053.stdout:3/726: write d1/d5/f70 [2449928,20849] 0 2024-09-16T00:50:31.329 INFO:tasks.workunit.client.0.smithi053.stdout:3/727: write d1/d5/d31/f38 [8459613,14596] 0 2024-09-16T00:50:31.330 INFO:tasks.workunit.client.0.smithi053.stdout:5/752: dwrite d3/d7/d24/d34/d3e/f64 [0,4194304] 0 2024-09-16T00:50:31.334 INFO:tasks.workunit.client.0.smithi053.stdout:4/560: rename d0/d3c/d48/d95/fa3 to d0/da/d42/d8b/fc7 0 2024-09-16T00:50:31.338 INFO:tasks.workunit.client.0.smithi053.stdout:0/794: mknod d4/cfb 0 2024-09-16T00:50:31.338 INFO:tasks.workunit.client.0.smithi053.stdout:0/795: write d4/dc/d1e/d22/fe5 [314367,42070] 0 2024-09-16T00:50:31.339 INFO:tasks.workunit.client.0.smithi053.stdout:0/796: chown d4/dc 6153 1 2024-09-16T00:50:31.339 INFO:tasks.workunit.client.0.smithi053.stdout:0/797: chown d4 931545501 1 2024-09-16T00:50:31.346 INFO:tasks.workunit.client.0.smithi053.stdout:3/728: dwrite d1/d5/d31/d3b/d9c/fa3 [0,4194304] 0 2024-09-16T00:50:31.349 INFO:tasks.workunit.client.0.smithi053.stdout:5/753: getdents d3/d7/d42/ddd 0 2024-09-16T00:50:31.350 INFO:tasks.workunit.client.0.smithi053.stdout:0/798: write d4/d13/f41 [1393280,111510] 0 2024-09-16T00:50:31.350 INFO:tasks.workunit.client.0.smithi053.stdout:4/561: unlink d0/f5 0 2024-09-16T00:50:31.371 INFO:tasks.workunit.client.0.smithi053.stdout:0/799: rename d4/dc/d87/dbf to d4/dc/d1e/dfc 0 2024-09-16T00:50:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:0/800: symlink d4/dc/d1e/d1f/d40/d73/lfd 0 2024-09-16T00:50:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:0/801: link d4/dc/d1e/d1f/d40/l5c d4/dc/d1e/d1f/dd4/lfe 0 2024-09-16T00:50:31.372 INFO:tasks.workunit.client.0.smithi053.stdout:0/802: write d4/dc/d1e/dfc/fe1 [874492,87686] 0 2024-09-16T00:50:31.375 INFO:tasks.workunit.client.0.smithi053.stdout:3/729: dwrite d1/d89/f18 [0,4194304] 0 2024-09-16T00:50:31.375 INFO:tasks.workunit.client.0.smithi053.stdout:4/562: dwrite d0/d3c/d48/d95/f9c [4194304,4194304] 0 2024-09-16T00:50:31.376 INFO:tasks.workunit.client.0.smithi053.stdout:0/803: dread d4/d13/f63 [0,4194304] 0 2024-09-16T00:50:31.378 INFO:tasks.workunit.client.0.smithi053.stdout:3/730: symlink d1/d5/d31/d7c/dbf/dcd/de6/lf1 0 2024-09-16T00:50:31.379 INFO:tasks.workunit.client.0.smithi053.stdout:0/804: mknod d4/d13/de8/cff 0 2024-09-16T00:50:31.381 INFO:tasks.workunit.client.0.smithi053.stdout:3/731: creat d1/d5/d31/d7c/dbf/ff2 x:0 0 0 2024-09-16T00:50:31.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/805: truncate d4/dc/d1e/d1f/d40/d44/d54/db8/fc1 3540018 0 2024-09-16T00:50:31.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/806: fsync d4/dc/d25/d34/d71/fdb 0 2024-09-16T00:50:31.384 INFO:tasks.workunit.client.0.smithi053.stdout:0/807: truncate d4/d13/f41 3802540 0 2024-09-16T00:50:31.397 INFO:tasks.workunit.client.0.smithi053.stdout:3/732: dread d1/d5/d91/d47/fa6 [4194304,4194304] 0 2024-09-16T00:50:31.399 INFO:tasks.workunit.client.0.smithi053.stdout:3/733: symlink d1/d5/d91/d5e/lf3 0 2024-09-16T00:50:31.399 INFO:tasks.workunit.client.0.smithi053.stdout:4/563: dwrite d0/f38 [0,4194304] 0 2024-09-16T00:50:31.400 INFO:tasks.workunit.client.0.smithi053.stdout:4/564: mknod d0/d3c/d48/d4d/cc8 0 2024-09-16T00:50:31.400 INFO:tasks.workunit.client.0.smithi053.stdout:4/565: creat d0/da/fc9 x:0 0 0 2024-09-16T00:50:31.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/734: write d1/d5/d31/d7a/dbb/fcb [2723199,69348] 0 2024-09-16T00:50:31.402 INFO:tasks.workunit.client.0.smithi053.stdout:0/808: dwrite d4/dc/d1e/d1f/d40/d9a/fa3 [0,4194304] 0 2024-09-16T00:50:31.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/735: fdatasync d1/d5/f68 0 2024-09-16T00:50:31.402 INFO:tasks.workunit.client.0.smithi053.stdout:3/736: creat d1/d5/d91/d47/d65/d97/d7f/ff4 x:0 0 0 2024-09-16T00:50:31.408 INFO:tasks.workunit.client.0.smithi053.stdout:4/566: dread d0/d2/dd/f6e [0,4194304] 0 2024-09-16T00:50:31.413 INFO:tasks.workunit.client.0.smithi053.stdout:0/809: write d4/dc/d1e/d1f/d40/f62 [6831989,50153] 0 2024-09-16T00:50:31.423 INFO:tasks.workunit.client.0.smithi053.stdout:3/737: unlink d1/d5/f70 0 2024-09-16T00:50:31.424 INFO:tasks.workunit.client.0.smithi053.stdout:3/738: chown d1/d5/d11/la5 3877950 1 2024-09-16T00:50:31.429 INFO:tasks.workunit.client.0.smithi053.stdout:4/567: mkdir d0/d2/dd/d25/d39/dca 0 2024-09-16T00:50:31.429 INFO:tasks.workunit.client.0.smithi053.stdout:4/568: creat d0/d3c/d48/d58/fcb x:0 0 0 2024-09-16T00:50:31.429 INFO:tasks.workunit.client.0.smithi053.stdout:4/569: stat d0/da/d42/d8b/d87/d99 0 2024-09-16T00:50:31.429 INFO:tasks.workunit.client.0.smithi053.stdout:3/739: dread d1/d89/d28/d5a/f9b [0,4194304] 0 2024-09-16T00:50:31.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/810: mknod d4/dc/d25/d34/d71/c100 0 2024-09-16T00:50:31.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/811: stat d4/dc/d1e/d1f/d40 0 2024-09-16T00:50:31.431 INFO:tasks.workunit.client.0.smithi053.stdout:0/812: fsync d4/ff2 0 2024-09-16T00:50:31.433 INFO:tasks.workunit.client.0.smithi053.stdout:0/813: dread d4/dc/d25/f9d [0,4194304] 0 2024-09-16T00:50:31.437 INFO:tasks.workunit.client.0.smithi053.stdout:4/570: mkdir d0/d2/d1e/dcc 0 2024-09-16T00:50:31.437 INFO:tasks.workunit.client.0.smithi053.stdout:4/571: chown d0/d2/d1e/dcc 20 1 2024-09-16T00:50:31.438 INFO:tasks.workunit.client.0.smithi053.stdout:0/814: mknod d4/dc/d1e/c101 0 2024-09-16T00:50:31.442 INFO:tasks.workunit.client.0.smithi053.stdout:3/740: dwrite d1/d5/d91/f4d [8388608,4194304] 0 2024-09-16T00:50:31.443 INFO:tasks.workunit.client.0.smithi053.stdout:4/572: link d0/d65/fa4 d0/d3c/d48/d4d/d70/fcd 0 2024-09-16T00:50:31.443 INFO:tasks.workunit.client.0.smithi053.stdout:4/573: creat d0/da/d42/fce x:0 0 0 2024-09-16T00:50:31.444 INFO:tasks.workunit.client.0.smithi053.stdout:0/815: symlink d4/dc/d1e/d1f/d40/d73/l102 0 2024-09-16T00:50:31.447 INFO:tasks.workunit.client.0.smithi053.stdout:3/741: mkdir d1/d89/d28/dcc/df5 0 2024-09-16T00:50:31.447 INFO:tasks.workunit.client.0.smithi053.stdout:3/742: fsync d1/d5/d31/d7a/dbb/daa/fc3 0 2024-09-16T00:50:31.452 INFO:tasks.workunit.client.0.smithi053.stdout:0/816: rename d4/dc/d87/dc6/dbe/f37 to d4/dc/d1e/d22/dc5/dd2/dec/f103 0 2024-09-16T00:50:31.452 INFO:tasks.workunit.client.0.smithi053.stdout:0/817: dread - d4/dc/dbd/fc4 zero size 2024-09-16T00:50:31.453 INFO:tasks.workunit.client.0.smithi053.stdout:3/743: symlink d1/d5/d11/lf6 0 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:9/664: sync 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:1/728: sync 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/744: rename d1/d5/d31/d7c/c8a to d1/d89/cf7 0 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:2/693: sync 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/745: write d1/d5/d91/d47/f5d [908737,98855] 0 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/746: write d1/d89/fe1 [2549989,29375] 0 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/747: chown d1/d5/d31/d7a/dbb/daa 0 1 2024-09-16T00:50:31.458 INFO:tasks.workunit.client.0.smithi053.stdout:6/790: sync 2024-09-16T00:50:31.459 INFO:tasks.workunit.client.0.smithi053.stdout:7/825: sync 2024-09-16T00:50:31.460 INFO:tasks.workunit.client.0.smithi053.stdout:1/729: creat d5/d18/d33/d30/ff4 x:0 0 0 2024-09-16T00:50:31.460 INFO:tasks.workunit.client.0.smithi053.stdout:1/730: read d5/d18/d33/d8a/d98/dd0/f5c [97703,24260] 0 2024-09-16T00:50:31.465 INFO:tasks.workunit.client.0.smithi053.stdout:3/748: rmdir d1/d89/d28/dcc/df5 0 2024-09-16T00:50:31.465 INFO:tasks.workunit.client.0.smithi053.stdout:6/791: dread d1/dc/d45/fb0 [0,4194304] 0 2024-09-16T00:50:31.466 INFO:tasks.workunit.client.0.smithi053.stdout:7/826: mknod d1/d3/d85/c112 0 2024-09-16T00:50:31.466 INFO:tasks.workunit.client.0.smithi053.stdout:7/827: write d1/d35/d14/fd0 [636455,33311] 0 2024-09-16T00:50:31.466 INFO:tasks.workunit.client.0.smithi053.stdout:0/818: dwrite d4/dc/d1e/d22/fe9 [0,4194304] 0 2024-09-16T00:50:31.469 INFO:tasks.workunit.client.0.smithi053.stdout:3/749: unlink d1/d5/f19 0 2024-09-16T00:50:31.473 INFO:tasks.workunit.client.0.smithi053.stdout:6/792: readlink d1/dc/d3c/d4b/d75/lc4 0 2024-09-16T00:50:31.477 INFO:tasks.workunit.client.0.smithi053.stdout:0/819: mkdir d4/dc/d1e/d1f/d40/d44/d54/deb/d104 0 2024-09-16T00:50:31.478 INFO:tasks.workunit.client.0.smithi053.stdout:0/820: chown d4/f4b 124617 1 2024-09-16T00:50:31.478 INFO:tasks.workunit.client.0.smithi053.stdout:0/821: creat d4/dc/d1e/d1f/d40/d73/dd7/f105 x:0 0 0 2024-09-16T00:50:31.479 INFO:tasks.workunit.client.0.smithi053.stdout:3/750: creat d1/d5/d31/d7c/ff8 x:0 0 0 2024-09-16T00:50:31.483 INFO:tasks.workunit.client.0.smithi053.stdout:0/822: rename d4/dc/d25/d34/d71/c100 to d4/dc/d1e/d1f/d40/d44/d54/deb/d104/c106 0 2024-09-16T00:50:31.484 INFO:tasks.workunit.client.0.smithi053.stdout:6/793: dread d1/dc/d39/f13 [4194304,4194304] 0 2024-09-16T00:50:31.485 INFO:tasks.workunit.client.0.smithi053.stdout:3/751: mknod d1/d5/d11/d3a/dc5/cf9 0 2024-09-16T00:50:31.487 INFO:tasks.workunit.client.0.smithi053.stdout:9/665: dwrite d8/f46 [0,4194304] 0 2024-09-16T00:50:31.489 INFO:tasks.workunit.client.0.smithi053.stdout:0/823: mknod d4/dc/d25/d34/d71/c107 0 2024-09-16T00:50:31.489 INFO:tasks.workunit.client.0.smithi053.stdout:2/694: dwrite d6/d9/dd/d3e/d52/d65/d92/fa7 [0,4194304] 0 2024-09-16T00:50:31.489 INFO:tasks.workunit.client.0.smithi053.stdout:2/695: chown d6/d9/dd/f3a 1609430 1 2024-09-16T00:50:31.491 INFO:tasks.workunit.client.0.smithi053.stdout:1/731: dwrite d5/d9/d88/f60 [0,4194304] 0 2024-09-16T00:50:31.491 INFO:tasks.workunit.client.0.smithi053.stdout:0/824: write d4/dc/d87/dc6/dbe/fae [760578,15239] 0 2024-09-16T00:50:31.491 INFO:tasks.workunit.client.0.smithi053.stdout:6/794: creat d1/f105 x:0 0 0 2024-09-16T00:50:31.491 INFO:tasks.workunit.client.0.smithi053.stdout:6/795: chown d1/dc/d43/cd4 1614340245 1 2024-09-16T00:50:31.491 INFO:tasks.workunit.client.0.smithi053.stdout:6/796: chown d1/dc/d66/c71 1225105549 1 2024-09-16T00:50:31.492 INFO:tasks.workunit.client.0.smithi053.stdout:7/828: dwrite d1/d60/d62/f69 [0,4194304] 0 2024-09-16T00:50:31.494 INFO:tasks.workunit.client.0.smithi053.stdout:9/666: rmdir d8/d22/d26/d83/dc1 0 2024-09-16T00:50:31.494 INFO:tasks.workunit.client.0.smithi053.stdout:1/732: dread d5/d9/d73/d84/fd7 [0,4194304] 0 2024-09-16T00:50:31.494 INFO:tasks.workunit.client.0.smithi053.stdout:1/733: readlink d5/l3e 0 2024-09-16T00:50:31.498 INFO:tasks.workunit.client.0.smithi053.stdout:2/696: getdents d6/d9/dd/d3e 0 2024-09-16T00:50:31.499 INFO:tasks.workunit.client.0.smithi053.stdout:2/697: read - d6/d29/db7/fe1 zero size 2024-09-16T00:50:31.499 INFO:tasks.workunit.client.0.smithi053.stdout:9/667: dread d8/d1c/d2b/d5c/f81 [0,4194304] 0 2024-09-16T00:50:31.504 INFO:tasks.workunit.client.0.smithi053.stdout:7/829: write d1/d3/d85/fbc [1932111,19121] 0 2024-09-16T00:50:31.509 INFO:tasks.workunit.client.0.smithi053.stdout:2/698: creat d6/d9/db6/dbc/fe2 x:0 0 0 2024-09-16T00:50:31.510 INFO:tasks.workunit.client.0.smithi053.stdout:9/668: creat d8/d1c/d2b/fd8 x:0 0 0 2024-09-16T00:50:31.512 INFO:tasks.workunit.client.0.smithi053.stdout:7/830: mkdir d1/d2a/d4f/d113 0 2024-09-16T00:50:31.512 INFO:tasks.workunit.client.0.smithi053.stdout:3/752: dwrite d1/d5/d31/d7c/dbf/de3/feb [0,4194304] 0 2024-09-16T00:50:31.512 INFO:tasks.workunit.client.0.smithi053.stdout:3/753: write d1/d5/d91/d47/dd5/fd0 [1020311,60274] 0 2024-09-16T00:50:31.513 INFO:tasks.workunit.client.0.smithi053.stdout:0/825: dwrite d4/dc/d87/dc6/fd8 [0,4194304] 0 2024-09-16T00:50:31.513 INFO:tasks.workunit.client.0.smithi053.stdout:1/734: mknod d5/d9/cf5 0 2024-09-16T00:50:31.514 INFO:tasks.workunit.client.0.smithi053.stdout:1/735: dread d5/dd/dbb/fdb [0,4194304] 0 2024-09-16T00:50:31.514 INFO:tasks.workunit.client.0.smithi053.stdout:7/831: unlink d1/d2a/d83/lb8 0 2024-09-16T00:50:31.515 INFO:tasks.workunit.client.0.smithi053.stdout:7/832: chown d1/d35/d14/d15/f5a 800750552 1 2024-09-16T00:50:31.517 INFO:tasks.workunit.client.0.smithi053.stdout:3/754: creat d1/d5/d91/d5e/d69/ddd/ffa x:0 0 0 2024-09-16T00:50:31.521 INFO:tasks.workunit.client.0.smithi053.stdout:3/755: dread d1/d5/d91/d5e/d90/fd6 [0,4194304] 0 2024-09-16T00:50:31.521 INFO:tasks.workunit.client.0.smithi053.stdout:3/756: chown d1/d5/l72 1756 1 2024-09-16T00:50:31.521 INFO:tasks.workunit.client.0.smithi053.stdout:3/757: write d1/d5/d91/d47/d65/d97/d7f/fee [957893,123467] 0 2024-09-16T00:50:31.521 INFO:tasks.workunit.client.0.smithi053.stdout:3/758: fdatasync d1/d5/d91/d47/fb9 0 2024-09-16T00:50:31.523 INFO:tasks.workunit.client.0.smithi053.stdout:0/826: mknod d4/dc/d25/d34/d71/d96/c108 0 2024-09-16T00:50:31.523 INFO:tasks.workunit.client.0.smithi053.stdout:0/827: chown d4/dc/d1e/d1f/d40/d73/dd7/fe3 19104 1 2024-09-16T00:50:31.523 INFO:tasks.workunit.client.0.smithi053.stdout:0/828: fsync d4/dc/ff4 0 2024-09-16T00:50:31.525 INFO:tasks.workunit.client.0.smithi053.stdout:1/736: write f2 [4775703,129457] 0 2024-09-16T00:50:31.526 INFO:tasks.workunit.client.0.smithi053.stdout:9/669: dwrite d8/d1c/d2b/d2c/f85 [0,4194304] 0 2024-09-16T00:50:31.531 INFO:tasks.workunit.client.0.smithi053.stdout:7/833: rmdir d1/dd9 39 2024-09-16T00:50:31.544 INFO:tasks.workunit.client.0.smithi053.stdout:1/737: dwrite d5/dd/dbb/fdb [0,4194304] 0 2024-09-16T00:50:31.544 INFO:tasks.workunit.client.0.smithi053.stdout:1/738: stat d5/d9/d88 0 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/834: mknod d1/d2a/d83/d84/db1/de8/c114 0 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/835: readlink d1/l39 0 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/836: write d1/d35/fe1 [194786,46829] 0 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/837: write d1/d35/d4a/f56 [3750822,42123] 0 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:7/838: read - d1/db5/f10c zero size 2024-09-16T00:50:31.546 INFO:tasks.workunit.client.0.smithi053.stdout:9/670: dwrite d8/f35 [0,4194304] 0 2024-09-16T00:50:31.547 INFO:tasks.workunit.client.0.smithi053.stdout:9/671: dread - d8/d19/f7d zero size 2024-09-16T00:50:31.552 INFO:tasks.workunit.client.0.smithi053.stdout:3/759: rename d1/d5/d91/d47 to d1/d5/d11/da9/db8/dfb 0 2024-09-16T00:50:31.553 INFO:tasks.workunit.client.0.smithi053.stdout:7/839: creat d1/db5/f115 x:0 0 0 2024-09-16T00:50:31.562 INFO:tasks.workunit.client.0.smithi053.stdout:3/760: symlink d1/d5/d31/d7c/dbf/dcd/de6/lfc 0 2024-09-16T00:50:31.562 INFO:tasks.workunit.client.0.smithi053.stdout:3/761: readlink d1/d5/d31/d7c/dbf/dcd/de6/lf1 0 2024-09-16T00:50:31.562 INFO:tasks.workunit.client.0.smithi053.stdout:3/762: creat d1/d5/d31/d7c/dbf/ffd x:0 0 0 2024-09-16T00:50:31.562 INFO:tasks.workunit.client.0.smithi053.stdout:7/840: mkdir d1/d35/d5b/d93/d116 0 2024-09-16T00:50:31.564 INFO:tasks.workunit.client.0.smithi053.stdout:7/841: write d1/d60/fa8 [384678,32819] 0 2024-09-16T00:50:31.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/763: creat d1/d89/d28/ffe x:0 0 0 2024-09-16T00:50:31.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/764: creat d1/d5/d31/d3b/d9c/fff x:0 0 0 2024-09-16T00:50:31.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/765: stat d1/d5/d11/da9/db8/dfb/d65/fde 0 2024-09-16T00:50:31.566 INFO:tasks.workunit.client.0.smithi053.stdout:3/766: write d1/d89/d28/f98 [818432,6247] 0 2024-09-16T00:50:31.570 INFO:tasks.workunit.client.0.smithi053.stdout:9/672: write d8/f1f [2480057,50407] 0 2024-09-16T00:50:31.570 INFO:tasks.workunit.client.0.smithi053.stdout:9/673: fsync d8/d1c/d2b/fd8 0 2024-09-16T00:50:31.570 INFO:tasks.workunit.client.0.smithi053.stdout:9/674: fsync d8/d22/d26/f32 0 2024-09-16T00:50:31.570 INFO:tasks.workunit.client.0.smithi053.stdout:9/675: read - d8/d13/fd1 zero size 2024-09-16T00:50:31.573 INFO:tasks.workunit.client.0.smithi053.stdout:7/842: creat d1/d60/d70/d92/f117 x:0 0 0 2024-09-16T00:50:31.577 INFO:tasks.workunit.client.0.smithi053.stdout:3/767: link d1/d5/d11/da9/db8/dfb/d65/d97/d7f/fee d1/d5/d11/da9/db8/dfb/d4c/d50/db5/f100 0 2024-09-16T00:50:31.578 INFO:tasks.workunit.client.0.smithi053.stdout:9/676: mknod d8/d4c/cd9 0 2024-09-16T00:50:31.581 INFO:tasks.workunit.client.0.smithi053.stdout:3/768: creat d1/d5/d11/d3a/dc5/f101 x:0 0 0 2024-09-16T00:50:31.602 INFO:tasks.workunit.client.0.smithi053.stdout:7/843: dwrite d1/d60/d70/dac/f5d [0,4194304] 0 2024-09-16T00:50:31.602 INFO:tasks.workunit.client.0.smithi053.stdout:7/844: fsync d1/d35/f46 0 2024-09-16T00:50:31.602 INFO:tasks.workunit.client.0.smithi053.stdout:9/677: dwrite d8/d1c/d2b/d2c/f48 [4194304,4194304] 0 2024-09-16T00:50:31.614 INFO:tasks.workunit.client.0.smithi053.stdout:7/845: dwrite d1/d2a/d83/dcc/ff5 [0,4194304] 0 2024-09-16T00:50:31.627 INFO:tasks.workunit.client.0.smithi053.stdout:8/672: sync 2024-09-16T00:50:31.627 INFO:tasks.workunit.client.0.smithi053.stdout:8/673: write d10/d21/d28/fb7 [2878072,26178] 0 2024-09-16T00:50:31.648 INFO:tasks.workunit.client.0.smithi053.stdout:3/769: unlink d1/d89/d28/d5a/faf 0 2024-09-16T00:50:31.651 INFO:tasks.workunit.client.0.smithi053.stdout:9/678: rename d8/d1c/d2b/d49/f6b to d8/d1c/d2b/fda 0 2024-09-16T00:50:31.653 INFO:tasks.workunit.client.0.smithi053.stdout:7/846: mknod d1/d35/d5b/ddf/c118 0 2024-09-16T00:50:31.654 INFO:tasks.workunit.client.0.smithi053.stdout:8/674: rmdir d10/d1c/d92/d66/db1 39 2024-09-16T00:50:31.656 INFO:tasks.workunit.client.0.smithi053.stdout:7/847: dread d1/d2a/d4f/d52/f26 [0,4194304] 0 2024-09-16T00:50:31.656 INFO:tasks.workunit.client.0.smithi053.stdout:7/848: write d1/d3/f1f [4871490,66023] 0 2024-09-16T00:50:31.661 INFO:tasks.workunit.client.0.smithi053.stdout:3/770: creat d1/d5/d11/da9/db8/dfb/d65/f102 x:0 0 0 2024-09-16T00:50:31.665 INFO:tasks.workunit.client.0.smithi053.stdout:9/679: symlink d8/d19/d51/d6d/ldb 0 2024-09-16T00:50:31.665 INFO:tasks.workunit.client.0.smithi053.stdout:9/680: truncate d8/d1c/d2b/d2c/f85 4841681 0 2024-09-16T00:50:31.669 INFO:tasks.workunit.client.0.smithi053.stdout:7/849: mkdir d1/dd9/d119 0 2024-09-16T00:50:31.672 INFO:tasks.workunit.client.0.smithi053.stdout:3/771: symlink d1/d5/d31/d7c/dbf/l103 0 2024-09-16T00:50:31.673 INFO:tasks.workunit.client.0.smithi053.stdout:3/772: write d1/d5/f68 [5096174,125276] 0 2024-09-16T00:50:31.673 INFO:tasks.workunit.client.0.smithi053.stdout:8/675: mkdir d10/d1c/d92/d66/d9d/da6/ddf 0 2024-09-16T00:50:31.677 INFO:tasks.workunit.client.0.smithi053.stdout:3/773: rename d1/d5/d11/da9/db8/dfb/dd5/f6a to d1/d5/d91/d5e/d69/ddd/f104 0 2024-09-16T00:50:31.677 INFO:tasks.workunit.client.0.smithi053.stdout:8/676: rename d10/d1c/d49 to d10/d1c/d49/de0 22 2024-09-16T00:50:31.680 INFO:tasks.workunit.client.0.smithi053.stdout:9/681: link d8/d1c/d2b/d5c/fb8 d8/d13/fdc 0 2024-09-16T00:50:31.681 INFO:tasks.workunit.client.0.smithi053.stdout:7/850: mknod d1/d2a/d4f/d52/c11a 0 2024-09-16T00:50:31.683 INFO:tasks.workunit.client.0.smithi053.stdout:3/774: symlink d1/d5/d11/da9/db8/l105 0 2024-09-16T00:50:31.685 INFO:tasks.workunit.client.0.smithi053.stdout:7/851: creat d1/d3/df3/f11b x:0 0 0 2024-09-16T00:50:31.685 INFO:tasks.workunit.client.0.smithi053.stdout:7/852: chown d1/d35/d4a/c5c 83 1 2024-09-16T00:50:31.687 INFO:tasks.workunit.client.0.smithi053.stdout:3/775: rmdir d1/d5/d11/d3a/dc6/de8/def 0 2024-09-16T00:50:31.687 INFO:tasks.workunit.client.0.smithi053.stdout:9/682: getdents d8/d22/dc2 0 2024-09-16T00:50:31.690 INFO:tasks.workunit.client.0.smithi053.stdout:7/853: mkdir d1/d35/d4a/dbb/ddc/d105/d11c 0 2024-09-16T00:50:31.692 INFO:tasks.workunit.client.0.smithi053.stdout:3/776: mkdir d1/d5/d91/d5e/d69/ddd/d106 0 2024-09-16T00:50:31.692 INFO:tasks.workunit.client.0.smithi053.stdout:3/777: chown d1/d5/d31/ced 3848022 1 2024-09-16T00:50:31.692 INFO:tasks.workunit.client.0.smithi053.stdout:3/778: truncate d1/d5/d31/d7c/dbf/ffd 3097 0 2024-09-16T00:50:31.692 INFO:tasks.workunit.client.0.smithi053.stdout:8/677: dwrite d10/d1c/d49/fb9 [4194304,4194304] 0 2024-09-16T00:50:31.693 INFO:tasks.workunit.client.0.smithi053.stdout:8/678: chown d10/d1c/d92 110307270 1 2024-09-16T00:50:31.693 INFO:tasks.workunit.client.0.smithi053.stdout:9/683: dread d8/d22/d26/f61 [0,4194304] 0 2024-09-16T00:50:31.698 INFO:tasks.workunit.client.0.smithi053.stdout:7/854: unlink d1/d60/d77/f6a 0 2024-09-16T00:50:31.698 INFO:tasks.workunit.client.0.smithi053.stdout:7/855: write d1/d35/d5b/d93/f96 [1265729,112451] 0 2024-09-16T00:50:31.700 INFO:tasks.workunit.client.0.smithi053.stdout:3/779: symlink d1/d5/d11/da9/db8/l107 0 2024-09-16T00:50:31.705 INFO:tasks.workunit.client.0.smithi053.stdout:8/679: dwrite d10/d21/d28/d3c/d63/fab [0,4194304] 0 2024-09-16T00:50:31.706 INFO:tasks.workunit.client.0.smithi053.stdout:3/780: mknod d1/d5/d11/da9/c108 0 2024-09-16T00:50:31.706 INFO:tasks.workunit.client.0.smithi053.stdout:3/781: dread - d1/d89/fdf zero size 2024-09-16T00:50:31.706 INFO:tasks.workunit.client.0.smithi053.stdout:3/782: write d1/d5/d31/d7a/dbb/f9a [1057089,33191] 0 2024-09-16T00:50:31.710 INFO:tasks.workunit.client.0.smithi053.stdout:9/684: getdents d8/d1c/d2b/d5c 0 2024-09-16T00:50:31.713 INFO:tasks.workunit.client.0.smithi053.stdout:7/856: getdents d1/d60/d70/dac 0 2024-09-16T00:50:31.714 INFO:tasks.workunit.client.0.smithi053.stdout:3/783: dread d1/d5/d11/da9/db8/dfb/fa6 [0,4194304] 0 2024-09-16T00:50:31.720 INFO:tasks.workunit.client.0.smithi053.stdout:8/680: unlink d10/d1c/d92/d66/f7a 0 2024-09-16T00:50:31.724 INFO:tasks.workunit.client.0.smithi053.stdout:9/685: creat d8/d19/d31/fdd x:0 0 0 2024-09-16T00:50:31.727 INFO:tasks.workunit.client.0.smithi053.stdout:7/857: link d1/f3a d1/d3/de9/f11d 0 2024-09-16T00:50:31.728 INFO:tasks.workunit.client.0.smithi053.stdout:7/858: write d1/d60/faf [219851,1759] 0 2024-09-16T00:50:31.728 INFO:tasks.workunit.client.0.smithi053.stdout:7/859: fdatasync d1/d35/f6b 0 2024-09-16T00:50:31.732 INFO:tasks.workunit.client.0.smithi053.stdout:8/681: symlink d10/d21/d28/d3c/d84/le1 0 2024-09-16T00:50:31.732 INFO:tasks.workunit.client.0.smithi053.stdout:9/686: write d8/f35 [1874500,33080] 0 2024-09-16T00:50:31.732 INFO:tasks.workunit.client.0.smithi053.stdout:9/687: chown d8/d1c/d2b/f47 207284 1 2024-09-16T00:50:31.737 INFO:tasks.workunit.client.0.smithi053.stdout:7/860: unlink d1/d35/d14/d15/f1a 0 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/861: creat d1/d3/df3/f11e x:0 0 0 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/862: chown d1/d35/d5b/ddf 23 1 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/863: chown d1/d2a/fb6 52107245 1 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/864: chown d1/d60/fa8 2917897 1 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/865: write d1/d35/d4a/dbb/fbd [1931300,101623] 0 2024-09-16T00:50:31.738 INFO:tasks.workunit.client.0.smithi053.stdout:7/866: creat d1/d60/f11f x:0 0 0 2024-09-16T00:50:31.739 INFO:tasks.workunit.client.0.smithi053.stdout:8/682: rename d10/c17 to d10/d1c/d2b/d40/dc8/ce2 0 2024-09-16T00:50:31.740 INFO:tasks.workunit.client.0.smithi053.stdout:3/784: write d1/d5/f22 [1520520,7794] 0 2024-09-16T00:50:31.742 INFO:tasks.workunit.client.0.smithi053.stdout:3/785: read d1/d5/d91/d5e/d90/fd6 [123299,125263] 0 2024-09-16T00:50:31.742 INFO:tasks.workunit.client.0.smithi053.stdout:3/786: readlink d1/d89/l73 0 2024-09-16T00:50:31.746 INFO:tasks.workunit.client.0.smithi053.stdout:7/867: unlink d1/d60/d70/ca3 0 2024-09-16T00:50:31.748 INFO:tasks.workunit.client.0.smithi053.stdout:8/683: dread d10/f1d [0,4194304] 0 2024-09-16T00:50:31.749 INFO:tasks.workunit.client.0.smithi053.stdout:9/688: dwrite d8/d1c/d2b/f93 [0,4194304] 0 2024-09-16T00:50:31.749 INFO:tasks.workunit.client.0.smithi053.stdout:9/689: write d8/d19/f7d [948532,87524] 0 2024-09-16T00:50:31.753 INFO:tasks.workunit.client.0.smithi053.stdout:9/690: dread d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:31.756 INFO:tasks.workunit.client.0.smithi053.stdout:8/684: truncate d10/d21/d28/fb7 1829774 0 2024-09-16T00:50:31.757 INFO:tasks.workunit.client.0.smithi053.stdout:8/685: chown d10/d21/d28/d3c/d84/fcb 214074252 1 2024-09-16T00:50:31.757 INFO:tasks.workunit.client.0.smithi053.stdout:8/686: creat d10/d21/d28/d6f/fe3 x:0 0 0 2024-09-16T00:50:31.762 INFO:tasks.workunit.client.0.smithi053.stdout:3/787: rename d1/d89 to d1/d5/d91/d5e/d69/d109 0 2024-09-16T00:50:31.763 INFO:tasks.workunit.client.0.smithi053.stdout:3/788: readlink d1/d5/d31/d7a/le5 0 2024-09-16T00:50:31.769 INFO:tasks.workunit.client.0.smithi053.stdout:8/687: mknod d10/d1c/d2b/ce4 0 2024-09-16T00:50:31.771 INFO:tasks.workunit.client.0.smithi053.stdout:3/789: write d1/d5/d91/d5e/d69/d109/f30 [2003464,126564] 0 2024-09-16T00:50:31.779 INFO:tasks.workunit.client.0.smithi053.stdout:7/868: getdents d1/d60 0 2024-09-16T00:50:31.782 INFO:tasks.workunit.client.0.smithi053.stdout:8/688: dwrite d10/d52/fd0 [0,4194304] 0 2024-09-16T00:50:31.791 INFO:tasks.workunit.client.0.smithi053.stdout:9/691: rename d8/d19/f7d to d8/d4c/d5a/d99/dc8/fde 0 2024-09-16T00:50:31.794 INFO:tasks.workunit.client.0.smithi053.stdout:7/869: getdents d1/d3/de9 0 2024-09-16T00:50:31.798 INFO:tasks.workunit.client.0.smithi053.stdout:8/689: symlink d10/d1c/le5 0 2024-09-16T00:50:31.801 INFO:tasks.workunit.client.0.smithi053.stdout:3/790: rename d1/d5/d11/da9/db8/dfb/d4c/d50 to d1/d4e/d10a 0 2024-09-16T00:50:31.804 INFO:tasks.workunit.client.0.smithi053.stdout:9/692: creat d8/d22/fdf x:0 0 0 2024-09-16T00:50:31.804 INFO:tasks.workunit.client.0.smithi053.stdout:9/693: chown d8/d1c/d2b/d5c/f70 0 1 2024-09-16T00:50:31.805 INFO:tasks.workunit.client.0.smithi053.stdout:7/870: mknod d1/df1/c120 0 2024-09-16T00:50:31.805 INFO:tasks.workunit.client.0.smithi053.stdout:7/871: chown d1/d35/d4a/l110 11 1 2024-09-16T00:50:31.806 INFO:tasks.workunit.client.0.smithi053.stdout:4/574: sync 2024-09-16T00:50:31.806 INFO:tasks.workunit.client.0.smithi053.stdout:5/754: sync 2024-09-16T00:50:31.806 INFO:tasks.workunit.client.0.smithi053.stdout:4/575: write d0/da/f4a [2045164,9662] 0 2024-09-16T00:50:31.807 INFO:tasks.workunit.client.0.smithi053.stdout:4/576: readlink d0/l29 0 2024-09-16T00:50:31.809 INFO:tasks.workunit.client.0.smithi053.stdout:3/791: rename d1/d5/d11/f46 to d1/d5/d91/d5e/d69/d109/d28/dcc/f10b 0 2024-09-16T00:50:31.811 INFO:tasks.workunit.client.0.smithi053.stdout:9/694: mkdir d8/d22/d54/dd5/de0 0 2024-09-16T00:50:31.812 INFO:tasks.workunit.client.0.smithi053.stdout:7/872: mknod d1/d2a/d4f/d113/c121 0 2024-09-16T00:50:31.817 INFO:tasks.workunit.client.0.smithi053.stdout:8/690: dread d10/d1c/d92/f94 [0,4194304] 0 2024-09-16T00:50:31.819 INFO:tasks.workunit.client.0.smithi053.stdout:5/755: rename d3/d7/d2b/d37/f44 to d3/d7/d2b/d4b/d51/ddc/dea/ff7 0 2024-09-16T00:50:31.821 INFO:tasks.workunit.client.0.smithi053.stdout:3/792: creat d1/d5/f10c x:0 0 0 2024-09-16T00:50:31.822 INFO:tasks.workunit.client.0.smithi053.stdout:7/873: symlink d1/d60/d77/da9/de6/l122 0 2024-09-16T00:50:31.829 INFO:tasks.workunit.client.0.smithi053.stdout:3/793: rename d1/d5/f93 to d1/d5/d11/d3a/dc6/de8/f10d 0 2024-09-16T00:50:31.831 INFO:tasks.workunit.client.0.smithi053.stdout:7/874: read d1/d35/d5b/ffd [149815,31293] 0 2024-09-16T00:50:31.831 INFO:tasks.workunit.client.0.smithi053.stdout:7/875: chown d1/f3a 1065 1 2024-09-16T00:50:31.835 INFO:tasks.workunit.client.0.smithi053.stdout:3/794: unlink d1/d5/d91/d5e/d69/d109/fe1 0 2024-09-16T00:50:31.838 INFO:tasks.workunit.client.0.smithi053.stdout:7/876: rename d1/d2a/d4f/c66 to d1/d35/d4a/dbb/c123 0 2024-09-16T00:50:31.838 INFO:tasks.workunit.client.0.smithi053.stdout:6/797: sync 2024-09-16T00:50:31.838 INFO:tasks.workunit.client.0.smithi053.stdout:2/699: sync 2024-09-16T00:50:31.839 INFO:tasks.workunit.client.0.smithi053.stdout:2/700: chown d6/f23 78726787 1 2024-09-16T00:50:31.841 INFO:tasks.workunit.client.0.smithi053.stdout:6/798: mknod d1/dc/d3c/ddd/c106 0 2024-09-16T00:50:31.841 INFO:tasks.workunit.client.0.smithi053.stdout:6/799: readlink d1/dc/d1e/l100 0 2024-09-16T00:50:31.841 INFO:tasks.workunit.client.0.smithi053.stdout:6/800: read - d1/d2f/db3/ff0 zero size 2024-09-16T00:50:31.842 INFO:tasks.workunit.client.0.smithi053.stdout:3/795: dread d1/d4e/f6b [0,4194304] 0 2024-09-16T00:50:31.842 INFO:tasks.workunit.client.0.smithi053.stdout:3/796: fsync d1/d5/d91/d5e/d69/d109/d28/dcc/f10b 0 2024-09-16T00:50:31.842 INFO:tasks.workunit.client.0.smithi053.stdout:3/797: readlink d1/d5/d91/d5e/d69/d109/l73 0 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:4/577: dwrite d0/d2/dd/f9b [0,4194304] 0 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:9/695: dwrite d8/d19/d51/f56 [0,4194304] 0 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/756: dwrite d3/fd9 [0,4194304] 0 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:9/696: fsync d8/d1c/d2b/d5c/f70 0 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/757: chown d3/d7/d2b/d37/d58/d9f/lb9 118902800 1 2024-09-16T00:50:31.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/758: write d3/d7/d2b/d37/d58/d9f/f77 [1061628,125718] 0 2024-09-16T00:50:31.844 INFO:tasks.workunit.client.0.smithi053.stdout:2/701: rename d6/d9/dd/d3e/f59 to d6/d9/dd/d3e/d52/d7e/fe3 0 2024-09-16T00:50:31.845 INFO:tasks.workunit.client.0.smithi053.stdout:2/702: fsync d6/d9/dd/d3e/d52/d65/d92/fc9 0 2024-09-16T00:50:31.845 INFO:tasks.workunit.client.0.smithi053.stdout:2/703: write d6/d9/dd/d3e/d72/d75/fc2 [338772,12191] 0 2024-09-16T00:50:31.845 INFO:tasks.workunit.client.0.smithi053.stdout:2/704: write d6/d9/dd/d76/f88 [703059,3156] 0 2024-09-16T00:50:31.846 INFO:tasks.workunit.client.0.smithi053.stdout:7/877: symlink d1/d2a/d4f/d52/l124 0 2024-09-16T00:50:31.849 INFO:tasks.workunit.client.0.smithi053.stdout:6/801: dread d1/dc/d45/f76 [0,4194304] 0 2024-09-16T00:50:31.857 INFO:tasks.workunit.client.0.smithi053.stdout:5/759: creat d3/d7/d2b/d37/d58/d9f/dce/ff8 x:0 0 0 2024-09-16T00:50:31.859 INFO:tasks.workunit.client.0.smithi053.stdout:2/705: symlink d6/d29/da0/le4 0 2024-09-16T00:50:31.859 INFO:tasks.workunit.client.0.smithi053.stdout:2/706: creat d6/d9/db6/dbc/fe5 x:0 0 0 2024-09-16T00:50:31.860 INFO:tasks.workunit.client.0.smithi053.stdout:7/878: mknod d1/dd9/c125 0 2024-09-16T00:50:31.862 INFO:tasks.workunit.client.0.smithi053.stdout:6/802: symlink d1/dc/d3c/d4a/dec/df5/l107 0 2024-09-16T00:50:31.862 INFO:tasks.workunit.client.0.smithi053.stdout:6/803: write d1/dc/d39/f56 [9425981,112509] 0 2024-09-16T00:50:31.865 INFO:tasks.workunit.client.0.smithi053.stdout:2/707: unlink d6/f71 0 2024-09-16T00:50:31.865 INFO:tasks.workunit.client.0.smithi053.stdout:2/708: chown d6/d9/dd/d3e/f6f 18729 1 2024-09-16T00:50:31.865 INFO:tasks.workunit.client.0.smithi053.stdout:2/709: chown d6/d9/dd/d3e/d52/d7e/d87 160 1 2024-09-16T00:50:31.865 INFO:tasks.workunit.client.0.smithi053.stdout:2/710: write d6/d9/dd/d76/faa [317477,43165] 0 2024-09-16T00:50:31.866 INFO:tasks.workunit.client.0.smithi053.stdout:2/711: write d6/f73 [834762,125488] 0 2024-09-16T00:50:31.866 INFO:tasks.workunit.client.0.smithi053.stdout:6/804: read - d1/dc/f99 zero size 2024-09-16T00:50:31.866 INFO:tasks.workunit.client.0.smithi053.stdout:3/798: dwrite d1/d5/d91/d5e/d69/d109/f2a [0,4194304] 0 2024-09-16T00:50:31.866 INFO:tasks.workunit.client.0.smithi053.stdout:3/799: getdents d1/d5/d91/d5e/d69/ddd/d106 0 2024-09-16T00:50:31.866 INFO:tasks.workunit.client.0.smithi053.stdout:9/697: dwrite d8/d1c/f63 [0,4194304] 0 2024-09-16T00:50:31.870 INFO:tasks.workunit.client.0.smithi053.stdout:7/879: write d1/d60/d70/f78 [1934161,107642] 0 2024-09-16T00:50:31.870 INFO:tasks.workunit.client.0.smithi053.stdout:5/760: dwrite d3/d7/d42/d57/fa8 [4194304,4194304] 0 2024-09-16T00:50:31.872 INFO:tasks.workunit.client.0.smithi053.stdout:3/800: getdents d1/d5/d31/d7c/dbf/dcd 0 2024-09-16T00:50:31.874 INFO:tasks.workunit.client.0.smithi053.stdout:6/805: mknod d1/dc/d3c/d4b/d75/c108 0 2024-09-16T00:50:31.881 INFO:tasks.workunit.client.0.smithi053.stdout:9/698: rename d8/d1c/d2b/d5c/f94 to d8/d4c/d5b/fe1 0 2024-09-16T00:50:31.882 INFO:tasks.workunit.client.0.smithi053.stdout:9/699: write d8/d13/fdc [139815,77918] 0 2024-09-16T00:50:31.883 INFO:tasks.workunit.client.0.smithi053.stdout:2/712: dwrite d6/d9/dd/d3e/d72/d75/d84/fc5 [0,4194304] 0 2024-09-16T00:50:31.887 INFO:tasks.workunit.client.0.smithi053.stdout:5/761: creat d3/d7/d2b/d4b/d51/d53/da9/ff9 x:0 0 0 2024-09-16T00:50:31.891 INFO:tasks.workunit.client.0.smithi053.stdout:3/801: unlink d1/d5/d91/d5e/d69/d109/d28/f35 0 2024-09-16T00:50:31.892 INFO:tasks.workunit.client.0.smithi053.stdout:7/880: dwrite d1/d35/d4a/d74/fcb [0,4194304] 0 2024-09-16T00:50:31.892 INFO:tasks.workunit.client.0.smithi053.stdout:7/881: chown d1/d35/d14/fd0 1 1 2024-09-16T00:50:31.893 INFO:tasks.workunit.client.0.smithi053.stdout:3/802: dread d1/d5/d91/d5e/d69/d109/d28/f7b [0,4194304] 0 2024-09-16T00:50:31.893 INFO:tasks.workunit.client.0.smithi053.stdout:3/803: chown d1/d5/d91/d5e/d69/d109/f18 3563 1 2024-09-16T00:50:31.893 INFO:tasks.workunit.client.0.smithi053.stdout:3/804: fdatasync d1/d5/d11/d3a/dc5/f101 0 2024-09-16T00:50:31.893 INFO:tasks.workunit.client.0.smithi053.stdout:3/805: write d1/d5/d91/d5e/d69/d109/d28/dcc/f10b [4172321,59841] 0 2024-09-16T00:50:31.896 INFO:tasks.workunit.client.0.smithi053.stdout:9/700: write d8/d1c/d2b/f86 [1365980,40140] 0 2024-09-16T00:50:31.896 INFO:tasks.workunit.client.0.smithi053.stdout:9/701: stat d8/d19/c3e 0 2024-09-16T00:50:31.896 INFO:tasks.workunit.client.0.smithi053.stdout:9/702: dread - d8/d4c/d5b/f91 zero size 2024-09-16T00:50:31.898 INFO:tasks.workunit.client.0.smithi053.stdout:9/703: dread d8/d1c/d2b/d2c/f60 [0,4194304] 0 2024-09-16T00:50:31.899 INFO:tasks.workunit.client.0.smithi053.stdout:5/762: dread d3/d7/d2b/d4b/d51/d53/da5/fcf [0,4194304] 0 2024-09-16T00:50:31.906 INFO:tasks.workunit.client.0.smithi053.stdout:2/713: dwrite d6/d29/d2b/f8d [4194304,4194304] 0 2024-09-16T00:50:31.912 INFO:tasks.workunit.client.0.smithi053.stdout:5/763: dread d3/d7/d2b/d4b/d4f/f87 [0,4194304] 0 2024-09-16T00:50:31.916 INFO:tasks.workunit.client.0.smithi053.stdout:7/882: mkdir d1/d2a/d83/d84/db1/d126 0 2024-09-16T00:50:31.918 INFO:tasks.workunit.client.0.smithi053.stdout:3/806: getdents d1/d5/d11/da9/db8/dfb/d64 0 2024-09-16T00:50:31.921 INFO:tasks.workunit.client.0.smithi053.stdout:9/704: symlink d8/d1c/d2b/d2c/le2 0 2024-09-16T00:50:31.926 INFO:tasks.workunit.client.0.smithi053.stdout:2/714: link d6/d9/f12 d6/d9/dd/d3e/d72/d75/d84/fe6 0 2024-09-16T00:50:31.926 INFO:tasks.workunit.client.0.smithi053.stdout:2/715: dread - d6/d9/dd/d3e/d52/d65/fde zero size 2024-09-16T00:50:31.926 INFO:tasks.workunit.client.0.smithi053.stdout:3/807: dread d1/d5/d91/f2b [0,4194304] 0 2024-09-16T00:50:31.928 INFO:tasks.workunit.client.0.smithi053.stdout:7/883: mknod d1/d60/d77/c127 0 2024-09-16T00:50:31.929 INFO:tasks.workunit.client.0.smithi053.stdout:7/884: stat d1/d35/d5b/fb3 0 2024-09-16T00:50:31.929 INFO:tasks.workunit.client.0.smithi053.stdout:5/764: dwrite d3/f2c [0,4194304] 0 2024-09-16T00:50:31.930 INFO:tasks.workunit.client.0.smithi053.stdout:5/765: read d3/d7/f1f [518352,112749] 0 2024-09-16T00:50:31.930 INFO:tasks.workunit.client.0.smithi053.stdout:9/705: rename d8/d1c/d2b/d2c/f41 to d8/d4c/d5a/d99/dc8/fe3 0 2024-09-16T00:50:31.933 INFO:tasks.workunit.client.0.smithi053.stdout:2/716: dread d6/d9/dd/d3e/fd5 [0,4194304] 0 2024-09-16T00:50:31.934 INFO:tasks.workunit.client.0.smithi053.stdout:2/717: fdatasync d6/d29/d2b/f82 0 2024-09-16T00:50:31.934 INFO:tasks.workunit.client.0.smithi053.stdout:2/718: dread - d6/d9/d14/d81/f9e zero size 2024-09-16T00:50:31.934 INFO:tasks.workunit.client.0.smithi053.stdout:2/719: stat d6/d9 0 2024-09-16T00:50:31.936 INFO:tasks.workunit.client.0.smithi053.stdout:7/885: unlink d1/d35/d4a/l51 0 2024-09-16T00:50:31.940 INFO:tasks.workunit.client.0.smithi053.stdout:5/766: rename d3/d7/d24/d3f/f9e to d3/d7/d2b/d37/d58/d79/ffa 0 2024-09-16T00:50:31.940 INFO:tasks.workunit.client.0.smithi053.stdout:5/767: chown d3/d7/d2b/d37/d58/d79/cb4 8449 1 2024-09-16T00:50:31.941 INFO:tasks.workunit.client.0.smithi053.stdout:9/706: mkdir d8/d19/d51/d6d/d7a/db2/de4 0 2024-09-16T00:50:31.941 INFO:tasks.workunit.client.0.smithi053.stdout:9/707: write d8/d22/fdf [387019,52751] 0 2024-09-16T00:50:31.941 INFO:tasks.workunit.client.0.smithi053.stdout:9/708: write d8/d1c/d2b/f86 [3733575,92247] 0 2024-09-16T00:50:31.942 INFO:tasks.workunit.client.0.smithi053.stdout:9/709: dread d8/d22/f72 [0,4194304] 0 2024-09-16T00:50:31.943 INFO:tasks.workunit.client.0.smithi053.stdout:3/808: dread d1/d5/d11/da9/db8/dfb/dd5/fd0 [0,4194304] 0 2024-09-16T00:50:31.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:31 smithi152 ceph-mon[33237]: pgmap v16: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 218 MiB/s rd, 241 MiB/s wr, 370 op/s 2024-09-16T00:50:31.975 INFO:tasks.workunit.client.0.smithi053.stdout:2/720: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/721: read f5 [8664263,23440] 0 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/722: stat d6/d9/dd/d3e/d52/d65/d92/fa6 0 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/723: write d6/d9/dd/d28/f57 [4875589,34165] 0 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/724: stat d6/d9/dd/d3e/d52/d65/f7c 0 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/725: chown d6/dae/fcd 10 1 2024-09-16T00:50:31.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/726: symlink d6/d9/dd/dbb/le7 0 2024-09-16T00:50:31.978 INFO:tasks.workunit.client.0.smithi053.stdout:7/886: dwrite d1/d35/d14/f38 [0,4194304] 0 2024-09-16T00:50:31.978 INFO:tasks.workunit.client.0.smithi053.stdout:5/768: dwrite d3/d7/d2b/d37/d58/f38 [0,4194304] 0 2024-09-16T00:50:31.978 INFO:tasks.workunit.client.0.smithi053.stdout:3/809: dwrite d1/d5/d11/f95 [0,4194304] 0 2024-09-16T00:50:31.982 INFO:tasks.workunit.client.0.smithi053.stdout:7/887: creat d1/d2a/d4f/d52/f128 x:0 0 0 2024-09-16T00:50:31.982 INFO:tasks.workunit.client.0.smithi053.stdout:9/710: dwrite d8/d1c/d2b/fda [0,4194304] 0 2024-09-16T00:50:31.983 INFO:tasks.workunit.client.0.smithi053.stdout:7/888: read d1/d2a/fb6 [80319,42041] 0 2024-09-16T00:50:31.983 INFO:tasks.workunit.client.0.smithi053.stdout:7/889: write d1/db5/f10c [291247,63062] 0 2024-09-16T00:50:31.991 INFO:tasks.workunit.client.0.smithi053.stdout:2/727: dread d6/d29/f3b [0,4194304] 0 2024-09-16T00:50:31.991 INFO:tasks.workunit.client.0.smithi053.stdout:2/728: fsync d6/dae/fcd 0 2024-09-16T00:50:31.995 INFO:tasks.workunit.client.0.smithi053.stdout:3/810: dwrite d1/d5/d31/f39 [4194304,4194304] 0 2024-09-16T00:50:32.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/769: rmdir d3/d7/d24 39 2024-09-16T00:50:32.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/770: dread - d3/d7/d2b/d4b/d51/d96/fde zero size 2024-09-16T00:50:32.006 INFO:tasks.workunit.client.0.smithi053.stdout:5/771: write d3/fd3 [861382,96148] 0 2024-09-16T00:50:32.010 INFO:tasks.workunit.client.0.smithi053.stdout:7/890: truncate d1/db5/fe4 253769 0 2024-09-16T00:50:32.010 INFO:tasks.workunit.client.0.smithi053.stdout:7/891: fdatasync d1/d35/d4a/f56 0 2024-09-16T00:50:32.011 INFO:tasks.workunit.client.0.smithi053.stdout:2/729: rmdir d6 39 2024-09-16T00:50:32.011 INFO:tasks.workunit.client.0.smithi053.stdout:0/829: sync 2024-09-16T00:50:32.011 INFO:tasks.workunit.client.0.smithi053.stdout:1/739: sync 2024-09-16T00:50:32.012 INFO:tasks.workunit.client.0.smithi053.stdout:3/811: rmdir d1/d5/d11 39 2024-09-16T00:50:32.013 INFO:tasks.workunit.client.0.smithi053.stdout:9/711: rmdir d8/d19/d31 39 2024-09-16T00:50:32.015 INFO:tasks.workunit.client.0.smithi053.stdout:2/730: mknod d6/d9/d74/ce8 0 2024-09-16T00:50:32.015 INFO:tasks.workunit.client.0.smithi053.stdout:2/731: chown d6/d90/dba/cd1 33401235 1 2024-09-16T00:50:32.016 INFO:tasks.workunit.client.0.smithi053.stdout:5/772: dread d3/d7/d42/d57/fcd [0,4194304] 0 2024-09-16T00:50:32.017 INFO:tasks.workunit.client.0.smithi053.stdout:0/830: rename d4/dc/d1e/c101 to d4/dc/d1e/d1f/d40/d44/d54/deb/c109 0 2024-09-16T00:50:32.020 INFO:tasks.workunit.client.0.smithi053.stdout:1/740: creat d5/d18/d33/d8a/ff6 x:0 0 0 2024-09-16T00:50:32.020 INFO:tasks.workunit.client.0.smithi053.stdout:3/812: dread d1/d4e/f6b [0,4194304] 0 2024-09-16T00:50:32.021 INFO:tasks.workunit.client.0.smithi053.stdout:7/892: dread d1/d60/d70/dac/f7c [0,4194304] 0 2024-09-16T00:50:32.021 INFO:tasks.workunit.client.0.smithi053.stdout:9/712: creat d8/d1c/d2b/d2c/fe5 x:0 0 0 2024-09-16T00:50:32.021 INFO:tasks.workunit.client.0.smithi053.stdout:9/713: chown d8/d22/f72 34 1 2024-09-16T00:50:32.024 INFO:tasks.workunit.client.0.smithi053.stdout:2/732: rmdir d6/d9/dd 39 2024-09-16T00:50:32.024 INFO:tasks.workunit.client.0.smithi053.stdout:2/733: read - d6/d9/dd/d3e/d52/d65/fde zero size 2024-09-16T00:50:32.024 INFO:tasks.workunit.client.0.smithi053.stdout:2/734: stat d6/d29/db7/fe1 0 2024-09-16T00:50:32.035 INFO:tasks.workunit.client.0.smithi053.stdout:0/831: write d4/dc/d25/d34/f8f [3285677,127629] 0 2024-09-16T00:50:32.036 INFO:tasks.workunit.client.0.smithi053.stdout:1/741: dread d5/d7/d39/d57/d82/fb3 [0,4194304] 0 2024-09-16T00:50:32.039 INFO:tasks.workunit.client.0.smithi053.stdout:7/893: dwrite d1/d60/fa8 [0,4194304] 0 2024-09-16T00:50:32.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:31 smithi053 ceph-mon[27950]: pgmap v16: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 218 MiB/s rd, 241 MiB/s wr, 370 op/s 2024-09-16T00:50:32.111 INFO:tasks.workunit.client.0.smithi053.stdout:5/773: unlink d3/d7/d2b/d37/d58/d9f/laf 0 2024-09-16T00:50:32.118 INFO:tasks.workunit.client.0.smithi053.stdout:5/774: dread d3/d7/d2b/d4b/d51/ddc/dea/ff7 [0,4194304] 0 2024-09-16T00:50:32.118 INFO:tasks.workunit.client.0.smithi053.stdout:5/775: fdatasync d3/d7/d24/d3f/f5e 0 2024-09-16T00:50:32.118 INFO:tasks.workunit.client.0.smithi053.stdout:5/776: dread - d3/d7/d24/d34/d3e/da1/fc9 zero size 2024-09-16T00:50:32.132 INFO:tasks.workunit.client.0.smithi053.stdout:5/777: dwrite d3/d7/d2b/d37/d58/f38 [0,4194304] 0 2024-09-16T00:50:32.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/778: dread d3/d7/d2b/d4b/d51/fab [0,4194304] 0 2024-09-16T00:50:32.142 INFO:tasks.workunit.client.0.smithi053.stdout:5/779: fsync d3/d7/d24/f66 0 2024-09-16T00:50:32.171 INFO:tasks.workunit.client.0.smithi053.stdout:2/735: creat d6/fe9 x:0 0 0 2024-09-16T00:50:32.172 INFO:tasks.workunit.client.0.smithi053.stdout:2/736: write d6/d29/d2b/d39/f40 [1039403,100685] 0 2024-09-16T00:50:32.172 INFO:tasks.workunit.client.0.smithi053.stdout:2/737: creat d6/dae/fea x:0 0 0 2024-09-16T00:50:32.176 INFO:tasks.workunit.client.0.smithi053.stdout:0/832: mknod d4/d13/de8/c10a 0 2024-09-16T00:50:32.177 INFO:tasks.workunit.client.0.smithi053.stdout:1/742: getdents d5/dd/d7f 0 2024-09-16T00:50:32.180 INFO:tasks.workunit.client.0.smithi053.stdout:2/738: dread d6/d29/d2b/d39/f9b [0,4194304] 0 2024-09-16T00:50:32.185 INFO:tasks.workunit.client.0.smithi053.stdout:7/894: chown d1/d2a/d83/leb 2468 1 2024-09-16T00:50:32.187 INFO:tasks.workunit.client.0.smithi053.stdout:3/813: rename d1/d5/d11/da9/db8/dfb/lba to d1/d5/d11/d3a/dc6/de8/l10e 0 2024-09-16T00:50:32.188 INFO:tasks.workunit.client.0.smithi053.stdout:3/814: fsync d1/d5/d11/da9/db8/dfb/d65/d97/d7f/ff4 0 2024-09-16T00:50:32.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/739: dread d6/dae/fcd [0,4194304] 0 2024-09-16T00:50:32.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/740: readlink d6/d9/d74/l83 0 2024-09-16T00:50:32.197 INFO:tasks.workunit.client.0.smithi053.stdout:9/714: rmdir d8/d22 39 2024-09-16T00:50:32.200 INFO:tasks.workunit.client.0.smithi053.stdout:5/780: unlink c1 0 2024-09-16T00:50:32.200 INFO:tasks.workunit.client.0.smithi053.stdout:5/781: dread - d3/d7/d2b/d4b/d51/d53/f88 zero size 2024-09-16T00:50:32.203 INFO:tasks.workunit.client.0.smithi053.stdout:0/833: mknod d4/dc/d1e/dfc/c10b 0 2024-09-16T00:50:32.203 INFO:tasks.workunit.client.0.smithi053.stdout:0/834: chown d4/dc/d1e/d1f/d40/d73/dd6 1008 1 2024-09-16T00:50:32.203 INFO:tasks.workunit.client.0.smithi053.stdout:0/835: fsync d4/d5a/f94 0 2024-09-16T00:50:32.204 INFO:tasks.workunit.client.0.smithi053.stdout:1/743: truncate d5/d18/d33/d8a/d98/dd0/f72 378519 0 2024-09-16T00:50:32.206 INFO:tasks.workunit.client.0.smithi053.stdout:7/895: creat d1/d60/d62/df8/f129 x:0 0 0 2024-09-16T00:50:32.207 INFO:tasks.workunit.client.0.smithi053.stdout:3/815: creat d1/d5/d11/da9/db8/dfb/d65/d97/da4/f10f x:0 0 0 2024-09-16T00:50:32.210 INFO:tasks.workunit.client.0.smithi053.stdout:5/782: rename d3/d7/d2b/d37/d58/f21 to d3/d7/d24/d34/ffb 0 2024-09-16T00:50:32.210 INFO:tasks.workunit.client.0.smithi053.stdout:2/741: dwrite d6/d29/d2b/d39/f40 [0,4194304] 0 2024-09-16T00:50:32.210 INFO:tasks.workunit.client.0.smithi053.stdout:2/742: dread - d6/d90/fd3 zero size 2024-09-16T00:50:32.211 INFO:tasks.workunit.client.0.smithi053.stdout:0/836: mknod d4/dc/d1e/d1f/d40/d44/d54/deb/d104/c10c 0 2024-09-16T00:50:32.212 INFO:tasks.workunit.client.0.smithi053.stdout:1/744: mknod d5/cf7 0 2024-09-16T00:50:32.214 INFO:tasks.workunit.client.0.smithi053.stdout:7/896: truncate d1/d2a/d4f/d52/f26 137203 0 2024-09-16T00:50:32.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/715: mkdir d8/d13/de6 0 2024-09-16T00:50:32.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/716: write d8/d22/dc2/fcd [367961,117576] 0 2024-09-16T00:50:32.217 INFO:tasks.workunit.client.0.smithi053.stdout:3/816: write d1/d5/d11/da9/db8/dfb/d65/d66/f86 [2416426,53075] 0 2024-09-16T00:50:32.220 INFO:tasks.workunit.client.0.smithi053.stdout:5/783: creat d3/d7/d2b/d4b/d51/ddc/ffc x:0 0 0 2024-09-16T00:50:32.221 INFO:tasks.workunit.client.0.smithi053.stdout:2/743: creat d6/d29/d2b/dd0/feb x:0 0 0 2024-09-16T00:50:32.223 INFO:tasks.workunit.client.0.smithi053.stdout:0/837: unlink d4/dc/d25/d34/d71/d96/fb2 0 2024-09-16T00:50:32.228 INFO:tasks.workunit.client.0.smithi053.stdout:1/745: symlink d5/dd/lf8 0 2024-09-16T00:50:32.230 INFO:tasks.workunit.client.0.smithi053.stdout:7/897: mkdir d1/d60/d12a 0 2024-09-16T00:50:32.231 INFO:tasks.workunit.client.0.smithi053.stdout:9/717: truncate d8/d1c/fa8 202830 0 2024-09-16T00:50:32.231 INFO:tasks.workunit.client.0.smithi053.stdout:9/718: fsync d8/d19/d31/f71 0 2024-09-16T00:50:32.232 INFO:tasks.workunit.client.0.smithi053.stdout:3/817: mknod d1/d5/d91/d5e/d90/c110 0 2024-09-16T00:50:32.238 INFO:tasks.workunit.client.0.smithi053.stdout:3/818: dread d1/d5/d11/da9/db8/dfb/d65/d66/f86 [0,4194304] 0 2024-09-16T00:50:32.244 INFO:tasks.workunit.client.0.smithi053.stdout:0/838: symlink d4/dc/d1e/d1f/d40/d44/d54/deb/l10d 0 2024-09-16T00:50:32.244 INFO:tasks.workunit.client.0.smithi053.stdout:0/839: stat d4/d13/de8/c10a 0 2024-09-16T00:50:32.245 INFO:tasks.workunit.client.0.smithi053.stdout:1/746: mknod d5/dd/cf9 0 2024-09-16T00:50:32.245 INFO:tasks.workunit.client.0.smithi053.stdout:1/747: fdatasync d5/d18/d33/d8a/d98/dd0/f5c 0 2024-09-16T00:50:32.248 INFO:tasks.workunit.client.0.smithi053.stdout:7/898: unlink d1/d3/d85/fc0 0 2024-09-16T00:50:32.248 INFO:tasks.workunit.client.0.smithi053.stdout:7/899: dread - d1/d3/d85/f9d zero size 2024-09-16T00:50:32.248 INFO:tasks.workunit.client.0.smithi053.stdout:7/900: creat d1/d3/dc1/f12b x:0 0 0 2024-09-16T00:50:32.253 INFO:tasks.workunit.client.0.smithi053.stdout:9/719: mknod d8/d19/ce7 0 2024-09-16T00:50:32.258 INFO:tasks.workunit.client.0.smithi053.stdout:5/784: mknod d3/d9c/dc4/cfd 0 2024-09-16T00:50:32.259 INFO:tasks.workunit.client.0.smithi053.stdout:2/744: rmdir d6/d9/d14 39 2024-09-16T00:50:32.260 INFO:tasks.workunit.client.0.smithi053.stdout:0/840: mkdir d4/d13/d10e 0 2024-09-16T00:50:32.261 INFO:tasks.workunit.client.0.smithi053.stdout:1/748: creat d5/d9/d77/ffa x:0 0 0 2024-09-16T00:50:32.263 INFO:tasks.workunit.client.0.smithi053.stdout:7/901: creat d1/d35/d4a/dbb/ddc/d105/d11c/f12c x:0 0 0 2024-09-16T00:50:32.263 INFO:tasks.workunit.client.0.smithi053.stdout:7/902: truncate d1/dd9/ffc 950677 0 2024-09-16T00:50:32.263 INFO:tasks.workunit.client.0.smithi053.stdout:7/903: truncate d1/d35/d14/fc8 343914 0 2024-09-16T00:50:32.264 INFO:tasks.workunit.client.0.smithi053.stdout:9/720: mkdir d8/d4c/d5a/d99/dc8/de8 0 2024-09-16T00:50:32.267 INFO:tasks.workunit.client.0.smithi053.stdout:5/785: symlink d3/d7/d2b/d4b/lfe 0 2024-09-16T00:50:32.267 INFO:tasks.workunit.client.0.smithi053.stdout:5/786: stat d3/d7/d2b/d4b/d51/ddc/dea/faa 0 2024-09-16T00:50:32.268 INFO:tasks.workunit.client.0.smithi053.stdout:2/745: creat d6/d90/fec x:0 0 0 2024-09-16T00:50:32.270 INFO:tasks.workunit.client.0.smithi053.stdout:2/746: write d6/f77 [44814,15005] 0 2024-09-16T00:50:32.270 INFO:tasks.workunit.client.0.smithi053.stdout:2/747: write d6/d9/dd/d3e/f7d [385797,96904] 0 2024-09-16T00:50:32.270 INFO:tasks.workunit.client.0.smithi053.stdout:0/841: link d4/dc/d1e/d1f/d40/d44/lc8 d4/dc/d1e/d22/dc5/dd2/df6/l10f 0 2024-09-16T00:50:32.272 INFO:tasks.workunit.client.0.smithi053.stdout:1/749: link d5/d18/d33/d8a/d98/dd0/fd6 d5/d7/d39/d57/d82/ffb 0 2024-09-16T00:50:32.273 INFO:tasks.workunit.client.0.smithi053.stdout:7/904: symlink d1/d35/d14/da7/l12d 0 2024-09-16T00:50:32.275 INFO:tasks.workunit.client.0.smithi053.stdout:9/721: mknod d8/d19/d51/ce9 0 2024-09-16T00:50:32.275 INFO:tasks.workunit.client.0.smithi053.stdout:9/722: chown d8/d19/d51/faa 473 1 2024-09-16T00:50:32.276 INFO:tasks.workunit.client.0.smithi053.stdout:9/723: creat d8/d1c/d2b/d8b/fea x:0 0 0 2024-09-16T00:50:32.276 INFO:tasks.workunit.client.0.smithi053.stdout:9/724: getdents d8/d1c/d2b/d2c/dbb 0 2024-09-16T00:50:32.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/787: symlink d3/d7/d2b/d4b/d51/lff 0 2024-09-16T00:50:32.278 INFO:tasks.workunit.client.0.smithi053.stdout:9/725: write d8/d22/dc2/fcd [156453,107115] 0 2024-09-16T00:50:32.278 INFO:tasks.workunit.client.0.smithi053.stdout:1/750: write d5/d7/f20 [2543906,81702] 0 2024-09-16T00:50:32.279 INFO:tasks.workunit.client.0.smithi053.stdout:3/819: rmdir d1/d5/d91/d5e/d90 39 2024-09-16T00:50:32.283 INFO:tasks.workunit.client.0.smithi053.stdout:2/748: rename d6/d9/db6/dbc/fdd to d6/d9/dd/d3e/d52/d65/fed 0 2024-09-16T00:50:32.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/905: mkdir d1/d102/d12e 0 2024-09-16T00:50:32.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/906: write d1/d2a/f99 [4766052,130645] 0 2024-09-16T00:50:32.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/907: fdatasync d1/d2a/d4f/fb7 0 2024-09-16T00:50:32.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/908: creat d1/db5/f12f x:0 0 0 2024-09-16T00:50:32.285 INFO:tasks.workunit.client.0.smithi053.stdout:7/909: dread - d1/d60/d70/dac/fd1 zero size 2024-09-16T00:50:32.292 INFO:tasks.workunit.client.0.smithi053.stdout:5/788: truncate d3/d7/d2b/d37/d58/f19 3377499 0 2024-09-16T00:50:32.295 INFO:tasks.workunit.client.0.smithi053.stdout:2/749: write d6/d29/d2b/f8d [777348,117538] 0 2024-09-16T00:50:32.295 INFO:tasks.workunit.client.0.smithi053.stdout:2/750: chown d6/d29/l45 0 1 2024-09-16T00:50:32.295 INFO:tasks.workunit.client.0.smithi053.stdout:2/751: creat d6/d9/dd/d3e/d72/d75/fee x:0 0 0 2024-09-16T00:50:32.299 INFO:tasks.workunit.client.0.smithi053.stdout:9/726: symlink d8/d19/d51/d6d/leb 0 2024-09-16T00:50:32.299 INFO:tasks.workunit.client.0.smithi053.stdout:1/751: getdents d5/d9/d73 0 2024-09-16T00:50:32.302 INFO:tasks.workunit.client.0.smithi053.stdout:0/842: rename d4/dc/dc0/l7d to d4/dc/d1e/d1f/d40/d44/l110 0 2024-09-16T00:50:32.304 INFO:tasks.workunit.client.0.smithi053.stdout:7/910: creat d1/d60/d77/da9/de6/f130 x:0 0 0 2024-09-16T00:50:32.307 INFO:tasks.workunit.client.0.smithi053.stdout:3/820: dwrite d1/d5/d31/d7c/dbf/ffd [0,4194304] 0 2024-09-16T00:50:32.307 INFO:tasks.workunit.client.0.smithi053.stdout:3/821: chown d1/d5/d31/d7c/dbf 3985 1 2024-09-16T00:50:32.310 INFO:tasks.workunit.client.0.smithi053.stdout:2/752: symlink d6/d9/d74/lef 0 2024-09-16T00:50:32.313 INFO:tasks.workunit.client.0.smithi053.stdout:1/752: truncate d5/dd/d19/f46 1954244 0 2024-09-16T00:50:32.313 INFO:tasks.workunit.client.0.smithi053.stdout:1/753: fdatasync d5/d18/d33/d30/ff4 0 2024-09-16T00:50:32.313 INFO:tasks.workunit.client.0.smithi053.stdout:7/911: creat d1/d3/de9/f131 x:0 0 0 2024-09-16T00:50:32.314 INFO:tasks.workunit.client.0.smithi053.stdout:9/727: dread d8/d1c/d2b/d49/fa1 [0,4194304] 0 2024-09-16T00:50:32.314 INFO:tasks.workunit.client.0.smithi053.stdout:9/728: creat d8/d19/d51/d6d/fec x:0 0 0 2024-09-16T00:50:32.315 INFO:tasks.workunit.client.0.smithi053.stdout:0/843: write d4/dc/d1e/d22/dc5/ff3 [206250,66531] 0 2024-09-16T00:50:32.319 INFO:tasks.workunit.client.0.smithi053.stdout:5/789: dwrite d3/d7/d2b/d37/d58/d79/f84 [0,4194304] 0 2024-09-16T00:50:32.319 INFO:tasks.workunit.client.0.smithi053.stdout:5/790: truncate d3/fc6 906888 0 2024-09-16T00:50:32.321 INFO:tasks.workunit.client.0.smithi053.stdout:2/753: link d6/d9/dd/d3e/d52/d65/d92/fc9 d6/d9/dd/d3e/d72/ff0 0 2024-09-16T00:50:32.322 INFO:tasks.workunit.client.0.smithi053.stdout:2/754: creat d6/d29/db7/ff1 x:0 0 0 2024-09-16T00:50:32.322 INFO:tasks.workunit.client.0.smithi053.stdout:2/755: chown d6/d9/d14/d81/fb5 723 1 2024-09-16T00:50:32.322 INFO:tasks.workunit.client.0.smithi053.stdout:2/756: creat d6/ff2 x:0 0 0 2024-09-16T00:50:32.322 INFO:tasks.workunit.client.0.smithi053.stdout:2/757: stat d6/ff2 0 2024-09-16T00:50:32.322 INFO:tasks.workunit.client.0.smithi053.stdout:2/758: chown d6/d9/d74/ce8 61948 1 2024-09-16T00:50:32.328 INFO:tasks.workunit.client.0.smithi053.stdout:5/791: dread d3/d7/d2b/d37/d58/d79/f84 [0,4194304] 0 2024-09-16T00:50:32.329 INFO:tasks.workunit.client.0.smithi053.stdout:5/792: chown d3/d7 11254 1 2024-09-16T00:50:32.329 INFO:tasks.workunit.client.0.smithi053.stdout:9/729: mkdir d8/d22/d54/ded 0 2024-09-16T00:50:32.330 INFO:tasks.workunit.client.0.smithi053.stdout:3/822: dwrite d1/d5/d91/d5e/d90/fa8 [0,4194304] 0 2024-09-16T00:50:32.338 INFO:tasks.workunit.client.0.smithi053.stdout:2/759: creat d6/d9/d74/ff3 x:0 0 0 2024-09-16T00:50:32.340 INFO:tasks.workunit.client.0.smithi053.stdout:7/912: mknod d1/d2a/d83/d84/db1/d126/c132 0 2024-09-16T00:50:32.340 INFO:tasks.workunit.client.0.smithi053.stdout:7/913: dread - d1/d60/d70/d92/fc7 zero size 2024-09-16T00:50:32.342 INFO:tasks.workunit.client.0.smithi053.stdout:5/793: creat d3/d7/d2b/f100 x:0 0 0 2024-09-16T00:50:32.343 INFO:tasks.workunit.client.0.smithi053.stdout:9/730: mkdir d8/d4c/d5a/d99/dee 0 2024-09-16T00:50:32.346 INFO:tasks.workunit.client.0.smithi053.stdout:1/754: getdents d5/d9/d77 0 2024-09-16T00:50:32.348 INFO:tasks.workunit.client.0.smithi053.stdout:3/823: creat d1/d5/d31/d3b/f111 x:0 0 0 2024-09-16T00:50:32.348 INFO:tasks.workunit.client.0.smithi053.stdout:3/824: truncate d1/d5/fec 1015516 0 2024-09-16T00:50:32.348 INFO:tasks.workunit.client.0.smithi053.stdout:3/825: write d1/d5/d91/f1f [3167496,44884] 0 2024-09-16T00:50:32.349 INFO:tasks.workunit.client.0.smithi053.stdout:0/844: getdents d4/dc/d25/d34 0 2024-09-16T00:50:32.351 INFO:tasks.workunit.client.0.smithi053.stdout:2/760: link d6/f77 d6/d9/dd/d76/ff4 0 2024-09-16T00:50:32.353 INFO:tasks.workunit.client.0.smithi053.stdout:7/914: creat d1/d2a/d4f/d113/f133 x:0 0 0 2024-09-16T00:50:32.353 INFO:tasks.workunit.client.0.smithi053.stdout:8/691: sync 2024-09-16T00:50:32.353 INFO:tasks.workunit.client.0.smithi053.stdout:6/806: sync 2024-09-16T00:50:32.353 INFO:tasks.workunit.client.0.smithi053.stdout:4/578: sync 2024-09-16T00:50:32.353 INFO:tasks.workunit.client.0.smithi053.stdout:6/807: chown d1/dc/d3c/d4b/d75/f8b 82795 1 2024-09-16T00:50:32.354 INFO:tasks.workunit.client.0.smithi053.stdout:5/794: mknod d3/d7/d2b/d37/d58/d9f/dce/c101 0 2024-09-16T00:50:32.354 INFO:tasks.workunit.client.0.smithi053.stdout:5/795: chown d3/d7/d2b/d4b/d51 7148 1 2024-09-16T00:50:32.354 INFO:tasks.workunit.client.0.smithi053.stdout:1/755: dread d5/dd/f6f [0,4194304] 0 2024-09-16T00:50:32.356 INFO:tasks.workunit.client.0.smithi053.stdout:3/826: unlink d1/d5/d11/d3a/dc6/de8/l10e 0 2024-09-16T00:50:32.360 INFO:tasks.workunit.client.0.smithi053.stdout:2/761: mkdir d6/d29/d2b/d39/df5 0 2024-09-16T00:50:32.361 INFO:tasks.workunit.client.0.smithi053.stdout:7/915: mknod d1/d2a/d83/d84/db1/c134 0 2024-09-16T00:50:32.361 INFO:tasks.workunit.client.0.smithi053.stdout:7/916: dread - d1/d60/d70/dac/fa4 zero size 2024-09-16T00:50:32.362 INFO:tasks.workunit.client.0.smithi053.stdout:8/692: creat d10/d1c/d2b/d40/ddc/fe6 x:0 0 0 2024-09-16T00:50:32.363 INFO:tasks.workunit.client.0.smithi053.stdout:5/796: write d3/d7/d24/d34/d3e/f64 [2332197,17617] 0 2024-09-16T00:50:32.363 INFO:tasks.workunit.client.0.smithi053.stdout:5/797: readlink d3/d7/lc 0 2024-09-16T00:50:32.363 INFO:tasks.workunit.client.0.smithi053.stdout:6/808: truncate d1/dc/f32 3817063 0 2024-09-16T00:50:32.364 INFO:tasks.workunit.client.0.smithi053.stdout:9/731: rmdir d8/d13 39 2024-09-16T00:50:32.368 INFO:tasks.workunit.client.0.smithi053.stdout:6/809: dread d1/dc/d1e/f8d [0,4194304] 0 2024-09-16T00:50:32.372 INFO:tasks.workunit.client.0.smithi053.stdout:4/579: dwrite d0/d2/dd/f40 [0,4194304] 0 2024-09-16T00:50:32.372 INFO:tasks.workunit.client.0.smithi053.stdout:0/845: rmdir d4/dc/d25 39 2024-09-16T00:50:32.372 INFO:tasks.workunit.client.0.smithi053.stdout:2/762: symlink d6/d9/db6/lf6 0 2024-09-16T00:50:32.373 INFO:tasks.workunit.client.0.smithi053.stdout:2/763: stat d6/d9/dd/d3e/d72 0 2024-09-16T00:50:32.373 INFO:tasks.workunit.client.0.smithi053.stdout:2/764: write d6/d29/d2b/f46 [12421548,77339] 0 2024-09-16T00:50:32.373 INFO:tasks.workunit.client.0.smithi053.stdout:7/917: mknod d1/d35/d4a/dbb/ddc/c135 0 2024-09-16T00:50:32.373 INFO:tasks.workunit.client.0.smithi053.stdout:7/918: getdents d1/d60/d70/d92/da1 0 2024-09-16T00:50:32.375 INFO:tasks.workunit.client.0.smithi053.stdout:8/693: write d10/d21/d28/da2/f9f [1115717,42583] 0 2024-09-16T00:50:32.376 INFO:tasks.workunit.client.0.smithi053.stdout:5/798: creat d3/d7/d2b/d37/d58/d79/f102 x:0 0 0 2024-09-16T00:50:32.380 INFO:tasks.workunit.client.0.smithi053.stdout:1/756: rmdir d5/d18 39 2024-09-16T00:50:32.382 INFO:tasks.workunit.client.0.smithi053.stdout:3/827: symlink d1/d5/d11/da9/db8/dfb/dd5/l112 0 2024-09-16T00:50:32.384 INFO:tasks.workunit.client.0.smithi053.stdout:6/810: rmdir d1/d90 39 2024-09-16T00:50:32.384 INFO:tasks.workunit.client.0.smithi053.stdout:6/811: read - d1/dc/d45/fc7 zero size 2024-09-16T00:50:32.385 INFO:tasks.workunit.client.0.smithi053.stdout:6/812: truncate d1/fca 994288 0 2024-09-16T00:50:32.386 INFO:tasks.workunit.client.0.smithi053.stdout:9/732: dwrite d8/d13/fae [0,4194304] 0 2024-09-16T00:50:32.386 INFO:tasks.workunit.client.0.smithi053.stdout:9/733: dread - d8/d22/d26/d83/f88 zero size 2024-09-16T00:50:32.387 INFO:tasks.workunit.client.0.smithi053.stdout:2/765: truncate d6/d29/fab 2096319 0 2024-09-16T00:50:32.387 INFO:tasks.workunit.client.0.smithi053.stdout:2/766: chown d6/d9/dd/dbb/cd7 8813931 1 2024-09-16T00:50:32.389 INFO:tasks.workunit.client.0.smithi053.stdout:8/694: mkdir d10/d4a/dbf/de7 0 2024-09-16T00:50:32.389 INFO:tasks.workunit.client.0.smithi053.stdout:8/695: dread - d10/d21/d28/d6f/fb6 zero size 2024-09-16T00:50:32.392 INFO:tasks.workunit.client.0.smithi053.stdout:3/828: write d1/d5/d11/da9/db8/dfb/dd5/f8c [3665056,88106] 0 2024-09-16T00:50:32.395 INFO:tasks.workunit.client.0.smithi053.stdout:2/767: dread d6/d9/d14/d81/fb5 [0,4194304] 0 2024-09-16T00:50:32.396 INFO:tasks.workunit.client.0.smithi053.stdout:2/768: dread - d6/d9/dd/d3e/d52/fc3 zero size 2024-09-16T00:50:32.396 INFO:tasks.workunit.client.0.smithi053.stdout:7/919: dread d1/d35/d14/d15/f9c [0,4194304] 0 2024-09-16T00:50:32.396 INFO:tasks.workunit.client.0.smithi053.stdout:6/813: link d1/dc/d1e/d41/c80 d1/dc/d3d/db1/c109 0 2024-09-16T00:50:32.396 INFO:tasks.workunit.client.0.smithi053.stdout:6/814: stat d1/dc/d66/c74 0 2024-09-16T00:50:32.396 INFO:tasks.workunit.client.0.smithi053.stdout:6/815: stat d1/d2f/c3a 0 2024-09-16T00:50:32.400 INFO:tasks.workunit.client.0.smithi053.stdout:9/734: unlink d8/d4c/d5a/d99/dc8/fde 0 2024-09-16T00:50:32.405 INFO:tasks.workunit.client.0.smithi053.stdout:3/829: stat d1/d5/d31/d7a/dbb/cc0 0 2024-09-16T00:50:32.405 INFO:tasks.workunit.client.0.smithi053.stdout:4/580: dwrite d0/d3c/d48/d4d/fa0 [4194304,4194304] 0 2024-09-16T00:50:32.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/816: read d1/dc/d3c/d4b/d58/fa4 [379586,7492] 0 2024-09-16T00:50:32.406 INFO:tasks.workunit.client.0.smithi053.stdout:4/581: dread d0/d31/fb0 [0,4194304] 0 2024-09-16T00:50:32.406 INFO:tasks.workunit.client.0.smithi053.stdout:7/920: mkdir d1/d35/d5b/ddf/d136 0 2024-09-16T00:50:32.408 INFO:tasks.workunit.client.0.smithi053.stdout:9/735: creat d8/d22/d54/dd5/fef x:0 0 0 2024-09-16T00:50:32.408 INFO:tasks.workunit.client.0.smithi053.stdout:0/846: dwrite d4/dc/d25/f5f [0,4194304] 0 2024-09-16T00:50:32.409 INFO:tasks.workunit.client.0.smithi053.stdout:1/757: dwrite d5/de3/f71 [0,4194304] 0 2024-09-16T00:50:32.409 INFO:tasks.workunit.client.0.smithi053.stdout:1/758: read d5/d18/d33/d8a/d98/dd0/f5c [794666,89653] 0 2024-09-16T00:50:32.409 INFO:tasks.workunit.client.0.smithi053.stdout:8/696: rename fb to d10/fe8 0 2024-09-16T00:50:32.416 INFO:tasks.workunit.client.0.smithi053.stdout:9/736: write d8/d19/d31/f71 [1012921,79126] 0 2024-09-16T00:50:32.416 INFO:tasks.workunit.client.0.smithi053.stdout:3/830: truncate d1/d5/d11/da9/db8/dfb/fb9 2863891 0 2024-09-16T00:50:32.417 INFO:tasks.workunit.client.0.smithi053.stdout:6/817: truncate d1/dc/d39/f56 9357602 0 2024-09-16T00:50:32.421 INFO:tasks.workunit.client.0.smithi053.stdout:4/582: symlink d0/d3c/lcf 0 2024-09-16T00:50:32.423 INFO:tasks.workunit.client.0.smithi053.stdout:7/921: mknod d1/d35/d5b/ddf/d136/c137 0 2024-09-16T00:50:32.424 INFO:tasks.workunit.client.0.smithi053.stdout:8/697: dread d10/d21/d28/d3c/f3d [0,4194304] 0 2024-09-16T00:50:32.425 INFO:tasks.workunit.client.0.smithi053.stdout:2/769: dread f0 [0,4194304] 0 2024-09-16T00:50:32.427 INFO:tasks.workunit.client.0.smithi053.stdout:6/818: dread d1/dc/d1e/fc3 [0,4194304] 0 2024-09-16T00:50:32.428 INFO:tasks.workunit.client.0.smithi053.stdout:0/847: unlink d4/d13/ca7 0 2024-09-16T00:50:32.430 INFO:tasks.workunit.client.0.smithi053.stdout:9/737: symlink d8/d22/dc2/lf0 0 2024-09-16T00:50:32.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/770: dread d6/d29/d2b/d39/f9b [0,4194304] 0 2024-09-16T00:50:32.431 INFO:tasks.workunit.client.0.smithi053.stdout:2/771: fsync d6/d9/dd/d3e/d52/f68 0 2024-09-16T00:50:32.437 INFO:tasks.workunit.client.0.smithi053.stdout:3/831: symlink d1/d5/d91/d5e/d69/ddd/l113 0 2024-09-16T00:50:32.437 INFO:tasks.workunit.client.0.smithi053.stdout:3/832: chown d1/d5/d11/l24 221833 1 2024-09-16T00:50:32.438 INFO:tasks.workunit.client.0.smithi053.stdout:7/922: symlink d1/d2a/d83/d84/l138 0 2024-09-16T00:50:32.438 INFO:tasks.workunit.client.0.smithi053.stdout:7/923: dread - d1/d3/df3/f11b zero size 2024-09-16T00:50:32.439 INFO:tasks.workunit.client.0.smithi053.stdout:7/924: write d1/dd9/ffb [339163,69926] 0 2024-09-16T00:50:32.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/583: dwrite d0/da/d42/fce [0,4194304] 0 2024-09-16T00:50:32.441 INFO:tasks.workunit.client.0.smithi053.stdout:8/698: creat d10/d4a/dbf/fe9 x:0 0 0 2024-09-16T00:50:32.442 INFO:tasks.workunit.client.0.smithi053.stdout:7/925: dread d1/d60/d62/f6f [0,4194304] 0 2024-09-16T00:50:32.442 INFO:tasks.workunit.client.0.smithi053.stdout:7/926: creat d1/d60/d77/da9/f139 x:0 0 0 2024-09-16T00:50:32.443 INFO:tasks.workunit.client.0.smithi053.stdout:1/759: dwrite d5/d18/d33/d8a/d98/dd0/f15 [0,4194304] 0 2024-09-16T00:50:32.445 INFO:tasks.workunit.client.0.smithi053.stdout:6/819: unlink d1/dc/d66/f93 0 2024-09-16T00:50:32.445 INFO:tasks.workunit.client.0.smithi053.stdout:6/820: readlink d1/dc/d39/l1a 0 2024-09-16T00:50:32.447 INFO:tasks.workunit.client.0.smithi053.stdout:9/738: rmdir d8/d13/de6 0 2024-09-16T00:50:32.448 INFO:tasks.workunit.client.0.smithi053.stdout:2/772: mknod d6/d29/db7/cf7 0 2024-09-16T00:50:32.459 INFO:tasks.workunit.client.0.smithi053.stdout:5/799: write d3/f32 [368132,74325] 0 2024-09-16T00:50:32.466 INFO:tasks.workunit.client.0.smithi053.stdout:8/699: dwrite d10/d21/f3e [0,4194304] 0 2024-09-16T00:50:32.472 INFO:tasks.workunit.client.0.smithi053.stdout:4/584: unlink d0/da/d42/l7e 0 2024-09-16T00:50:32.472 INFO:tasks.workunit.client.0.smithi053.stdout:5/800: dwrite d3/d7/fdf [0,4194304] 0 2024-09-16T00:50:32.474 INFO:tasks.workunit.client.0.smithi053.stdout:7/927: mknod d1/d102/c13a 0 2024-09-16T00:50:32.475 INFO:tasks.workunit.client.0.smithi053.stdout:1/760: getdents d5/d18/d33/d8a 0 2024-09-16T00:50:32.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/739: unlink d8/d19/ce7 0 2024-09-16T00:50:32.482 INFO:tasks.workunit.client.0.smithi053.stdout:2/773: mkdir d6/d9/dd/df8 0 2024-09-16T00:50:32.483 INFO:tasks.workunit.client.0.smithi053.stdout:2/774: write d6/ff2 [27825,98378] 0 2024-09-16T00:50:32.483 INFO:tasks.workunit.client.0.smithi053.stdout:2/775: stat d6/d9/d14/f9f 0 2024-09-16T00:50:32.484 INFO:tasks.workunit.client.0.smithi053.stdout:3/833: rename d1/d5/la to d1/d5/d91/d5e/d90/da2/l114 0 2024-09-16T00:50:32.484 INFO:tasks.workunit.client.0.smithi053.stdout:3/834: read - d1/d5/d31/d7c/dbf/ff2 zero size 2024-09-16T00:50:32.488 INFO:tasks.workunit.client.0.smithi053.stdout:5/801: write d3/d7/d2b/d4b/d51/fab [3641883,94011] 0 2024-09-16T00:50:32.488 INFO:tasks.workunit.client.0.smithi053.stdout:5/802: dread - d3/d7/d42/fcb zero size 2024-09-16T00:50:32.491 INFO:tasks.workunit.client.0.smithi053.stdout:7/928: mkdir d1/d60/d13b 0 2024-09-16T00:50:32.492 INFO:tasks.workunit.client.0.smithi053.stdout:6/821: write d1/dc/d3c/d4b/d75/fad [2301860,107904] 0 2024-09-16T00:50:32.493 INFO:tasks.workunit.client.0.smithi053.stdout:9/740: creat d8/d19/d51/d6d/d7a/ff1 x:0 0 0 2024-09-16T00:50:32.493 INFO:tasks.workunit.client.0.smithi053.stdout:1/761: dwrite d5/dd/d7f/fb4 [0,4194304] 0 2024-09-16T00:50:32.497 INFO:tasks.workunit.client.0.smithi053.stdout:4/585: dwrite d0/d3c/d48/d4d/d70/f85 [0,4194304] 0 2024-09-16T00:50:32.498 INFO:tasks.workunit.client.0.smithi053.stdout:3/835: creat d1/d5/d91/d5e/d69/f115 x:0 0 0 2024-09-16T00:50:32.500 INFO:tasks.workunit.client.0.smithi053.stdout:8/700: symlink d10/d1c/d92/d66/d9d/da6/lea 0 2024-09-16T00:50:32.502 INFO:tasks.workunit.client.0.smithi053.stdout:5/803: mknod d3/d7/d2b/d4b/d51/ddc/c103 0 2024-09-16T00:50:32.504 INFO:tasks.workunit.client.0.smithi053.stdout:7/929: mknod d1/dd9/c13c 0 2024-09-16T00:50:32.508 INFO:tasks.workunit.client.0.smithi053.stdout:6/822: rename d1/dc/d3c/f70 to d1/dc/d3c/d4a/dec/df5/f10a 0 2024-09-16T00:50:32.508 INFO:tasks.workunit.client.0.smithi053.stdout:6/823: write d1/dc/d1e/d41/dfd/dc6/f104 [408334,21107] 0 2024-09-16T00:50:32.512 INFO:tasks.workunit.client.0.smithi053.stdout:1/762: getdents d5/d9/d77/da8 0 2024-09-16T00:50:32.516 INFO:tasks.workunit.client.0.smithi053.stdout:9/741: dwrite d8/f1f [0,4194304] 0 2024-09-16T00:50:32.518 INFO:tasks.workunit.client.0.smithi053.stdout:5/804: symlink d3/d7/d2b/d37/d58/d9f/dce/l104 0 2024-09-16T00:50:32.518 INFO:tasks.workunit.client.0.smithi053.stdout:5/805: fdatasync d3/f2d 0 2024-09-16T00:50:32.519 INFO:tasks.workunit.client.0.smithi053.stdout:7/930: mknod d1/d35/d14/da7/c13d 0 2024-09-16T00:50:32.523 INFO:tasks.workunit.client.0.smithi053.stdout:3/836: rename d1/d5/d11/da9/db8/dfb/d65/d66/f86 to d1/f116 0 2024-09-16T00:50:32.525 INFO:tasks.workunit.client.0.smithi053.stdout:9/742: creat d8/d4c/d5a/d99/dc8/de8/ff2 x:0 0 0 2024-09-16T00:50:32.525 INFO:tasks.workunit.client.0.smithi053.stdout:9/743: write d8/d22/d54/fd2 [251834,36113] 0 2024-09-16T00:50:32.525 INFO:tasks.workunit.client.0.smithi053.stdout:9/744: write d8/d22/d54/f9a [310201,20575] 0 2024-09-16T00:50:32.527 INFO:tasks.workunit.client.0.smithi053.stdout:1/763: dread d5/d7/d39/f55 [0,4194304] 0 2024-09-16T00:50:32.528 INFO:tasks.workunit.client.0.smithi053.stdout:5/806: getdents d3/d7/d24/d34/d80 0 2024-09-16T00:50:32.529 INFO:tasks.workunit.client.0.smithi053.stdout:5/807: stat d3/d7/d24/d34/d80/l93 0 2024-09-16T00:50:32.531 INFO:tasks.workunit.client.0.smithi053.stdout:4/586: dwrite d0/d3c/d48/d4d/fa0 [4194304,4194304] 0 2024-09-16T00:50:32.533 INFO:tasks.workunit.client.0.smithi053.stdout:7/931: link d1/d35/d14/d15/c24 d1/d60/d77/da9/c13e 0 2024-09-16T00:50:32.534 INFO:tasks.workunit.client.0.smithi053.stdout:6/824: dwrite d1/dc/d1e/d41/f69 [0,4194304] 0 2024-09-16T00:50:32.535 INFO:tasks.workunit.client.0.smithi053.stdout:8/701: dwrite d10/f24 [0,4194304] 0 2024-09-16T00:50:32.537 INFO:tasks.workunit.client.0.smithi053.stdout:3/837: creat d1/d5/d91/d5e/d69/d109/d28/d5a/f117 x:0 0 0 2024-09-16T00:50:32.537 INFO:tasks.workunit.client.0.smithi053.stdout:3/838: fsync d1/d5/d31/f39 0 2024-09-16T00:50:32.537 INFO:tasks.workunit.client.0.smithi053.stdout:3/839: stat d1/d5/d11/da9/db8/dfb/d65/d97/d7f/lea 0 2024-09-16T00:50:32.538 INFO:tasks.workunit.client.0.smithi053.stdout:9/745: creat d8/d19/d51/d6d/d7a/db2/ff3 x:0 0 0 2024-09-16T00:50:32.538 INFO:tasks.workunit.client.0.smithi053.stdout:9/746: write d8/d1c/d2b/d49/f8d [2158512,46288] 0 2024-09-16T00:50:32.543 INFO:tasks.workunit.client.0.smithi053.stdout:8/702: dread d10/d1c/d2b/f72 [0,4194304] 0 2024-09-16T00:50:32.544 INFO:tasks.workunit.client.0.smithi053.stdout:2/776: write d6/d9/dd/f31 [170810,35869] 0 2024-09-16T00:50:32.548 INFO:tasks.workunit.client.0.smithi053.stdout:7/932: creat d1/d60/d77/f13f x:0 0 0 2024-09-16T00:50:32.548 INFO:tasks.workunit.client.0.smithi053.stdout:7/933: write d1/d2a/fb6 [348134,67256] 0 2024-09-16T00:50:32.553 INFO:tasks.workunit.client.0.smithi053.stdout:4/587: dwrite d0/da/fc4 [0,4194304] 0 2024-09-16T00:50:32.559 INFO:tasks.workunit.client.0.smithi053.stdout:3/840: mknod d1/d5/d11/da9/c118 0 2024-09-16T00:50:32.564 INFO:tasks.workunit.client.0.smithi053.stdout:9/747: link d8/d1c/d2b/d8b/fea d8/d19/ff4 0 2024-09-16T00:50:32.566 INFO:tasks.workunit.client.0.smithi053.stdout:6/825: rename d1/dc/c26 to d1/dc/d3d/db1/c10b 0 2024-09-16T00:50:32.567 INFO:tasks.workunit.client.0.smithi053.stdout:6/826: chown d1/dc/d39/cb7 28713 1 2024-09-16T00:50:32.569 INFO:tasks.workunit.client.0.smithi053.stdout:4/588: dwrite d0/da/f3d [0,4194304] 0 2024-09-16T00:50:32.575 INFO:tasks.workunit.client.0.smithi053.stdout:3/841: truncate d1/d5/d11/da9/db8/dfb/f4b 3527905 0 2024-09-16T00:50:32.583 INFO:tasks.workunit.client.0.smithi053.stdout:4/589: symlink d0/d2/d1e/dcc/ld0 0 2024-09-16T00:50:32.583 INFO:tasks.workunit.client.0.smithi053.stdout:9/748: dwrite d8/d1c/d2b/d49/fa1 [0,4194304] 0 2024-09-16T00:50:32.583 INFO:tasks.workunit.client.0.smithi053.stdout:9/749: dread - d8/d1c/d2b/d2c/d9b/fb7 zero size 2024-09-16T00:50:32.587 INFO:tasks.workunit.client.0.smithi053.stdout:3/842: symlink d1/d5/d11/d3a/dc5/l119 0 2024-09-16T00:50:32.587 INFO:tasks.workunit.client.0.smithi053.stdout:3/843: read d1/d5/d91/d5e/d69/fa1 [1112321,78060] 0 2024-09-16T00:50:32.587 INFO:tasks.workunit.client.0.smithi053.stdout:3/844: truncate d1/d5/d91/d5e/d69/d109/fdf 731618 0 2024-09-16T00:50:32.587 INFO:tasks.workunit.client.0.smithi053.stdout:8/703: rename cf to d10/d1c/d2b/d40/ddc/ceb 0 2024-09-16T00:50:32.592 INFO:tasks.workunit.client.0.smithi053.stdout:6/827: mknod d1/dc/d3c/d4b/d58/c10c 0 2024-09-16T00:50:32.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/845: mkdir d1/d5/d91/d5e/d69/d109/d28/d5a/d11a 0 2024-09-16T00:50:32.600 INFO:tasks.workunit.client.0.smithi053.stdout:3/846: dread d1/d5/d91/d5e/d69/d109/f30 [0,4194304] 0 2024-09-16T00:50:32.601 INFO:tasks.workunit.client.0.smithi053.stdout:2/777: rename d6/d9/d14/d81/f9e to d6/d9/dd/d3e/ff9 0 2024-09-16T00:50:32.602 INFO:tasks.workunit.client.0.smithi053.stdout:6/828: getdents d1/dc/d3c/d4b 0 2024-09-16T00:50:32.605 INFO:tasks.workunit.client.0.smithi053.stdout:3/847: unlink d1/d5/d91/d5e/d69/d109/f2d 0 2024-09-16T00:50:32.607 INFO:tasks.workunit.client.0.smithi053.stdout:7/934: rename d1/db5/dce/c103 to d1/db5/c140 0 2024-09-16T00:50:32.607 INFO:tasks.workunit.client.0.smithi053.stdout:9/750: dwrite d8/fb [0,4194304] 0 2024-09-16T00:50:32.607 INFO:tasks.workunit.client.0.smithi053.stdout:8/704: dwrite d10/d1c/d49/f89 [0,4194304] 0 2024-09-16T00:50:32.609 INFO:tasks.workunit.client.0.smithi053.stdout:3/848: mkdir d1/d5/d31/d3b/d9c/d11b 0 2024-09-16T00:50:32.609 INFO:tasks.workunit.client.0.smithi053.stdout:3/849: write d1/d5/d11/d3a/dc6/de8/f10d [792447,38640] 0 2024-09-16T00:50:32.611 INFO:tasks.workunit.client.0.smithi053.stdout:4/590: rename d0/d2/dd/l2f to d0/d3c/d48/d95/ld1 0 2024-09-16T00:50:32.615 INFO:tasks.workunit.client.0.smithi053.stdout:8/705: readlink d10/l13 0 2024-09-16T00:50:32.617 INFO:tasks.workunit.client.0.smithi053.stdout:3/850: write d1/d5/d11/da9/db8/dfb/fb9 [1374512,8334] 0 2024-09-16T00:50:32.617 INFO:tasks.workunit.client.0.smithi053.stdout:2/778: write d6/d29/d2b/f99 [4078735,103102] 0 2024-09-16T00:50:32.617 INFO:tasks.workunit.client.0.smithi053.stdout:2/779: stat d6/d29/f9a 0 2024-09-16T00:50:32.617 INFO:tasks.workunit.client.0.smithi053.stdout:2/780: dread - d6/d9/dd/d3e/d72/ff0 zero size 2024-09-16T00:50:32.618 INFO:tasks.workunit.client.0.smithi053.stdout:7/935: rename d1/d2a/d4f/ca6 to d1/d35/d4a/dbb/ddc/d105/c141 0 2024-09-16T00:50:32.619 INFO:tasks.workunit.client.0.smithi053.stdout:4/591: mkdir d0/d2/dd2 0 2024-09-16T00:50:32.621 INFO:tasks.workunit.client.0.smithi053.stdout:3/851: truncate d1/d5/d91/d5e/d69/d109/f18 6036075 0 2024-09-16T00:50:32.622 INFO:tasks.workunit.client.0.smithi053.stdout:3/852: read d1/d5/d31/d7a/dbb/f9a [750889,15927] 0 2024-09-16T00:50:32.624 INFO:tasks.workunit.client.0.smithi053.stdout:7/936: mknod d1/d102/d12e/c142 0 2024-09-16T00:50:32.626 INFO:tasks.workunit.client.0.smithi053.stdout:2/781: rename d6/d9/dd/d3e/d52/d65/cc1 to d6/d9/dd/dbb/cfa 0 2024-09-16T00:50:32.626 INFO:tasks.workunit.client.0.smithi053.stdout:4/592: truncate d0/da/d42/fce 1533707 0 2024-09-16T00:50:32.628 INFO:tasks.workunit.client.0.smithi053.stdout:3/853: link d1/d5/d91/l43 d1/d5/d31/d7c/dbf/dcd/de6/l11c 0 2024-09-16T00:50:32.628 INFO:tasks.workunit.client.0.smithi053.stdout:3/854: fdatasync d1/f6f 0 2024-09-16T00:50:32.629 INFO:tasks.workunit.client.0.smithi053.stdout:4/593: mknod d0/da/cd3 0 2024-09-16T00:50:32.630 INFO:tasks.workunit.client.0.smithi053.stdout:3/855: mkdir d1/d5/d11/da9/db8/d11d 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:3/856: read - d1/d5/d91/d5e/d69/d109/d28/d5a/fca zero size 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:3/857: dread - d1/d5/d31/d7c/dbf/ff2 zero size 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:3/858: creat d1/d5/d31/d3b/d9c/f11e x:0 0 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:9/751: dwrite d8/d19/d51/d6d/d7a/faf [0,4194304] 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:9/752: creat d8/d4c/d5a/d99/dc8/de8/ff5 x:0 0 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:6/829: dwrite d1/dc/d1e/f8d [0,4194304] 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:6/830: stat d1/dc/d3d/cf9 0 2024-09-16T00:50:32.631 INFO:tasks.workunit.client.0.smithi053.stdout:6/831: rename d1/dc to d1/dc/d1e/d41/d10d 22 2024-09-16T00:50:32.632 INFO:tasks.workunit.client.0.smithi053.stdout:7/937: truncate d1/d2a/d83/dcc/f104 3010751 0 2024-09-16T00:50:32.634 INFO:tasks.workunit.client.0.smithi053.stdout:2/782: write d6/d29/fab [708466,58050] 0 2024-09-16T00:50:32.635 INFO:tasks.workunit.client.0.smithi053.stdout:2/783: read - d6/d9/dd/d3e/d52/d65/d92/fa6 zero size 2024-09-16T00:50:32.641 INFO:tasks.workunit.client.0.smithi053.stdout:3/859: link d1/d5/d11/da9/db8/l107 d1/l11f 0 2024-09-16T00:50:32.643 INFO:tasks.workunit.client.0.smithi053.stdout:4/594: dwrite d0/d3c/d48/faf [0,4194304] 0 2024-09-16T00:50:32.644 INFO:tasks.workunit.client.0.smithi053.stdout:9/753: mkdir d8/d4c/d5a/d99/dc8/df6 0 2024-09-16T00:50:32.648 INFO:tasks.workunit.client.0.smithi053.stdout:7/938: rename d1/f36 to d1/dd9/d119/f143 0 2024-09-16T00:50:32.649 INFO:tasks.workunit.client.0.smithi053.stdout:6/832: dwrite d1/dc/d39/fa8 [0,4194304] 0 2024-09-16T00:50:32.649 INFO:tasks.workunit.client.0.smithi053.stdout:6/833: write d1/dc/d3c/fe3 [472918,66111] 0 2024-09-16T00:50:32.659 INFO:tasks.workunit.client.0.smithi053.stdout:4/595: mknod d0/d2/dd/d25/d37/dc5/cd4 0 2024-09-16T00:50:32.660 INFO:tasks.workunit.client.0.smithi053.stdout:4/596: fdatasync d0/d31/f81 0 2024-09-16T00:50:32.660 INFO:tasks.workunit.client.0.smithi053.stdout:4/597: fdatasync d0/d2/d1e/d4b/f57 0 2024-09-16T00:50:32.661 INFO:tasks.workunit.client.0.smithi053.stdout:9/754: getdents d8/d19/d31 0 2024-09-16T00:50:32.661 INFO:tasks.workunit.client.0.smithi053.stdout:9/755: chown d8/d19/d31/f71 47667 1 2024-09-16T00:50:32.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/756: write d8/d19/ff4 [626574,120656] 0 2024-09-16T00:50:32.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/757: fdatasync d8/fc7 0 2024-09-16T00:50:32.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/758: write d8/d22/d26/f6f [760547,114199] 0 2024-09-16T00:50:32.668 INFO:tasks.workunit.client.0.smithi053.stdout:3/860: rename d1/d5/d91/d5e/lf3 to d1/d5/d11/da9/db8/l120 0 2024-09-16T00:50:32.668 INFO:tasks.workunit.client.0.smithi053.stdout:3/861: chown d1/d5/d91/d5e/d69/ddd/d106 1420 1 2024-09-16T00:50:32.671 INFO:tasks.workunit.client.0.smithi053.stdout:6/834: dwrite d1/dc/d3d/f8c [4194304,4194304] 0 2024-09-16T00:50:32.671 INFO:tasks.workunit.client.0.smithi053.stdout:7/939: unlink d1/d2a/d83/d84/db1/cd3 0 2024-09-16T00:50:32.683 INFO:tasks.workunit.client.0.smithi053.stdout:2/784: dwrite d6/d9/f49 [0,4194304] 0 2024-09-16T00:50:32.684 INFO:tasks.workunit.client.0.smithi053.stdout:3/862: dwrite d1/d5/d31/d7c/ff8 [0,4194304] 0 2024-09-16T00:50:32.684 INFO:tasks.workunit.client.0.smithi053.stdout:3/863: stat d1/d5/d11/da9/db8/dfb/fcf 0 2024-09-16T00:50:32.711 INFO:tasks.workunit.client.0.smithi053.stdout:4/598: truncate d0/d3c/d48/faf 70720 0 2024-09-16T00:50:32.714 INFO:tasks.workunit.client.0.smithi053.stdout:2/785: rmdir d6/d9/dd/d3e 39 2024-09-16T00:50:32.718 INFO:tasks.workunit.client.0.smithi053.stdout:3/864: mkdir d1/d5/d31/d7c/dbf/dcd/d121 0 2024-09-16T00:50:32.719 INFO:tasks.workunit.client.0.smithi053.stdout:6/835: mknod d1/dc/d3c/d4b/d58/c10e 0 2024-09-16T00:50:32.723 INFO:tasks.workunit.client.0.smithi053.stdout:4/599: rename d0/d2/da1 to d0/da/dd5 0 2024-09-16T00:50:32.727 INFO:tasks.workunit.client.0.smithi053.stdout:2/786: creat d6/d9/dd/d3e/ffb x:0 0 0 2024-09-16T00:50:32.727 INFO:tasks.workunit.client.0.smithi053.stdout:2/787: dread - d6/d9/d74/ff3 zero size 2024-09-16T00:50:32.727 INFO:tasks.workunit.client.0.smithi053.stdout:2/788: fdatasync d6/d9/dd/d3e/d72/d75/fee 0 2024-09-16T00:50:32.729 INFO:tasks.workunit.client.0.smithi053.stdout:6/836: mkdir d1/dc/d3c/d4a/dec/d10f 0 2024-09-16T00:50:32.729 INFO:tasks.workunit.client.0.smithi053.stdout:6/837: truncate d1/dc/feb 584165 0 2024-09-16T00:50:32.731 INFO:tasks.workunit.client.0.smithi053.stdout:7/940: rmdir d1/d60/d70/d92/da1 0 2024-09-16T00:50:32.733 INFO:tasks.workunit.client.0.smithi053.stdout:2/789: getdents d6/d29/d2b/d39 0 2024-09-16T00:50:32.734 INFO:tasks.workunit.client.0.smithi053.stdout:6/838: unlink d1/dc/d3d/db1/c109 0 2024-09-16T00:50:32.737 INFO:tasks.workunit.client.0.smithi053.stdout:6/839: mknod d1/dc/d54/c110 0 2024-09-16T00:50:32.743 INFO:tasks.workunit.client.0.smithi053.stdout:6/840: dread d1/dc/d45/f76 [0,4194304] 0 2024-09-16T00:50:32.743 INFO:tasks.workunit.client.0.smithi053.stdout:3/865: dwrite d1/d5/d91/d5e/d69/d109/d28/ffe [0,4194304] 0 2024-09-16T00:50:32.743 INFO:tasks.workunit.client.0.smithi053.stdout:3/866: chown d1/d5/d91/d5e/d69/fa1 40256926 1 2024-09-16T00:50:32.744 INFO:tasks.workunit.client.0.smithi053.stdout:3/867: chown d1/d5/d91/d5e/d90 2099009373 1 2024-09-16T00:50:32.744 INFO:tasks.workunit.client.0.smithi053.stdout:6/841: write d1/dc/d3c/d4b/fb2 [1583681,100834] 0 2024-09-16T00:50:32.744 INFO:tasks.workunit.client.0.smithi053.stdout:6/842: fdatasync d1/dc/d66/fc2 0 2024-09-16T00:50:32.744 INFO:tasks.workunit.client.0.smithi053.stdout:4/600: dwrite d0/d31/fb0 [0,4194304] 0 2024-09-16T00:50:32.748 INFO:tasks.workunit.client.0.smithi053.stdout:3/868: stat d1/d5/d91/d5e/d69/d109/cf7 0 2024-09-16T00:50:32.748 INFO:tasks.workunit.client.0.smithi053.stdout:3/869: truncate d1/d5/d11/da9/db8/dfb/d65/d97/da4/f10f 892976 0 2024-09-16T00:50:32.748 INFO:tasks.workunit.client.0.smithi053.stdout:3/870: stat d1/d5/d31/d7c/dbf/dcd 0 2024-09-16T00:50:32.749 INFO:tasks.workunit.client.0.smithi053.stdout:6/843: mknod d1/dc/d54/dd1/de5/c111 0 2024-09-16T00:50:32.752 INFO:tasks.workunit.client.0.smithi053.stdout:6/844: dread d1/dc/d3c/d4b/f73 [0,4194304] 0 2024-09-16T00:50:32.753 INFO:tasks.workunit.client.0.smithi053.stdout:7/941: dwrite d1/d35/d14/d15/f5a [0,4194304] 0 2024-09-16T00:50:32.754 INFO:tasks.workunit.client.0.smithi053.stdout:2/790: dwrite d6/d9/dd/f3a [0,4194304] 0 2024-09-16T00:50:32.756 INFO:tasks.workunit.client.0.smithi053.stdout:4/601: unlink d0/d2/dd/d25/d41/fa9 0 2024-09-16T00:50:32.757 INFO:tasks.workunit.client.0.smithi053.stdout:4/602: write d0/da/f69 [422146,2472] 0 2024-09-16T00:50:32.761 INFO:tasks.workunit.client.0.smithi053.stdout:3/871: symlink d1/d5/d11/da9/db8/dfb/d65/d97/da4/l122 0 2024-09-16T00:50:32.762 INFO:tasks.workunit.client.0.smithi053.stdout:4/603: dread d0/da/f69 [0,4194304] 0 2024-09-16T00:50:32.762 INFO:tasks.workunit.client.0.smithi053.stdout:6/845: mkdir d1/dc/d1e/d41/dfd/dc6/d112 0 2024-09-16T00:50:32.769 INFO:tasks.workunit.client.0.smithi053.stdout:7/942: dwrite d1/d35/fff [0,4194304] 0 2024-09-16T00:50:32.769 INFO:tasks.workunit.client.0.smithi053.stdout:2/791: unlink d6/d9/f49 0 2024-09-16T00:50:32.769 INFO:tasks.workunit.client.0.smithi053.stdout:2/792: creat d6/ffc x:0 0 0 2024-09-16T00:50:32.770 INFO:tasks.workunit.client.0.smithi053.stdout:3/872: truncate d1/d5/d11/d3a/f67 87589 0 2024-09-16T00:50:32.772 INFO:tasks.workunit.client.0.smithi053.stdout:4/604: mkdir d0/d2/dd/d25/d41/d78/dd6 0 2024-09-16T00:50:32.773 INFO:tasks.workunit.client.0.smithi053.stdout:6/846: rename d1/dc/d45/c77 to d1/da6/dea/c113 0 2024-09-16T00:50:32.777 INFO:tasks.workunit.client.0.smithi053.stdout:7/943: creat d1/d35/d14/da7/f144 x:0 0 0 2024-09-16T00:50:32.781 INFO:tasks.workunit.client.0.smithi053.stdout:2/793: mkdir d6/d29/d2b/d39/dfd 0 2024-09-16T00:50:32.783 INFO:tasks.workunit.client.0.smithi053.stdout:3/873: mkdir d1/d5/d31/d7c/dbf/dcd/d121/d123 0 2024-09-16T00:50:32.785 INFO:tasks.workunit.client.0.smithi053.stdout:4/605: creat d0/d2/dd/d25/d39/dca/fd7 x:0 0 0 2024-09-16T00:50:32.786 INFO:tasks.workunit.client.0.smithi053.stdout:4/606: write d0/da/fa5 [888890,8179] 0 2024-09-16T00:50:32.786 INFO:tasks.workunit.client.0.smithi053.stdout:4/607: chown d0/d31/f77 2865204 1 2024-09-16T00:50:32.786 INFO:tasks.workunit.client.0.smithi053.stdout:6/847: symlink d1/dc/d54/dd1/de5/l114 0 2024-09-16T00:50:32.790 INFO:tasks.workunit.client.0.smithi053.stdout:7/944: rename d1/d35/d4a/c5c to d1/d35/d5b/d93/d116/c145 0 2024-09-16T00:50:32.790 INFO:tasks.workunit.client.0.smithi053.stdout:7/945: chown d1/d35/d14/d15/l2b 31760 1 2024-09-16T00:50:32.790 INFO:tasks.workunit.client.0.smithi053.stdout:7/946: write d1/d2a/f82 [783850,52408] 0 2024-09-16T00:50:32.792 INFO:tasks.workunit.client.0.smithi053.stdout:2/794: mkdir d6/d9/dd/df8/dfe 0 2024-09-16T00:50:32.793 INFO:tasks.workunit.client.0.smithi053.stdout:2/795: fdatasync d6/d9/dd/d3e/d72/d75/fc2 0 2024-09-16T00:50:32.794 INFO:tasks.workunit.client.0.smithi053.stdout:3/874: mkdir d1/d5/d11/da9/db8/dfb/d65/d97/da4/d124 0 2024-09-16T00:50:32.795 INFO:tasks.workunit.client.0.smithi053.stdout:4/608: rmdir d0/d2/d1e/d4b 39 2024-09-16T00:50:32.797 INFO:tasks.workunit.client.0.smithi053.stdout:7/947: symlink d1/d3/dda/l146 0 2024-09-16T00:50:32.799 INFO:tasks.workunit.client.0.smithi053.stdout:2/796: mknod d6/d9/dd/d76/cff 0 2024-09-16T00:50:32.804 INFO:tasks.workunit.client.0.smithi053.stdout:3/875: rename d1/d5/d91/d5e/d69/d109/cf7 to d1/d5/d11/da9/c125 0 2024-09-16T00:50:32.805 INFO:tasks.workunit.client.0.smithi053.stdout:6/848: dwrite d1/dc/d45/fc7 [0,4194304] 0 2024-09-16T00:50:32.806 INFO:tasks.workunit.client.0.smithi053.stdout:2/797: truncate d6/d29/d2b/d39/f40 1406834 0 2024-09-16T00:50:32.809 INFO:tasks.workunit.client.0.smithi053.stdout:4/609: rename d0/d2/dd/f13 to d0/d31/d98/fd8 0 2024-09-16T00:50:32.810 INFO:tasks.workunit.client.0.smithi053.stdout:3/876: creat d1/d5/d91/d5e/d69/d109/d28/f126 x:0 0 0 2024-09-16T00:50:32.820 INFO:tasks.workunit.client.0.smithi053.stdout:2/798: write d6/f7 [2777336,121219] 0 2024-09-16T00:50:32.821 INFO:tasks.workunit.client.0.smithi053.stdout:2/799: truncate d6/dae/fb3 1017214 0 2024-09-16T00:50:32.821 INFO:tasks.workunit.client.0.smithi053.stdout:2/800: fdatasync d6/f6c 0 2024-09-16T00:50:32.825 INFO:tasks.workunit.client.0.smithi053.stdout:4/610: link d0/d2/lb d0/da/dd5/ld9 0 2024-09-16T00:50:32.825 INFO:tasks.workunit.client.0.smithi053.stdout:4/611: creat d0/d3c/d48/d95/fda x:0 0 0 2024-09-16T00:50:32.826 INFO:tasks.workunit.client.0.smithi053.stdout:4/612: dread d0/da/f69 [0,4194304] 0 2024-09-16T00:50:32.827 INFO:tasks.workunit.client.0.smithi053.stdout:7/948: rename d1/f3f to d1/d3/f147 0 2024-09-16T00:50:32.829 INFO:tasks.workunit.client.0.smithi053.stdout:6/849: dwrite d1/dc/d39/f89 [4194304,4194304] 0 2024-09-16T00:50:32.830 INFO:tasks.workunit.client.0.smithi053.stdout:3/877: dwrite d1/d5/d31/d3b/f111 [0,4194304] 0 2024-09-16T00:50:32.831 INFO:tasks.workunit.client.0.smithi053.stdout:2/801: symlink d6/d9/dd/df8/dfe/l100 0 2024-09-16T00:50:32.837 INFO:tasks.workunit.client.0.smithi053.stdout:4/613: read d0/d2/d1e/d4b/f57 [1650175,48880] 0 2024-09-16T00:50:32.851 INFO:tasks.workunit.client.0.smithi053.stdout:6/850: dwrite d1/dc/d39/f13 [0,4194304] 0 2024-09-16T00:50:32.851 INFO:tasks.workunit.client.0.smithi053.stdout:6/851: creat d1/dc/d3d/f115 x:0 0 0 2024-09-16T00:50:32.863 INFO:tasks.workunit.client.0.smithi053.stdout:3/878: readlink d1/d5/lb1 0 2024-09-16T00:50:32.863 INFO:tasks.workunit.client.0.smithi053.stdout:3/879: fsync d1/d5/d11/f95 0 2024-09-16T00:50:32.865 INFO:tasks.workunit.client.0.smithi053.stdout:2/802: link d6/d9/d74/ce8 d6/d29/db7/c101 0 2024-09-16T00:50:32.871 INFO:tasks.workunit.client.0.smithi053.stdout:4/614: rename d0/d2/dd2 to d0/d2/dd/d25/d39/dca/ddb 0 2024-09-16T00:50:32.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/949: rmdir d1/d2a/d4f 39 2024-09-16T00:50:32.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/950: dread - d1/d60/d62/df8/f129 zero size 2024-09-16T00:50:32.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/951: read - d1/d35/d4a/dbb/ddc/fe7 zero size 2024-09-16T00:50:32.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/952: chown d1/d3/fde 37966 1 2024-09-16T00:50:32.874 INFO:tasks.workunit.client.0.smithi053.stdout:7/953: truncate d1/d35/d14/da7/f144 843776 0 2024-09-16T00:50:32.878 INFO:tasks.workunit.client.0.smithi053.stdout:6/852: mkdir d1/dc/d45/d116 0 2024-09-16T00:50:32.878 INFO:tasks.workunit.client.0.smithi053.stdout:6/853: chown d1/dc/d43/c68 174781 1 2024-09-16T00:50:32.878 INFO:tasks.workunit.client.0.smithi053.stdout:6/854: chown d1/dc/d1e/d41/dfd/d81/fe4 15224135 1 2024-09-16T00:50:32.879 INFO:tasks.workunit.client.0.smithi053.stdout:4/615: write d0/d2/dd/d25/f5b [1214726,74170] 0 2024-09-16T00:50:32.879 INFO:tasks.workunit.client.0.smithi053.stdout:4/616: chown d0/d2/dd/d25/d41/d78/l6b 18 1 2024-09-16T00:50:32.881 INFO:tasks.workunit.client.0.smithi053.stdout:7/954: unlink d1/d60/d70/d92/l10b 0 2024-09-16T00:50:32.881 INFO:tasks.workunit.client.0.smithi053.stdout:7/955: dread - d1/d60/d77/da9/f139 zero size 2024-09-16T00:50:32.881 INFO:tasks.workunit.client.0.smithi053.stdout:7/956: chown d1/d35/d5b/ddf/f10d 59366 1 2024-09-16T00:50:32.883 INFO:tasks.workunit.client.0.smithi053.stdout:6/855: mknod d1/d2f/c117 0 2024-09-16T00:50:32.896 INFO:tasks.workunit.client.0.smithi053.stdout:7/957: read d1/f3a [2416790,45233] 0 2024-09-16T00:50:32.896 INFO:tasks.workunit.client.0.smithi053.stdout:7/958: write d1/d60/d62/f6f [821005,125704] 0 2024-09-16T00:50:32.899 INFO:tasks.workunit.client.0.smithi053.stdout:6/856: write d1/dc/d1e/f8d [2783394,21479] 0 2024-09-16T00:50:32.899 INFO:tasks.workunit.client.0.smithi053.stdout:3/880: dwrite d1/d5/d31/d3b/f111 [0,4194304] 0 2024-09-16T00:50:32.900 INFO:tasks.workunit.client.0.smithi053.stdout:6/857: chown d1/dc/d3c/d4b/d58/db9/fe0 74 1 2024-09-16T00:50:32.900 INFO:tasks.workunit.client.0.smithi053.stdout:3/881: write d1/d5/d91/d5e/d69/ddd/f104 [992805,108603] 0 2024-09-16T00:50:32.900 INFO:tasks.workunit.client.0.smithi053.stdout:2/803: dwrite d6/d9/dd/f6d [4194304,4194304] 0 2024-09-16T00:50:32.901 INFO:tasks.workunit.client.0.smithi053.stdout:4/617: dwrite d0/d2/dd/d25/f24 [4194304,4194304] 0 2024-09-16T00:50:32.902 INFO:tasks.workunit.client.0.smithi053.stdout:6/858: truncate d1/dc/d1e/d41/dfd/dc6/fd3 59957 0 2024-09-16T00:50:32.907 INFO:tasks.workunit.client.0.smithi053.stdout:7/959: read d1/d2a/d83/dcc/ff5 [2308264,39330] 0 2024-09-16T00:50:32.907 INFO:tasks.workunit.client.0.smithi053.stdout:7/960: creat d1/d2a/d83/d84/f148 x:0 0 0 2024-09-16T00:50:32.907 INFO:tasks.workunit.client.0.smithi053.stdout:7/961: chown d1/d102/d12e 87 1 2024-09-16T00:50:32.907 INFO:tasks.workunit.client.0.smithi053.stdout:7/962: creat d1/d3/de9/f149 x:0 0 0 2024-09-16T00:50:32.907 INFO:tasks.workunit.client.0.smithi053.stdout:7/963: write d1/d2a/d4f/f81 [1213426,43202] 0 2024-09-16T00:50:32.908 INFO:tasks.workunit.client.0.smithi053.stdout:7/964: readlink d1/lb0 0 2024-09-16T00:50:32.910 INFO:tasks.workunit.client.0.smithi053.stdout:4/618: write d0/da/fc4 [3589769,9617] 0 2024-09-16T00:50:32.913 INFO:tasks.workunit.client.0.smithi053.stdout:3/882: dread d1/d5/d11/f55 [0,4194304] 0 2024-09-16T00:50:32.919 INFO:tasks.workunit.client.0.smithi053.stdout:4/619: mknod d0/d65/cdc 0 2024-09-16T00:50:32.921 INFO:tasks.workunit.client.0.smithi053.stdout:6/859: getdents d1/dc/d3d/db1 0 2024-09-16T00:50:32.923 INFO:tasks.workunit.client.0.smithi053.stdout:3/883: creat d1/d5/d31/d7a/dbb/f127 x:0 0 0 2024-09-16T00:50:32.927 INFO:tasks.workunit.client.0.smithi053.stdout:2/804: dwrite d6/f32 [0,4194304] 0 2024-09-16T00:50:32.928 INFO:tasks.workunit.client.0.smithi053.stdout:7/965: dwrite d1/d3/f10f [0,4194304] 0 2024-09-16T00:50:32.928 INFO:tasks.workunit.client.0.smithi053.stdout:4/620: symlink d0/d2/dd/d25/d41/d78/ldd 0 2024-09-16T00:50:32.928 INFO:tasks.workunit.client.0.smithi053.stdout:4/621: chown d0/da 683841 1 2024-09-16T00:50:32.930 INFO:tasks.workunit.client.0.smithi053.stdout:2/805: mkdir d6/d29/d2b/d39/df5/d102 0 2024-09-16T00:50:32.945 INFO:tasks.workunit.client.0.smithi053.stdout:3/884: dwrite d1/d5/d11/da9/db8/dfb/f5d [0,4194304] 0 2024-09-16T00:50:32.946 INFO:tasks.workunit.client.0.smithi053.stdout:7/966: symlink d1/l14a 0 2024-09-16T00:50:32.946 INFO:tasks.workunit.client.0.smithi053.stdout:7/967: creat d1/d3/dc1/f14b x:0 0 0 2024-09-16T00:50:32.946 INFO:tasks.workunit.client.0.smithi053.stdout:7/968: write d1/d3/de9/f131 [1020202,96688] 0 2024-09-16T00:50:32.946 INFO:tasks.workunit.client.0.smithi053.stdout:7/969: fdatasync d1/d60/d62/fc9 0 2024-09-16T00:50:32.951 INFO:tasks.workunit.client.0.smithi053.stdout:6/860: getdents d1/dc/d3c/ddd 0 2024-09-16T00:50:32.951 INFO:tasks.workunit.client.0.smithi053.stdout:6/861: chown d1/dc/d3c/d4a 3877273 1 2024-09-16T00:50:32.952 INFO:tasks.workunit.client.0.smithi053.stdout:0/848: sync 2024-09-16T00:50:32.955 INFO:tasks.workunit.client.0.smithi053.stdout:5/808: sync 2024-09-16T00:50:32.955 INFO:tasks.workunit.client.0.smithi053.stdout:9/759: sync 2024-09-16T00:50:32.955 INFO:tasks.workunit.client.0.smithi053.stdout:1/764: sync 2024-09-16T00:50:32.959 INFO:tasks.workunit.client.0.smithi053.stdout:8/706: sync 2024-09-16T00:50:32.959 INFO:tasks.workunit.client.0.smithi053.stdout:8/707: fsync d10/d21/d28/d3c/d63/fab 0 2024-09-16T00:50:32.964 INFO:tasks.workunit.client.0.smithi053.stdout:5/809: write d3/d7/d42/d57/fa8 [8230075,78993] 0 2024-09-16T00:50:32.965 INFO:tasks.workunit.client.0.smithi053.stdout:4/622: getdents d0/d2/dd/d25/d41 0 2024-09-16T00:50:32.966 INFO:tasks.workunit.client.0.smithi053.stdout:5/810: write d3/fd3 [265043,83584] 0 2024-09-16T00:50:32.966 INFO:tasks.workunit.client.0.smithi053.stdout:5/811: dread - d3/d7/d2b/d37/d58/d79/fd6 zero size 2024-09-16T00:50:32.968 INFO:tasks.workunit.client.0.smithi053.stdout:2/806: mkdir d6/d9/d103 0 2024-09-16T00:50:32.970 INFO:tasks.workunit.client.0.smithi053.stdout:6/862: dwrite d1/dc/d3c/d4b/fb2 [0,4194304] 0 2024-09-16T00:50:32.970 INFO:tasks.workunit.client.0.smithi053.stdout:6/863: read - d1/d90/ff8 zero size 2024-09-16T00:50:32.970 INFO:tasks.workunit.client.0.smithi053.stdout:9/760: dwrite d8/f30 [0,4194304] 0 2024-09-16T00:50:32.971 INFO:tasks.workunit.client.0.smithi053.stdout:0/849: creat d4/dc/d1e/dfc/f111 x:0 0 0 2024-09-16T00:50:32.972 INFO:tasks.workunit.client.0.smithi053.stdout:1/765: mknod d5/cfc 0 2024-09-16T00:50:32.976 INFO:tasks.workunit.client.0.smithi053.stdout:8/708: mkdir d10/d4a/dac/dec 0 2024-09-16T00:50:32.979 INFO:tasks.workunit.client.0.smithi053.stdout:3/885: getdents d1/d5/d31/d3b 0 2024-09-16T00:50:32.983 INFO:tasks.workunit.client.0.smithi053.stdout:4/623: rename d0/d2/dd/d25/d41/d78/ldd to d0/da/d7c/lde 0 2024-09-16T00:50:32.983 INFO:tasks.workunit.client.0.smithi053.stdout:4/624: chown d0/d2/dd/d25/d41/d78/dac 2199161 1 2024-09-16T00:50:32.983 INFO:tasks.workunit.client.0.smithi053.stdout:5/812: getdents d3/d7/d24/d34/d5b 0 2024-09-16T00:50:32.984 INFO:tasks.workunit.client.0.smithi053.stdout:5/813: chown d3/fb5 18285413 1 2024-09-16T00:50:32.985 INFO:tasks.workunit.client.0.smithi053.stdout:9/761: dwrite d8/d1c/d2b/f96 [0,4194304] 0 2024-09-16T00:50:32.985 INFO:tasks.workunit.client.0.smithi053.stdout:2/807: creat d6/d29/d2b/d39/df5/d102/f104 x:0 0 0 2024-09-16T00:50:32.985 INFO:tasks.workunit.client.0.smithi053.stdout:2/808: chown d6/d29/d2b/f82 539133 1 2024-09-16T00:50:32.991 INFO:tasks.workunit.client.0.smithi053.stdout:0/850: creat d4/dc/d1e/d1f/f112 x:0 0 0 2024-09-16T00:50:32.994 INFO:tasks.workunit.client.0.smithi053.stdout:3/886: unlink d1/d5/d11/da9/db8/dfb/d65/d97/da4/f10f 0 2024-09-16T00:50:32.994 INFO:tasks.workunit.client.0.smithi053.stdout:3/887: write d1/d5/d11/da9/db8/dfb/fb9 [3525922,28669] 0 2024-09-16T00:50:32.998 INFO:tasks.workunit.client.0.smithi053.stdout:2/809: creat d6/d29/d2b/d39/f105 x:0 0 0 2024-09-16T00:50:32.998 INFO:tasks.workunit.client.0.smithi053.stdout:2/810: read - d6/d9/dd/d28/f3f zero size 2024-09-16T00:50:32.999 INFO:tasks.workunit.client.0.smithi053.stdout:2/811: read - d6/d9/dd/d3e/d52/d65/fde zero size 2024-09-16T00:50:32.999 INFO:tasks.workunit.client.0.smithi053.stdout:6/864: rename d1/dc/d3c/d4a/dec/df5/l107 to d1/dc/d3c/d4b/d75/dd6/l118 0 2024-09-16T00:50:32.999 INFO:tasks.workunit.client.0.smithi053.stdout:6/865: read - d1/dc/d3c/d4b/d58/db9/fe0 zero size 2024-09-16T00:50:33.002 INFO:tasks.workunit.client.0.smithi053.stdout:0/851: creat d4/dc/d1e/f113 x:0 0 0 2024-09-16T00:50:33.002 INFO:tasks.workunit.client.0.smithi053.stdout:2/812: dread d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:33.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/625: rmdir d0/d3c/d48/d58 39 2024-09-16T00:50:33.002 INFO:tasks.workunit.client.0.smithi053.stdout:4/626: chown d0/d3c/d48/d58/c8d 0 1 2024-09-16T00:50:33.004 INFO:tasks.workunit.client.0.smithi053.stdout:0/852: mknod d4/dc/c114 0 2024-09-16T00:50:33.005 INFO:tasks.workunit.client.0.smithi053.stdout:2/813: mknod d6/d9/db6/dbc/c106 0 2024-09-16T00:50:33.006 INFO:tasks.workunit.client.0.smithi053.stdout:0/853: mknod d4/dc/d87/dc6/c115 0 2024-09-16T00:50:33.008 INFO:tasks.workunit.client.0.smithi053.stdout:2/814: rename d6/d29/d2b/c54 to d6/d29/d2b/d39/c107 0 2024-09-16T00:50:33.008 INFO:tasks.workunit.client.0.smithi053.stdout:2/815: write d6/d29/d2b/f99 [2987963,86754] 0 2024-09-16T00:50:33.008 INFO:tasks.workunit.client.0.smithi053.stdout:2/816: mkdir d6/db1/d108 0 2024-09-16T00:50:33.009 INFO:tasks.workunit.client.0.smithi053.stdout:2/817: chown d6/d9/dd/d28/l6a 167186 1 2024-09-16T00:50:33.009 INFO:tasks.workunit.client.0.smithi053.stdout:2/818: write d6/d29/d2b/dd0/feb [289398,102752] 0 2024-09-16T00:50:33.009 INFO:tasks.workunit.client.0.smithi053.stdout:2/819: creat d6/d9/d14/f109 x:0 0 0 2024-09-16T00:50:33.009 INFO:tasks.workunit.client.0.smithi053.stdout:2/820: stat d6/d9/d14/f37 0 2024-09-16T00:50:33.010 INFO:tasks.workunit.client.0.smithi053.stdout:2/821: dread d6/f6c [0,4194304] 0 2024-09-16T00:50:33.010 INFO:tasks.workunit.client.0.smithi053.stdout:2/822: readlink d6/d9/dd/d3e/l4d 0 2024-09-16T00:50:33.010 INFO:tasks.workunit.client.0.smithi053.stdout:2/823: creat d6/d9/dd/d3e/d52/d65/f10a x:0 0 0 2024-09-16T00:50:33.012 INFO:tasks.workunit.client.0.smithi053.stdout:2/824: unlink d6/d90/fd3 0 2024-09-16T00:50:33.012 INFO:tasks.workunit.client.0.smithi053.stdout:4/627: dread d0/d2/d1e/d4b/f62 [0,4194304] 0 2024-09-16T00:50:33.017 INFO:tasks.workunit.client.0.smithi053.stdout:6/866: dwrite d1/dc/d1e/d41/dfd/d81/fe4 [0,4194304] 0 2024-09-16T00:50:33.017 INFO:tasks.workunit.client.0.smithi053.stdout:6/867: dread - d1/dc/f99 zero size 2024-09-16T00:50:33.020 INFO:tasks.workunit.client.0.smithi053.stdout:0/854: dread d4/dc/d1e/d22/fba [0,4194304] 0 2024-09-16T00:50:33.031 INFO:tasks.workunit.client.0.smithi053.stdout:5/814: dread d3/d7/f2a [0,4194304] 0 2024-09-16T00:50:33.031 INFO:tasks.workunit.client.0.smithi053.stdout:5/815: chown d3/d7/d24/d3f/l72 323229 1 2024-09-16T00:50:33.031 INFO:tasks.workunit.client.0.smithi053.stdout:5/816: creat d3/d7/d2b/d37/d58/f105 x:0 0 0 2024-09-16T00:50:33.031 INFO:tasks.workunit.client.0.smithi053.stdout:5/817: dread - d3/d9c/fe3 zero size 2024-09-16T00:50:33.032 INFO:tasks.workunit.client.0.smithi053.stdout:2/825: dread d6/d29/d2b/f99 [0,4194304] 0 2024-09-16T00:50:33.037 INFO:tasks.workunit.client.0.smithi053.stdout:6/868: dread d1/dc/d1e/d41/f69 [0,4194304] 0 2024-09-16T00:50:33.037 INFO:tasks.workunit.client.0.smithi053.stdout:6/869: dread - d1/d2f/d9b/dd0/de6/ff6 zero size 2024-09-16T00:50:33.038 INFO:tasks.workunit.client.0.smithi053.stdout:4/628: dwrite d0/d2/dd/d25/d39/dca/fd7 [0,4194304] 0 2024-09-16T00:50:33.039 INFO:tasks.workunit.client.0.smithi053.stdout:2/826: getdents d6/d9/dd/d3e/d72/d75 0 2024-09-16T00:50:33.039 INFO:tasks.workunit.client.0.smithi053.stdout:2/827: readlink d6/d9/dd/d28/l6a 0 2024-09-16T00:50:33.042 INFO:tasks.workunit.client.0.smithi053.stdout:6/870: unlink d1/d2f/c3a 0 2024-09-16T00:50:33.042 INFO:tasks.workunit.client.0.smithi053.stdout:6/871: readlink d1/dc/d39/l19 0 2024-09-16T00:50:33.042 INFO:tasks.workunit.client.0.smithi053.stdout:9/762: dwrite d8/d19/d51/d6d/fec [0,4194304] 0 2024-09-16T00:50:33.045 INFO:tasks.workunit.client.0.smithi053.stdout:8/709: dwrite d10/d1c/d2b/d40/d76/fc5 [0,4194304] 0 2024-09-16T00:50:33.045 INFO:tasks.workunit.client.0.smithi053.stdout:8/710: write d10/d52/f55 [2126504,31756] 0 2024-09-16T00:50:33.045 INFO:tasks.workunit.client.0.smithi053.stdout:5/818: write d3/d7/d2b/d4b/d51/fc1 [1940569,12075] 0 2024-09-16T00:50:33.046 INFO:tasks.workunit.client.0.smithi053.stdout:4/629: rename d0/d2/dd/d25/d41/f64 to d0/d2/d1e/dcc/fdf 0 2024-09-16T00:50:33.046 INFO:tasks.workunit.client.0.smithi053.stdout:4/630: fsync d0/d2/dd/d25/d41/d78/f2c 0 2024-09-16T00:50:33.047 INFO:tasks.workunit.client.0.smithi053.stdout:2/828: creat d6/d29/d2b/d39/dfd/f10b x:0 0 0 2024-09-16T00:50:33.047 INFO:tasks.workunit.client.0.smithi053.stdout:2/829: write d6/d9/dd/d28/f57 [2089557,90442] 0 2024-09-16T00:50:33.049 INFO:tasks.workunit.client.0.smithi053.stdout:0/855: dwrite d4/d13/f41 [0,4194304] 0 2024-09-16T00:50:33.049 INFO:tasks.workunit.client.0.smithi053.stdout:0/856: dread - d4/d13/fde zero size 2024-09-16T00:50:33.049 INFO:tasks.workunit.client.0.smithi053.stdout:0/857: getdents d4/dc/d1e/d22/dc5/dd2/df6/dfa 0 2024-09-16T00:50:33.049 INFO:tasks.workunit.client.0.smithi053.stdout:6/872: creat d1/da6/f119 x:0 0 0 2024-09-16T00:50:33.055 INFO:tasks.workunit.client.0.smithi053.stdout:5/819: dread d3/d7/f5c [0,4194304] 0 2024-09-16T00:50:33.055 INFO:tasks.workunit.client.0.smithi053.stdout:9/763: write d8/fc [1413862,64926] 0 2024-09-16T00:50:33.065 INFO:tasks.workunit.client.0.smithi053.stdout:4/631: rmdir d0/da/d42/d8b/d87 39 2024-09-16T00:50:33.066 INFO:tasks.workunit.client.0.smithi053.stdout:4/632: dread d0/d3c/d48/d95/f9d [0,4194304] 0 2024-09-16T00:50:33.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/830: mknod d6/d9/dd/d3e/d52/d65/d92/c10c 0 2024-09-16T00:50:33.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/831: chown d6/d9/dd/d3e/d52/ld6 61433 1 2024-09-16T00:50:33.069 INFO:tasks.workunit.client.0.smithi053.stdout:6/873: rename d1/dc/d3d/c50 to d1/d2f/d9b/dd0/c11a 0 2024-09-16T00:50:33.069 INFO:tasks.workunit.client.0.smithi053.stdout:6/874: creat d1/dc/d43/f11b x:0 0 0 2024-09-16T00:50:33.070 INFO:tasks.workunit.client.0.smithi053.stdout:8/711: dwrite d10/d1c/d2b/f4e [0,4194304] 0 2024-09-16T00:50:33.070 INFO:tasks.workunit.client.0.smithi053.stdout:0/858: dwrite d4/dc/dbd/fc4 [0,4194304] 0 2024-09-16T00:50:33.074 INFO:tasks.workunit.client.0.smithi053.stdout:5/820: mkdir d3/d7/d2b/d37/d106 0 2024-09-16T00:50:33.080 INFO:tasks.workunit.client.0.smithi053.stdout:9/764: unlink d8/d1c/d2b/d8b/c90 0 2024-09-16T00:50:33.080 INFO:tasks.workunit.client.0.smithi053.stdout:9/765: fdatasync d8/d4c/d5b/fe1 0 2024-09-16T00:50:33.085 INFO:tasks.workunit.client.0.smithi053.stdout:8/712: dwrite d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:33.085 INFO:tasks.workunit.client.0.smithi053.stdout:8/713: chown d10/d1c/d2b/c67 11 1 2024-09-16T00:50:33.085 INFO:tasks.workunit.client.0.smithi053.stdout:8/714: fsync d10/d52/fb8 0 2024-09-16T00:50:33.085 INFO:tasks.workunit.client.0.smithi053.stdout:8/715: creat d10/d1c/d2b/fed x:0 0 0 2024-09-16T00:50:33.088 INFO:tasks.workunit.client.0.smithi053.stdout:6/875: link d1/da6/dea/lee d1/d2f/l11c 0 2024-09-16T00:50:33.088 INFO:tasks.workunit.client.0.smithi053.stdout:6/876: getdents d1/dc/d3c/ddd 0 2024-09-16T00:50:33.097 INFO:tasks.workunit.client.0.smithi053.stdout:0/859: link d4/d13/f63 d4/dc/d1e/d1f/d40/d44/d54/f116 0 2024-09-16T00:50:33.100 INFO:tasks.workunit.client.0.smithi053.stdout:5/821: mkdir d3/d7/d2b/d4b/d51/ddc/d107 0 2024-09-16T00:50:33.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/860: read d4/f4b [7328997,103861] 0 2024-09-16T00:50:33.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/861: creat d4/dc/d1e/f117 x:0 0 0 2024-09-16T00:50:33.115 INFO:tasks.workunit.client.0.smithi053.stdout:4/633: getdents d0 0 2024-09-16T00:50:33.123 INFO:tasks.workunit.client.0.smithi053.stdout:5/822: dwrite d3/d7/d24/d34/d5b/f8b [0,4194304] 0 2024-09-16T00:50:33.123 INFO:tasks.workunit.client.0.smithi053.stdout:5/823: write d3/f2d [1158211,94115] 0 2024-09-16T00:50:33.123 INFO:tasks.workunit.client.0.smithi053.stdout:5/824: dread - d3/d9c/fe3 zero size 2024-09-16T00:50:33.124 INFO:tasks.workunit.client.0.smithi053.stdout:2/832: rmdir d6/d29/d2b/d39 39 2024-09-16T00:50:33.126 INFO:tasks.workunit.client.0.smithi053.stdout:8/716: creat d10/d1c/d2b/d40/dc8/fee x:0 0 0 2024-09-16T00:50:33.127 INFO:tasks.workunit.client.0.smithi053.stdout:8/717: fsync d10/d21/f2c 0 2024-09-16T00:50:33.130 INFO:tasks.workunit.client.0.smithi053.stdout:6/877: creat d1/dc/d1e/d41/dfd/f11d x:0 0 0 2024-09-16T00:50:33.141 INFO:tasks.workunit.client.0.smithi053.stdout:5/825: mkdir d3/d7/d2b/d4b/d108 0 2024-09-16T00:50:33.141 INFO:tasks.workunit.client.0.smithi053.stdout:5/826: write d3/d7/d2b/f3a [2164792,115013] 0 2024-09-16T00:50:33.141 INFO:tasks.workunit.client.0.smithi053.stdout:5/827: creat d3/d7/d2b/d4b/d51/ddc/f109 x:0 0 0 2024-09-16T00:50:33.142 INFO:tasks.workunit.client.0.smithi053.stdout:2/833: link f5 d6/d9/dd/d3e/f10d 0 2024-09-16T00:50:33.144 INFO:tasks.workunit.client.0.smithi053.stdout:8/718: rmdir d10 39 2024-09-16T00:50:33.145 INFO:tasks.workunit.client.0.smithi053.stdout:6/878: fdatasync d1/dc/f3b 0 2024-09-16T00:50:33.145 INFO:tasks.workunit.client.0.smithi053.stdout:6/879: write d1/dc/d1e/d41/f7e [2339775,85767] 0 2024-09-16T00:50:33.146 INFO:tasks.workunit.client.0.smithi053.stdout:9/766: rename d8/d1c/d2b/db6 to d8/d22/d54/df7 0 2024-09-16T00:50:33.146 INFO:tasks.workunit.client.0.smithi053.stdout:9/767: dread - d8/d1c/d2b/d8b/fc5 zero size 2024-09-16T00:50:33.147 INFO:tasks.workunit.client.0.smithi053.stdout:9/768: truncate d8/d19/f4a 4226596 0 2024-09-16T00:50:33.150 INFO:tasks.workunit.client.0.smithi053.stdout:8/719: dread - d10/d1c/d2b/d40/fa3 zero size 2024-09-16T00:50:33.150 INFO:tasks.workunit.client.0.smithi053.stdout:8/720: getdents d10/dbe 0 2024-09-16T00:50:33.151 INFO:tasks.workunit.client.0.smithi053.stdout:0/862: dwrite d4/dc/d1e/d1f/d40/d73/f8e [0,4194304] 0 2024-09-16T00:50:33.152 INFO:tasks.workunit.client.0.smithi053.stdout:4/634: rename d0/da/d42/f75 to d0/d2/d1e/fe0 0 2024-09-16T00:50:33.154 INFO:tasks.workunit.client.0.smithi053.stdout:9/769: link d8/d19/d31/lc6 d8/d4c/d5a/d99/dc8/df6/lf8 0 2024-09-16T00:50:33.154 INFO:tasks.workunit.client.0.smithi053.stdout:9/770: truncate d8/d22/d26/f68 2230297 0 2024-09-16T00:50:33.155 INFO:tasks.workunit.client.0.smithi053.stdout:5/828: mknod d3/c10a 0 2024-09-16T00:50:33.157 INFO:tasks.workunit.client.0.smithi053.stdout:8/721: mknod d10/d1c/d49/cef 0 2024-09-16T00:50:33.158 INFO:tasks.workunit.client.0.smithi053.stdout:0/863: mkdir d4/d13/de8/d118 0 2024-09-16T00:50:33.159 INFO:tasks.workunit.client.0.smithi053.stdout:4/635: rmdir d0/da/d42/d8b/d87 39 2024-09-16T00:50:33.159 INFO:tasks.workunit.client.0.smithi053.stdout:4/636: readlink d0/d2/dd/d25/d37/l47 0 2024-09-16T00:50:33.161 INFO:tasks.workunit.client.0.smithi053.stdout:8/722: mknod d10/d21/d28/d3c/d63/cf0 0 2024-09-16T00:50:33.161 INFO:tasks.workunit.client.0.smithi053.stdout:8/723: fdatasync d10/d21/d28/d3c/d63/f74 0 2024-09-16T00:50:33.161 INFO:tasks.workunit.client.0.smithi053.stdout:8/724: chown d10/l13 82 1 2024-09-16T00:50:33.161 INFO:tasks.workunit.client.0.smithi053.stdout:0/864: symlink d4/dc/d87/l119 0 2024-09-16T00:50:33.162 INFO:tasks.workunit.client.0.smithi053.stdout:4/637: mkdir d0/da/d7c/de1 0 2024-09-16T00:50:33.163 INFO:tasks.workunit.client.0.smithi053.stdout:9/771: mkdir d8/df9 0 2024-09-16T00:50:33.163 INFO:tasks.workunit.client.0.smithi053.stdout:8/725: write d10/d1c/d92/fb0 [2554193,16983] 0 2024-09-16T00:50:33.165 INFO:tasks.workunit.client.0.smithi053.stdout:4/638: link d0/d3c/d48/d58/fcb d0/da/dbf/fe2 0 2024-09-16T00:50:33.166 INFO:tasks.workunit.client.0.smithi053.stdout:9/772: rename d8/d1c/d2b/d2c/le2 to d8/d22/d26/d83/lfa 0 2024-09-16T00:50:33.168 INFO:tasks.workunit.client.0.smithi053.stdout:8/726: link d10/d21/d28/d3c/d63/d6a/fb3 d10/d1c/d2b/d40/ff1 0 2024-09-16T00:50:33.170 INFO:tasks.workunit.client.0.smithi053.stdout:4/639: mknod d0/da/ce3 0 2024-09-16T00:50:33.170 INFO:tasks.workunit.client.0.smithi053.stdout:8/727: mkdir d10/d9e/df2 0 2024-09-16T00:50:33.172 INFO:tasks.workunit.client.0.smithi053.stdout:8/728: creat d10/d21/d28/ff3 x:0 0 0 2024-09-16T00:50:33.173 INFO:tasks.workunit.client.0.smithi053.stdout:8/729: mknod d10/d1c/d2b/d40/cf4 0 2024-09-16T00:50:33.173 INFO:tasks.workunit.client.0.smithi053.stdout:5/829: write d3/d7/d24/d34/f39 [1923361,117710] 0 2024-09-16T00:50:33.174 INFO:tasks.workunit.client.0.smithi053.stdout:5/830: mkdir d3/d7/d24/d34/d5b/d10b 0 2024-09-16T00:50:33.179 INFO:tasks.workunit.client.0.smithi053.stdout:8/730: rename d10/d21/d28/d3c/d63/d6a/fb3 to d10/ff5 0 2024-09-16T00:50:33.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/834: dwrite d6/d9/f25 [0,4194304] 0 2024-09-16T00:50:33.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/835: readlink d6/d29/l45 0 2024-09-16T00:50:33.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/836: write d6/d9/d14/f4c [1038271,109769] 0 2024-09-16T00:50:33.181 INFO:tasks.workunit.client.0.smithi053.stdout:2/837: rename d6/d29/d2b/l62 to d6/d29/d2b/l10e 0 2024-09-16T00:50:33.183 INFO:tasks.workunit.client.0.smithi053.stdout:8/731: unlink d10/d1c/d92/d66/d9d/da6/fca 0 2024-09-16T00:50:33.183 INFO:tasks.workunit.client.0.smithi053.stdout:8/732: dread - d10/d21/d28/d6f/fb6 zero size 2024-09-16T00:50:33.186 INFO:tasks.workunit.client.0.smithi053.stdout:2/838: rename d6/d9/d74/ce8 to d6/d29/da0/c10f 0 2024-09-16T00:50:33.187 INFO:tasks.workunit.client.0.smithi053.stdout:4/640: dread d0/d2/f1b [4194304,4194304] 0 2024-09-16T00:50:33.187 INFO:tasks.workunit.client.0.smithi053.stdout:8/733: link d10/d1c/d2b/fc4 d10/d21/d28/da2/ff6 0 2024-09-16T00:50:33.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/839: truncate d6/d9/d14/d81/fb5 2518152 0 2024-09-16T00:50:33.189 INFO:tasks.workunit.client.0.smithi053.stdout:6/880: dwrite d1/dc/d45/fb0 [0,4194304] 0 2024-09-16T00:50:33.191 INFO:tasks.workunit.client.0.smithi053.stdout:4/641: link d0/d2/d1e/dbb/cbc d0/d2/dd/d25/d41/ce4 0 2024-09-16T00:50:33.191 INFO:tasks.workunit.client.0.smithi053.stdout:2/840: dread d6/d29/d2b/d39/f8f [0,4194304] 0 2024-09-16T00:50:33.191 INFO:tasks.workunit.client.0.smithi053.stdout:2/841: stat d6/d9/dd/f31 0 2024-09-16T00:50:33.191 INFO:tasks.workunit.client.0.smithi053.stdout:2/842: readlink d6/d29/da0/le4 0 2024-09-16T00:50:33.193 INFO:tasks.workunit.client.0.smithi053.stdout:0/865: dwrite d4/dc/d1e/d1f/d40/d44/d54/f116 [0,4194304] 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:5/831: dwrite d3/d7/d2b/d37/d58/f4c [4194304,4194304] 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:5/832: write d3/d7/f1f [3998319,24037] 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:5/833: fsync d3/d7/d2b/d37/f99 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:5/834: write d3/d7/d2b/d4b/d51/d53/f88 [340375,130577] 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:5/835: stat d3/d7/d2b/d37/l9d 0 2024-09-16T00:50:33.194 INFO:tasks.workunit.client.0.smithi053.stdout:8/734: creat d10/d1c/d92/ff7 x:0 0 0 2024-09-16T00:50:33.209 INFO:tasks.workunit.client.0.smithi053.stdout:6/881: rmdir d1/d2f/d9b 39 2024-09-16T00:50:33.217 INFO:tasks.workunit.client.0.smithi053.stdout:4/642: creat d0/fe5 x:0 0 0 2024-09-16T00:50:33.218 INFO:tasks.workunit.client.0.smithi053.stdout:5/836: dwrite d3/d7/d2b/d4b/d51/ddc/dea/ff7 [0,4194304] 0 2024-09-16T00:50:33.219 INFO:tasks.workunit.client.0.smithi053.stdout:0/866: unlink d4/dc/d1e/d1f/d40/d73/dd7/fef 0 2024-09-16T00:50:33.225 INFO:tasks.workunit.client.0.smithi053.stdout:8/735: stat d10/d4a/dc2/dcd/ldd 0 2024-09-16T00:50:33.227 INFO:tasks.workunit.client.0.smithi053.stdout:4/643: chown d0/d3c/d48/d4d/d70/fb9 1 1 2024-09-16T00:50:33.228 INFO:tasks.workunit.client.0.smithi053.stdout:4/644: fsync d0/d2/dd/d25/d41/d78/f6a 0 2024-09-16T00:50:33.228 INFO:tasks.workunit.client.0.smithi053.stdout:5/837: write d3/d7/d24/d34/d5b/f7b [2686559,124551] 0 2024-09-16T00:50:33.232 INFO:tasks.workunit.client.0.smithi053.stdout:4/645: mkdir d0/d3c/d48/d4d/d70/de6 0 2024-09-16T00:50:33.232 INFO:tasks.workunit.client.0.smithi053.stdout:6/882: dwrite d1/d2f/f33 [0,4194304] 0 2024-09-16T00:50:33.233 INFO:tasks.workunit.client.0.smithi053.stdout:4/646: write d0/da/d42/d8b/d87/d99/f83 [549293,21429] 0 2024-09-16T00:50:33.234 INFO:tasks.workunit.client.0.smithi053.stdout:0/867: mkdir d4/dc/d25/d11a 0 2024-09-16T00:50:33.239 INFO:tasks.workunit.client.0.smithi053.stdout:6/883: mknod d1/d2f/d9b/c11e 0 2024-09-16T00:50:33.242 INFO:tasks.workunit.client.0.smithi053.stdout:4/647: dread d0/d31/d98/fb4 [0,4194304] 0 2024-09-16T00:50:33.243 INFO:tasks.workunit.client.0.smithi053.stdout:5/838: dwrite d3/d7/d2b/d37/f99 [0,4194304] 0 2024-09-16T00:50:33.244 INFO:tasks.workunit.client.0.smithi053.stdout:5/839: write d3/d7/d24/d3f/f5e [484643,120848] 0 2024-09-16T00:50:33.245 INFO:tasks.workunit.client.0.smithi053.stdout:6/884: creat d1/dc/d3c/d4a/dec/d10f/f11f x:0 0 0 2024-09-16T00:50:33.246 INFO:tasks.workunit.client.0.smithi053.stdout:8/736: dwrite d10/d1c/d2b/f72 [0,4194304] 0 2024-09-16T00:50:33.246 INFO:tasks.workunit.client.0.smithi053.stdout:0/868: mkdir d4/dc/d25/d11b 0 2024-09-16T00:50:33.246 INFO:tasks.workunit.client.0.smithi053.stdout:0/869: chown d4/dc/d1e/d1f/dd4 53 1 2024-09-16T00:50:33.253 INFO:tasks.workunit.client.0.smithi053.stdout:6/885: mkdir d1/da6/dea/d120 0 2024-09-16T00:50:33.255 INFO:tasks.workunit.client.0.smithi053.stdout:0/870: mknod d4/dc/d1e/d22/dc5/dd2/df6/c11c 0 2024-09-16T00:50:33.255 INFO:tasks.workunit.client.0.smithi053.stdout:0/871: chown d4/f17 2539266 1 2024-09-16T00:50:33.258 INFO:tasks.workunit.client.0.smithi053.stdout:6/886: creat d1/dc/d3c/d4b/f121 x:0 0 0 2024-09-16T00:50:33.258 INFO:tasks.workunit.client.0.smithi053.stdout:6/887: chown d1/d2f/d9b/dd0/de6/ff6 105777 1 2024-09-16T00:50:33.258 INFO:tasks.workunit.client.0.smithi053.stdout:6/888: dread - d1/fe7 zero size 2024-09-16T00:50:33.261 INFO:tasks.workunit.client.0.smithi053.stdout:0/872: rename d4/dc/d25/d34/d71/d96/l89 to d4/dc/d1e/d1f/d40/d44/d54/deb/d104/l11d 0 2024-09-16T00:50:33.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/873: chown d4/ff2 876 1 2024-09-16T00:50:33.267 INFO:tasks.workunit.client.0.smithi053.stdout:0/874: mkdir d4/dc/d1e/d1f/d40/d73/d11e 0 2024-09-16T00:50:33.267 INFO:tasks.workunit.client.0.smithi053.stdout:0/875: creat d4/dc/d87/f11f x:0 0 0 2024-09-16T00:50:33.269 INFO:tasks.workunit.client.0.smithi053.stdout:6/889: link d1/dc/dba/cf2 d1/d2f/d9b/dd0/c122 0 2024-09-16T00:50:33.271 INFO:tasks.workunit.client.0.smithi053.stdout:0/876: mkdir d4/dc/d1e/dfc/d120 0 2024-09-16T00:50:33.273 INFO:tasks.workunit.client.0.smithi053.stdout:6/890: truncate d1/dc/d3d/f8c 6895854 0 2024-09-16T00:50:33.273 INFO:tasks.workunit.client.0.smithi053.stdout:6/891: fdatasync d1/d90/ff8 0 2024-09-16T00:50:33.274 INFO:tasks.workunit.client.0.smithi053.stdout:0/877: symlink d4/dc/d1e/d1f/d40/d44/l121 0 2024-09-16T00:50:33.276 INFO:tasks.workunit.client.0.smithi053.stdout:4/648: dwrite d0/d65/f8e [0,4194304] 0 2024-09-16T00:50:33.277 INFO:tasks.workunit.client.0.smithi053.stdout:8/737: dwrite d10/d1c/d2b/d40/ddc/fe6 [0,4194304] 0 2024-09-16T00:50:33.277 INFO:tasks.workunit.client.0.smithi053.stdout:8/738: write d10/d1c/d2b/d40/d76/fc0 [530016,69036] 0 2024-09-16T00:50:33.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/840: dwrite d3/d7/d24/d34/f76 [0,4194304] 0 2024-09-16T00:50:33.277 INFO:tasks.workunit.client.0.smithi053.stdout:5/841: fsync d3/d7/f2a 0 2024-09-16T00:50:33.278 INFO:tasks.workunit.client.0.smithi053.stdout:6/892: rename d1/dc/d3c/d4a/c5c to d1/dc/d3c/c123 0 2024-09-16T00:50:33.278 INFO:tasks.workunit.client.0.smithi053.stdout:6/893: write d1/dc/d3c/d4b/d58/fa4 [492308,19570] 0 2024-09-16T00:50:33.280 INFO:tasks.workunit.client.0.smithi053.stdout:0/878: creat d4/d13/de8/f122 x:0 0 0 2024-09-16T00:50:33.293 INFO:tasks.workunit.client.0.smithi053.stdout:4/649: rmdir d0/d2/dd/d25/d41/d78/dd6 0 2024-09-16T00:50:33.301 INFO:tasks.workunit.client.0.smithi053.stdout:4/650: write d0/d2/dd/f6e [1032078,58405] 0 2024-09-16T00:50:33.308 INFO:tasks.workunit.client.0.smithi053.stdout:8/739: mkdir d10/d52/df8 0 2024-09-16T00:50:33.310 INFO:tasks.workunit.client.0.smithi053.stdout:5/842: mkdir d3/d7/d2b/d37/d58/d9f/dce/d10c 0 2024-09-16T00:50:33.311 INFO:tasks.workunit.client.0.smithi053.stdout:6/894: rmdir d1/dc/d45/d116 0 2024-09-16T00:50:33.316 INFO:tasks.workunit.client.0.smithi053.stdout:4/651: link d0/d2/dd/d25/d39/c86 d0/da/d42/d8b/d87/d99/ce7 0 2024-09-16T00:50:33.316 INFO:tasks.workunit.client.0.smithi053.stdout:4/652: creat d0/d2/dd/d25/d39/dca/fe8 x:0 0 0 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:4/653: stat d0/d2/d1e/c92 0 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:4/654: fsync d0/f38 0 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:4/655: dread - d0/d3c/d48/d58/fcb zero size 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:4/656: chown d0/da/d7c/de1 5745 1 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:5/843: dread d3/d7/d2b/d37/d58/d79/f84 [0,4194304] 0 2024-09-16T00:50:33.317 INFO:tasks.workunit.client.0.smithi053.stdout:8/740: truncate d10/fe8 1206971 0 2024-09-16T00:50:33.318 INFO:tasks.workunit.client.0.smithi053.stdout:8/741: fdatasync d10/f24 0 2024-09-16T00:50:33.318 INFO:tasks.workunit.client.0.smithi053.stdout:8/742: write d10/d1c/d92/d66/d9d/da6/fd9 [1040765,7102] 0 2024-09-16T00:50:33.320 INFO:tasks.workunit.client.0.smithi053.stdout:6/895: rmdir d1/dc/d3c/d4b/d58 39 2024-09-16T00:50:33.323 INFO:tasks.workunit.client.0.smithi053.stdout:4/657: creat d0/d31/d98/fe9 x:0 0 0 2024-09-16T00:50:33.324 INFO:tasks.workunit.client.0.smithi053.stdout:5/844: creat d3/d7/d2b/d4b/d51/ddc/dea/df1/f10d x:0 0 0 2024-09-16T00:50:33.324 INFO:tasks.workunit.client.0.smithi053.stdout:5/845: chown d3/d7/d24/f28 5 1 2024-09-16T00:50:33.329 INFO:tasks.workunit.client.0.smithi053.stdout:6/896: dread d1/dc/d1e/f8d [0,4194304] 0 2024-09-16T00:50:33.329 INFO:tasks.workunit.client.0.smithi053.stdout:6/897: chown d1/d2f/c98 27 1 2024-09-16T00:50:33.329 INFO:tasks.workunit.client.0.smithi053.stdout:6/898: dread - d1/dc/d3d/f115 zero size 2024-09-16T00:50:33.329 INFO:tasks.workunit.client.0.smithi053.stdout:4/658: link d0/d2/dd/d25/d37/l47 d0/d3c/d48/d4d/lea 0 2024-09-16T00:50:33.329 INFO:tasks.workunit.client.0.smithi053.stdout:4/659: dread - d0/da/fc9 zero size 2024-09-16T00:50:33.332 INFO:tasks.workunit.client.0.smithi053.stdout:6/899: link d1/dc/d1e/fe2 d1/dc/d66/f124 0 2024-09-16T00:50:33.334 INFO:tasks.workunit.client.0.smithi053.stdout:4/660: dread d0/d2/dd/f6e [0,4194304] 0 2024-09-16T00:50:33.334 INFO:tasks.workunit.client.0.smithi053.stdout:4/661: write d0/d3c/d48/d58/fcb [447815,81873] 0 2024-09-16T00:50:33.336 INFO:tasks.workunit.client.0.smithi053.stdout:8/743: dwrite d10/d1c/d2b/d40/f6d [0,4194304] 0 2024-09-16T00:50:33.338 INFO:tasks.workunit.client.0.smithi053.stdout:6/900: mkdir d1/dc/d3c/d4b/d58/d125 0 2024-09-16T00:50:33.339 INFO:tasks.workunit.client.0.smithi053.stdout:6/901: fdatasync d1/dc/d1e/fe2 0 2024-09-16T00:50:33.343 INFO:tasks.workunit.client.0.smithi053.stdout:5/846: dwrite d3/d7/d2b/d37/d58/f82 [0,4194304] 0 2024-09-16T00:50:33.343 INFO:tasks.workunit.client.0.smithi053.stdout:8/744: unlink d10/d1c/d2b/d40/dc8/fee 0 2024-09-16T00:50:33.346 INFO:tasks.workunit.client.0.smithi053.stdout:6/902: dread d1/dc/d3c/d4b/d58/fa4 [0,4194304] 0 2024-09-16T00:50:33.346 INFO:tasks.workunit.client.0.smithi053.stdout:6/903: truncate d1/dc/d3c/d4a/dec/d10f/f11f 187021 0 2024-09-16T00:50:33.348 INFO:tasks.workunit.client.0.smithi053.stdout:4/662: read d0/d2/dd/d25/d39/dca/fd7 [815377,51787] 0 2024-09-16T00:50:33.349 INFO:tasks.workunit.client.0.smithi053.stdout:5/847: getdents d3/d7/d2b/d4b/d4f 0 2024-09-16T00:50:33.350 INFO:tasks.workunit.client.0.smithi053.stdout:6/904: stat d1/dc/d3c/d4b/d75/dd6/l118 0 2024-09-16T00:50:33.353 INFO:tasks.workunit.client.0.smithi053.stdout:4/663: mkdir d0/da/d7c/de1/deb 0 2024-09-16T00:50:33.353 INFO:tasks.workunit.client.0.smithi053.stdout:4/664: dread - d0/d31/d98/fe9 zero size 2024-09-16T00:50:33.353 INFO:tasks.workunit.client.0.smithi053.stdout:6/905: symlink d1/dc/d1e/d41/l126 0 2024-09-16T00:50:33.354 INFO:tasks.workunit.client.0.smithi053.stdout:8/745: write d10/d21/f3e [550470,94247] 0 2024-09-16T00:50:33.354 INFO:tasks.workunit.client.0.smithi053.stdout:8/746: chown d10/d1c/d2b/f5d 137294 1 2024-09-16T00:50:33.355 INFO:tasks.workunit.client.0.smithi053.stdout:8/747: chown d10/d1c/d92/d66 291068789 1 2024-09-16T00:50:33.355 INFO:tasks.workunit.client.0.smithi053.stdout:8/748: readlink d10/d1c/d49/l96 0 2024-09-16T00:50:33.355 INFO:tasks.workunit.client.0.smithi053.stdout:8/749: dread - d10/d1c/d2b/fed zero size 2024-09-16T00:50:33.355 INFO:tasks.workunit.client.0.smithi053.stdout:4/665: stat d0/d2/dd/d25/d41/d78/f2b 0 2024-09-16T00:50:33.356 INFO:tasks.workunit.client.0.smithi053.stdout:6/906: mknod d1/dc/d1e/c127 0 2024-09-16T00:50:33.357 INFO:tasks.workunit.client.0.smithi053.stdout:5/848: write d3/d7/d2b/d37/d58/f38 [3515538,59515] 0 2024-09-16T00:50:33.358 INFO:tasks.workunit.client.0.smithi053.stdout:8/750: read d10/d1c/d92/f7d [4019389,49559] 0 2024-09-16T00:50:33.359 INFO:tasks.workunit.client.0.smithi053.stdout:6/907: dread d1/dc/d3c/d4b/f91 [0,4194304] 0 2024-09-16T00:50:33.359 INFO:tasks.workunit.client.0.smithi053.stdout:6/908: fdatasync d1/dc/d1e/f8d 0 2024-09-16T00:50:33.360 INFO:tasks.workunit.client.0.smithi053.stdout:4/666: unlink d0/d2/dd/d25/d39/dca/fe8 0 2024-09-16T00:50:33.362 INFO:tasks.workunit.client.0.smithi053.stdout:5/849: mknod d3/d9c/dc4/c10e 0 2024-09-16T00:50:33.365 INFO:tasks.workunit.client.0.smithi053.stdout:8/751: mkdir d10/d1c/d92/d66/d9d/da6/ddf/df9 0 2024-09-16T00:50:33.366 INFO:tasks.workunit.client.0.smithi053.stdout:8/752: creat d10/d4a/dc2/ffa x:0 0 0 2024-09-16T00:50:33.385 INFO:tasks.workunit.client.0.smithi053.stdout:6/909: dwrite d1/dc/d3c/d4b/f121 [0,4194304] 0 2024-09-16T00:50:33.386 INFO:tasks.workunit.client.0.smithi053.stdout:4/667: dwrite d0/da/d42/d8b/fba [4194304,4194304] 0 2024-09-16T00:50:33.388 INFO:tasks.workunit.client.0.smithi053.stdout:6/910: mkdir d1/d2f/d9b/d128 0 2024-09-16T00:50:33.389 INFO:tasks.workunit.client.0.smithi053.stdout:6/911: write d1/dc/d3c/d4b/f91 [225974,48695] 0 2024-09-16T00:50:33.392 INFO:tasks.workunit.client.0.smithi053.stdout:4/668: mkdir d0/d2/dd/d25/d41/d78/dac/dec 0 2024-09-16T00:50:33.392 INFO:tasks.workunit.client.0.smithi053.stdout:4/669: write d0/da/dbf/fe2 [1225577,31194] 0 2024-09-16T00:50:33.394 INFO:tasks.workunit.client.0.smithi053.stdout:6/912: mknod d1/d2f/d9b/dd0/d103/c129 0 2024-09-16T00:50:33.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/913: dread d1/dc/f3e [0,4194304] 0 2024-09-16T00:50:33.406 INFO:tasks.workunit.client.0.smithi053.stdout:6/914: truncate d1/dc/d3c/d4b/d58/db9/fe0 979790 0 2024-09-16T00:50:33.419 INFO:tasks.workunit.client.0.smithi053.stdout:6/915: unlink d1/dc/d54/c110 0 2024-09-16T00:50:33.422 INFO:tasks.workunit.client.0.smithi053.stdout:5/850: dwrite d3/f2d [0,4194304] 0 2024-09-16T00:50:33.423 INFO:tasks.workunit.client.0.smithi053.stdout:5/851: readlink d3/d7/d2b/d37/d58/d79/le8 0 2024-09-16T00:50:33.423 INFO:tasks.workunit.client.0.smithi053.stdout:5/852: chown d3/d7/d2b/d37 488 1 2024-09-16T00:50:33.423 INFO:tasks.workunit.client.0.smithi053.stdout:5/853: write d3/d7/d2b/d37/d58/f6b [4389009,51297] 0 2024-09-16T00:50:33.443 INFO:tasks.workunit.client.0.smithi053.stdout:5/854: unlink d3/d7/d2b/d37/d58/f6b 0 2024-09-16T00:50:33.449 INFO:tasks.workunit.client.0.smithi053.stdout:6/916: getdents d1/dc/d3d 0 2024-09-16T00:50:33.449 INFO:tasks.workunit.client.0.smithi053.stdout:6/917: write d1/f57 [3962190,49722] 0 2024-09-16T00:50:33.450 INFO:tasks.workunit.client.0.smithi053.stdout:5/855: symlink d3/d7/d2b/d37/d106/l10f 0 2024-09-16T00:50:33.455 INFO:tasks.workunit.client.0.smithi053.stdout:4/670: rmdir d0/d3c/d48 39 2024-09-16T00:50:33.459 INFO:tasks.workunit.client.0.smithi053.stdout:5/856: getdents d3/d7/d42/d57 0 2024-09-16T00:50:33.466 INFO:tasks.workunit.client.0.smithi053.stdout:6/918: dwrite d1/dc/d3c/ddd/ff7 [0,4194304] 0 2024-09-16T00:50:33.470 INFO:tasks.workunit.client.0.smithi053.stdout:5/857: write d3/d7/d2b/d37/f99 [2206862,36582] 0 2024-09-16T00:50:33.478 INFO:tasks.workunit.client.0.smithi053.stdout:6/919: getdents d1/dc/d54/dd1 0 2024-09-16T00:50:33.478 INFO:tasks.workunit.client.0.smithi053.stdout:6/920: truncate d1/d2f/fc5 671617 0 2024-09-16T00:50:33.482 INFO:tasks.workunit.client.0.smithi053.stdout:5/858: mknod d3/d7/d2b/d4b/d51/d53/da5/df4/c110 0 2024-09-16T00:50:33.486 INFO:tasks.workunit.client.0.smithi053.stdout:6/921: mknod d1/d2f/d9b/dd0/de6/c12a 0 2024-09-16T00:50:33.487 INFO:tasks.workunit.client.0.smithi053.stdout:6/922: write d1/dc/d1e/d41/dfd/dc6/fd7 [1236795,18822] 0 2024-09-16T00:50:33.491 INFO:tasks.workunit.client.0.smithi053.stdout:5/859: rename d3/d7/d42/d57/cf6 to d3/d7/d2b/d4b/c111 0 2024-09-16T00:50:33.495 INFO:tasks.workunit.client.0.smithi053.stdout:6/923: mkdir d1/d2f/d9b/d128/d12b 0 2024-09-16T00:50:33.496 INFO:tasks.workunit.client.0.smithi053.stdout:5/860: symlink d3/d7/d2b/d4b/d51/l112 0 2024-09-16T00:50:33.501 INFO:tasks.workunit.client.0.smithi053.stdout:5/861: creat d3/d7/d2b/d37/d106/f113 x:0 0 0 2024-09-16T00:50:33.501 INFO:tasks.workunit.client.0.smithi053.stdout:5/862: chown d3/d7/d2b/d37/d58/d79/f94 0 1 2024-09-16T00:50:33.503 INFO:tasks.workunit.client.0.smithi053.stdout:6/924: dread d1/dc/f32 [0,4194304] 0 2024-09-16T00:50:33.505 INFO:tasks.workunit.client.0.smithi053.stdout:6/925: symlink d1/dc/d1e/d41/dfd/l12c 0 2024-09-16T00:50:33.510 INFO:tasks.workunit.client.0.smithi053.stdout:5/863: write d3/d7/d2b/d37/d58/d79/f94 [2436792,107168] 0 2024-09-16T00:50:33.510 INFO:tasks.workunit.client.0.smithi053.stdout:6/926: dread d1/dc/d3c/d4b/f91 [0,4194304] 0 2024-09-16T00:50:33.513 INFO:tasks.workunit.client.0.smithi053.stdout:5/864: mknod d3/d7/d2b/d4b/d51/ddc/d107/c114 0 2024-09-16T00:50:33.513 INFO:tasks.workunit.client.0.smithi053.stdout:5/865: creat d3/d9c/f115 x:0 0 0 2024-09-16T00:50:33.515 INFO:tasks.workunit.client.0.smithi053.stdout:6/927: symlink d1/da6/dea/dff/l12d 0 2024-09-16T00:50:33.519 INFO:tasks.workunit.client.0.smithi053.stdout:5/866: mknod d3/d7/d24/d34/d3e/da1/c116 0 2024-09-16T00:50:33.523 INFO:tasks.workunit.client.0.smithi053.stdout:6/928: dread d1/dc/d43/f83 [0,4194304] 0 2024-09-16T00:50:33.525 INFO:tasks.workunit.client.0.smithi053.stdout:5/867: dread d3/d7/d2b/d4b/d51/d53/da5/fcf [0,4194304] 0 2024-09-16T00:50:33.529 INFO:tasks.workunit.client.0.smithi053.stdout:6/929: rename d1/dc/d1e/d41/l126 to d1/d2f/d9b/dd0/l12e 0 2024-09-16T00:50:33.530 INFO:tasks.workunit.client.0.smithi053.stdout:5/868: rmdir d3/d7/d24 39 2024-09-16T00:50:33.530 INFO:tasks.workunit.client.0.smithi053.stdout:5/869: fdatasync d3/d7/d24/d34/d80/f92 0 2024-09-16T00:50:33.530 INFO:tasks.workunit.client.0.smithi053.stdout:5/870: write d3/d7/d2b/d4b/fba [503527,38293] 0 2024-09-16T00:50:33.530 INFO:tasks.workunit.client.0.smithi053.stdout:5/871: write d3/d7/d42/d57/fa0 [391388,65208] 0 2024-09-16T00:50:33.542 INFO:tasks.workunit.client.0.smithi053.stdout:5/872: dread d3/d7/d24/d34/d5b/f8b [0,4194304] 0 2024-09-16T00:50:33.542 INFO:tasks.workunit.client.0.smithi053.stdout:5/873: chown d3/fb5 2 1 2024-09-16T00:50:33.542 INFO:tasks.workunit.client.0.smithi053.stdout:5/874: chown d3/d7/d2b/d4b/d51/ddc/dea/df1/f10d 954689 1 2024-09-16T00:50:33.544 INFO:tasks.workunit.client.0.smithi053.stdout:5/875: creat d3/d7/d24/d34/d5b/d10b/f117 x:0 0 0 2024-09-16T00:50:33.547 INFO:tasks.workunit.client.0.smithi053.stdout:6/930: dwrite d1/dc/d1e/f5d [0,4194304] 0 2024-09-16T00:50:33.547 INFO:tasks.workunit.client.0.smithi053.stdout:6/931: write d1/dc/d3c/d4b/d58/fa4 [6028542,26065] 0 2024-09-16T00:50:33.547 INFO:tasks.workunit.client.0.smithi053.stdout:5/876: symlink d3/d7/d2b/d37/d58/d9f/dce/l118 0 2024-09-16T00:50:33.552 INFO:tasks.workunit.client.0.smithi053.stdout:6/932: creat d1/dc/d3c/d4b/d75/dd6/f12f x:0 0 0 2024-09-16T00:50:33.552 INFO:tasks.workunit.client.0.smithi053.stdout:6/933: chown d1/dc/d1e/d41/c87 531919892 1 2024-09-16T00:50:33.553 INFO:tasks.workunit.client.0.smithi053.stdout:5/877: mknod d3/d7/d24/c119 0 2024-09-16T00:50:33.553 INFO:tasks.workunit.client.0.smithi053.stdout:5/878: stat d3/d7/d2b/d4b/d51/d96/fe1 0 2024-09-16T00:50:33.555 INFO:tasks.workunit.client.0.smithi053.stdout:5/879: mkdir d3/d7/d2b/d37/d46/d11a 0 2024-09-16T00:50:33.557 INFO:tasks.workunit.client.0.smithi053.stdout:6/934: mkdir d1/dc/d3c/d4b/d58/d130 0 2024-09-16T00:50:33.557 INFO:tasks.workunit.client.0.smithi053.stdout:6/935: creat d1/dc/d1e/d41/dfd/f131 x:0 0 0 2024-09-16T00:50:33.562 INFO:tasks.workunit.client.0.smithi053.stdout:6/936: unlink d1/dc/d3c/d4a/c97 0 2024-09-16T00:50:33.562 INFO:tasks.workunit.client.0.smithi053.stdout:6/937: fdatasync d1/d90/f9f 0 2024-09-16T00:50:33.565 INFO:tasks.workunit.client.0.smithi053.stdout:5/880: dread d3/d7/d2b/d37/d58/d9f/f77 [0,4194304] 0 2024-09-16T00:50:33.570 INFO:tasks.workunit.client.0.smithi053.stdout:5/881: unlink d3/d7/d2b/d4b/d51/d53/da5/ld8 0 2024-09-16T00:50:33.570 INFO:tasks.workunit.client.0.smithi053.stdout:5/882: creat d3/d7/d2b/f11b x:0 0 0 2024-09-16T00:50:33.574 INFO:tasks.workunit.client.0.smithi053.stdout:5/883: dread d3/fd3 [0,4194304] 0 2024-09-16T00:50:33.577 INFO:tasks.workunit.client.0.smithi053.stdout:5/884: unlink d3/d7/d2b/d37/d58/d9f/fda 0 2024-09-16T00:50:33.577 INFO:tasks.workunit.client.0.smithi053.stdout:5/885: readlink d3/d7/d2b/d4b/d51/lff 0 2024-09-16T00:50:33.580 INFO:tasks.workunit.client.0.smithi053.stdout:6/938: dwrite d1/dc/d3c/d4b/fb2 [0,4194304] 0 2024-09-16T00:50:33.580 INFO:tasks.workunit.client.0.smithi053.stdout:6/939: getdents d1/dc/d3c/ddd 0 2024-09-16T00:50:33.581 INFO:tasks.workunit.client.0.smithi053.stdout:5/886: mkdir d3/d9c/dc4/d11c 0 2024-09-16T00:50:33.584 INFO:tasks.workunit.client.0.smithi053.stdout:5/887: rmdir d3/d7/d2b/d4b/d51/de2 39 2024-09-16T00:50:33.584 INFO:tasks.workunit.client.0.smithi053.stdout:5/888: chown d3/d7/d2b/d37/d58/lf2 1468 1 2024-09-16T00:50:33.585 INFO:tasks.workunit.client.0.smithi053.stdout:5/889: dread - d3/d7/d2b/d4b/d51/ddc/f109 zero size 2024-09-16T00:50:33.585 INFO:tasks.workunit.client.0.smithi053.stdout:5/890: truncate d3/d7/d2b/d4b/d51/fab 1775104 0 2024-09-16T00:50:33.585 INFO:tasks.workunit.client.0.smithi053.stdout:5/891: chown d3/d7/d2b/d4b/d51/ddc/dea/faa 131611 1 2024-09-16T00:50:33.586 INFO:tasks.workunit.client.0.smithi053.stdout:5/892: rmdir d3/d7/d24 39 2024-09-16T00:50:33.590 INFO:tasks.workunit.client.0.smithi053.stdout:6/940: write d1/dc/d1e/d41/dfd/fd5 [3915526,112570] 0 2024-09-16T00:50:33.593 INFO:tasks.workunit.client.0.smithi053.stdout:6/941: symlink d1/dc/dba/l132 0 2024-09-16T00:50:33.593 INFO:tasks.workunit.client.0.smithi053.stdout:6/942: chown d1/d2f/l36 8 1 2024-09-16T00:50:33.597 INFO:tasks.workunit.client.0.smithi053.stdout:5/893: write d3/d7/d2b/d37/d58/f82 [3324528,27695] 0 2024-09-16T00:50:33.601 INFO:tasks.workunit.client.0.smithi053.stdout:5/894: link d3/d7/d42/d57/fa0 d3/d7/d2b/d4b/d51/ddc/d107/f11d 0 2024-09-16T00:50:33.603 INFO:tasks.workunit.client.0.smithi053.stdout:5/895: getdents d3 0 2024-09-16T00:50:33.605 INFO:tasks.workunit.client.0.smithi053.stdout:5/896: symlink d3/d7/d24/d34/d5b/d10b/l11e 0 2024-09-16T00:50:33.608 INFO:tasks.workunit.client.0.smithi053.stdout:5/897: link d3/lf d3/d7/d2b/d37/d106/l11f 0 2024-09-16T00:50:33.608 INFO:tasks.workunit.client.0.smithi053.stdout:5/898: read - d3/d7/d2b/d4b/d51/ddc/dea/df1/f10d zero size 2024-09-16T00:50:33.608 INFO:tasks.workunit.client.0.smithi053.stdout:5/899: mkdir d3/d7/d2b/d4b/d51/ddc/d107/d120 0 2024-09-16T00:50:33.609 INFO:tasks.workunit.client.0.smithi053.stdout:5/900: chown d3/d7/d2b/d37/d58/c6f 0 1 2024-09-16T00:50:33.609 INFO:tasks.workunit.client.0.smithi053.stdout:5/901: chown d3/d7/d24/d34/f39 364875035 1 2024-09-16T00:50:33.609 INFO:tasks.workunit.client.0.smithi053.stdout:5/902: truncate d3/d7/d2b/d37/f99 4228548 0 2024-09-16T00:50:33.609 INFO:tasks.workunit.client.0.smithi053.stdout:6/943: dwrite d1/dc/d54/fe8 [0,4194304] 0 2024-09-16T00:50:33.609 INFO:tasks.workunit.client.0.smithi053.stdout:6/944: fdatasync d1/dc/d1e/d41/fae 0 2024-09-16T00:50:33.610 INFO:tasks.workunit.client.0.smithi053.stdout:6/945: chown d1/dc/d3c/d4b/f91 7172 1 2024-09-16T00:50:33.610 INFO:tasks.workunit.client.0.smithi053.stdout:6/946: chown d1/dc/d1e/d41/dfd/f131 47152 1 2024-09-16T00:50:33.610 INFO:tasks.workunit.client.0.smithi053.stdout:5/903: rmdir d3/d7/d24/d34/d3e 39 2024-09-16T00:50:33.611 INFO:tasks.workunit.client.0.smithi053.stdout:6/947: dread d1/dc/d45/f59 [0,4194304] 0 2024-09-16T00:50:33.613 INFO:tasks.workunit.client.0.smithi053.stdout:6/948: truncate d1/dc/d1e/d41/f7e 625480 0 2024-09-16T00:50:33.615 INFO:tasks.workunit.client.0.smithi053.stdout:6/949: mknod d1/dc/d1e/d41/dfd/dc6/d112/c133 0 2024-09-16T00:50:33.616 INFO:tasks.workunit.client.0.smithi053.stdout:6/950: readlink d1/dc/d3c/d4b/d75/lb5 0 2024-09-16T00:50:33.617 INFO:tasks.workunit.client.0.smithi053.stdout:6/951: mknod d1/da6/c134 0 2024-09-16T00:50:33.617 INFO:tasks.workunit.client.0.smithi053.stdout:6/952: readlink d1/l35 0 2024-09-16T00:50:33.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/904: write d3/d7/d2b/d4b/d51/d53/da5/fcf [871389,37830] 0 2024-09-16T00:50:33.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/905: chown d3/d7/d24/d3f/f5e 19 1 2024-09-16T00:50:33.619 INFO:tasks.workunit.client.0.smithi053.stdout:5/906: chown d3/d7/d2b/d37/d58 0 1 2024-09-16T00:50:33.627 INFO:tasks.workunit.client.0.smithi053.stdout:6/953: dread d1/dc/d3c/d4a/dec/df5/f10a [0,4194304] 0 2024-09-16T00:50:33.627 INFO:tasks.workunit.client.0.smithi053.stdout:6/954: fsync d1/dc/d54/fe8 0 2024-09-16T00:50:33.628 INFO:tasks.workunit.client.0.smithi053.stdout:6/955: mknod d1/dc/d3c/d4a/dec/c135 0 2024-09-16T00:50:33.629 INFO:tasks.workunit.client.0.smithi053.stdout:5/907: dread d3/f2c [0,4194304] 0 2024-09-16T00:50:33.695 INFO:tasks.workunit.client.0.smithi053.stdout:7/970: sync 2024-09-16T00:50:33.712 INFO:tasks.workunit.client.0.smithi053.stdout:7/971: dwrite d1/d35/fff [0,4194304] 0 2024-09-16T00:50:33.713 INFO:tasks.workunit.client.0.smithi053.stdout:7/972: creat d1/d2a/d4f/d52/f14c x:0 0 0 2024-09-16T00:50:33.718 INFO:tasks.workunit.client.0.smithi053.stdout:7/973: dread d1/d2a/d83/d84/fca [0,4194304] 0 2024-09-16T00:50:33.718 INFO:tasks.workunit.client.0.smithi053.stdout:7/974: chown d1/db5/fe4 9 1 2024-09-16T00:50:33.719 INFO:tasks.workunit.client.0.smithi053.stdout:7/975: mkdir d1/d3/de9/d14d 0 2024-09-16T00:50:33.720 INFO:tasks.workunit.client.0.smithi053.stdout:7/976: symlink d1/d2a/l14e 0 2024-09-16T00:50:33.722 INFO:tasks.workunit.client.0.smithi053.stdout:7/977: mknod d1/d60/c14f 0 2024-09-16T00:50:33.722 INFO:tasks.workunit.client.0.smithi053.stdout:7/978: creat d1/d60/d62/df8/f150 x:0 0 0 2024-09-16T00:50:33.722 INFO:tasks.workunit.client.0.smithi053.stdout:7/979: read d1/d60/d62/fc9 [3141785,69132] 0 2024-09-16T00:50:33.723 INFO:tasks.workunit.client.0.smithi053.stdout:7/980: dread d1/d2a/d4f/d52/f26 [0,4194304] 0 2024-09-16T00:50:33.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/981: dread d1/dd9/ffb [0,4194304] 0 2024-09-16T00:50:33.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/982: chown d1/d35/d4a/dbb/c123 24748 1 2024-09-16T00:50:33.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/983: chown d1/d35/d5b/c9e 0 1 2024-09-16T00:50:33.725 INFO:tasks.workunit.client.0.smithi053.stdout:7/984: dread d1/d35/d14/da7/f144 [0,4194304] 0 2024-09-16T00:50:33.728 INFO:tasks.workunit.client.0.smithi053.stdout:7/985: creat d1/dd9/d119/f151 x:0 0 0 2024-09-16T00:50:33.733 INFO:tasks.workunit.client.0.smithi053.stdout:1/766: sync 2024-09-16T00:50:33.733 INFO:tasks.workunit.client.0.smithi053.stdout:1/767: write d5/d18/d33/d8a/d98/dd0/de2/fe6 [2018519,15930] 0 2024-09-16T00:50:33.735 INFO:tasks.workunit.client.0.smithi053.stdout:1/768: rename d5/d7/d39/f55 to d5/d9/d77/da8/ffd 0 2024-09-16T00:50:33.747 INFO:tasks.workunit.client.0.smithi053.stdout:7/986: dwrite d1/d35/f46 [0,4194304] 0 2024-09-16T00:50:33.749 INFO:tasks.workunit.client.0.smithi053.stdout:1/769: rename d5/d9/d88/lb8 to d5/d18/d33/d8a/d98/dd0/df2/lfe 0 2024-09-16T00:50:33.752 INFO:tasks.workunit.client.0.smithi053.stdout:7/987: mkdir d1/d60/d12a/d152 0 2024-09-16T00:50:33.752 INFO:tasks.workunit.client.0.smithi053.stdout:7/988: chown d1/d60/f11f 43772 1 2024-09-16T00:50:33.775 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:33 smithi053 ceph-mon[27950]: pgmap v17: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 291 MiB/s rd, 322 MiB/s wr, 520 op/s 2024-09-16T00:50:33.873 INFO:tasks.workunit.client.0.smithi053.stdout:7/989: rename d1/d60/d70/d92/f117 to d1/d35/d5b/ddf/d136/f153 0 2024-09-16T00:50:33.878 INFO:tasks.workunit.client.0.smithi053.stdout:7/990: unlink d1/d2a/d83/d84/db1/d126/c132 0 2024-09-16T00:50:33.884 INFO:tasks.workunit.client.0.smithi053.stdout:7/991: getdents d1/d3 0 2024-09-16T00:50:33.887 INFO:tasks.workunit.client.0.smithi053.stdout:7/992: rename d1/d60/d77/c127 to d1/d60/c154 0 2024-09-16T00:50:33.887 INFO:tasks.workunit.client.0.smithi053.stdout:7/993: chown d1/l8 9160130 1 2024-09-16T00:50:33.895 INFO:tasks.workunit.client.0.smithi053.stdout:7/994: dread d1/d35/d14/d15/f48 [0,4194304] 0 2024-09-16T00:50:33.895 INFO:tasks.workunit.client.0.smithi053.stdout:7/995: getdents d1/d3 0 2024-09-16T00:50:33.902 INFO:tasks.workunit.client.0.smithi053.stdout:7/996: dread d1/d2a/d83/dcc/f104 [0,4194304] 0 2024-09-16T00:50:33.902 INFO:tasks.workunit.client.0.smithi053.stdout:7/997: creat d1/d35/d14/d15/f155 x:0 0 0 2024-09-16T00:50:33.911 INFO:tasks.workunit.client.0.smithi053.stdout:7/998: write d1/d60/d62/f69 [1704900,39841] 0 2024-09-16T00:50:33.911 INFO:tasks.workunit.client.0.smithi053.stdout:7/999: chown d1/d60/c87 35746 1 2024-09-16T00:50:33.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:33 smithi152 ceph-mon[33237]: pgmap v17: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 291 MiB/s rd, 322 MiB/s wr, 520 op/s 2024-09-16T00:50:34.074 INFO:tasks.workunit.client.0.smithi053.stdout:3/888: sync 2024-09-16T00:50:34.074 INFO:tasks.workunit.client.0.smithi053.stdout:9/773: sync 2024-09-16T00:50:34.074 INFO:tasks.workunit.client.0.smithi053.stdout:2/843: sync 2024-09-16T00:50:34.075 INFO:tasks.workunit.client.0.smithi053.stdout:9/774: creat d8/d1c/d2b/d8b/ffb x:0 0 0 2024-09-16T00:50:34.075 INFO:tasks.workunit.client.0.smithi053.stdout:9/775: write d8/f30 [2695062,17075] 0 2024-09-16T00:50:34.109 INFO:tasks.workunit.client.0.smithi053.stdout:3/889: truncate d1/d5/d11/f55 432787 0 2024-09-16T00:50:34.110 INFO:tasks.workunit.client.0.smithi053.stdout:2/844: link d6/d9/d14/l3d d6/d9/d14/d81/l110 0 2024-09-16T00:50:34.110 INFO:tasks.workunit.client.0.smithi053.stdout:2/845: truncate d6/d29/f9a 416932 0 2024-09-16T00:50:34.115 INFO:tasks.workunit.client.0.smithi053.stdout:3/890: dread d1/d5/d11/da9/db8/dfb/fb9 [0,4194304] 0 2024-09-16T00:50:34.115 INFO:tasks.workunit.client.0.smithi053.stdout:9/776: mknod d8/d1c/cfc 0 2024-09-16T00:50:34.115 INFO:tasks.workunit.client.0.smithi053.stdout:9/777: dread - d8/d19/d31/fdd zero size 2024-09-16T00:50:34.121 INFO:tasks.workunit.client.0.smithi053.stdout:2/846: mkdir d6/d9/dd/d76/d111 0 2024-09-16T00:50:34.121 INFO:tasks.workunit.client.0.smithi053.stdout:2/847: chown d6/d9/d14/l21 1100 1 2024-09-16T00:50:34.127 INFO:tasks.workunit.client.0.smithi053.stdout:3/891: creat d1/d5/d11/d3a/dc6/de8/f128 x:0 0 0 2024-09-16T00:50:34.129 INFO:tasks.workunit.client.0.smithi053.stdout:9/778: mknod d8/d1c/d2b/d5c/cfd 0 2024-09-16T00:50:34.129 INFO:tasks.workunit.client.0.smithi053.stdout:9/779: truncate d8/d19/f3f 1224241 0 2024-09-16T00:50:34.133 INFO:tasks.workunit.client.0.smithi053.stdout:2/848: mknod d6/d29/da0/c112 0 2024-09-16T00:50:34.139 INFO:tasks.workunit.client.0.smithi053.stdout:3/892: creat d1/d5/d11/da9/db8/dfb/d64/f129 x:0 0 0 2024-09-16T00:50:34.140 INFO:tasks.workunit.client.0.smithi053.stdout:3/893: dread - d1/d5/d11/da9/db8/dfb/d65/f102 zero size 2024-09-16T00:50:34.142 INFO:tasks.workunit.client.0.smithi053.stdout:9/780: creat d8/d19/d31/ffe x:0 0 0 2024-09-16T00:50:34.145 INFO:tasks.workunit.client.0.smithi053.stdout:2/849: mkdir d6/d9/d14/d81/d113 0 2024-09-16T00:50:34.149 INFO:tasks.workunit.client.0.smithi053.stdout:3/894: creat d1/d4e/d10a/db5/f12a x:0 0 0 2024-09-16T00:50:34.157 INFO:tasks.workunit.client.0.smithi053.stdout:2/850: creat d6/d9/dd/d3e/d72/d75/f114 x:0 0 0 2024-09-16T00:50:34.158 INFO:tasks.workunit.client.0.smithi053.stdout:3/895: link d1/d5/d91/d5e/d69/d109/fdf d1/d5/d11/da9/db8/f12b 0 2024-09-16T00:50:34.159 INFO:tasks.workunit.client.0.smithi053.stdout:3/896: readlink d1/d5/d91/d5e/d90/da2/ld9 0 2024-09-16T00:50:34.161 INFO:tasks.workunit.client.0.smithi053.stdout:9/781: rmdir d8/d4c/d5a/d99/dc8/de8 39 2024-09-16T00:50:34.161 INFO:tasks.workunit.client.0.smithi053.stdout:9/782: dread - d8/d4c/d5b/f91 zero size 2024-09-16T00:50:34.161 INFO:tasks.workunit.client.0.smithi053.stdout:9/783: fsync d8/d19/d51/f56 0 2024-09-16T00:50:34.166 INFO:tasks.workunit.client.0.smithi053.stdout:3/897: write d1/d5/d31/d3b/d9c/fe7 [2597203,50762] 0 2024-09-16T00:50:34.171 INFO:tasks.workunit.client.0.smithi053.stdout:2/851: getdents d6/d29/d2b/dd0 0 2024-09-16T00:50:34.173 INFO:tasks.workunit.client.0.smithi053.stdout:2/852: dread d6/d9/dd/d3e/f7d [0,4194304] 0 2024-09-16T00:50:34.174 INFO:tasks.workunit.client.0.smithi053.stdout:2/853: creat d6/db1/d108/f115 x:0 0 0 2024-09-16T00:50:34.174 INFO:tasks.workunit.client.0.smithi053.stdout:2/854: fdatasync d6/d9/dd/d3e/d52/d7e/fe3 0 2024-09-16T00:50:34.175 INFO:tasks.workunit.client.0.smithi053.stdout:2/855: creat d6/d9/d74/f116 x:0 0 0 2024-09-16T00:50:34.175 INFO:tasks.workunit.client.0.smithi053.stdout:2/856: write d6/d9/d74/fce [619898,51619] 0 2024-09-16T00:50:34.175 INFO:tasks.workunit.client.0.smithi053.stdout:3/898: dread d1/d5/d11/da9/db8/dfb/f5b [0,4194304] 0 2024-09-16T00:50:34.178 INFO:tasks.workunit.client.0.smithi053.stdout:2/857: unlink d6/dad/fb0 0 2024-09-16T00:50:34.178 INFO:tasks.workunit.client.0.smithi053.stdout:2/858: chown d6 939 1 2024-09-16T00:50:34.178 INFO:tasks.workunit.client.0.smithi053.stdout:2/859: write d6/d9/dd/d3e/d52/d65/f10a [745404,74347] 0 2024-09-16T00:50:34.178 INFO:tasks.workunit.client.0.smithi053.stdout:2/860: write d6/d9/f5e [105206,82805] 0 2024-09-16T00:50:34.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/861: write d6/d9/db6/dbc/fe2 [271000,9451] 0 2024-09-16T00:50:34.179 INFO:tasks.workunit.client.0.smithi053.stdout:2/862: write d6/d9/dd/d76/ff4 [2000650,23596] 0 2024-09-16T00:50:34.183 INFO:tasks.workunit.client.0.smithi053.stdout:2/863: symlink d6/d90/l117 0 2024-09-16T00:50:34.183 INFO:tasks.workunit.client.0.smithi053.stdout:2/864: read d6/f6c [340018,77397] 0 2024-09-16T00:50:34.187 INFO:tasks.workunit.client.0.smithi053.stdout:2/865: symlink d6/d9/d14/d81/d113/l118 0 2024-09-16T00:50:34.187 INFO:tasks.workunit.client.0.smithi053.stdout:2/866: fdatasync d6/f73 0 2024-09-16T00:50:34.187 INFO:tasks.workunit.client.0.smithi053.stdout:2/867: stat d6/d9/db6/dbc 0 2024-09-16T00:50:34.187 INFO:tasks.workunit.client.0.smithi053.stdout:2/868: stat d6/d29/fab 0 2024-09-16T00:50:34.189 INFO:tasks.workunit.client.0.smithi053.stdout:2/869: stat d6/d29/d2b/l10e 0 2024-09-16T00:50:34.190 INFO:tasks.workunit.client.0.smithi053.stdout:2/870: mkdir d6/d9/dd/d28/d119 0 2024-09-16T00:50:34.192 INFO:tasks.workunit.client.0.smithi053.stdout:2/871: rmdir d6/d9/dd/df8 39 2024-09-16T00:50:34.193 INFO:tasks.workunit.client.0.smithi053.stdout:2/872: unlink d6/d29/db7/ff1 0 2024-09-16T00:50:34.194 INFO:tasks.workunit.client.0.smithi053.stdout:2/873: symlink d6/d9/dd/d3e/d72/d75/d84/l11a 0 2024-09-16T00:50:34.196 INFO:tasks.workunit.client.0.smithi053.stdout:2/874: rename d6/d9/dd/d3e/d52/d65/fde to d6/d29/d2b/f11b 0 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/875: creat d6/d9/dd/df8/dfe/f11c x:0 0 0 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/876: fsync d6/d9/dd/d3e/d72/d75/f114 0 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/877: write d6/f32 [7387723,9136] 0 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/878: chown d6/d9/dd/dbb 353 1 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/879: write d6/d29/db7/fe1 [178607,67809] 0 2024-09-16T00:50:34.198 INFO:tasks.workunit.client.0.smithi053.stdout:2/880: creat d6/d9/dd/d3e/d52/f11d x:0 0 0 2024-09-16T00:50:34.201 INFO:tasks.workunit.client.0.smithi053.stdout:2/881: rename d6/fe9 to d6/f11e 0 2024-09-16T00:50:34.203 INFO:tasks.workunit.client.0.smithi053.stdout:2/882: mknod d6/d9/dd/c11f 0 2024-09-16T00:50:34.204 INFO:tasks.workunit.client.0.smithi053.stdout:2/883: symlink d6/d9/dd/d3e/d52/d65/l120 0 2024-09-16T00:50:34.205 INFO:tasks.workunit.client.0.smithi053.stdout:2/884: fsync d6/f18 0 2024-09-16T00:50:34.208 INFO:tasks.workunit.client.0.smithi053.stdout:2/885: dread d6/d29/d2b/d39/f40 [0,4194304] 0 2024-09-16T00:50:34.214 INFO:tasks.workunit.client.0.smithi053.stdout:2/886: getdents d6/d9/dd/d3e/d72/d75/d84 0 2024-09-16T00:50:34.217 INFO:tasks.workunit.client.0.smithi053.stdout:2/887: rename d6/d9/dd/d3e/d52/d7e/ccb to d6/d29/d2b/dd0/c121 0 2024-09-16T00:50:34.221 INFO:tasks.workunit.client.0.smithi053.stdout:2/888: fsync d6/f23 0 2024-09-16T00:50:34.221 INFO:tasks.workunit.client.0.smithi053.stdout:2/889: fdatasync d6/d9/dd/d3e/d52/d65/d92/fdc 0 2024-09-16T00:50:34.221 INFO:tasks.workunit.client.0.smithi053.stdout:2/890: chown d6/d29/f70 30194849 1 2024-09-16T00:50:34.222 INFO:tasks.workunit.client.0.smithi053.stdout:2/891: dread d6/d9/db6/dbc/fe2 [0,4194304] 0 2024-09-16T00:50:34.230 INFO:tasks.workunit.client.0.smithi053.stdout:2/892: dread d6/d9/dd/d3e/d72/f9c [0,4194304] 0 2024-09-16T00:50:34.233 INFO:tasks.workunit.client.0.smithi053.stdout:2/893: fsync d6/d29/db7/fe1 0 2024-09-16T00:50:34.233 INFO:tasks.workunit.client.0.smithi053.stdout:2/894: creat d6/d9/dd/d3e/d72/d75/f122 x:0 0 0 2024-09-16T00:50:34.233 INFO:tasks.workunit.client.0.smithi053.stdout:2/895: stat d6/f11e 0 2024-09-16T00:50:34.233 INFO:tasks.workunit.client.0.smithi053.stdout:2/896: write d6/d29/d2b/f11b [883092,127815] 0 2024-09-16T00:50:34.239 INFO:tasks.workunit.client.0.smithi053.stdout:2/897: unlink d6/d29/d2b/f8d 0 2024-09-16T00:50:34.253 INFO:tasks.workunit.client.0.smithi053.stdout:2/898: mknod d6/d29/d2b/d39/dfd/c123 0 2024-09-16T00:50:34.254 INFO:tasks.workunit.client.0.smithi053.stdout:2/899: dread d6/d9/d74/fce [0,4194304] 0 2024-09-16T00:50:34.342 INFO:tasks.workunit.client.0.smithi053.stdout:0/879: sync 2024-09-16T00:50:34.342 INFO:tasks.workunit.client.0.smithi053.stdout:8/753: sync 2024-09-16T00:50:34.343 INFO:tasks.workunit.client.0.smithi053.stdout:0/880: chown d4/dc/d1e/d1f/d40/l5c 40635555 1 2024-09-16T00:50:34.343 INFO:tasks.workunit.client.0.smithi053.stdout:0/881: fsync d4/f69 0 2024-09-16T00:50:34.343 INFO:tasks.workunit.client.0.smithi053.stdout:0/882: chown d4/dc/d1e/d1f/d40/d73/l9b 11415 1 2024-09-16T00:50:34.343 INFO:tasks.workunit.client.0.smithi053.stdout:0/883: creat d4/dc/d1e/d1f/d40/d73/dd7/f123 x:0 0 0 2024-09-16T00:50:34.343 INFO:tasks.workunit.client.0.smithi053.stdout:8/754: write d10/f24 [4509150,20] 0 2024-09-16T00:50:34.369 INFO:tasks.workunit.client.0.smithi053.stdout:0/884: dwrite d4/dc/d87/dc6/dbe/fae [0,4194304] 0 2024-09-16T00:50:34.369 INFO:tasks.workunit.client.0.smithi053.stdout:0/885: fdatasync d4/dc/d25/f2f 0 2024-09-16T00:50:34.369 INFO:tasks.workunit.client.0.smithi053.stdout:8/755: dwrite d10/d4a/dc2/fdb [0,4194304] 0 2024-09-16T00:50:34.369 INFO:tasks.workunit.client.0.smithi053.stdout:8/756: fdatasync d10/d1c/d92/d66/d9d/da6/fd9 0 2024-09-16T00:50:34.369 INFO:tasks.workunit.client.0.smithi053.stdout:0/886: write d4/dc/d87/f60 [984757,94816] 0 2024-09-16T00:50:34.373 INFO:tasks.workunit.client.0.smithi053.stdout:0/887: link d4/dc/d25/d34/d71/fca d4/dc/d1e/d22/dc5/dd2/df6/dfa/f124 0 2024-09-16T00:50:34.373 INFO:tasks.workunit.client.0.smithi053.stdout:0/888: dread - d4/dc/d25/faf zero size 2024-09-16T00:50:34.373 INFO:tasks.workunit.client.0.smithi053.stdout:0/889: fsync d4/dc/d1e/d1f/d40/d9a/fa3 0 2024-09-16T00:50:34.376 INFO:tasks.workunit.client.0.smithi053.stdout:0/890: mknod d4/dc/d1e/d1f/d40/d44/d54/deb/d104/c125 0 2024-09-16T00:50:34.379 INFO:tasks.workunit.client.0.smithi053.stdout:8/757: write d10/d1c/d92/f7d [5273185,94782] 0 2024-09-16T00:50:34.380 INFO:tasks.workunit.client.0.smithi053.stdout:8/758: readlink d10/d21/d28/l71 0 2024-09-16T00:50:34.380 INFO:tasks.workunit.client.0.smithi053.stdout:0/891: link d4/dc/d1e/d1f/d40/d44/d54/deb/d104/c125 d4/dc/d25/d34/db7/c126 0 2024-09-16T00:50:34.386 INFO:tasks.workunit.client.0.smithi053.stdout:8/759: unlink d10/d1c/l25 0 2024-09-16T00:50:34.389 INFO:tasks.workunit.client.0.smithi053.stdout:8/760: mkdir d10/d1c/d2b/d40/ddc/dfb 0 2024-09-16T00:50:34.389 INFO:tasks.workunit.client.0.smithi053.stdout:0/892: write d4/d5a/f94 [394182,86860] 0 2024-09-16T00:50:34.392 INFO:tasks.workunit.client.0.smithi053.stdout:8/761: creat d10/d1c/d92/ffc x:0 0 0 2024-09-16T00:50:34.407 INFO:tasks.workunit.client.0.smithi053.stdout:0/893: dwrite d4/dc/d1e/d1f/d40/d9a/fa3 [0,4194304] 0 2024-09-16T00:50:34.419 INFO:tasks.workunit.client.0.smithi053.stdout:0/894: dwrite d4/dc/d1e/d22/fe5 [0,4194304] 0 2024-09-16T00:50:34.424 INFO:tasks.workunit.client.0.smithi053.stdout:8/762: truncate d10/d4a/dc2/fdb 3698326 0 2024-09-16T00:50:34.427 INFO:tasks.workunit.client.0.smithi053.stdout:0/895: truncate d4/dc/d1e/d22/f42 260316 0 2024-09-16T00:50:34.432 INFO:tasks.workunit.client.0.smithi053.stdout:0/896: link d4/dc/d1e/d1f/d40/d9a/lab d4/d13/l127 0 2024-09-16T00:50:34.433 INFO:tasks.workunit.client.0.smithi053.stdout:8/763: getdents d10/d1c/d2b/d40/dc8 0 2024-09-16T00:50:34.433 INFO:tasks.workunit.client.0.smithi053.stdout:8/764: dread - d10/d4a/dc2/ffa zero size 2024-09-16T00:50:34.433 INFO:tasks.workunit.client.0.smithi053.stdout:8/765: fdatasync d10/d21/f2c 0 2024-09-16T00:50:34.435 INFO:tasks.workunit.client.0.smithi053.stdout:0/897: symlink d4/dc/l128 0 2024-09-16T00:50:34.435 INFO:tasks.workunit.client.0.smithi053.stdout:0/898: chown d4/dc/l128 165 1 2024-09-16T00:50:34.437 INFO:tasks.workunit.client.0.smithi053.stdout:8/766: creat d10/d1c/d92/d66/d9d/da6/ddf/ffd x:0 0 0 2024-09-16T00:50:34.437 INFO:tasks.workunit.client.0.smithi053.stdout:8/767: chown d10/d4a/dbf/de7 0 1 2024-09-16T00:50:34.438 INFO:tasks.workunit.client.0.smithi053.stdout:0/899: rmdir d4/dc/dc0 39 2024-09-16T00:50:34.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/768: symlink d10/d21/d28/da2/lfe 0 2024-09-16T00:50:34.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/769: write d10/fe8 [2035044,81183] 0 2024-09-16T00:50:34.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/770: dread - d10/d1c/d49/faf zero size 2024-09-16T00:50:34.446 INFO:tasks.workunit.client.0.smithi053.stdout:0/900: truncate d4/f17 5917858 0 2024-09-16T00:50:34.453 INFO:tasks.workunit.client.0.smithi053.stdout:0/901: rename d4/dc/c36 to d4/dc/d1e/d1f/d40/d9a/c129 0 2024-09-16T00:50:34.453 INFO:tasks.workunit.client.0.smithi053.stdout:0/902: chown d4/dc/d1e/l43 225 1 2024-09-16T00:50:34.458 INFO:tasks.workunit.client.0.smithi053.stdout:6/956: sync 2024-09-16T00:50:34.458 INFO:tasks.workunit.client.0.smithi053.stdout:4/671: sync 2024-09-16T00:50:34.458 INFO:tasks.workunit.client.0.smithi053.stdout:4/672: dread - d0/d65/fa4 zero size 2024-09-16T00:50:34.467 INFO:tasks.workunit.client.0.smithi053.stdout:0/903: dread d4/dc/d1e/d22/dc5/dd2/dec/f103 [0,4194304] 0 2024-09-16T00:50:34.467 INFO:tasks.workunit.client.0.smithi053.stdout:0/904: stat d4/d5a/d82/f93 0 2024-09-16T00:50:34.467 INFO:tasks.workunit.client.0.smithi053.stdout:8/771: dwrite d10/f3a [0,4194304] 0 2024-09-16T00:50:34.471 INFO:tasks.workunit.client.0.smithi053.stdout:4/673: dread d0/d31/fb0 [0,4194304] 0 2024-09-16T00:50:34.475 INFO:tasks.workunit.client.0.smithi053.stdout:4/674: link d0/d31/f77 d0/d3c/d48/d95/fed 0 2024-09-16T00:50:34.475 INFO:tasks.workunit.client.0.smithi053.stdout:4/675: write d0/d3c/d48/f91 [3274826,108177] 0 2024-09-16T00:50:34.475 INFO:tasks.workunit.client.0.smithi053.stdout:4/676: write d0/d2/dd/d25/d41/d78/f2c [8693643,55541] 0 2024-09-16T00:50:34.475 INFO:tasks.workunit.client.0.smithi053.stdout:4/677: creat d0/d31/d98/fee x:0 0 0 2024-09-16T00:50:34.475 INFO:tasks.workunit.client.0.smithi053.stdout:8/772: dread d10/d1c/d49/f64 [0,4194304] 0 2024-09-16T00:50:34.481 INFO:tasks.workunit.client.0.smithi053.stdout:8/773: symlink d10/lff 0 2024-09-16T00:50:34.483 INFO:tasks.workunit.client.0.smithi053.stdout:8/774: creat d10/d1c/f100 x:0 0 0 2024-09-16T00:50:34.486 INFO:tasks.workunit.client.0.smithi053.stdout:8/775: rename d10/d1c/c35 to d10/d4a/dbf/de7/c101 0 2024-09-16T00:50:34.487 INFO:tasks.workunit.client.0.smithi053.stdout:8/776: chown d10/d1c/d92/cc7 43 1 2024-09-16T00:50:34.488 INFO:tasks.workunit.client.0.smithi053.stdout:0/905: dwrite d4/d5a/f94 [0,4194304] 0 2024-09-16T00:50:34.489 INFO:tasks.workunit.client.0.smithi053.stdout:8/777: symlink d10/d21/d28/d3c/d63/d6a/l102 0 2024-09-16T00:50:34.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/906: symlink d4/dc/d1e/d1f/d40/d9a/l12a 0 2024-09-16T00:50:34.490 INFO:tasks.workunit.client.0.smithi053.stdout:0/907: write d4/fa6 [622662,51932] 0 2024-09-16T00:50:34.493 INFO:tasks.workunit.client.0.smithi053.stdout:0/908: mkdir d4/dc/d25/d11a/d12b 0 2024-09-16T00:50:34.496 INFO:tasks.workunit.client.0.smithi053.stdout:0/909: mkdir d4/dc/d1e/dfc/d12c 0 2024-09-16T00:50:34.496 INFO:tasks.workunit.client.0.smithi053.stdout:0/910: chown d4/dc/d1e/d1f/d40/d73/l9b 516997 1 2024-09-16T00:50:34.504 INFO:tasks.workunit.client.0.smithi053.stdout:0/911: write d4/dc/d1e/d1f/d40/d44/d54/db8/fc1 [1503452,112282] 0 2024-09-16T00:50:34.506 INFO:tasks.workunit.client.0.smithi053.stdout:8/778: dwrite d10/d4a/dbf/f79 [0,4194304] 0 2024-09-16T00:50:34.507 INFO:tasks.workunit.client.0.smithi053.stdout:8/779: write d10/d1c/d2b/fc4 [54712,76903] 0 2024-09-16T00:50:34.510 INFO:tasks.workunit.client.0.smithi053.stdout:8/780: link d10/d4a/dbf/f9b d10/d4a/dbf/de7/f103 0 2024-09-16T00:50:34.514 INFO:tasks.workunit.client.0.smithi053.stdout:0/912: write d4/dc/d25/f5f [1666908,114686] 0 2024-09-16T00:50:34.515 INFO:tasks.workunit.client.0.smithi053.stdout:0/913: mkdir d4/dc/d1e/d22/de2/d12d 0 2024-09-16T00:50:34.516 INFO:tasks.workunit.client.0.smithi053.stdout:0/914: creat d4/d13/de8/d118/f12e x:0 0 0 2024-09-16T00:50:34.518 INFO:tasks.workunit.client.0.smithi053.stdout:8/781: dread d10/d21/d28/d3c/d84/fcb [0,4194304] 0 2024-09-16T00:50:34.520 INFO:tasks.workunit.client.0.smithi053.stdout:8/782: creat d10/d21/d28/da2/f104 x:0 0 0 2024-09-16T00:50:34.525 INFO:tasks.workunit.client.0.smithi053.stdout:0/915: dread d4/dc/d1e/d1f/d40/d44/d54/f116 [0,4194304] 0 2024-09-16T00:50:34.525 INFO:tasks.workunit.client.0.smithi053.stdout:0/916: chown d4/dc/d25/ce4 0 1 2024-09-16T00:50:34.534 INFO:tasks.workunit.client.0.smithi053.stdout:0/917: dread d4/f9 [0,4194304] 0 2024-09-16T00:50:34.536 INFO:tasks.workunit.client.0.smithi053.stdout:0/918: creat d4/d5a/d82/f12f x:0 0 0 2024-09-16T00:50:34.536 INFO:tasks.workunit.client.0.smithi053.stdout:8/783: dwrite d10/d1c/d2b/f4e [0,4194304] 0 2024-09-16T00:50:34.537 INFO:tasks.workunit.client.0.smithi053.stdout:0/919: symlink d4/dc/l130 0 2024-09-16T00:50:34.537 INFO:tasks.workunit.client.0.smithi053.stdout:0/920: stat d4/dc/d1e/d22/dc5/dd2/df6/dfa/f124 0 2024-09-16T00:50:34.538 INFO:tasks.workunit.client.0.smithi053.stdout:8/784: mknod d10/d21/d28/d3c/c105 0 2024-09-16T00:50:34.539 INFO:tasks.workunit.client.0.smithi053.stdout:0/921: truncate d4/dc/d25/d34/d71/fca 953084 0 2024-09-16T00:50:34.542 INFO:tasks.workunit.client.0.smithi053.stdout:8/785: symlink d10/d1c/d92/d66/d9d/da6/ddf/l106 0 2024-09-16T00:50:34.555 INFO:tasks.workunit.client.0.smithi053.stdout:8/786: unlink d10/d1c/d92/c77 0 2024-09-16T00:50:34.555 INFO:tasks.workunit.client.0.smithi053.stdout:8/787: fsync d10/d21/f4b 0 2024-09-16T00:50:34.558 INFO:tasks.workunit.client.0.smithi053.stdout:8/788: link d10/d21/f2c d10/d21/d28/d3c/d63/d6a/f107 0 2024-09-16T00:50:34.566 INFO:tasks.workunit.client.0.smithi053.stdout:8/789: write d10/d21/d28/d3c/d63/d6a/fcc [1440980,65772] 0 2024-09-16T00:50:34.581 INFO:tasks.workunit.client.0.smithi053.stdout:8/790: dwrite d10/d21/f4b [0,4194304] 0 2024-09-16T00:50:34.585 INFO:tasks.workunit.client.0.smithi053.stdout:8/791: mknod d10/d21/d28/d3c/d63/c108 0 2024-09-16T00:50:34.606 INFO:tasks.workunit.client.0.smithi053.stdout:8/792: dwrite d10/d1c/d2b/d40/d76/fc5 [0,4194304] 0 2024-09-16T00:50:34.612 INFO:tasks.workunit.client.0.smithi053.stdout:8/793: dread d10/d1c/f7b [0,4194304] 0 2024-09-16T00:50:34.614 INFO:tasks.workunit.client.0.smithi053.stdout:8/794: dread d10/d21/d28/f34 [0,4194304] 0 2024-09-16T00:50:34.620 INFO:tasks.workunit.client.0.smithi053.stdout:8/795: dread d10/d21/d28/d3c/d63/fab [0,4194304] 0 2024-09-16T00:50:34.620 INFO:tasks.workunit.client.0.smithi053.stdout:8/796: readlink d10/d1c/d49/l96 0 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:3/899: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:4/678: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:9/784: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:1/770: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:5/908: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:9/785: chown d8/d4c/d5a/d99/dc8/df6 292080196 1 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:2/900: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:6/957: sync 2024-09-16T00:50:34.909 INFO:tasks.workunit.client.0.smithi053.stdout:3/900: write d1/d5/d91/d5e/d69/fa1 [1057175,103024] 0 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:3/901: getdents d1/d5/d91/d5e/d69/d109/d28/d5a/d11a 0 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/901: creat d6/d90/dba/f124 x:0 0 0 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/902: fsync d6/d9/dd/d76/ff4 0 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:2/903: write d6/d9/dd/f31 [76902,31750] 0 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:0/922: sync 2024-09-16T00:50:34.910 INFO:tasks.workunit.client.0.smithi053.stdout:8/797: sync 2024-09-16T00:50:34.911 INFO:tasks.workunit.client.0.smithi053.stdout:4/679: read d0/da/dbf/fe2 [65609,10857] 0 2024-09-16T00:50:34.913 INFO:tasks.workunit.client.0.smithi053.stdout:5/909: unlink d3/d7/d2b/f100 0 2024-09-16T00:50:34.918 INFO:tasks.workunit.client.0.smithi053.stdout:1/771: rename d5/d18/d33/d8a/d98/dd0/de2 to d5/d9/d4c/dff 0 2024-09-16T00:50:34.918 INFO:tasks.workunit.client.0.smithi053.stdout:1/772: chown d5/d18/f79 7116 1 2024-09-16T00:50:34.918 INFO:tasks.workunit.client.0.smithi053.stdout:1/773: truncate d5/d9/d77/ffa 202417 0 2024-09-16T00:50:34.918 INFO:tasks.workunit.client.0.smithi053.stdout:1/774: truncate d5/d9/d73/fe4 238152 0 2024-09-16T00:50:34.919 INFO:tasks.workunit.client.0.smithi053.stdout:9/786: mknod d8/d1c/d2b/d2c/cff 0 2024-09-16T00:50:34.923 INFO:tasks.workunit.client.0.smithi053.stdout:4/680: read d0/d3c/f80 [3564462,112777] 0 2024-09-16T00:50:34.923 INFO:tasks.workunit.client.0.smithi053.stdout:4/681: chown d0/l82 183534417 1 2024-09-16T00:50:34.923 INFO:tasks.workunit.client.0.smithi053.stdout:4/682: write d0/da/d42/d8b/d87/d99/f83 [104153,7037] 0 2024-09-16T00:50:34.924 INFO:tasks.workunit.client.0.smithi053.stdout:3/902: truncate d1/d5/d31/f39 8225091 0 2024-09-16T00:50:34.931 INFO:tasks.workunit.client.0.smithi053.stdout:8/798: creat d10/f109 x:0 0 0 2024-09-16T00:50:34.933 INFO:tasks.workunit.client.0.smithi053.stdout:0/923: link d4/dc/d87/dc6/dc2/cd0 d4/dc/d1e/d22/dc5/dd2/df6/c131 0 2024-09-16T00:50:34.934 INFO:tasks.workunit.client.0.smithi053.stdout:2/904: dwrite d6/d9/dd/d3e/d52/d65/d92/fdc [0,4194304] 0 2024-09-16T00:50:34.934 INFO:tasks.workunit.client.0.smithi053.stdout:2/905: write d6/d90/dba/fbf [639173,73954] 0 2024-09-16T00:50:34.935 INFO:tasks.workunit.client.0.smithi053.stdout:2/906: dread - d6/d90/dba/f124 zero size 2024-09-16T00:50:34.935 INFO:tasks.workunit.client.0.smithi053.stdout:6/958: dwrite d1/dc/d39/f67 [0,4194304] 0 2024-09-16T00:50:34.935 INFO:tasks.workunit.client.0.smithi053.stdout:6/959: chown d1/dc/d3c/d4b/d58/c10c 848492 1 2024-09-16T00:50:34.935 INFO:tasks.workunit.client.0.smithi053.stdout:6/960: chown d1/dc/d1e/ca7 0 1 2024-09-16T00:50:34.935 INFO:tasks.workunit.client.0.smithi053.stdout:5/910: rename d3/d9c/dc4/le5 to d3/d7/d2b/d4b/d51/d96/l121 0 2024-09-16T00:50:34.937 INFO:tasks.workunit.client.0.smithi053.stdout:1/775: dread d5/d18/fc1 [4194304,4194304] 0 2024-09-16T00:50:34.940 INFO:tasks.workunit.client.0.smithi053.stdout:8/799: dread d10/d1c/d92/f7d [4194304,4194304] 0 2024-09-16T00:50:34.940 INFO:tasks.workunit.client.0.smithi053.stdout:8/800: write d10/d1c/f26 [3561203,5570] 0 2024-09-16T00:50:34.941 INFO:tasks.workunit.client.0.smithi053.stdout:6/961: dread d1/dc/d3d/f40 [0,4194304] 0 2024-09-16T00:50:34.943 INFO:tasks.workunit.client.0.smithi053.stdout:0/924: unlink d4/dc/d1e/dfc/fe1 0 2024-09-16T00:50:34.943 INFO:tasks.workunit.client.0.smithi053.stdout:0/925: creat d4/dc/d1e/d22/dc5/dd2/f132 x:0 0 0 2024-09-16T00:50:34.943 INFO:tasks.workunit.client.0.smithi053.stdout:0/926: stat d4/dc/d25/d34/d71/d96 0 2024-09-16T00:50:34.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/801: write d10/d21/f4b [265395,94634] 0 2024-09-16T00:50:34.948 INFO:tasks.workunit.client.0.smithi053.stdout:3/903: dwrite d1/d5/d31/d7a/dbb/f9a [0,4194304] 0 2024-09-16T00:50:34.949 INFO:tasks.workunit.client.0.smithi053.stdout:4/683: dwrite d0/d3c/d48/d95/fed [0,4194304] 0 2024-09-16T00:50:34.950 INFO:tasks.workunit.client.0.smithi053.stdout:1/776: dread d5/d5a/f7e [0,4194304] 0 2024-09-16T00:50:34.955 INFO:tasks.workunit.client.0.smithi053.stdout:6/962: dread d1/dc/d45/f94 [0,4194304] 0 2024-09-16T00:50:34.955 INFO:tasks.workunit.client.0.smithi053.stdout:6/963: getdents d1/da6/dea/d120 0 2024-09-16T00:50:34.960 INFO:tasks.workunit.client.0.smithi053.stdout:1/777: dread d5/dd/d7f/fb4 [0,4194304] 0 2024-09-16T00:50:34.964 INFO:tasks.workunit.client.0.smithi053.stdout:5/911: mkdir d3/d7/d2b/d4b/d51/ddc/d122 0 2024-09-16T00:50:34.966 INFO:tasks.workunit.client.0.smithi053.stdout:8/802: dwrite d10/d52/fd0 [0,4194304] 0 2024-09-16T00:50:34.972 INFO:tasks.workunit.client.0.smithi053.stdout:9/787: rmdir d8/d19 39 2024-09-16T00:50:34.973 INFO:tasks.workunit.client.0.smithi053.stdout:6/964: dwrite d1/dc/d45/fc7 [0,4194304] 0 2024-09-16T00:50:34.973 INFO:tasks.workunit.client.0.smithi053.stdout:5/912: dread d3/d7/d42/d57/fbe [0,4194304] 0 2024-09-16T00:50:34.973 INFO:tasks.workunit.client.0.smithi053.stdout:5/913: chown d3/c85 110007842 1 2024-09-16T00:50:34.974 INFO:tasks.workunit.client.0.smithi053.stdout:5/914: chown d3/d7/d2b/d4b/d51/d53/da5/df4 21840014 1 2024-09-16T00:50:34.975 INFO:tasks.workunit.client.0.smithi053.stdout:6/965: dread d1/dc/d3d/f40 [0,4194304] 0 2024-09-16T00:50:34.975 INFO:tasks.workunit.client.0.smithi053.stdout:0/927: symlink d4/dc/d1e/d1f/d40/d44/l133 0 2024-09-16T00:50:34.976 INFO:tasks.workunit.client.0.smithi053.stdout:2/907: rmdir d6/db1/d108 39 2024-09-16T00:50:34.983 INFO:tasks.workunit.client.0.smithi053.stdout:3/904: getdents d1/d5/d31/d7c/dbf/dcd/de6 0 2024-09-16T00:50:34.983 INFO:tasks.workunit.client.0.smithi053.stdout:3/905: chown d1/d5/d11/da9/db8/dfb/d65/d97/d7f/fe4 0 1 2024-09-16T00:50:34.984 INFO:tasks.workunit.client.0.smithi053.stdout:1/778: dwrite d5/dd/d7f/f93 [0,4194304] 0 2024-09-16T00:50:34.985 INFO:tasks.workunit.client.0.smithi053.stdout:2/908: dread d6/d29/f91 [0,4194304] 0 2024-09-16T00:50:34.988 INFO:tasks.workunit.client.0.smithi053.stdout:0/928: write d4/d5a/d82/f9c [753238,105213] 0 2024-09-16T00:50:34.992 INFO:tasks.workunit.client.0.smithi053.stdout:4/684: getdents d0/d9f 0 2024-09-16T00:50:35.001 INFO:tasks.workunit.client.0.smithi053.stdout:5/915: mknod d3/d7/d2b/d4b/d51/c123 0 2024-09-16T00:50:35.005 INFO:tasks.workunit.client.0.smithi053.stdout:6/966: link d1/dc/d39/c4c d1/dc/d3c/d4a/dec/d10f/c136 0 2024-09-16T00:50:35.005 INFO:tasks.workunit.client.0.smithi053.stdout:6/967: truncate d1/dc/d45/fcf 248500 0 2024-09-16T00:50:35.006 INFO:tasks.workunit.client.0.smithi053.stdout:6/968: write d1/dc/d1e/d41/dfd/d81/f84 [518430,88131] 0 2024-09-16T00:50:35.009 INFO:tasks.workunit.client.0.smithi053.stdout:1/779: getdents d5/dd/d7f/ddf 0 2024-09-16T00:50:35.009 INFO:tasks.workunit.client.0.smithi053.stdout:1/780: fdatasync d5/d18/d33/d8a/d98/dd0/fd6 0 2024-09-16T00:50:35.010 INFO:tasks.workunit.client.0.smithi053.stdout:2/909: rmdir d6/d9/dd/d3e/d72 39 2024-09-16T00:50:35.013 INFO:tasks.workunit.client.0.smithi053.stdout:5/916: dwrite d3/d7/d2b/d4b/d51/d96/fc3 [0,4194304] 0 2024-09-16T00:50:35.013 INFO:tasks.workunit.client.0.smithi053.stdout:0/929: creat d4/dc/d1e/d22/de2/f134 x:0 0 0 2024-09-16T00:50:35.014 INFO:tasks.workunit.client.0.smithi053.stdout:4/685: mknod d0/d3c/d48/d4d/d70/cef 0 2024-09-16T00:50:35.031 INFO:tasks.workunit.client.0.smithi053.stdout:4/686: dwrite d0/f38 [0,4194304] 0 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:8/803: rmdir d10 39 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:8/804: stat d10/d1c/d2b/d40 0 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:9/788: truncate d8/d1c/fa8 162532 0 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:9/789: fdatasync d8/d1c/d2b/f76 0 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:9/790: creat d8/d1c/d2b/d8b/f100 x:0 0 0 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:9/791: chown d8/d1c/d2b/l89 3102762 1 2024-09-16T00:50:35.037 INFO:tasks.workunit.client.0.smithi053.stdout:6/969: truncate d1/dc/d3c/d4b/d75/fc0 2332399 0 2024-09-16T00:50:35.038 INFO:tasks.workunit.client.0.smithi053.stdout:3/906: link d1/d4e/f6b d1/d5/d11/da9/db8/dfb/dd5/d9f/f12c 0 2024-09-16T00:50:35.051 INFO:tasks.workunit.client.0.smithi053.stdout:4/687: dwrite d0/d3c/d48/f91 [0,4194304] 0 2024-09-16T00:50:35.100 INFO:tasks.workunit.client.0.smithi053.stdout:2/910: symlink d6/d9/dd/dbb/l125 0 2024-09-16T00:50:35.109 INFO:tasks.workunit.client.0.smithi053.stdout:2/911: dread d6/d29/d2b/f46 [8388608,4194304] 0 2024-09-16T00:50:35.109 INFO:tasks.workunit.client.0.smithi053.stdout:2/912: dread - d6/d29/d2b/d39/df5/d102/f104 zero size 2024-09-16T00:50:35.109 INFO:tasks.workunit.client.0.smithi053.stdout:2/913: chown d6/d9/dd/d3e/d52/cb8 3277 1 2024-09-16T00:50:35.109 INFO:tasks.workunit.client.0.smithi053.stdout:2/914: chown d6/d9/dd/d3e/d52/ld6 5706236 1 2024-09-16T00:50:35.121 INFO:tasks.workunit.client.0.smithi053.stdout:0/930: creat d4/dc/d25/d11a/f135 x:0 0 0 2024-09-16T00:50:35.123 INFO:tasks.workunit.client.0.smithi053.stdout:1/781: dwrite d5/dd/d19/f46 [0,4194304] 0 2024-09-16T00:50:35.125 INFO:tasks.workunit.client.0.smithi053.stdout:0/931: dread d4/dc/d25/d34/d71/fca [0,4194304] 0 2024-09-16T00:50:35.133 INFO:tasks.workunit.client.0.smithi053.stdout:8/805: unlink d10/d21/d28/d3c/d63/f74 0 2024-09-16T00:50:35.144 INFO:tasks.workunit.client.0.smithi053.stdout:9/792: getdents d8/d13 0 2024-09-16T00:50:35.149 INFO:tasks.workunit.client.0.smithi053.stdout:6/970: mknod d1/d2f/d9b/d128/c137 0 2024-09-16T00:50:35.149 INFO:tasks.workunit.client.0.smithi053.stdout:6/971: fdatasync d1/dc/d39/f23 0 2024-09-16T00:50:35.156 INFO:tasks.workunit.client.0.smithi053.stdout:3/907: unlink d1/d5/d31/d7c/dbf/dcd/de6/lc4 0 2024-09-16T00:50:35.158 INFO:tasks.workunit.client.0.smithi053.stdout:4/688: truncate d0/d2/dd/d25/d39/dca/fd7 2952794 0 2024-09-16T00:50:35.159 INFO:tasks.workunit.client.0.smithi053.stdout:4/689: read - d0/fe5 zero size 2024-09-16T00:50:35.159 INFO:tasks.workunit.client.0.smithi053.stdout:4/690: readlink d0/da/d42/d8b/l8f 0 2024-09-16T00:50:35.167 INFO:tasks.workunit.client.0.smithi053.stdout:4/691: write d0/d2/d1e/f6d [3558320,104214] 0 2024-09-16T00:50:35.167 INFO:tasks.workunit.client.0.smithi053.stdout:4/692: dread - d0/d31/d98/fe9 zero size 2024-09-16T00:50:35.169 INFO:tasks.workunit.client.0.smithi053.stdout:4/693: fdatasync d0/d2/d1e/f6d 0 2024-09-16T00:50:35.193 INFO:tasks.workunit.client.0.smithi053.stdout:4/694: dwrite d0/d2/dd/d25/d41/d78/f50 [0,4194304] 0 2024-09-16T00:50:35.193 INFO:tasks.workunit.client.0.smithi053.stdout:4/695: chown d0/da/dd5/ld9 32247 1 2024-09-16T00:50:35.252 INFO:tasks.workunit.client.0.smithi053.stdout:5/917: rmdir d3/d7/d2b/d37/d58/d9f 39 2024-09-16T00:50:35.257 INFO:tasks.workunit.client.0.smithi053.stdout:1/782: rename d5/d18/d33/d8a/d98/dd0/l23 to d5/dd/d8e/dcf/l100 0 2024-09-16T00:50:35.257 INFO:tasks.workunit.client.0.smithi053.stdout:0/932: rename d4/dc/d87 to d4/dc/d87/dc6/dbe/d136 22 2024-09-16T00:50:35.257 INFO:tasks.workunit.client.0.smithi053.stdout:1/783: chown d5/dd/lf8 1638421 1 2024-09-16T00:50:35.257 INFO:tasks.workunit.client.0.smithi053.stdout:1/784: readlink d5/d18/d33/d30/l3c 0 2024-09-16T00:50:35.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/933: dread d4/dc/d1e/d22/fba [0,4194304] 0 2024-09-16T00:50:35.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/934: chown d4/dc/d87/dc6/dbe/l7a 71812 1 2024-09-16T00:50:35.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/935: chown d4/dc/d1e/d22/dc5/dd2/dec/f103 58395 1 2024-09-16T00:50:35.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/936: chown d4/dc/d1e/d22/dc5 858040 1 2024-09-16T00:50:35.262 INFO:tasks.workunit.client.0.smithi053.stdout:0/937: readlink d4/dc/d1e/d1f/d40/d73/l9b 0 2024-09-16T00:50:35.338 INFO:tasks.workunit.client.0.smithi053.stdout:6/972: symlink d1/dc/d3c/d4a/dec/d10f/l138 0 2024-09-16T00:50:35.339 INFO:tasks.workunit.client.0.smithi053.stdout:6/973: chown d1/dc/d3d/f115 18214113 1 2024-09-16T00:50:35.340 INFO:tasks.workunit.client.0.smithi053.stdout:4/696: mknod d0/d2/dd/d25/d37/dc5/cf0 0 2024-09-16T00:50:35.340 INFO:tasks.workunit.client.0.smithi053.stdout:4/697: chown d0/d3c/d48/d58/c8d 107 1 2024-09-16T00:50:35.341 INFO:tasks.workunit.client.0.smithi053.stdout:5/918: mknod d3/d7/d2b/d4b/d51/c124 0 2024-09-16T00:50:35.345 INFO:tasks.workunit.client.0.smithi053.stdout:1/785: symlink d5/dd/dd5/l101 0 2024-09-16T00:50:35.347 INFO:tasks.workunit.client.0.smithi053.stdout:6/974: dread d1/dc/d3c/d4b/fb2 [0,4194304] 0 2024-09-16T00:50:35.347 INFO:tasks.workunit.client.0.smithi053.stdout:0/938: mknod d4/dc/d1e/dfc/d120/c137 0 2024-09-16T00:50:35.347 INFO:tasks.workunit.client.0.smithi053.stdout:6/975: stat d1/dc/d39 0 2024-09-16T00:50:35.347 INFO:tasks.workunit.client.0.smithi053.stdout:6/976: chown d1/da6/dea/dff 2550 1 2024-09-16T00:50:35.348 INFO:tasks.workunit.client.0.smithi053.stdout:6/977: fsync d1/dc/d3c/d4a/fdb 0 2024-09-16T00:50:35.351 INFO:tasks.workunit.client.0.smithi053.stdout:5/919: getdents d3/d9c/dc4 0 2024-09-16T00:50:35.352 INFO:tasks.workunit.client.0.smithi053.stdout:6/978: getdents d1/dc/d54/dd1/de5 0 2024-09-16T00:50:35.353 INFO:tasks.workunit.client.0.smithi053.stdout:6/979: write d1/dc/d45/fb0 [5030477,85282] 0 2024-09-16T00:50:35.354 INFO:tasks.workunit.client.0.smithi053.stdout:6/980: dread d1/dc/d1e/fe2 [0,4194304] 0 2024-09-16T00:50:35.354 INFO:tasks.workunit.client.0.smithi053.stdout:5/920: symlink d3/d7/d2b/d4b/d51/ddc/dea/l125 0 2024-09-16T00:50:35.354 INFO:tasks.workunit.client.0.smithi053.stdout:5/921: write d3/d7/d2b/d37/d58/d9f/dce/ff8 [50377,103686] 0 2024-09-16T00:50:35.357 INFO:tasks.workunit.client.0.smithi053.stdout:6/981: truncate d1/dc/d3c/d4b/d58/db9/fe0 30575 0 2024-09-16T00:50:35.358 INFO:tasks.workunit.client.0.smithi053.stdout:0/939: creat d4/dc/d25/d34/f138 x:0 0 0 2024-09-16T00:50:35.358 INFO:tasks.workunit.client.0.smithi053.stdout:0/940: creat d4/dc/d25/d11a/f139 x:0 0 0 2024-09-16T00:50:35.370 INFO:tasks.workunit.client.0.smithi053.stdout:6/982: creat d1/dc/d3c/d4a/dec/f139 x:0 0 0 2024-09-16T00:50:35.375 INFO:tasks.workunit.client.0.smithi053.stdout:0/941: creat d4/dc/d1e/dfc/d12c/f13a x:0 0 0 2024-09-16T00:50:35.375 INFO:tasks.workunit.client.0.smithi053.stdout:0/942: truncate d4/dc/d25/d34/f138 170050 0 2024-09-16T00:50:35.430 INFO:tasks.workunit.client.0.smithi053.stdout:2/915: creat d6/d9/dd/d3e/d52/d65/f126 x:0 0 0 2024-09-16T00:50:35.435 INFO:tasks.workunit.client.0.smithi053.stdout:9/793: rmdir d8/d4c/d5b 39 2024-09-16T00:50:35.435 INFO:tasks.workunit.client.0.smithi053.stdout:9/794: write d8/d19/d31/fdd [717456,84199] 0 2024-09-16T00:50:35.436 INFO:tasks.workunit.client.0.smithi053.stdout:9/795: mkdir d8/df9/d101 0 2024-09-16T00:50:35.444 INFO:tasks.workunit.client.0.smithi053.stdout:3/908: rename d1/d5/d11/da9/db8/dfb/fb9 to d1/d5/d31/d3b/d9c/f12d 0 2024-09-16T00:50:35.447 INFO:tasks.workunit.client.0.smithi053.stdout:2/916: dwrite d6/d9/dd/d3e/d52/d65/d92/fa6 [0,4194304] 0 2024-09-16T00:50:35.447 INFO:tasks.workunit.client.0.smithi053.stdout:2/917: fsync d6/dae/fb3 0 2024-09-16T00:50:35.447 INFO:tasks.workunit.client.0.smithi053.stdout:2/918: creat d6/d90/dba/f127 x:0 0 0 2024-09-16T00:50:35.447 INFO:tasks.workunit.client.0.smithi053.stdout:1/786: rename d5/d18/d1f/f3d to d5/d18/d33/d8a/d98/dd0/df2/f102 0 2024-09-16T00:50:35.448 INFO:tasks.workunit.client.0.smithi053.stdout:1/787: write d5/dd/f31 [1737276,15740] 0 2024-09-16T00:50:35.450 INFO:tasks.workunit.client.0.smithi053.stdout:5/922: mkdir d3/d9c/d126 0 2024-09-16T00:50:35.453 INFO:tasks.workunit.client.0.smithi053.stdout:2/919: read d6/d9/dd/d28/f2f [3887466,14858] 0 2024-09-16T00:50:35.456 INFO:tasks.workunit.client.0.smithi053.stdout:5/923: mkdir d3/d9c/dc4/d127 0 2024-09-16T00:50:35.456 INFO:tasks.workunit.client.0.smithi053.stdout:9/796: dwrite d8/d1c/d2b/d8b/f100 [0,4194304] 0 2024-09-16T00:50:35.460 INFO:tasks.workunit.client.0.smithi053.stdout:5/924: symlink d3/d9c/dc4/l128 0 2024-09-16T00:50:35.460 INFO:tasks.workunit.client.0.smithi053.stdout:5/925: write d3/d7/d24/d34/d3e/fb7 [686089,99608] 0 2024-09-16T00:50:35.461 INFO:tasks.workunit.client.0.smithi053.stdout:5/926: write d3/d9c/f115 [633774,94046] 0 2024-09-16T00:50:35.465 INFO:tasks.workunit.client.0.smithi053.stdout:5/927: mknod d3/d7/d24/d3f/c129 0 2024-09-16T00:50:35.469 INFO:tasks.workunit.client.0.smithi053.stdout:5/928: creat d3/d7/d2b/d4b/d51/d53/f12a x:0 0 0 2024-09-16T00:50:35.471 INFO:tasks.workunit.client.0.smithi053.stdout:5/929: mkdir d3/d7/d24/d3f/d12b 0 2024-09-16T00:50:35.473 INFO:tasks.workunit.client.0.smithi053.stdout:2/920: dwrite d6/d9/d14/d81/fb5 [0,4194304] 0 2024-09-16T00:50:35.494 INFO:tasks.workunit.client.0.smithi053.stdout:5/930: dwrite d3/d7/d2b/d4b/d51/ddc/dea/faa [0,4194304] 0 2024-09-16T00:50:35.498 INFO:tasks.workunit.client.0.smithi053.stdout:5/931: creat d3/d7/d2b/d37/f12c x:0 0 0 2024-09-16T00:50:35.498 INFO:tasks.workunit.client.0.smithi053.stdout:5/932: write d3/d7/d2b/f3a [3637395,53706] 0 2024-09-16T00:50:35.502 INFO:tasks.workunit.client.0.smithi053.stdout:5/933: rmdir d3/d7/d2b/d4b/d51/d96 39 2024-09-16T00:50:35.504 INFO:tasks.workunit.client.0.smithi053.stdout:5/934: link d3/d7/d2b/d37/d58/d79/lb3 d3/l12d 0 2024-09-16T00:50:35.505 INFO:tasks.workunit.client.0.smithi053.stdout:5/935: creat d3/d7/d2b/d37/d58/d9f/f12e x:0 0 0 2024-09-16T00:50:35.510 INFO:tasks.workunit.client.0.smithi053.stdout:4/698: dwrite d0/d2/dd/d25/f21 [0,4194304] 0 2024-09-16T00:50:35.512 INFO:tasks.workunit.client.0.smithi053.stdout:4/699: symlink d0/da/d7c/lf1 0 2024-09-16T00:50:35.512 INFO:tasks.workunit.client.0.smithi053.stdout:4/700: truncate d0/d2/dd/d25/d41/d78/f50 4694769 0 2024-09-16T00:50:35.514 INFO:tasks.workunit.client.0.smithi053.stdout:4/701: mknod d0/cf2 0 2024-09-16T00:50:35.514 INFO:tasks.workunit.client.0.smithi053.stdout:4/702: fdatasync d0/da/d7c/f9e 0 2024-09-16T00:50:35.517 INFO:tasks.workunit.client.0.smithi053.stdout:4/703: creat d0/d3c/d48/d95/ff3 x:0 0 0 2024-09-16T00:50:35.520 INFO:tasks.workunit.client.0.smithi053.stdout:4/704: getdents d0/da/d42/d8b/d87/d99 0 2024-09-16T00:50:35.520 INFO:tasks.workunit.client.0.smithi053.stdout:4/705: readlink d0/d2/l2e 0 2024-09-16T00:50:35.523 INFO:tasks.workunit.client.0.smithi053.stdout:4/706: symlink d0/da/dbf/lf4 0 2024-09-16T00:50:35.523 INFO:tasks.workunit.client.0.smithi053.stdout:4/707: chown d0/d2/dd/d25/f5b 0 1 2024-09-16T00:50:35.524 INFO:tasks.workunit.client.0.smithi053.stdout:4/708: readlink d0/d3c/la6 0 2024-09-16T00:50:35.529 INFO:tasks.workunit.client.0.smithi053.stdout:2/921: unlink d6/d9/dd/d3e/d52/f11d 0 2024-09-16T00:50:35.532 INFO:tasks.workunit.client.0.smithi053.stdout:6/983: rename d1/dc/d3d/f115 to d1/dc/d3c/f13a 0 2024-09-16T00:50:35.532 INFO:tasks.workunit.client.0.smithi053.stdout:4/709: dread d0/d2/d1e/f6d [0,4194304] 0 2024-09-16T00:50:35.534 INFO:tasks.workunit.client.0.smithi053.stdout:2/922: mkdir d6/d29/d2b/d39/df5/d102/d128 0 2024-09-16T00:50:35.537 INFO:tasks.workunit.client.0.smithi053.stdout:0/943: rename c2 to d4/dc/d1e/d1f/d40/d73/dd6/c13b 0 2024-09-16T00:50:35.539 INFO:tasks.workunit.client.0.smithi053.stdout:4/710: symlink d0/d2/d1e/d4b/lf5 0 2024-09-16T00:50:35.539 INFO:tasks.workunit.client.0.smithi053.stdout:4/711: readlink d0/d2/lb 0 2024-09-16T00:50:35.540 INFO:tasks.workunit.client.0.smithi053.stdout:2/923: truncate d6/d9/dd/d3e/f7d 163016 0 2024-09-16T00:50:35.543 INFO:tasks.workunit.client.0.smithi053.stdout:3/909: rename d1/d5/d11/da9/db8/dfb/d65/d97/d7f/lea to d1/d5/d91/d5e/d90/da2/l12e 0 2024-09-16T00:50:35.544 INFO:tasks.workunit.client.0.smithi053.stdout:4/712: link d0/d3c/d48/d4d/d70/fb9 d0/d65/ff6 0 2024-09-16T00:50:35.547 INFO:tasks.workunit.client.0.smithi053.stdout:0/944: write d4/dc/d87/dc6/f70 [2115300,110923] 0 2024-09-16T00:50:35.552 INFO:tasks.workunit.client.0.smithi053.stdout:2/924: dread f5 [4194304,4194304] 0 2024-09-16T00:50:35.556 INFO:tasks.workunit.client.0.smithi053.stdout:4/713: dread d0/d2/dd/d25/d41/d78/f2c [0,4194304] 0 2024-09-16T00:50:35.559 INFO:tasks.workunit.client.0.smithi053.stdout:0/945: stat d4/dc/d1e/d1f/d40/d73/dd6/c13b 0 2024-09-16T00:50:35.560 INFO:tasks.workunit.client.0.smithi053.stdout:6/984: dwrite d1/dc/d1e/fc3 [0,4194304] 0 2024-09-16T00:50:35.561 INFO:tasks.workunit.client.0.smithi053.stdout:4/714: creat d0/d2/dd/d25/d41/ff7 x:0 0 0 2024-09-16T00:50:35.570 INFO:tasks.workunit.client.0.smithi053.stdout:6/985: mkdir d1/dc/d3c/d4a/dec/df5/d13b 0 2024-09-16T00:50:35.579 INFO:tasks.workunit.client.0.smithi053.stdout:9/797: rename d8/f46 to d8/d19/d51/d6d/f102 0 2024-09-16T00:50:35.582 INFO:tasks.workunit.client.0.smithi053.stdout:5/936: rename d3/d7/d24/d34/d80/f92 to d3/d7/d2b/d37/d46/d11a/f12f 0 2024-09-16T00:50:35.583 INFO:tasks.workunit.client.0.smithi053.stdout:9/798: mkdir d8/d1c/d2b/d2c/dbb/d103 0 2024-09-16T00:50:35.585 INFO:tasks.workunit.client.0.smithi053.stdout:6/986: write d1/dc/d1e/f30 [2607204,31837] 0 2024-09-16T00:50:35.585 INFO:tasks.workunit.client.0.smithi053.stdout:3/910: rename d1/d5/d11/da9/db8/dfb/d6c/ce9 to d1/d5/d91/d5e/d90/c12f 0 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/937: mkdir d3/d7/d2b/d4b/d51/d130 0 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/938: chown d3/d7/d2b/d37/d58/f105 838153 1 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/939: creat d3/d7/d2b/d37/d58/d79/f131 x:0 0 0 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/940: stat d3/d7/d2b/d37/d58/d79 0 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:5/941: dread - d3/d7/d2b/d37/d106/f113 zero size 2024-09-16T00:50:35.588 INFO:tasks.workunit.client.0.smithi053.stdout:0/946: dwrite d4/dc/d25/d11a/f135 [0,4194304] 0 2024-09-16T00:50:35.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/715: dwrite d0/da/fc4 [0,4194304] 0 2024-09-16T00:50:35.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/716: truncate d0/d2/dd/d25/fc2 858010 0 2024-09-16T00:50:35.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/717: readlink d0/d2/dd/d25/d37/l3a 0 2024-09-16T00:50:35.589 INFO:tasks.workunit.client.0.smithi053.stdout:4/718: creat d0/d31/ff8 x:0 0 0 2024-09-16T00:50:35.591 INFO:tasks.workunit.client.0.smithi053.stdout:9/799: dread d8/d1c/f63 [0,4194304] 0 2024-09-16T00:50:35.592 INFO:tasks.workunit.client.0.smithi053.stdout:5/942: dread d3/d7/d24/fc8 [0,4194304] 0 2024-09-16T00:50:35.592 INFO:tasks.workunit.client.0.smithi053.stdout:5/943: read - d3/d7/d2b/d37/d58/d79/f102 zero size 2024-09-16T00:50:35.592 INFO:tasks.workunit.client.0.smithi053.stdout:6/987: rmdir d1/dc/d3d 39 2024-09-16T00:50:35.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/911: creat d1/f130 x:0 0 0 2024-09-16T00:50:35.595 INFO:tasks.workunit.client.0.smithi053.stdout:3/912: write d1/d5/d11/da9/db8/dfb/fd1 [9319263,70492] 0 2024-09-16T00:50:35.599 INFO:tasks.workunit.client.0.smithi053.stdout:9/800: dread d8/f17 [0,4194304] 0 2024-09-16T00:50:35.604 INFO:tasks.workunit.client.0.smithi053.stdout:4/719: symlink d0/da/d42/d8b/lf9 0 2024-09-16T00:50:35.606 INFO:tasks.workunit.client.0.smithi053.stdout:5/944: mknod d3/d7/d2b/d4b/d51/d53/c132 0 2024-09-16T00:50:35.608 INFO:tasks.workunit.client.0.smithi053.stdout:6/988: mknod d1/da6/dea/d120/c13c 0 2024-09-16T00:50:35.610 INFO:tasks.workunit.client.0.smithi053.stdout:3/913: creat d1/d5/d11/da9/db8/dfb/d6c/f131 x:0 0 0 2024-09-16T00:50:35.610 INFO:tasks.workunit.client.0.smithi053.stdout:3/914: readlink d1/d5/l72 0 2024-09-16T00:50:35.610 INFO:tasks.workunit.client.0.smithi053.stdout:3/915: chown d1 143377 1 2024-09-16T00:50:35.611 INFO:tasks.workunit.client.0.smithi053.stdout:9/801: getdents d8/d1c 0 2024-09-16T00:50:35.612 INFO:tasks.workunit.client.0.smithi053.stdout:0/947: getdents d4/dc/d1e/dfc/d12c 0 2024-09-16T00:50:35.615 INFO:tasks.workunit.client.0.smithi053.stdout:4/720: mkdir d0/d2/dd/d25/d39/dca/dfa 0 2024-09-16T00:50:35.615 INFO:tasks.workunit.client.0.smithi053.stdout:4/721: truncate d0/da/f69 1372494 0 2024-09-16T00:50:35.616 INFO:tasks.workunit.client.0.smithi053.stdout:5/945: link d3/f35 d3/d7/d24/d3f/f133 0 2024-09-16T00:50:35.616 INFO:tasks.workunit.client.0.smithi053.stdout:5/946: truncate d3/d7/d2b/d4b/d51/d53/f88 763766 0 2024-09-16T00:50:35.616 INFO:tasks.workunit.client.0.smithi053.stdout:5/947: creat d3/d7/d2b/d37/f134 x:0 0 0 2024-09-16T00:50:35.616 INFO:tasks.workunit.client.0.smithi053.stdout:5/948: chown d3/d7/d24/d34 912194339 1 2024-09-16T00:50:35.625 INFO:tasks.workunit.client.0.smithi053.stdout:3/916: creat d1/d5/d31/d7c/dbf/dcd/d121/f132 x:0 0 0 2024-09-16T00:50:35.626 INFO:tasks.workunit.client.0.smithi053.stdout:0/948: symlink d4/dc/d1e/d22/dc5/dd2/l13c 0 2024-09-16T00:50:35.626 INFO:tasks.workunit.client.0.smithi053.stdout:0/949: read d4/dc/d25/d34/d71/fdb [25350,104974] 0 2024-09-16T00:50:35.626 INFO:tasks.workunit.client.0.smithi053.stdout:0/950: chown d4/dc/d1e/f113 155317 1 2024-09-16T00:50:35.627 INFO:tasks.workunit.client.0.smithi053.stdout:4/722: symlink d0/d2/dd/d25/d39/dca/dfa/lfb 0 2024-09-16T00:50:35.627 INFO:tasks.workunit.client.0.smithi053.stdout:4/723: stat d0/da/d42/d8b/d87/d99 0 2024-09-16T00:50:35.627 INFO:tasks.workunit.client.0.smithi053.stdout:4/724: chown d0/fe5 1 1 2024-09-16T00:50:35.627 INFO:tasks.workunit.client.0.smithi053.stdout:4/725: fsync d0/d31/fb0 0 2024-09-16T00:50:35.629 INFO:tasks.workunit.client.0.smithi053.stdout:5/949: creat d3/d7/d2b/f135 x:0 0 0 2024-09-16T00:50:35.629 INFO:tasks.workunit.client.0.smithi053.stdout:5/950: truncate d3/d7/d24/d3f/f75 9133486 0 2024-09-16T00:50:35.629 INFO:tasks.workunit.client.0.smithi053.stdout:6/989: getdents d1/dc/d3c/d4b 0 2024-09-16T00:50:35.630 INFO:tasks.workunit.client.0.smithi053.stdout:3/917: mknod d1/d5/d91/c133 0 2024-09-16T00:50:35.630 INFO:tasks.workunit.client.0.smithi053.stdout:3/918: chown d1/d5/d11/d3a/f67 1 1 2024-09-16T00:50:35.633 INFO:tasks.workunit.client.0.smithi053.stdout:0/951: mknod d4/dc/d1e/d1f/d40/d73/c13d 0 2024-09-16T00:50:35.633 INFO:tasks.workunit.client.0.smithi053.stdout:0/952: write d4/dc/d1e/d22/de2/fcf [973909,68431] 0 2024-09-16T00:50:35.633 INFO:tasks.workunit.client.0.smithi053.stdout:0/953: chown d4/dc/d1e/d1f/d40/cad 24 1 2024-09-16T00:50:35.633 INFO:tasks.workunit.client.0.smithi053.stdout:9/802: dwrite d8/d1c/d2b/fda [0,4194304] 0 2024-09-16T00:50:35.633 INFO:tasks.workunit.client.0.smithi053.stdout:9/803: truncate d8/d4c/d5a/d99/dc8/de8/ff2 4397 0 2024-09-16T00:50:35.634 INFO:tasks.workunit.client.0.smithi053.stdout:4/726: unlink d0/d31/d98/fb4 0 2024-09-16T00:50:35.636 INFO:tasks.workunit.client.0.smithi053.stdout:5/951: mkdir d3/d7/d2b/d4b/d51/d53/da5/d136 0 2024-09-16T00:50:35.636 INFO:tasks.workunit.client.0.smithi053.stdout:5/952: write d3/d7/d2b/d37/d58/d9f/f12e [940500,19776] 0 2024-09-16T00:50:35.639 INFO:tasks.workunit.client.0.smithi053.stdout:0/954: mkdir d4/dc/d87/dc6/dbe/d13e 0 2024-09-16T00:50:35.639 INFO:tasks.workunit.client.0.smithi053.stdout:0/955: fdatasync d4/dc/d1e/d1f/d40/f62 0 2024-09-16T00:50:35.640 INFO:tasks.workunit.client.0.smithi053.stdout:4/727: truncate d0/d3c/d48/f4c 2478991 0 2024-09-16T00:50:35.641 INFO:tasks.workunit.client.0.smithi053.stdout:5/953: unlink d3/d7/c9b 0 2024-09-16T00:50:35.642 INFO:tasks.workunit.client.0.smithi053.stdout:5/954: read d3/d7/d2b/d4b/d51/ddc/d107/f11d [141560,46589] 0 2024-09-16T00:50:35.643 INFO:tasks.workunit.client.0.smithi053.stdout:6/990: link d1/dc/d39/f89 d1/dc/d3c/d4b/d58/f13d 0 2024-09-16T00:50:35.644 INFO:tasks.workunit.client.0.smithi053.stdout:9/804: mkdir d8/d104 0 2024-09-16T00:50:35.644 INFO:tasks.workunit.client.0.smithi053.stdout:9/805: chown d8/d1c/l2d 40726 1 2024-09-16T00:50:35.644 INFO:tasks.workunit.client.0.smithi053.stdout:4/728: mknod d0/d2/dd/d25/d41/d78/dac/cfc 0 2024-09-16T00:50:35.649 INFO:tasks.workunit.client.0.smithi053.stdout:3/919: dwrite d1/d5/d91/d5e/d69/d109/d28/fe0 [0,4194304] 0 2024-09-16T00:50:35.649 INFO:tasks.workunit.client.0.smithi053.stdout:6/991: mknod d1/dc/d3c/d4a/c13e 0 2024-09-16T00:50:35.649 INFO:tasks.workunit.client.0.smithi053.stdout:9/806: creat d8/d4c/d5a/d99/dc8/de8/f105 x:0 0 0 2024-09-16T00:50:35.649 INFO:tasks.workunit.client.0.smithi053.stdout:9/807: write d8/d4c/d5a/d99/dc8/de8/ff5 [556520,112074] 0 2024-09-16T00:50:35.649 INFO:tasks.workunit.client.0.smithi053.stdout:0/956: write d4/dc/d25/d34/f88 [2121105,105418] 0 2024-09-16T00:50:35.657 INFO:tasks.workunit.client.0.smithi053.stdout:2/925: rename d6/d90/faf to d6/d29/d2b/f129 0 2024-09-16T00:50:35.661 INFO:tasks.workunit.client.0.smithi053.stdout:3/920: rmdir d1/d5/d31/d7a/dbb 39 2024-09-16T00:50:35.662 INFO:tasks.workunit.client.0.smithi053.stdout:0/957: readlink d4/l3b 0 2024-09-16T00:50:35.662 INFO:tasks.workunit.client.0.smithi053.stdout:9/808: read d8/f1f [947270,31883] 0 2024-09-16T00:50:35.664 INFO:tasks.workunit.client.0.smithi053.stdout:4/729: dwrite d0/d31/d98/fee [0,4194304] 0 2024-09-16T00:50:35.664 INFO:tasks.workunit.client.0.smithi053.stdout:2/926: creat d6/d9/d14/d81/f12a x:0 0 0 2024-09-16T00:50:35.667 INFO:tasks.workunit.client.0.smithi053.stdout:3/921: creat d1/d5/d11/d3a/f134 x:0 0 0 2024-09-16T00:50:35.667 INFO:tasks.workunit.client.0.smithi053.stdout:3/922: readlink d1/d5/d91/d5e/d69/l8b 0 2024-09-16T00:50:35.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/809: mkdir d8/d22/d54/ded/d106 0 2024-09-16T00:50:35.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/810: dread - d8/d19/d51/faa zero size 2024-09-16T00:50:35.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/811: write d8/f35 [3707255,115709] 0 2024-09-16T00:50:35.669 INFO:tasks.workunit.client.0.smithi053.stdout:9/812: chown d8/d19/d51/ce9 0 1 2024-09-16T00:50:35.677 INFO:tasks.workunit.client.0.smithi053.stdout:6/992: dwrite d1/dc/d39/f89 [4194304,4194304] 0 2024-09-16T00:50:35.679 INFO:tasks.workunit.client.0.smithi053.stdout:2/927: symlink d6/dae/l12b 0 2024-09-16T00:50:35.689 INFO:tasks.workunit.client.0.smithi053.stdout:6/993: dread d1/dc/d1e/d41/f69 [0,4194304] 0 2024-09-16T00:50:35.689 INFO:tasks.workunit.client.0.smithi053.stdout:3/923: dwrite d1/d5/d11/d3a/dc5/f101 [0,4194304] 0 2024-09-16T00:50:35.691 INFO:tasks.workunit.client.0.smithi053.stdout:4/730: getdents d0 0 2024-09-16T00:50:35.691 INFO:tasks.workunit.client.0.smithi053.stdout:9/813: dwrite d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:35.693 INFO:tasks.workunit.client.0.smithi053.stdout:0/958: dwrite d4/d13/de8/f122 [0,4194304] 0 2024-09-16T00:50:35.693 INFO:tasks.workunit.client.0.smithi053.stdout:6/994: mkdir d1/d2f/d9b/dd0/de6/d13f 0 2024-09-16T00:50:35.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/924: truncate d1/d5/d31/d7c/dbf/de3/feb 3216189 0 2024-09-16T00:50:35.695 INFO:tasks.workunit.client.0.smithi053.stdout:4/731: mkdir d0/d3c/d48/d58/dfd 0 2024-09-16T00:50:35.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/928: dwrite d6/f73 [0,4194304] 0 2024-09-16T00:50:35.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/929: fsync d6/d9/dd/d28/f3f 0 2024-09-16T00:50:35.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/930: write d6/d29/d2b/d39/df5/d102/f104 [784271,92684] 0 2024-09-16T00:50:35.701 INFO:tasks.workunit.client.0.smithi053.stdout:0/959: mkdir d4/dc/d1e/d1f/d40/d44/d54/deb/d104/d13f 0 2024-09-16T00:50:35.703 INFO:tasks.workunit.client.0.smithi053.stdout:6/995: mknod d1/dc/d1e/c140 0 2024-09-16T00:50:35.703 INFO:tasks.workunit.client.0.smithi053.stdout:6/996: fdatasync d1/dc/d1e/d41/dfd/d81/fe4 0 2024-09-16T00:50:35.703 INFO:tasks.workunit.client.0.smithi053.stdout:6/997: getdents d1/d2f/d9b/dd0/de6/d13f 0 2024-09-16T00:50:35.703 INFO:tasks.workunit.client.0.smithi053.stdout:6/998: readlink d1/dc/d3d/l5e 0 2024-09-16T00:50:35.704 INFO:tasks.workunit.client.0.smithi053.stdout:3/925: mkdir d1/d5/d91/d5e/d69/d109/d135 0 2024-09-16T00:50:35.704 INFO:tasks.workunit.client.0.smithi053.stdout:2/931: dread d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:35.706 INFO:tasks.workunit.client.0.smithi053.stdout:4/732: link d0/d3c/d48/d58/f73 d0/d3c/d48/d4d/d70/ffe 0 2024-09-16T00:50:35.706 INFO:tasks.workunit.client.0.smithi053.stdout:4/733: write d0/da/fc4 [4438766,39131] 0 2024-09-16T00:50:35.706 INFO:tasks.workunit.client.0.smithi053.stdout:4/734: chown d0/d2/d1e/d4b/f79 110493419 1 2024-09-16T00:50:35.710 INFO:tasks.workunit.client.0.smithi053.stdout:6/999: mknod d1/d2f/db3/c141 0 2024-09-16T00:50:35.710 INFO:tasks.workunit.client.0.smithi053.stdout:9/814: dwrite d8/d4c/d5a/fa7 [0,4194304] 0 2024-09-16T00:50:35.710 INFO:tasks.workunit.client.0.smithi053.stdout:9/815: readlink d8/d22/d54/df7/lba 0 2024-09-16T00:50:35.712 INFO:tasks.workunit.client.0.smithi053.stdout:2/932: creat d6/d29/d2b/d39/df5/f12c x:0 0 0 2024-09-16T00:50:35.712 INFO:tasks.workunit.client.0.smithi053.stdout:2/933: read - d6/d9/dd/d80/fa5 zero size 2024-09-16T00:50:35.714 INFO:tasks.workunit.client.0.smithi053.stdout:3/926: write d1/d5/d91/f4d [11831940,44159] 0 2024-09-16T00:50:35.714 INFO:tasks.workunit.client.0.smithi053.stdout:3/927: readlink d1/d5/d91/d5e/d69/d109/lb2 0 2024-09-16T00:50:35.714 INFO:tasks.workunit.client.0.smithi053.stdout:3/928: fdatasync d1/d5/d11/d3a/f134 0 2024-09-16T00:50:35.714 INFO:tasks.workunit.client.0.smithi053.stdout:3/929: chown d1/d5/d11/d3a/dc5/l119 516038 1 2024-09-16T00:50:35.715 INFO:tasks.workunit.client.0.smithi053.stdout:3/930: write d1/d5/d91/d5e/d69/d109/fdf [134486,98753] 0 2024-09-16T00:50:35.715 INFO:tasks.workunit.client.0.smithi053.stdout:3/931: fdatasync d1/d5/d31/d7c/dbf/ff2 0 2024-09-16T00:50:35.715 INFO:tasks.workunit.client.0.smithi053.stdout:9/816: symlink d8/d1c/d2b/l107 0 2024-09-16T00:50:35.715 INFO:tasks.workunit.client.0.smithi053.stdout:0/960: write d4/dc/d1e/d1f/d40/d73/dd7/fa8 [3946744,111204] 0 2024-09-16T00:50:35.728 INFO:tasks.workunit.client.0.smithi053.stdout:5/955: getdents d3/d7/d24/d34/d80 0 2024-09-16T00:50:35.838 INFO:tasks.workunit.client.0.smithi053.stdout:5/956: fsync d3/d7/d24/d34/d3e/da1/fc9 0 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:0/961: rmdir d4/dc/d25/d11a 39 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:2/934: dwrite d6/d9/dd/d3e/d52/d65/d92/fdc [0,4194304] 0 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:2/935: chown d6/d9/d14/fd4 5503318 1 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:3/932: rename d1/d5/d11/d3a/dc5 to d1/d5/d11/da9/db8/dfb/d65/d97/d7f/d136 0 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:5/957: getdents d3/d7/d2b/d4b/d51 0 2024-09-16T00:50:35.842 INFO:tasks.workunit.client.0.smithi053.stdout:0/962: mknod d4/d5a/c140 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/958: mknod d3/d7/d2b/d4b/d51/d53/da5/d136/c137 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:0/963: mkdir d4/dc/d1e/d1f/d40/d44/d54/deb/d104/d141 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:0/964: truncate d4/dc/d25/fb0 447064 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:0/965: chown d4/dc/d25/d34/d71/fdb 69 1 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/959: rmdir d3/d7/d2b/d4b/d51/ddc/dea 39 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/960: getdents d3 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/961: mkdir d3/d7/d2b/d37/d58/d138 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/962: creat d3/d7/d2b/d4b/d51/ddc/d107/d120/f139 x:0 0 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/963: mknod d3/d7/d2b/d4b/d51/ddc/d107/d120/c13a 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/964: truncate d3/d7/d24/d34/d5b/d10b/f117 721130 0 2024-09-16T00:50:35.843 INFO:tasks.workunit.client.0.smithi053.stdout:5/965: creat d3/d7/d24/d3f/f13b x:0 0 0 2024-09-16T00:50:35.844 INFO:tasks.workunit.client.0.smithi053.stdout:5/966: write d3/d7/d24/f66 [1199499,53700] 0 2024-09-16T00:50:35.844 INFO:tasks.workunit.client.0.smithi053.stdout:2/936: dwrite d6/d29/d2b/d39/f105 [0,4194304] 0 2024-09-16T00:50:35.844 INFO:tasks.workunit.client.0.smithi053.stdout:2/937: creat d6/d9/dd/d80/f12d x:0 0 0 2024-09-16T00:50:35.844 INFO:tasks.workunit.client.0.smithi053.stdout:0/966: dwrite d4/f9 [4194304,4194304] 0 2024-09-16T00:50:35.844 INFO:tasks.workunit.client.0.smithi053.stdout:3/933: dwrite d1/d5/d91/d5e/d69/d109/f71 [0,4194304] 0 2024-09-16T00:50:35.852 INFO:tasks.workunit.client.0.smithi053.stdout:2/938: unlink d6/d90/dba/lda 0 2024-09-16T00:50:35.852 INFO:tasks.workunit.client.0.smithi053.stdout:2/939: creat d6/f12e x:0 0 0 2024-09-16T00:50:35.852 INFO:tasks.workunit.client.0.smithi053.stdout:2/940: readlink d6/d9/dd/d3e/d52/d7e/l8b 0 2024-09-16T00:50:35.852 INFO:tasks.workunit.client.0.smithi053.stdout:5/967: dwrite d3/d7/d2b/d4b/d51/ddc/dea/ff7 [0,4194304] 0 2024-09-16T00:50:35.858 INFO:tasks.workunit.client.0.smithi053.stdout:3/934: mknod d1/d5/d11/da9/c137 0 2024-09-16T00:50:35.859 INFO:tasks.workunit.client.0.smithi053.stdout:2/941: mkdir d6/d90/d12f 0 2024-09-16T00:50:35.862 INFO:tasks.workunit.client.0.smithi053.stdout:5/968: unlink d3/d7/d2b/d37/d58/d9f/dce/l104 0 2024-09-16T00:50:35.863 INFO:tasks.workunit.client.0.smithi053.stdout:2/942: unlink d6/d29/db7/lc0 0 2024-09-16T00:50:35.863 INFO:tasks.workunit.client.0.smithi053.stdout:0/967: dwrite d4/dc/d1e/d1f/d40/d73/dd7/f105 [0,4194304] 0 2024-09-16T00:50:35.864 INFO:tasks.workunit.client.0.smithi053.stdout:3/935: write d1/d5/d91/f2b [1274501,91254] 0 2024-09-16T00:50:35.864 INFO:tasks.workunit.client.0.smithi053.stdout:3/936: creat d1/d5/d31/d7c/dbf/de3/f138 x:0 0 0 2024-09-16T00:50:35.864 INFO:tasks.workunit.client.0.smithi053.stdout:0/968: read d4/dc/d25/d34/d71/fca [101957,98247] 0 2024-09-16T00:50:35.865 INFO:tasks.workunit.client.0.smithi053.stdout:5/969: creat d3/d9c/f13c x:0 0 0 2024-09-16T00:50:35.867 INFO:tasks.workunit.client.0.smithi053.stdout:8/806: sync 2024-09-16T00:50:35.868 INFO:tasks.workunit.client.0.smithi053.stdout:8/807: fsync d10/d21/d28/da2/ff6 0 2024-09-16T00:50:35.870 INFO:tasks.workunit.client.0.smithi053.stdout:1/788: sync 2024-09-16T00:50:35.870 INFO:tasks.workunit.client.0.smithi053.stdout:1/789: write d5/d18/f79 [717968,103978] 0 2024-09-16T00:50:35.870 INFO:tasks.workunit.client.0.smithi053.stdout:2/943: truncate d6/d29/d2b/f99 623589 0 2024-09-16T00:50:35.870 INFO:tasks.workunit.client.0.smithi053.stdout:1/790: write d5/d7/f76 [2906233,25102] 0 2024-09-16T00:50:35.870 INFO:tasks.workunit.client.0.smithi053.stdout:1/791: creat d5/d7/d39/dc6/f103 x:0 0 0 2024-09-16T00:50:35.875 INFO:tasks.workunit.client.0.smithi053.stdout:0/969: write d4/dc/d25/f2f [593491,103890] 0 2024-09-16T00:50:35.875 INFO:tasks.workunit.client.0.smithi053.stdout:3/937: mknod d1/d5/d11/da9/db8/dfb/d65/d97/d7f/c139 0 2024-09-16T00:50:35.878 INFO:tasks.workunit.client.0.smithi053.stdout:8/808: getdents d10/d4a/dbf 0 2024-09-16T00:50:35.881 INFO:tasks.workunit.client.0.smithi053.stdout:1/792: mkdir d5/d9/d88/dea/d104 0 2024-09-16T00:50:35.881 INFO:tasks.workunit.client.0.smithi053.stdout:1/793: truncate d5/d9/d77/ffa 1190747 0 2024-09-16T00:50:35.881 INFO:tasks.workunit.client.0.smithi053.stdout:1/794: truncate d5/d18/d33/fcb 810324 0 2024-09-16T00:50:35.884 INFO:tasks.workunit.client.0.smithi053.stdout:3/938: mknod d1/d5/d91/d5e/d69/ddd/d106/c13a 0 2024-09-16T00:50:35.890 INFO:tasks.workunit.client.0.smithi053.stdout:8/809: mknod d10/d4a/dc2/dcd/c10a 0 2024-09-16T00:50:35.893 INFO:tasks.workunit.client.0.smithi053.stdout:1/795: mknod d5/d5a/c105 0 2024-09-16T00:50:35.893 INFO:tasks.workunit.client.0.smithi053.stdout:3/939: mkdir d1/d5/d91/d5e/d69/d109/d28/dcc/d13b 0 2024-09-16T00:50:35.895 INFO:tasks.workunit.client.0.smithi053.stdout:8/810: dread d10/fe8 [0,4194304] 0 2024-09-16T00:50:35.895 INFO:tasks.workunit.client.0.smithi053.stdout:8/811: truncate d10/d1c/d49/f89 4761209 0 2024-09-16T00:50:35.895 INFO:tasks.workunit.client.0.smithi053.stdout:1/796: truncate d5/d18/d33/d8a/d98/dd0/f15 333131 0 2024-09-16T00:50:35.896 INFO:tasks.workunit.client.0.smithi053.stdout:3/940: symlink d1/d5/d91/d5e/d69/d109/d28/dcc/d13b/l13c 0 2024-09-16T00:50:35.900 INFO:tasks.workunit.client.0.smithi053.stdout:4/735: write d0/d3c/d48/d4d/d70/ffe [339626,1377] 0 2024-09-16T00:50:35.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/797: creat d5/d9/d4c/dff/f106 x:0 0 0 2024-09-16T00:50:35.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/798: stat d5/d7/d39/d57/d82 0 2024-09-16T00:50:35.901 INFO:tasks.workunit.client.0.smithi053.stdout:1/799: chown d5/d9/d73/d84/fc8 54715768 1 2024-09-16T00:50:35.904 INFO:tasks.workunit.client.0.smithi053.stdout:3/941: dread d1/d5/d31/d7c/ff8 [0,4194304] 0 2024-09-16T00:50:35.905 INFO:tasks.workunit.client.0.smithi053.stdout:3/942: creat d1/d4e/d10a/db5/f13d x:0 0 0 2024-09-16T00:50:35.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/736: getdents d0/da 0 2024-09-16T00:50:35.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/737: dread - d0/d3c/d48/d95/fda zero size 2024-09-16T00:50:35.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/738: fsync d0/da/fc4 0 2024-09-16T00:50:35.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/739: fdatasync d0/fe5 0 2024-09-16T00:50:35.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/740: fdatasync d0/d2/f1b 0 2024-09-16T00:50:35.907 INFO:tasks.workunit.client.0.smithi053.stdout:8/812: dwrite d10/d1c/d2b/d40/ff1 [0,4194304] 0 2024-09-16T00:50:35.922 INFO:tasks.workunit.client.0.smithi053.stdout:8/813: dwrite d10/d1c/d49/faf [0,4194304] 0 2024-09-16T00:50:35.923 INFO:tasks.workunit.client.0.smithi053.stdout:8/814: write d10/d21/f2c [4472684,2721] 0 2024-09-16T00:50:35.923 INFO:tasks.workunit.client.0.smithi053.stdout:8/815: fsync d10/d1c/d49/fb9 0 2024-09-16T00:50:35.928 INFO:tasks.workunit.client.0.smithi053.stdout:8/816: truncate d10/d4a/dc2/fdb 2502941 0 2024-09-16T00:50:35.942 INFO:tasks.workunit.client.0.smithi053.stdout:1/800: fsync d5/d18/d33/d8a/d98/dd0/f15 0 2024-09-16T00:50:35.946 INFO:tasks.workunit.client.0.smithi053.stdout:1/801: rename d5/de3/f78 to d5/d18/d33/d30/daf/f107 0 2024-09-16T00:50:35.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:35 smithi152 ceph-mon[33237]: pgmap v18: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 183 MiB/s rd, 200 MiB/s wr, 339 op/s 2024-09-16T00:50:35.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:35 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:35.950 INFO:tasks.workunit.client.0.smithi053.stdout:1/802: link d5/d9/d73/d84/fc5 d5/d18/d1f/f108 0 2024-09-16T00:50:35.954 INFO:tasks.workunit.client.0.smithi053.stdout:1/803: rename d5/d5a/cd4 to d5/d9/d4c/dcd/c109 0 2024-09-16T00:50:35.955 INFO:tasks.workunit.client.0.smithi053.stdout:8/817: dwrite d10/d1c/d2b/d40/d76/fc5 [0,4194304] 0 2024-09-16T00:50:35.955 INFO:tasks.workunit.client.0.smithi053.stdout:8/818: write d10/d21/d28/f32 [4768311,90455] 0 2024-09-16T00:50:35.956 INFO:tasks.workunit.client.0.smithi053.stdout:1/804: mkdir d5/d18/d33/d8a/d98/dd0/d10a 0 2024-09-16T00:50:35.956 INFO:tasks.workunit.client.0.smithi053.stdout:1/805: fsync d5/d18/d33/fad 0 2024-09-16T00:50:35.956 INFO:tasks.workunit.client.0.smithi053.stdout:2/944: dwrite d6/d29/d2b/f99 [0,4194304] 0 2024-09-16T00:50:35.957 INFO:tasks.workunit.client.0.smithi053.stdout:1/806: dread d5/d7/f20 [4194304,4194304] 0 2024-09-16T00:50:35.957 INFO:tasks.workunit.client.0.smithi053.stdout:1/807: chown d5/d9/d73/d84 2440738 1 2024-09-16T00:50:35.958 INFO:tasks.workunit.client.0.smithi053.stdout:8/819: stat d10/d21/l48 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:2/945: dwrite d6/d9/dd/d3e/ff9 [0,4194304] 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:2/946: fsync d6/d9/dd/d3e/d52/f68 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:1/808: dwrite d5/d18/d33/d8a/d98/dd0/f5c [0,4194304] 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:1/809: write d5/d9/d4c/f89 [2177654,75876] 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:8/820: dwrite d10/d1c/d2b/f4e [4194304,4194304] 0 2024-09-16T00:50:35.980 INFO:tasks.workunit.client.0.smithi053.stdout:8/821: chown d10/d4a/dac/f90 15600869 1 2024-09-16T00:50:35.990 INFO:tasks.workunit.client.0.smithi053.stdout:2/947: creat d6/d9/dd/d28/f130 x:0 0 0 2024-09-16T00:50:35.995 INFO:tasks.workunit.client.0.smithi053.stdout:2/948: dread d6/d9/f1d [0,4194304] 0 2024-09-16T00:50:35.995 INFO:tasks.workunit.client.0.smithi053.stdout:8/822: dwrite d10/d1c/d49/f89 [0,4194304] 0 2024-09-16T00:50:35.997 INFO:tasks.workunit.client.0.smithi053.stdout:1/810: mknod d5/dd/d7f/ddf/c10b 0 2024-09-16T00:50:35.997 INFO:tasks.workunit.client.0.smithi053.stdout:1/811: readlink d5/dd/lf8 0 2024-09-16T00:50:35.997 INFO:tasks.workunit.client.0.smithi053.stdout:1/812: write d5/d9/d4c/dff/fe6 [4023645,63969] 0 2024-09-16T00:50:35.997 INFO:tasks.workunit.client.0.smithi053.stdout:1/813: write d5/fc9 [753729,111156] 0 2024-09-16T00:50:35.997 INFO:tasks.workunit.client.0.smithi053.stdout:1/814: write d5/d9/d73/d84/fc5 [126774,48162] 0 2024-09-16T00:50:35.999 INFO:tasks.workunit.client.0.smithi053.stdout:2/949: mkdir d6/dae/d131 0 2024-09-16T00:50:36.006 INFO:tasks.workunit.client.0.smithi053.stdout:1/815: dread d5/dd/d19/f46 [0,4194304] 0 2024-09-16T00:50:36.006 INFO:tasks.workunit.client.0.smithi053.stdout:1/816: dread - d5/d18/d1f/fe8 zero size 2024-09-16T00:50:36.006 INFO:tasks.workunit.client.0.smithi053.stdout:8/823: rename d10/d52/df8 to d10/d1c/d92/d66/d9d/da6/ddf/d10b 0 2024-09-16T00:50:36.006 INFO:tasks.workunit.client.0.smithi053.stdout:8/824: write d10/d1c/d2b/fed [64113,1006] 0 2024-09-16T00:50:36.009 INFO:tasks.workunit.client.0.smithi053.stdout:2/950: mkdir d6/d29/d2b/d39/df5/d132 0 2024-09-16T00:50:36.011 INFO:tasks.workunit.client.0.smithi053.stdout:1/817: creat d5/d18/d33/d30/daf/f10c x:0 0 0 2024-09-16T00:50:36.011 INFO:tasks.workunit.client.0.smithi053.stdout:2/951: mknod d6/dae/d131/c133 0 2024-09-16T00:50:36.013 INFO:tasks.workunit.client.0.smithi053.stdout:2/952: dread d6/d9/dd/d3e/d52/d65/f10a [0,4194304] 0 2024-09-16T00:50:36.014 INFO:tasks.workunit.client.0.smithi053.stdout:2/953: readlink d6/d9/db6/dbc/ld8 0 2024-09-16T00:50:36.014 INFO:tasks.workunit.client.0.smithi053.stdout:2/954: creat d6/d9/dd/d80/f134 x:0 0 0 2024-09-16T00:50:36.019 INFO:tasks.workunit.client.0.smithi053.stdout:1/818: symlink d5/dd/l10d 0 2024-09-16T00:50:36.021 INFO:tasks.workunit.client.0.smithi053.stdout:2/955: link d6/d9/dd/d3e/d72/d75/d84/l11a d6/dad/l135 0 2024-09-16T00:50:36.024 INFO:tasks.workunit.client.0.smithi053.stdout:2/956: link d6/d9/dd/dbb/l125 d6/d29/d2b/d39/df5/d102/l136 0 2024-09-16T00:50:36.029 INFO:tasks.workunit.client.0.smithi053.stdout:2/957: mkdir d6/d9/dd/df8/d137 0 2024-09-16T00:50:36.033 INFO:tasks.workunit.client.0.smithi053.stdout:2/958: mknod d6/d9/dd/d76/d111/c138 0 2024-09-16T00:50:36.033 INFO:tasks.workunit.client.0.smithi053.stdout:2/959: chown d6/d9/dd 25846 1 2024-09-16T00:50:36.033 INFO:tasks.workunit.client.0.smithi053.stdout:1/819: dwrite d5/d18/d33/f63 [0,4194304] 0 2024-09-16T00:50:36.034 INFO:tasks.workunit.client.0.smithi053.stdout:1/820: dread d5/d9/d77/ffa [0,4194304] 0 2024-09-16T00:50:36.040 INFO:tasks.workunit.client.0.smithi053.stdout:1/821: creat d5/d7/d39/d57/d82/f10e x:0 0 0 2024-09-16T00:50:36.043 INFO:tasks.workunit.client.0.smithi053.stdout:2/960: dread d6/d9/dd/d3e/d52/d65/f7c [4194304,4194304] 0 2024-09-16T00:50:36.045 INFO:tasks.workunit.client.0.smithi053.stdout:1/822: rename d5/d9/d4c/dcd/c109 to d5/d7/d39/d57/c10f 0 2024-09-16T00:50:36.045 INFO:tasks.workunit.client.0.smithi053.stdout:1/823: read d5/d18/d33/d8a/d98/dd0/f6e [219486,33855] 0 2024-09-16T00:50:36.045 INFO:tasks.workunit.client.0.smithi053.stdout:2/961: write d6/d90/dba/fbf [396178,1786] 0 2024-09-16T00:50:36.046 INFO:tasks.workunit.client.0.smithi053.stdout:2/962: write d6/d9/dd/d28/f57 [4548207,16439] 0 2024-09-16T00:50:36.046 INFO:tasks.workunit.client.0.smithi053.stdout:1/824: rmdir d5/d9/d88/dea 39 2024-09-16T00:50:36.046 INFO:tasks.workunit.client.0.smithi053.stdout:1/825: stat d5/dd/d47 0 2024-09-16T00:50:36.060 INFO:tasks.workunit.client.0.smithi053.stdout:2/963: dwrite d6/d9/dd/d80/f134 [0,4194304] 0 2024-09-16T00:50:36.065 INFO:tasks.workunit.client.0.smithi053.stdout:2/964: mkdir d6/d9/d74/d139 0 2024-09-16T00:50:36.065 INFO:tasks.workunit.client.0.smithi053.stdout:2/965: stat d6/d29/f9a 0 2024-09-16T00:50:36.065 INFO:tasks.workunit.client.0.smithi053.stdout:2/966: truncate d6/d29/f70 714072 0 2024-09-16T00:50:36.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/967: stat d6/d9/dd/d3e/d52/d65/c93 0 2024-09-16T00:50:36.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/968: stat d6/d29/d2b/lb9 0 2024-09-16T00:50:36.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/969: chown d6/d9/c2d 94611 1 2024-09-16T00:50:36.066 INFO:tasks.workunit.client.0.smithi053.stdout:2/970: fsync d6/d29/d2b/dd0/feb 0 2024-09-16T00:50:36.069 INFO:tasks.workunit.client.0.smithi053.stdout:2/971: getdents d6/db1 0 2024-09-16T00:50:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:35 smithi053 ceph-mon[27950]: pgmap v18: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 183 MiB/s rd, 200 MiB/s wr, 339 op/s 2024-09-16T00:50:36.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:35 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:36.069 INFO:tasks.workunit.client.0.smithi053.stdout:2/972: readlink d6/d9/dd/d3e/d52/d65/l66 0 2024-09-16T00:50:36.071 INFO:tasks.workunit.client.0.smithi053.stdout:2/973: rename d6/d9/dd/dbb/l125 to d6/d9/dd/d3e/d72/d75/d84/l13a 0 2024-09-16T00:50:36.079 INFO:tasks.workunit.client.0.smithi053.stdout:2/974: dread d6/d29/f91 [0,4194304] 0 2024-09-16T00:50:36.080 INFO:tasks.workunit.client.0.smithi053.stdout:2/975: getdents d6/d29/d2b/d39/df5/d102 0 2024-09-16T00:50:36.082 INFO:tasks.workunit.client.0.smithi053.stdout:2/976: link d6/d9/f12 d6/d9/dd/d3e/d52/d65/f13b 0 2024-09-16T00:50:36.082 INFO:tasks.workunit.client.0.smithi053.stdout:2/977: chown d6/f32 1003401 1 2024-09-16T00:50:36.085 INFO:tasks.workunit.client.0.smithi053.stdout:2/978: unlink d6/d29/fab 0 2024-09-16T00:50:36.085 INFO:tasks.workunit.client.0.smithi053.stdout:2/979: chown f5 1 1 2024-09-16T00:50:36.434 INFO:tasks.workunit.client.0.smithi053.stdout:9/817: sync 2024-09-16T00:50:36.450 INFO:tasks.workunit.client.0.smithi053.stdout:9/818: dwrite d8/d22/d26/d83/fd3 [0,4194304] 0 2024-09-16T00:50:36.450 INFO:tasks.workunit.client.0.smithi053.stdout:9/819: readlink d8/d1c/l78 0 2024-09-16T00:50:36.454 INFO:tasks.workunit.client.0.smithi053.stdout:9/820: mkdir d8/d19/d31/d108 0 2024-09-16T00:50:36.457 INFO:tasks.workunit.client.0.smithi053.stdout:9/821: dread d8/d19/f3f [0,4194304] 0 2024-09-16T00:50:36.459 INFO:tasks.workunit.client.0.smithi053.stdout:9/822: mkdir d8/d4c/d5a/d99/dc8/d109 0 2024-09-16T00:50:36.460 INFO:tasks.workunit.client.0.smithi053.stdout:9/823: link d8/d1c/d2b/d49/ca6 d8/d22/d54/c10a 0 2024-09-16T00:50:36.465 INFO:tasks.workunit.client.0.smithi053.stdout:9/824: mkdir d8/d4c/d5b/d10b 0 2024-09-16T00:50:36.465 INFO:tasks.workunit.client.0.smithi053.stdout:9/825: chown d8/d1c/d2b/d2c/d9b/ccb 3393063 1 2024-09-16T00:50:36.465 INFO:tasks.workunit.client.0.smithi053.stdout:9/826: fsync d8/d19/d31/f71 0 2024-09-16T00:50:36.478 INFO:tasks.workunit.client.0.smithi053.stdout:9/827: dwrite d8/d1c/d2b/d2c/f77 [0,4194304] 0 2024-09-16T00:50:36.481 INFO:tasks.workunit.client.0.smithi053.stdout:9/828: creat d8/d4c/d5a/d99/dee/f10c x:0 0 0 2024-09-16T00:50:36.482 INFO:tasks.workunit.client.0.smithi053.stdout:9/829: mknod d8/d22/c10d 0 2024-09-16T00:50:36.483 INFO:tasks.workunit.client.0.smithi053.stdout:9/830: mkdir d8/d4c/d5a/d99/dc8/df6/d10e 0 2024-09-16T00:50:36.483 INFO:tasks.workunit.client.0.smithi053.stdout:9/831: fsync d8/d1c/d2b/f47 0 2024-09-16T00:50:36.484 INFO:tasks.workunit.client.0.smithi053.stdout:9/832: write d8/d1c/f33 [482454,3170] 0 2024-09-16T00:50:36.485 INFO:tasks.workunit.client.0.smithi053.stdout:9/833: truncate d8/fb3 431069 0 2024-09-16T00:50:36.485 INFO:tasks.workunit.client.0.smithi053.stdout:9/834: getdents d8/d13 0 2024-09-16T00:50:36.492 INFO:tasks.workunit.client.0.smithi053.stdout:9/835: dread d8/d19/d31/f71 [0,4194304] 0 2024-09-16T00:50:36.506 INFO:tasks.workunit.client.0.smithi053.stdout:9/836: dwrite d8/f35 [0,4194304] 0 2024-09-16T00:50:36.506 INFO:tasks.workunit.client.0.smithi053.stdout:9/837: write d8/d22/dc2/fcd [919779,5912] 0 2024-09-16T00:50:36.506 INFO:tasks.workunit.client.0.smithi053.stdout:9/838: write d8/d22/d26/d83/fd3 [4406103,90458] 0 2024-09-16T00:50:36.511 INFO:tasks.workunit.client.0.smithi053.stdout:9/839: rmdir d8/d1c/d2b/d49 39 2024-09-16T00:50:36.513 INFO:tasks.workunit.client.0.smithi053.stdout:9/840: symlink d8/d1c/d2b/d49/l10f 0 2024-09-16T00:50:36.513 INFO:tasks.workunit.client.0.smithi053.stdout:9/841: readlink d8/d22/d26/l2f 0 2024-09-16T00:50:36.533 INFO:tasks.workunit.client.0.smithi053.stdout:9/842: dwrite d8/d22/d26/f68 [0,4194304] 0 2024-09-16T00:50:36.537 INFO:tasks.workunit.client.0.smithi053.stdout:9/843: mkdir d8/d4c/d5a/d99/dc8/d109/d110 0 2024-09-16T00:50:36.541 INFO:tasks.workunit.client.0.smithi053.stdout:9/844: write d8/d19/f3f [1910021,25935] 0 2024-09-16T00:50:36.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/845: mknod d8/d4c/d5a/d99/dee/c111 0 2024-09-16T00:50:36.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/846: dread - d8/d4c/d5b/f91 zero size 2024-09-16T00:50:36.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/847: creat d8/d1c/d2b/d8b/f112 x:0 0 0 2024-09-16T00:50:36.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/848: write d8/d1c/d2b/d49/fa1 [4851831,22164] 0 2024-09-16T00:50:36.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/849: chown d8/d4c/d5a/d99/dc8/fe3 5 1 2024-09-16T00:50:36.547 INFO:tasks.workunit.client.0.smithi053.stdout:4/741: sync 2024-09-16T00:50:36.548 INFO:tasks.workunit.client.0.smithi053.stdout:3/943: sync 2024-09-16T00:50:36.548 INFO:tasks.workunit.client.0.smithi053.stdout:5/970: sync 2024-09-16T00:50:36.548 INFO:tasks.workunit.client.0.smithi053.stdout:0/970: sync 2024-09-16T00:50:36.548 INFO:tasks.workunit.client.0.smithi053.stdout:8/825: sync 2024-09-16T00:50:36.548 INFO:tasks.workunit.client.0.smithi053.stdout:5/971: getdents d3/d7/d2b/d37/d58/d9f/dce/d10c 0 2024-09-16T00:50:36.549 INFO:tasks.workunit.client.0.smithi053.stdout:8/826: mknod d10/dbe/c10c 0 2024-09-16T00:50:36.550 INFO:tasks.workunit.client.0.smithi053.stdout:5/972: rmdir d3/d7/d2b/d37/d46 39 2024-09-16T00:50:36.550 INFO:tasks.workunit.client.0.smithi053.stdout:5/973: write d3/d7/d2b/f135 [973765,28278] 0 2024-09-16T00:50:36.551 INFO:tasks.workunit.client.0.smithi053.stdout:9/850: dread d8/d1c/d2b/d5c/f70 [0,4194304] 0 2024-09-16T00:50:36.552 INFO:tasks.workunit.client.0.smithi053.stdout:3/944: getdents d1/d5/d11/d3a/dc6 0 2024-09-16T00:50:36.555 INFO:tasks.workunit.client.0.smithi053.stdout:8/827: truncate d10/d21/d28/d3c/d63/d6a/fcc 4227662 0 2024-09-16T00:50:36.557 INFO:tasks.workunit.client.0.smithi053.stdout:4/742: write d0/da/fc4 [2342716,68295] 0 2024-09-16T00:50:36.558 INFO:tasks.workunit.client.0.smithi053.stdout:5/974: symlink d3/d7/d2b/d37/d58/d9f/l13d 0 2024-09-16T00:50:36.561 INFO:tasks.workunit.client.0.smithi053.stdout:9/851: unlink d8/d22/d26/cac 0 2024-09-16T00:50:36.561 INFO:tasks.workunit.client.0.smithi053.stdout:0/971: write d4/dc/d1e/d22/fe5 [262622,117522] 0 2024-09-16T00:50:36.562 INFO:tasks.workunit.client.0.smithi053.stdout:8/828: creat d10/d4a/d54/f10d x:0 0 0 2024-09-16T00:50:36.563 INFO:tasks.workunit.client.0.smithi053.stdout:4/743: truncate d0/d2/dd/d25/d41/f5d 4035778 0 2024-09-16T00:50:36.563 INFO:tasks.workunit.client.0.smithi053.stdout:4/744: chown d0/da/fa5 912033 1 2024-09-16T00:50:36.564 INFO:tasks.workunit.client.0.smithi053.stdout:5/975: truncate d3/f2c 1860495 0 2024-09-16T00:50:36.565 INFO:tasks.workunit.client.0.smithi053.stdout:9/852: mkdir d8/d19/d51/d6d/d7a/d113 0 2024-09-16T00:50:36.567 INFO:tasks.workunit.client.0.smithi053.stdout:0/972: mknod d4/d13/d10e/c142 0 2024-09-16T00:50:36.567 INFO:tasks.workunit.client.0.smithi053.stdout:0/973: write d4/dc/d1e/d22/f29 [312453,110981] 0 2024-09-16T00:50:36.569 INFO:tasks.workunit.client.0.smithi053.stdout:8/829: rename d10/d21/d28/d3c/d63/d6a/f93 to d10/d4a/dbf/de7/f10e 0 2024-09-16T00:50:36.572 INFO:tasks.workunit.client.0.smithi053.stdout:4/745: mknod d0/cff 0 2024-09-16T00:50:36.573 INFO:tasks.workunit.client.0.smithi053.stdout:5/976: link d3/f27 d3/d7/d42/f13e 0 2024-09-16T00:50:36.573 INFO:tasks.workunit.client.0.smithi053.stdout:5/977: truncate d3/d7/d2b/d37/d58/d79/f102 162655 0 2024-09-16T00:50:36.574 INFO:tasks.workunit.client.0.smithi053.stdout:5/978: dread - d3/d9c/f13c zero size 2024-09-16T00:50:36.580 INFO:tasks.workunit.client.0.smithi053.stdout:3/945: dwrite d1/d5/d91/d5e/d69/d109/d28/dcc/f10b [0,4194304] 0 2024-09-16T00:50:36.580 INFO:tasks.workunit.client.0.smithi053.stdout:9/853: dread d8/d13/f66 [4194304,4194304] 0 2024-09-16T00:50:36.583 INFO:tasks.workunit.client.0.smithi053.stdout:0/974: rename d4/dc/d25/d34/d71 to d4/dc/d87/dc6/dbe/d143 0 2024-09-16T00:50:36.583 INFO:tasks.workunit.client.0.smithi053.stdout:0/975: readlink d4/dc/d1e/d22/de2/lcd 0 2024-09-16T00:50:36.584 INFO:tasks.workunit.client.0.smithi053.stdout:8/830: truncate d10/f24 838722 0 2024-09-16T00:50:36.586 INFO:tasks.workunit.client.0.smithi053.stdout:5/979: dread d3/d7/d2b/d37/d58/f23 [0,4194304] 0 2024-09-16T00:50:36.587 INFO:tasks.workunit.client.0.smithi053.stdout:4/746: mknod d0/d2/dd/d25/d39/dca/dfa/c100 0 2024-09-16T00:50:36.588 INFO:tasks.workunit.client.0.smithi053.stdout:9/854: write d8/d1c/d2b/d5c/f81 [2971888,122523] 0 2024-09-16T00:50:36.588 INFO:tasks.workunit.client.0.smithi053.stdout:9/855: chown d8/d4c/d5a/d99/dc8/df6 426 1 2024-09-16T00:50:36.593 INFO:tasks.workunit.client.0.smithi053.stdout:0/976: mkdir d4/dc/d87/dc6/dbe/d143/d96/d5b/d144 0 2024-09-16T00:50:36.594 INFO:tasks.workunit.client.0.smithi053.stdout:8/831: mkdir d10/d1c/d2b/d40/d76/d10f 0 2024-09-16T00:50:36.598 INFO:tasks.workunit.client.0.smithi053.stdout:5/980: creat d3/d7/d2b/d4b/d4f/f13f x:0 0 0 2024-09-16T00:50:36.601 INFO:tasks.workunit.client.0.smithi053.stdout:4/747: rename d0/d2/dd/d25/lc0 to d0/d2/d1e/d4b/l101 0 2024-09-16T00:50:36.601 INFO:tasks.workunit.client.0.smithi053.stdout:4/748: creat d0/d31/f102 x:0 0 0 2024-09-16T00:50:36.601 INFO:tasks.workunit.client.0.smithi053.stdout:4/749: getdents d0/d2/dd/d25/d41/d78/dac/dec 0 2024-09-16T00:50:36.604 INFO:tasks.workunit.client.0.smithi053.stdout:0/977: creat d4/dc/d1e/d1f/d40/d44/d54/deb/d104/d141/f145 x:0 0 0 2024-09-16T00:50:36.605 INFO:tasks.workunit.client.0.smithi053.stdout:0/978: write d4/d13/f1c [1006322,24413] 0 2024-09-16T00:50:36.608 INFO:tasks.workunit.client.0.smithi053.stdout:5/981: creat d3/d7/d24/d34/d3e/da1/dee/f140 x:0 0 0 2024-09-16T00:50:36.612 INFO:tasks.workunit.client.0.smithi053.stdout:4/750: mknod d0/d9f/dbd/c103 0 2024-09-16T00:50:36.612 INFO:tasks.workunit.client.0.smithi053.stdout:9/856: dwrite d8/d13/fae [0,4194304] 0 2024-09-16T00:50:36.630 INFO:tasks.workunit.client.0.smithi053.stdout:1/826: sync 2024-09-16T00:50:36.630 INFO:tasks.workunit.client.0.smithi053.stdout:2/980: sync 2024-09-16T00:50:36.630 INFO:tasks.workunit.client.0.smithi053.stdout:1/827: chown d5/d18/d33/d8a/d98/dd0/fd6 32931 1 2024-09-16T00:50:36.632 INFO:tasks.workunit.client.0.smithi053.stdout:8/832: mknod d10/c110 0 2024-09-16T00:50:36.632 INFO:tasks.workunit.client.0.smithi053.stdout:8/833: fsync d10/d1c/f26 0 2024-09-16T00:50:36.634 INFO:tasks.workunit.client.0.smithi053.stdout:3/946: dwrite d1/d5/d11/da9/db8/dfb/dd5/f8c [0,4194304] 0 2024-09-16T00:50:36.634 INFO:tasks.workunit.client.0.smithi053.stdout:5/982: mkdir d3/d7/d2b/d4b/d51/d53/da5/d141 0 2024-09-16T00:50:36.636 INFO:tasks.workunit.client.0.smithi053.stdout:4/751: truncate d0/d2/dd/d25/d41/d78/f50 1116032 0 2024-09-16T00:50:36.642 INFO:tasks.workunit.client.0.smithi053.stdout:9/857: creat d8/d4c/d5a/d99/f114 x:0 0 0 2024-09-16T00:50:36.645 INFO:tasks.workunit.client.0.smithi053.stdout:1/828: creat d5/d18/d33/f110 x:0 0 0 2024-09-16T00:50:36.651 INFO:tasks.workunit.client.0.smithi053.stdout:8/834: rename d10/d21/d28/d3c/d84 to d10/d21/d28/d3c/d63/d6a/d111 0 2024-09-16T00:50:36.651 INFO:tasks.workunit.client.0.smithi053.stdout:8/835: read - d10/d1c/d92/ffc zero size 2024-09-16T00:50:36.652 INFO:tasks.workunit.client.0.smithi053.stdout:3/947: symlink d1/d5/d11/l13e 0 2024-09-16T00:50:36.652 INFO:tasks.workunit.client.0.smithi053.stdout:3/948: chown d1/d5/d91/d5e/d69/d109/d28/dcc/f10b 791005 1 2024-09-16T00:50:36.656 INFO:tasks.workunit.client.0.smithi053.stdout:5/983: symlink d3/d9c/d126/l142 0 2024-09-16T00:50:36.656 INFO:tasks.workunit.client.0.smithi053.stdout:5/984: fdatasync d3/d7/d24/d34/d3e/da1/fc9 0 2024-09-16T00:50:36.656 INFO:tasks.workunit.client.0.smithi053.stdout:5/985: creat d3/d7/d2b/f143 x:0 0 0 2024-09-16T00:50:36.657 INFO:tasks.workunit.client.0.smithi053.stdout:5/986: write d3/fc6 [1639524,45669] 0 2024-09-16T00:50:36.657 INFO:tasks.workunit.client.0.smithi053.stdout:5/987: write d3/d7/d2b/d4b/d51/d53/f12a [600894,90303] 0 2024-09-16T00:50:36.657 INFO:tasks.workunit.client.0.smithi053.stdout:5/988: fsync d3/f27 0 2024-09-16T00:50:36.657 INFO:tasks.workunit.client.0.smithi053.stdout:4/752: creat d0/d9f/dbd/f104 x:0 0 0 2024-09-16T00:50:36.657 INFO:tasks.workunit.client.0.smithi053.stdout:1/829: dwrite d5/d7/d39/dc6/fd1 [0,4194304] 0 2024-09-16T00:50:36.660 INFO:tasks.workunit.client.0.smithi053.stdout:3/949: dread d1/d5/d91/d5e/d69/d109/d28/dcc/f10b [0,4194304] 0 2024-09-16T00:50:36.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/981: unlink d6/d9/f1e 0 2024-09-16T00:50:36.661 INFO:tasks.workunit.client.0.smithi053.stdout:2/982: chown d6/d9/d74/ff3 238321901 1 2024-09-16T00:50:36.662 INFO:tasks.workunit.client.0.smithi053.stdout:8/836: truncate d10/d21/f3e 802793 0 2024-09-16T00:50:36.669 INFO:tasks.workunit.client.0.smithi053.stdout:5/989: creat d3/d7/d2b/d4b/d51/d53/da5/d141/f144 x:0 0 0 2024-09-16T00:50:36.670 INFO:tasks.workunit.client.0.smithi053.stdout:5/990: write d3/d7/d2b/d4b/d51/ddc/d107/d120/f139 [54313,4535] 0 2024-09-16T00:50:36.671 INFO:tasks.workunit.client.0.smithi053.stdout:4/753: unlink d0/l18 0 2024-09-16T00:50:36.671 INFO:tasks.workunit.client.0.smithi053.stdout:4/754: getdents d0/da/d7c/dc6 0 2024-09-16T00:50:36.674 INFO:tasks.workunit.client.0.smithi053.stdout:3/950: dwrite d1/d5/d11/da9/db8/dfb/fd1 [4194304,4194304] 0 2024-09-16T00:50:36.676 INFO:tasks.workunit.client.0.smithi053.stdout:1/830: mkdir d5/d18/d33/d30/daf/d111 0 2024-09-16T00:50:36.680 INFO:tasks.workunit.client.0.smithi053.stdout:2/983: truncate d6/d9/dd/d3e/d52/d65/d92/fa7 1105037 0 2024-09-16T00:50:36.681 INFO:tasks.workunit.client.0.smithi053.stdout:8/837: mknod d10/d9e/df2/c112 0 2024-09-16T00:50:36.688 INFO:tasks.workunit.client.0.smithi053.stdout:4/755: truncate d0/d2/d1e/d4b/f62 214875 0 2024-09-16T00:50:36.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/951: symlink d1/d5/d11/da9/db8/dfb/d64/l13f 0 2024-09-16T00:50:36.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/952: chown d1/d5/lb1 24401 1 2024-09-16T00:50:36.694 INFO:tasks.workunit.client.0.smithi053.stdout:3/953: truncate d1/d5/d11/da9/db8/dfb/dd5/fd0 1291829 0 2024-09-16T00:50:36.696 INFO:tasks.workunit.client.0.smithi053.stdout:1/831: mknod d5/d18/d33/d8a/c112 0 2024-09-16T00:50:36.698 INFO:tasks.workunit.client.0.smithi053.stdout:2/984: mknod d6/d29/d2b/d39/df5/c13c 0 2024-09-16T00:50:36.699 INFO:tasks.workunit.client.0.smithi053.stdout:2/985: chown d6/d9/dd/dbb/le7 441 1 2024-09-16T00:50:36.700 INFO:tasks.workunit.client.0.smithi053.stdout:8/838: mknod d10/d1c/d2b/c113 0 2024-09-16T00:50:36.700 INFO:tasks.workunit.client.0.smithi053.stdout:8/839: dread - d10/d1c/d2b/d40/fba zero size 2024-09-16T00:50:36.700 INFO:tasks.workunit.client.0.smithi053.stdout:8/840: fsync d10/d52/f55 0 2024-09-16T00:50:36.707 INFO:tasks.workunit.client.0.smithi053.stdout:5/991: rmdir d3/d7/d24/d34/d3e/da1/dee 39 2024-09-16T00:50:36.714 INFO:tasks.workunit.client.0.smithi053.stdout:4/756: rmdir d0/da/d7c/de1 39 2024-09-16T00:50:36.719 INFO:tasks.workunit.client.0.smithi053.stdout:8/841: dwrite d10/d1c/f26 [0,4194304] 0 2024-09-16T00:50:36.719 INFO:tasks.workunit.client.0.smithi053.stdout:8/842: readlink d10/d1c/d49/l96 0 2024-09-16T00:50:36.723 INFO:tasks.workunit.client.0.smithi053.stdout:3/954: rename d1/d5/f68 to d1/d5/d11/da9/db8/d11d/f140 0 2024-09-16T00:50:36.724 INFO:tasks.workunit.client.0.smithi053.stdout:3/955: dread d1/d5/d91/d5e/d69/ddd/f104 [0,4194304] 0 2024-09-16T00:50:36.725 INFO:tasks.workunit.client.0.smithi053.stdout:3/956: readlink d1/d5/d11/da9/db8/dfb/d6c/l75 0 2024-09-16T00:50:36.726 INFO:tasks.workunit.client.0.smithi053.stdout:1/832: stat d5/d7/d39/d57/c10f 0 2024-09-16T00:50:36.729 INFO:tasks.workunit.client.0.smithi053.stdout:2/986: mknod d6/d9/dd/d80/c13d 0 2024-09-16T00:50:36.729 INFO:tasks.workunit.client.0.smithi053.stdout:2/987: stat d6/d9/dd/d3e/ff9 0 2024-09-16T00:50:36.732 INFO:tasks.workunit.client.0.smithi053.stdout:3/957: write d1/d5/d31/f38 [1357623,2706] 0 2024-09-16T00:50:36.733 INFO:tasks.workunit.client.0.smithi053.stdout:3/958: creat d1/d5/d11/da9/db8/dfb/d64/f141 x:0 0 0 2024-09-16T00:50:36.733 INFO:tasks.workunit.client.0.smithi053.stdout:5/992: symlink d3/d7/d24/d34/d5b/d10b/l145 0 2024-09-16T00:50:36.735 INFO:tasks.workunit.client.0.smithi053.stdout:1/833: write d5/d5a/fa4 [1770068,126823] 0 2024-09-16T00:50:36.737 INFO:tasks.workunit.client.0.smithi053.stdout:4/757: dread d0/d2/dd/d25/d41/d78/f2b [0,4194304] 0 2024-09-16T00:50:36.739 INFO:tasks.workunit.client.0.smithi053.stdout:8/843: mknod d10/d21/d28/d3c/c114 0 2024-09-16T00:50:36.741 INFO:tasks.workunit.client.0.smithi053.stdout:8/844: write d10/d1c/d2b/f5d [38219,59254] 0 2024-09-16T00:50:36.741 INFO:tasks.workunit.client.0.smithi053.stdout:5/993: dread d3/fb6 [0,4194304] 0 2024-09-16T00:50:36.741 INFO:tasks.workunit.client.0.smithi053.stdout:3/959: read d1/d5/d91/d5e/d69/d109/d28/ffe [437881,100637] 0 2024-09-16T00:50:36.741 INFO:tasks.workunit.client.0.smithi053.stdout:3/960: dread - d1/d5/d31/d7a/dbb/f127 zero size 2024-09-16T00:50:36.744 INFO:tasks.workunit.client.0.smithi053.stdout:1/834: creat d5/dd/d47/f113 x:0 0 0 2024-09-16T00:50:36.744 INFO:tasks.workunit.client.0.smithi053.stdout:1/835: chown d5/d18/d33/d8a/d98/dd0/f3a 1 1 2024-09-16T00:50:36.744 INFO:tasks.workunit.client.0.smithi053.stdout:1/836: stat d5/d9/f4b 0 2024-09-16T00:50:36.750 INFO:tasks.workunit.client.0.smithi053.stdout:2/988: getdents d6/d9/d74 0 2024-09-16T00:50:36.750 INFO:tasks.workunit.client.0.smithi053.stdout:2/989: write d6/d9/dd/d3e/d52/d65/f126 [168946,99630] 0 2024-09-16T00:50:36.750 INFO:tasks.workunit.client.0.smithi053.stdout:2/990: chown d6/d9/dd/dbb/cfa 7636 1 2024-09-16T00:50:36.751 INFO:tasks.workunit.client.0.smithi053.stdout:2/991: chown d6/d9/db6/dbc/ld8 378 1 2024-09-16T00:50:36.751 INFO:tasks.workunit.client.0.smithi053.stdout:3/961: getdents d1/d4e/d10a 0 2024-09-16T00:50:36.751 INFO:tasks.workunit.client.0.smithi053.stdout:3/962: readlink d1/d5/d91/d5e/d90/da2/ld9 0 2024-09-16T00:50:36.754 INFO:tasks.workunit.client.0.smithi053.stdout:8/845: mkdir d10/d1c/d92/d115 0 2024-09-16T00:50:36.755 INFO:tasks.workunit.client.0.smithi053.stdout:5/994: getdents d3/d9c 0 2024-09-16T00:50:36.759 INFO:tasks.workunit.client.0.smithi053.stdout:2/992: symlink d6/d29/da0/l13e 0 2024-09-16T00:50:36.761 INFO:tasks.workunit.client.0.smithi053.stdout:3/963: mknod d1/d5/d91/d5e/d90/c142 0 2024-09-16T00:50:36.764 INFO:tasks.workunit.client.0.smithi053.stdout:5/995: unlink d3/d7/d2b/d4b/d51/d53/l89 0 2024-09-16T00:50:36.764 INFO:tasks.workunit.client.0.smithi053.stdout:1/837: dwrite d5/d9/d4c/f9f [0,4194304] 0 2024-09-16T00:50:36.764 INFO:tasks.workunit.client.0.smithi053.stdout:2/993: mknod d6/d9/d103/c13f 0 2024-09-16T00:50:36.765 INFO:tasks.workunit.client.0.smithi053.stdout:4/758: dwrite d0/d2/dd/d25/d41/ff7 [0,4194304] 0 2024-09-16T00:50:36.767 INFO:tasks.workunit.client.0.smithi053.stdout:3/964: creat d1/d5/d91/d5e/d69/ddd/d106/f143 x:0 0 0 2024-09-16T00:50:36.769 INFO:tasks.workunit.client.0.smithi053.stdout:8/846: dwrite d10/d21/d28/d6f/fb6 [0,4194304] 0 2024-09-16T00:50:36.769 INFO:tasks.workunit.client.0.smithi053.stdout:5/996: truncate d3/fa6 1682659 0 2024-09-16T00:50:36.769 INFO:tasks.workunit.client.0.smithi053.stdout:5/997: chown d3/d7/d2b/d4b/d51/fc1 34 1 2024-09-16T00:50:36.770 INFO:tasks.workunit.client.0.smithi053.stdout:2/994: truncate d6/d29/f9a 1437580 0 2024-09-16T00:50:36.772 INFO:tasks.workunit.client.0.smithi053.stdout:2/995: dread d6/d9/d74/fce [0,4194304] 0 2024-09-16T00:50:36.772 INFO:tasks.workunit.client.0.smithi053.stdout:4/759: creat d0/f105 x:0 0 0 2024-09-16T00:50:36.775 INFO:tasks.workunit.client.0.smithi053.stdout:5/998: rename d3/d7/d24/d3f/f75 to d3/d7/d24/d34/d80/f146 0 2024-09-16T00:50:36.775 INFO:tasks.workunit.client.0.smithi053.stdout:2/996: truncate d6/f77 1676283 0 2024-09-16T00:50:36.775 INFO:tasks.workunit.client.0.smithi053.stdout:2/997: write d6/d9/dd/df8/dfe/f11c [767379,44870] 0 2024-09-16T00:50:36.776 INFO:tasks.workunit.client.0.smithi053.stdout:4/760: mknod d0/d2/d1e/dab/c106 0 2024-09-16T00:50:36.776 INFO:tasks.workunit.client.0.smithi053.stdout:4/761: chown d0/d2/dd/d25/d41/d78/f2b 23579 1 2024-09-16T00:50:36.776 INFO:tasks.workunit.client.0.smithi053.stdout:5/999: creat d3/d7/d42/d57/f147 x:0 0 0 2024-09-16T00:50:36.778 INFO:tasks.workunit.client.0.smithi053.stdout:2/998: creat d6/d29/da0/f140 x:0 0 0 2024-09-16T00:50:36.779 INFO:tasks.workunit.client.0.smithi053.stdout:4/762: link d0/d2/l2e d0/d2/dd/l107 0 2024-09-16T00:50:36.779 INFO:tasks.workunit.client.0.smithi053.stdout:2/999: stat d6/d9/dd/c3c 0 2024-09-16T00:50:36.802 INFO:tasks.workunit.client.0.smithi053.stdout:1/838: dwrite d5/d18/d33/fad [0,4194304] 0 2024-09-16T00:50:36.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/839: chown d5/d7/f52 82735 1 2024-09-16T00:50:36.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/840: fsync d5/d7/d39/d57/d82/fa0 0 2024-09-16T00:50:36.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/841: fdatasync d5/d9/f3b 0 2024-09-16T00:50:36.805 INFO:tasks.workunit.client.0.smithi053.stdout:1/842: creat d5/dd/f114 x:0 0 0 2024-09-16T00:50:36.805 INFO:tasks.workunit.client.0.smithi053.stdout:1/843: fdatasync d5/d9/f44 0 2024-09-16T00:50:36.807 INFO:tasks.workunit.client.0.smithi053.stdout:8/847: dwrite d10/d1c/d2b/f72 [0,4194304] 0 2024-09-16T00:50:36.807 INFO:tasks.workunit.client.0.smithi053.stdout:3/965: dwrite d1/d5/f10c [0,4194304] 0 2024-09-16T00:50:36.808 INFO:tasks.workunit.client.0.smithi053.stdout:4/763: dwrite d0/d3c/d48/d95/fed [0,4194304] 0 2024-09-16T00:50:36.808 INFO:tasks.workunit.client.0.smithi053.stdout:4/764: chown d0/d65/ff6 29433 1 2024-09-16T00:50:36.808 INFO:tasks.workunit.client.0.smithi053.stdout:4/765: chown d0/f105 1598159 1 2024-09-16T00:50:36.832 INFO:tasks.workunit.client.0.smithi053.stdout:3/966: dwrite d1/d5/d91/d5e/f63 [0,4194304] 0 2024-09-16T00:50:36.832 INFO:tasks.workunit.client.0.smithi053.stdout:3/967: readlink d1/d5/lb1 0 2024-09-16T00:50:36.832 INFO:tasks.workunit.client.0.smithi053.stdout:8/848: dwrite d10/d21/d28/ff3 [0,4194304] 0 2024-09-16T00:50:36.832 INFO:tasks.workunit.client.0.smithi053.stdout:8/849: stat d10/d1c/c60 0 2024-09-16T00:50:36.834 INFO:tasks.workunit.client.0.smithi053.stdout:4/766: dwrite d0/da/fc9 [0,4194304] 0 2024-09-16T00:50:36.834 INFO:tasks.workunit.client.0.smithi053.stdout:4/767: chown d0/da/d42/d8b/d87/d99/f83 5 1 2024-09-16T00:50:36.834 INFO:tasks.workunit.client.0.smithi053.stdout:4/768: dread - d0/f105 zero size 2024-09-16T00:50:36.834 INFO:tasks.workunit.client.0.smithi053.stdout:4/769: dread - d0/da/d7c/f9e zero size 2024-09-16T00:50:36.839 INFO:tasks.workunit.client.0.smithi053.stdout:3/968: link d1/d5/d11/da9/db8/dfb/dd5/fd0 d1/d5/d31/d3b/f144 0 2024-09-16T00:50:36.841 INFO:tasks.workunit.client.0.smithi053.stdout:3/969: dread d1/d5/d31/d3b/fc8 [0,4194304] 0 2024-09-16T00:50:36.844 INFO:tasks.workunit.client.0.smithi053.stdout:8/850: link d10/d1c/d2b/d40/d76/fc5 d10/d21/d28/d3c/f116 0 2024-09-16T00:50:36.848 INFO:tasks.workunit.client.0.smithi053.stdout:3/970: rename d1/d5/d31/d3b/d9c/f11e to d1/d5/d91/d5e/d69/ddd/d106/f145 0 2024-09-16T00:50:36.848 INFO:tasks.workunit.client.0.smithi053.stdout:3/971: creat d1/d5/d31/d7c/dbf/de3/f146 x:0 0 0 2024-09-16T00:50:36.853 INFO:tasks.workunit.client.0.smithi053.stdout:4/770: dwrite d0/d2/d1e/dcc/fdf [0,4194304] 0 2024-09-16T00:50:36.853 INFO:tasks.workunit.client.0.smithi053.stdout:4/771: truncate d0/d3c/d48/d4d/d70/fb9 647120 0 2024-09-16T00:50:36.866 INFO:tasks.workunit.client.0.smithi053.stdout:4/772: write d0/d3c/d48/f91 [38534,61496] 0 2024-09-16T00:50:36.869 INFO:tasks.workunit.client.0.smithi053.stdout:4/773: creat d0/d2/dd/d25/f108 x:0 0 0 2024-09-16T00:50:36.869 INFO:tasks.workunit.client.0.smithi053.stdout:3/972: dwrite d1/d5/d11/da9/db8/dfb/d65/fde [0,4194304] 0 2024-09-16T00:50:36.877 INFO:tasks.workunit.client.0.smithi053.stdout:4/774: truncate d0/d3c/d48/f52 7401290 0 2024-09-16T00:50:36.877 INFO:tasks.workunit.client.0.smithi053.stdout:4/775: getdents d0/d2/dd/d25/d39/dca/ddb 0 2024-09-16T00:50:36.877 INFO:tasks.workunit.client.0.smithi053.stdout:4/776: write d0/d2/dd/f6e [3100704,1814] 0 2024-09-16T00:50:36.880 INFO:tasks.workunit.client.0.smithi053.stdout:4/777: symlink d0/d3c/d48/d58/l109 0 2024-09-16T00:50:37.103 INFO:tasks.workunit.client.0.smithi053.stdout:0/979: sync 2024-09-16T00:50:37.103 INFO:tasks.workunit.client.0.smithi053.stdout:9/858: sync 2024-09-16T00:50:37.103 INFO:tasks.workunit.client.0.smithi053.stdout:0/980: mkdir d4/dc/d1e/d1f/d146 0 2024-09-16T00:50:37.105 INFO:tasks.workunit.client.0.smithi053.stdout:0/981: symlink d4/dc/dbd/l147 0 2024-09-16T00:50:37.116 INFO:tasks.workunit.client.0.smithi053.stdout:0/982: dwrite d4/f69 [4194304,4194304] 0 2024-09-16T00:50:37.118 INFO:tasks.workunit.client.0.smithi053.stdout:0/983: mkdir d4/dc/d87/dc6/dbe/d143/d96/d148 0 2024-09-16T00:50:37.120 INFO:tasks.workunit.client.0.smithi053.stdout:0/984: dread d4/d13/f1c [0,4194304] 0 2024-09-16T00:50:37.120 INFO:tasks.workunit.client.0.smithi053.stdout:0/985: fsync d4/dc/d1e/d1f/d40/d44/d54/f116 0 2024-09-16T00:50:37.121 INFO:tasks.workunit.client.0.smithi053.stdout:0/986: symlink d4/dc/dbd/l149 0 2024-09-16T00:50:37.128 INFO:tasks.workunit.client.0.smithi053.stdout:0/987: write d4/dc/d25/fb0 [1492948,13080] 0 2024-09-16T00:50:37.130 INFO:tasks.workunit.client.0.smithi053.stdout:0/988: creat d4/dc/d1e/d22/dc5/dd2/df6/f14a x:0 0 0 2024-09-16T00:50:37.131 INFO:tasks.workunit.client.0.smithi053.stdout:0/989: unlink d4/dc/d87/dc6/c115 0 2024-09-16T00:50:37.134 INFO:tasks.workunit.client.0.smithi053.stdout:0/990: mkdir d4/d5a/d82/d14b 0 2024-09-16T00:50:37.134 INFO:tasks.workunit.client.0.smithi053.stdout:0/991: truncate d4/dc/d1e/f117 72075 0 2024-09-16T00:50:37.137 INFO:tasks.workunit.client.0.smithi053.stdout:0/992: dread d4/dc/d87/f50 [0,4194304] 0 2024-09-16T00:50:37.138 INFO:tasks.workunit.client.0.smithi053.stdout:0/993: dread d4/dc/d25/f9d [0,4194304] 0 2024-09-16T00:50:37.146 INFO:tasks.workunit.client.0.smithi053.stdout:0/994: write d4/dc/d87/dc6/fd8 [3140746,123096] 0 2024-09-16T00:50:37.146 INFO:tasks.workunit.client.0.smithi053.stdout:0/995: readlink d4/dc/d25/d34/l79 0 2024-09-16T00:50:37.155 INFO:tasks.workunit.client.0.smithi053.stdout:0/996: dread d4/dc/d25/d34/f8f [0,4194304] 0 2024-09-16T00:50:37.157 INFO:tasks.workunit.client.0.smithi053.stdout:0/997: fsync d4/dc/d25/fb0 0 2024-09-16T00:50:37.157 INFO:tasks.workunit.client.0.smithi053.stdout:0/998: truncate d4/d13/de8/d118/f12e 629886 0 2024-09-16T00:50:37.177 INFO:tasks.workunit.client.0.smithi053.stdout:0/999: dwrite d4/d13/f41 [0,4194304] 0 2024-09-16T00:50:37.265 INFO:tasks.workunit.client.0.smithi053.stdout:1/844: sync 2024-09-16T00:50:37.272 INFO:tasks.workunit.client.0.smithi053.stdout:1/845: write d5/d18/d33/f63 [1841701,47233] 0 2024-09-16T00:50:37.275 INFO:tasks.workunit.client.0.smithi053.stdout:1/846: mknod d5/d18/d1f/c115 0 2024-09-16T00:50:37.297 INFO:tasks.workunit.client.0.smithi053.stdout:1/847: dwrite d5/d9/d88/f60 [0,4194304] 0 2024-09-16T00:50:37.298 INFO:tasks.workunit.client.0.smithi053.stdout:1/848: write d5/d5a/f7e [2264116,110390] 0 2024-09-16T00:50:37.414 INFO:tasks.workunit.client.0.smithi053.stdout:3/973: sync 2024-09-16T00:50:37.414 INFO:tasks.workunit.client.0.smithi053.stdout:4/778: sync 2024-09-16T00:50:37.415 INFO:tasks.workunit.client.0.smithi053.stdout:9/859: sync 2024-09-16T00:50:37.415 INFO:tasks.workunit.client.0.smithi053.stdout:8/851: sync 2024-09-16T00:50:37.415 INFO:tasks.workunit.client.0.smithi053.stdout:3/974: chown d1/d5/d11/da9/db8/dfb/f5d 126 1 2024-09-16T00:50:37.415 INFO:tasks.workunit.client.0.smithi053.stdout:3/975: chown d1/d5/d31/d3b/f111 44 1 2024-09-16T00:50:37.417 INFO:tasks.workunit.client.0.smithi053.stdout:9/860: mkdir d8/d1c/d2b/d49/d115 0 2024-09-16T00:50:37.419 INFO:tasks.workunit.client.0.smithi053.stdout:8/852: creat d10/d1c/d92/d66/d9d/f117 x:0 0 0 2024-09-16T00:50:37.422 INFO:tasks.workunit.client.0.smithi053.stdout:3/976: mkdir d1/d5/d31/d3b/d147 0 2024-09-16T00:50:37.422 INFO:tasks.workunit.client.0.smithi053.stdout:3/977: fsync d1/d4e/d10a/db5/f13d 0 2024-09-16T00:50:37.423 INFO:tasks.workunit.client.0.smithi053.stdout:4/779: dread d0/d2/d1e/dcc/fdf [0,4194304] 0 2024-09-16T00:50:37.424 INFO:tasks.workunit.client.0.smithi053.stdout:9/861: mknod d8/d22/d54/ded/c116 0 2024-09-16T00:50:37.424 INFO:tasks.workunit.client.0.smithi053.stdout:9/862: chown d8/d13/c6e 692 1 2024-09-16T00:50:37.424 INFO:tasks.workunit.client.0.smithi053.stdout:9/863: chown d8/d4c/d5a/fd0 19 1 2024-09-16T00:50:37.425 INFO:tasks.workunit.client.0.smithi053.stdout:9/864: dread d8/d1c/d2b/d2c/f85 [4194304,4194304] 0 2024-09-16T00:50:37.425 INFO:tasks.workunit.client.0.smithi053.stdout:9/865: chown d8/d1c/d2b/f52 113 1 2024-09-16T00:50:37.425 INFO:tasks.workunit.client.0.smithi053.stdout:9/866: chown d8/d1c/d2b/f52 0 1 2024-09-16T00:50:37.427 INFO:tasks.workunit.client.0.smithi053.stdout:8/853: chown l2 879 1 2024-09-16T00:50:37.433 INFO:tasks.workunit.client.0.smithi053.stdout:4/780: creat d0/d2/dd/d25/d37/f10a x:0 0 0 2024-09-16T00:50:37.433 INFO:tasks.workunit.client.0.smithi053.stdout:4/781: write d0/d31/ff8 [285531,61721] 0 2024-09-16T00:50:37.439 INFO:tasks.workunit.client.0.smithi053.stdout:8/854: creat d10/d4a/dc2/f118 x:0 0 0 2024-09-16T00:50:37.442 INFO:tasks.workunit.client.0.smithi053.stdout:3/978: rmdir d1/d5/d31/d7c/dbf/dcd/de6 39 2024-09-16T00:50:37.447 INFO:tasks.workunit.client.0.smithi053.stdout:4/782: rmdir d0/da 39 2024-09-16T00:50:37.447 INFO:tasks.workunit.client.0.smithi053.stdout:4/783: fsync d0/da/d42/d8b/fba 0 2024-09-16T00:50:37.447 INFO:tasks.workunit.client.0.smithi053.stdout:4/784: creat d0/d2/dd/d25/d39/dca/f10b x:0 0 0 2024-09-16T00:50:37.447 INFO:tasks.workunit.client.0.smithi053.stdout:4/785: chown d0/d3c/d48/d4d/d70/de6 5 1 2024-09-16T00:50:37.448 INFO:tasks.workunit.client.0.smithi053.stdout:8/855: read d10/d21/d28/d3c/d63/d6a/f107 [3925454,35973] 0 2024-09-16T00:50:37.448 INFO:tasks.workunit.client.0.smithi053.stdout:9/867: link d8/ca d8/d22/d54/ded/c117 0 2024-09-16T00:50:37.451 INFO:tasks.workunit.client.0.smithi053.stdout:3/979: unlink d1/d5/d11/da9/c118 0 2024-09-16T00:50:37.458 INFO:tasks.workunit.client.0.smithi053.stdout:4/786: symlink d0/da/d7c/de1/l10c 0 2024-09-16T00:50:37.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/980: write d1/d5/d11/da9/db8/dfb/d65/d97/d7f/d136/f101 [2903962,67838] 0 2024-09-16T00:50:37.458 INFO:tasks.workunit.client.0.smithi053.stdout:3/981: write d1/d5/d31/fd2 [30718,76336] 0 2024-09-16T00:50:37.461 INFO:tasks.workunit.client.0.smithi053.stdout:4/787: dread d0/da/fc4 [0,4194304] 0 2024-09-16T00:50:37.461 INFO:tasks.workunit.client.0.smithi053.stdout:9/868: mknod d8/d4c/d5a/d99/dc8/c118 0 2024-09-16T00:50:37.461 INFO:tasks.workunit.client.0.smithi053.stdout:4/788: read - d0/d3c/d48/d95/ff3 zero size 2024-09-16T00:50:37.466 INFO:tasks.workunit.client.0.smithi053.stdout:3/982: link d1/d5/d91/d5e/d69/ddd/d106/f145 d1/d5/d11/da9/db8/dfb/d65/d97/d7f/d136/f148 0 2024-09-16T00:50:37.466 INFO:tasks.workunit.client.0.smithi053.stdout:3/983: write d1/d5/d91/d5e/d69/d109/d28/d5a/fc1 [388407,84980] 0 2024-09-16T00:50:37.467 INFO:tasks.workunit.client.0.smithi053.stdout:4/789: symlink d0/da/dd5/l10d 0 2024-09-16T00:50:37.468 INFO:tasks.workunit.client.0.smithi053.stdout:3/984: dread d1/d5/d11/f12 [4194304,4194304] 0 2024-09-16T00:50:37.468 INFO:tasks.workunit.client.0.smithi053.stdout:3/985: chown d1/d5/d91/d5e/d69/ddd 6728 1 2024-09-16T00:50:37.469 INFO:tasks.workunit.client.0.smithi053.stdout:9/869: symlink d8/d4c/d5a/d99/l119 0 2024-09-16T00:50:37.469 INFO:tasks.workunit.client.0.smithi053.stdout:9/870: chown d8/d19/d51/d6d/d7a/db2/de4 49 1 2024-09-16T00:50:37.469 INFO:tasks.workunit.client.0.smithi053.stdout:9/871: truncate d8/f30 5407288 0 2024-09-16T00:50:37.469 INFO:tasks.workunit.client.0.smithi053.stdout:9/872: chown d8/d13/l97 80301463 1 2024-09-16T00:50:37.476 INFO:tasks.workunit.client.0.smithi053.stdout:9/873: read d8/d19/d51/f56 [5482497,111192] 0 2024-09-16T00:50:37.479 INFO:tasks.workunit.client.0.smithi053.stdout:3/986: write d1/d5/d11/da9/db8/dfb/fa6 [4994194,3796] 0 2024-09-16T00:50:37.482 INFO:tasks.workunit.client.0.smithi053.stdout:3/987: dread d1/d5/d11/da9/db8/dfb/fcf [0,4194304] 0 2024-09-16T00:50:37.489 INFO:tasks.workunit.client.0.smithi053.stdout:4/790: dwrite d0/d31/fb0 [0,4194304] 0 2024-09-16T00:50:37.499 INFO:tasks.workunit.client.0.smithi053.stdout:9/874: dwrite d8/fb [0,4194304] 0 2024-09-16T00:50:37.499 INFO:tasks.workunit.client.0.smithi053.stdout:9/875: write d8/d4c/d5a/fd0 [226746,41846] 0 2024-09-16T00:50:37.500 INFO:tasks.workunit.client.0.smithi053.stdout:9/876: chown d8/d19/d31/c67 10523 1 2024-09-16T00:50:37.505 INFO:tasks.workunit.client.0.smithi053.stdout:9/877: mknod d8/d1c/c11a 0 2024-09-16T00:50:37.508 INFO:tasks.workunit.client.0.smithi053.stdout:3/988: dwrite d1/d5/d91/d5e/d69/fa1 [0,4194304] 0 2024-09-16T00:50:37.509 INFO:tasks.workunit.client.0.smithi053.stdout:4/791: dwrite d0/d2/dd/d25/f24 [4194304,4194304] 0 2024-09-16T00:50:37.512 INFO:tasks.workunit.client.0.smithi053.stdout:4/792: mkdir d0/d2/dd/d25/d39/dca/ddb/d10e 0 2024-09-16T00:50:37.512 INFO:tasks.workunit.client.0.smithi053.stdout:9/878: rmdir d8/d4c/d5a/d99 39 2024-09-16T00:50:37.513 INFO:tasks.workunit.client.0.smithi053.stdout:3/989: symlink d1/d5/d11/da9/db8/dfb/dd5/l149 0 2024-09-16T00:50:37.515 INFO:tasks.workunit.client.0.smithi053.stdout:4/793: rename d0/d3c/d48/d4d/d70/fb9 to d0/d2/d1e/dab/f10f 0 2024-09-16T00:50:37.517 INFO:tasks.workunit.client.0.smithi053.stdout:9/879: creat d8/d22/f11b x:0 0 0 2024-09-16T00:50:37.518 INFO:tasks.workunit.client.0.smithi053.stdout:3/990: mknod d1/d5/d31/d3b/d147/c14a 0 2024-09-16T00:50:37.521 INFO:tasks.workunit.client.0.smithi053.stdout:4/794: write d0/d2/dd/d25/d41/f5d [2103671,64827] 0 2024-09-16T00:50:37.521 INFO:tasks.workunit.client.0.smithi053.stdout:4/795: stat d0/da/fc4 0 2024-09-16T00:50:37.522 INFO:tasks.workunit.client.0.smithi053.stdout:9/880: creat d8/d19/d51/d6d/f11c x:0 0 0 2024-09-16T00:50:37.526 INFO:tasks.workunit.client.0.smithi053.stdout:3/991: creat d1/d5/d31/d7c/f14b x:0 0 0 2024-09-16T00:50:37.529 INFO:tasks.workunit.client.0.smithi053.stdout:9/881: link d8/d22/d54/ded/c117 d8/d22/d26/c11d 0 2024-09-16T00:50:37.530 INFO:tasks.workunit.client.0.smithi053.stdout:3/992: creat d1/d5/d11/da9/db8/dfb/dd5/f14c x:0 0 0 2024-09-16T00:50:37.530 INFO:tasks.workunit.client.0.smithi053.stdout:9/882: creat d8/d1c/d2b/d49/f11e x:0 0 0 2024-09-16T00:50:37.532 INFO:tasks.workunit.client.0.smithi053.stdout:3/993: mkdir d1/d5/d91/d5e/d69/d109/d28/d5a/d14d 0 2024-09-16T00:50:37.532 INFO:tasks.workunit.client.0.smithi053.stdout:3/994: chown d1/d5/d11/da9/db8/l120 1 1 2024-09-16T00:50:37.532 INFO:tasks.workunit.client.0.smithi053.stdout:3/995: chown d1/d5/d91/l1a 273 1 2024-09-16T00:50:37.534 INFO:tasks.workunit.client.0.smithi053.stdout:9/883: unlink d8/d4c/cad 0 2024-09-16T00:50:37.534 INFO:tasks.workunit.client.0.smithi053.stdout:4/796: dwrite d0/da/fa5 [0,4194304] 0 2024-09-16T00:50:37.534 INFO:tasks.workunit.client.0.smithi053.stdout:4/797: readlink d0/d3c/d48/d95/ld1 0 2024-09-16T00:50:37.535 INFO:tasks.workunit.client.0.smithi053.stdout:3/996: rename d1/d5/d11/da9/db8/dfb/d65/d97/d7f/d136/cf9 to d1/d5/d91/c14e 0 2024-09-16T00:50:37.535 INFO:tasks.workunit.client.0.smithi053.stdout:3/997: creat d1/d4e/d10a/db5/f14f x:0 0 0 2024-09-16T00:50:37.538 INFO:tasks.workunit.client.0.smithi053.stdout:4/798: symlink d0/d3c/d48/d4d/d70/de6/l110 0 2024-09-16T00:50:37.542 INFO:tasks.workunit.client.0.smithi053.stdout:9/884: rename d8/d22/l75 to d8/d4c/d5a/d99/dc8/df6/l11f 0 2024-09-16T00:50:37.543 INFO:tasks.workunit.client.0.smithi053.stdout:9/885: chown d8/df9/d101 92885 1 2024-09-16T00:50:37.550 INFO:tasks.workunit.client.0.smithi053.stdout:3/998: creat d1/d5/d91/d5e/d90/f150 x:0 0 0 2024-09-16T00:50:37.550 INFO:tasks.workunit.client.0.smithi053.stdout:3/999: read - d1/d5/d31/d7c/dbf/dcd/d121/f132 zero size 2024-09-16T00:50:37.555 INFO:tasks.workunit.client.0.smithi053.stdout:9/886: dwrite d8/d19/d31/fdd [0,4194304] 0 2024-09-16T00:50:37.558 INFO:tasks.workunit.client.0.smithi053.stdout:9/887: symlink d8/d13/l120 0 2024-09-16T00:50:37.558 INFO:tasks.workunit.client.0.smithi053.stdout:9/888: getdents d8/d19/d51/d6d/d7a/d113 0 2024-09-16T00:50:37.560 INFO:tasks.workunit.client.0.smithi053.stdout:9/889: mkdir d8/d22/d26/d121 0 2024-09-16T00:50:37.562 INFO:tasks.workunit.client.0.smithi053.stdout:9/890: creat d8/d22/d54/ded/d106/f122 x:0 0 0 2024-09-16T00:50:37.562 INFO:tasks.workunit.client.0.smithi053.stdout:9/891: read d8/d22/f72 [264370,46006] 0 2024-09-16T00:50:37.576 INFO:tasks.workunit.client.0.smithi053.stdout:9/892: dwrite d8/d22/d54/df7/fbf [0,4194304] 0 2024-09-16T00:50:37.581 INFO:tasks.workunit.client.0.smithi053.stdout:9/893: dread d8/d19/d31/f43 [0,4194304] 0 2024-09-16T00:50:37.581 INFO:tasks.workunit.client.0.smithi053.stdout:9/894: dread - d8/d1c/d2b/d8b/ffb zero size 2024-09-16T00:50:37.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:37 smithi152 ceph-mon[33237]: pgmap v19: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 244 MiB/s rd, 267 MiB/s wr, 468 op/s 2024-09-16T00:50:37.709 INFO:tasks.workunit.client.0.smithi053.stdout:9/895: symlink d8/d19/d51/d6d/d7a/l123 0 2024-09-16T00:50:37.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/849: sync 2024-09-16T00:50:37.774 INFO:tasks.workunit.client.0.smithi053.stdout:8/856: sync 2024-09-16T00:50:37.774 INFO:tasks.workunit.client.0.smithi053.stdout:1/850: fdatasync d5/d18/d33/d8a/d98/fb7 0 2024-09-16T00:50:37.777 INFO:tasks.workunit.client.0.smithi053.stdout:1/851: rename d5/d18/d33/d8a to d5/d18/d33/d30/daf/d111/d116 0 2024-09-16T00:50:37.782 INFO:tasks.workunit.client.0.smithi053.stdout:1/852: symlink d5/d9/l117 0 2024-09-16T00:50:37.782 INFO:tasks.workunit.client.0.smithi053.stdout:1/853: truncate d5/d9/d73/d84/fc5 739698 0 2024-09-16T00:50:37.782 INFO:tasks.workunit.client.0.smithi053.stdout:1/854: symlink d5/d18/d33/l118 0 2024-09-16T00:50:37.783 INFO:tasks.workunit.client.0.smithi053.stdout:1/855: dread - d5/d18/d1f/fe8 zero size 2024-09-16T00:50:37.784 INFO:tasks.workunit.client.0.smithi053.stdout:1/856: dread d5/de3/f2a [0,4194304] 0 2024-09-16T00:50:37.785 INFO:tasks.workunit.client.0.smithi053.stdout:1/857: creat d5/d9/d77/da8/f119 x:0 0 0 2024-09-16T00:50:37.787 INFO:tasks.workunit.client.0.smithi053.stdout:1/858: symlink d5/d7/d39/dc6/def/l11a 0 2024-09-16T00:50:37.796 INFO:tasks.workunit.client.0.smithi053.stdout:8/857: dwrite d10/d1c/fce [0,4194304] 0 2024-09-16T00:50:37.802 INFO:tasks.workunit.client.0.smithi053.stdout:1/859: dread d5/d18/d33/d30/daf/d111/d116/d98/fb7 [0,4194304] 0 2024-09-16T00:50:37.803 INFO:tasks.workunit.client.0.smithi053.stdout:1/860: stat d5/d18/d33/d30/daf/d111/d116/d98/dd0/df2/lfe 0 2024-09-16T00:50:37.803 INFO:tasks.workunit.client.0.smithi053.stdout:8/858: dread d10/f19 [0,4194304] 0 2024-09-16T00:50:37.804 INFO:tasks.workunit.client.0.smithi053.stdout:8/859: rmdir d10/d1c/d92/d115 0 2024-09-16T00:50:37.807 INFO:tasks.workunit.client.0.smithi053.stdout:8/860: rename d10/d21/d28/da2/f104 to d10/d1c/d92/f119 0 2024-09-16T00:50:37.807 INFO:tasks.workunit.client.0.smithi053.stdout:8/861: chown d10/d21/f7f 131142 1 2024-09-16T00:50:37.812 INFO:tasks.workunit.client.0.smithi053.stdout:1/861: write d5/d9/d4c/f9f [989022,100743] 0 2024-09-16T00:50:37.815 INFO:tasks.workunit.client.0.smithi053.stdout:1/862: getdents d5/d9/d73/d84 0 2024-09-16T00:50:37.816 INFO:tasks.workunit.client.0.smithi053.stdout:1/863: symlink d5/d18/d33/d30/daf/d111/d116/d98/dd0/d10a/l11b 0 2024-09-16T00:50:37.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:37 smithi053 ceph-mon[27950]: pgmap v19: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 244 MiB/s rd, 267 MiB/s wr, 468 op/s 2024-09-16T00:50:37.825 INFO:tasks.workunit.client.0.smithi053.stdout:1/864: write d5/d18/d33/d30/daf/d111/d116/d98/dd0/f5c [415024,71330] 0 2024-09-16T00:50:37.830 INFO:tasks.workunit.client.0.smithi053.stdout:8/862: dwrite d10/d4a/dbf/de7/f103 [0,4194304] 0 2024-09-16T00:50:37.839 INFO:tasks.workunit.client.0.smithi053.stdout:1/865: dwrite d5/dd/dd5/ff3 [0,4194304] 0 2024-09-16T00:50:37.844 INFO:tasks.workunit.client.0.smithi053.stdout:8/863: dwrite d10/d4a/dbf/de7/f10e [0,4194304] 0 2024-09-16T00:50:37.845 INFO:tasks.workunit.client.0.smithi053.stdout:1/866: symlink d5/d7/d39/dc6/l11c 0 2024-09-16T00:50:37.856 INFO:tasks.workunit.client.0.smithi053.stdout:4/799: sync 2024-09-16T00:50:37.856 INFO:tasks.workunit.client.0.smithi053.stdout:9/896: sync 2024-09-16T00:50:37.856 INFO:tasks.workunit.client.0.smithi053.stdout:4/800: creat d0/d3c/d48/d95/f111 x:0 0 0 2024-09-16T00:50:37.856 INFO:tasks.workunit.client.0.smithi053.stdout:8/864: creat d10/d1c/d92/f11a x:0 0 0 2024-09-16T00:50:37.857 INFO:tasks.workunit.client.0.smithi053.stdout:1/867: truncate d5/d18/d33/fad 2692863 0 2024-09-16T00:50:37.858 INFO:tasks.workunit.client.0.smithi053.stdout:9/897: dread d8/d22/dc2/fcd [0,4194304] 0 2024-09-16T00:50:37.858 INFO:tasks.workunit.client.0.smithi053.stdout:9/898: readlink d8/d13/l97 0 2024-09-16T00:50:37.865 INFO:tasks.workunit.client.0.smithi053.stdout:4/801: mkdir d0/da/d42/d8b/d112 0 2024-09-16T00:50:37.865 INFO:tasks.workunit.client.0.smithi053.stdout:4/802: stat d0/da/d42/d8b/d87/d99/cad 0 2024-09-16T00:50:37.866 INFO:tasks.workunit.client.0.smithi053.stdout:9/899: mknod d8/d1c/d2b/d49/c124 0 2024-09-16T00:50:37.869 INFO:tasks.workunit.client.0.smithi053.stdout:4/803: mkdir d0/da/d42/d8b/d87/d99/d113 0 2024-09-16T00:50:37.871 INFO:tasks.workunit.client.0.smithi053.stdout:9/900: unlink d8/f39 0 2024-09-16T00:50:37.879 INFO:tasks.workunit.client.0.smithi053.stdout:8/865: dwrite d10/f14 [0,4194304] 0 2024-09-16T00:50:37.879 INFO:tasks.workunit.client.0.smithi053.stdout:4/804: write d0/d3c/d48/d4d/fa0 [770638,47628] 0 2024-09-16T00:50:37.879 INFO:tasks.workunit.client.0.smithi053.stdout:4/805: chown d0/da/fa5 17026 1 2024-09-16T00:50:37.880 INFO:tasks.workunit.client.0.smithi053.stdout:1/868: dwrite d5/d18/d33/d30/daf/d111/d116/d98/fb9 [4194304,4194304] 0 2024-09-16T00:50:37.883 INFO:tasks.workunit.client.0.smithi053.stdout:1/869: truncate d5/d18/d33/d30/f9b 1038284 0 2024-09-16T00:50:37.886 INFO:tasks.workunit.client.0.smithi053.stdout:1/870: unlink d5/d5a/c105 0 2024-09-16T00:50:37.886 INFO:tasks.workunit.client.0.smithi053.stdout:4/806: fdatasync d0/d2/dd/d25/d41/d78/f2c 0 2024-09-16T00:50:37.889 INFO:tasks.workunit.client.0.smithi053.stdout:9/901: dwrite d8/d19/d31/f71 [0,4194304] 0 2024-09-16T00:50:37.889 INFO:tasks.workunit.client.0.smithi053.stdout:9/902: truncate d8/d1c/d2b/d2c/d9b/fb7 170301 0 2024-09-16T00:50:37.890 INFO:tasks.workunit.client.0.smithi053.stdout:1/871: link d5/d7/d39/d57/d82/fb3 d5/de3/f11d 0 2024-09-16T00:50:37.890 INFO:tasks.workunit.client.0.smithi053.stdout:1/872: getdents d5/d9/d77 0 2024-09-16T00:50:37.891 INFO:tasks.workunit.client.0.smithi053.stdout:1/873: chown d5/d7/f52 11694456 1 2024-09-16T00:50:37.891 INFO:tasks.workunit.client.0.smithi053.stdout:1/874: fdatasync d5/d7/f86 0 2024-09-16T00:50:37.892 INFO:tasks.workunit.client.0.smithi053.stdout:1/875: dread d5/d18/d33/d30/daf/d111/d116/d98/dd0/f3a [0,4194304] 0 2024-09-16T00:50:37.896 INFO:tasks.workunit.client.0.smithi053.stdout:9/903: rename d8/d19/d31/f43 to d8/d19/d31/d108/f125 0 2024-09-16T00:50:37.896 INFO:tasks.workunit.client.0.smithi053.stdout:9/904: creat d8/d19/d51/d6d/f126 x:0 0 0 2024-09-16T00:50:37.897 INFO:tasks.workunit.client.0.smithi053.stdout:4/807: getdents d0/da/d7c 0 2024-09-16T00:50:37.897 INFO:tasks.workunit.client.0.smithi053.stdout:4/808: fdatasync d0/d3c/d48/d95/f9c 0 2024-09-16T00:50:37.897 INFO:tasks.workunit.client.0.smithi053.stdout:4/809: dread - d0/da/d42/d8a/fc1 zero size 2024-09-16T00:50:37.897 INFO:tasks.workunit.client.0.smithi053.stdout:4/810: write d0/d3c/d48/faf [833303,24882] 0 2024-09-16T00:50:37.898 INFO:tasks.workunit.client.0.smithi053.stdout:4/811: dread - d0/d2/dd/d25/d39/fb1 zero size 2024-09-16T00:50:37.898 INFO:tasks.workunit.client.0.smithi053.stdout:4/812: fsync d0/f105 0 2024-09-16T00:50:37.898 INFO:tasks.workunit.client.0.smithi053.stdout:8/866: dwrite d10/d52/f55 [0,4194304] 0 2024-09-16T00:50:37.902 INFO:tasks.workunit.client.0.smithi053.stdout:4/813: read d0/d3c/d48/d58/fcb [827987,60657] 0 2024-09-16T00:50:37.902 INFO:tasks.workunit.client.0.smithi053.stdout:4/814: creat d0/f114 x:0 0 0 2024-09-16T00:50:37.902 INFO:tasks.workunit.client.0.smithi053.stdout:1/876: unlink d5/d7/d39/d57/d82/f10e 0 2024-09-16T00:50:37.906 INFO:tasks.workunit.client.0.smithi053.stdout:8/867: mkdir d10/d4a/dc2/dcd/d11b 0 2024-09-16T00:50:37.911 INFO:tasks.workunit.client.0.smithi053.stdout:1/877: rename d5/dd/f31 to d5/d7/d39/dc6/f11e 0 2024-09-16T00:50:37.913 INFO:tasks.workunit.client.0.smithi053.stdout:8/868: creat d10/d21/d28/f11c x:0 0 0 2024-09-16T00:50:37.913 INFO:tasks.workunit.client.0.smithi053.stdout:8/869: truncate d10/d4a/dc2/f118 990372 0 2024-09-16T00:50:37.914 INFO:tasks.workunit.client.0.smithi053.stdout:8/870: readlink d10/d21/d28/da2/l75 0 2024-09-16T00:50:37.914 INFO:tasks.workunit.client.0.smithi053.stdout:4/815: getdents d0/d31/d98 0 2024-09-16T00:50:37.916 INFO:tasks.workunit.client.0.smithi053.stdout:8/871: link d10/d21/d28/d3c/f116 d10/d4a/d54/f11d 0 2024-09-16T00:50:37.917 INFO:tasks.workunit.client.0.smithi053.stdout:4/816: creat d0/da/d7c/f115 x:0 0 0 2024-09-16T00:50:37.917 INFO:tasks.workunit.client.0.smithi053.stdout:9/905: dwrite d8/f1d [0,4194304] 0 2024-09-16T00:50:37.919 INFO:tasks.workunit.client.0.smithi053.stdout:4/817: symlink d0/d3c/d48/d95/l116 0 2024-09-16T00:50:37.921 INFO:tasks.workunit.client.0.smithi053.stdout:4/818: creat d0/d2/dd/d25/d39/dca/ddb/d10e/f117 x:0 0 0 2024-09-16T00:50:37.924 INFO:tasks.workunit.client.0.smithi053.stdout:4/819: symlink d0/da/d42/d8b/d87/d99/d113/l118 0 2024-09-16T00:50:37.926 INFO:tasks.workunit.client.0.smithi053.stdout:8/872: write d10/d1c/d92/fb0 [568725,733] 0 2024-09-16T00:50:37.926 INFO:tasks.workunit.client.0.smithi053.stdout:8/873: chown d10/d1c/d92/d66/d9d/da6/ddf/d10b 73913 1 2024-09-16T00:50:37.926 INFO:tasks.workunit.client.0.smithi053.stdout:1/878: dwrite d5/dd/dbb/fdb [0,4194304] 0 2024-09-16T00:50:37.927 INFO:tasks.workunit.client.0.smithi053.stdout:1/879: chown d5/d9/f40 1 1 2024-09-16T00:50:37.927 INFO:tasks.workunit.client.0.smithi053.stdout:1/880: read d5/d9/f17 [4889420,105896] 0 2024-09-16T00:50:37.929 INFO:tasks.workunit.client.0.smithi053.stdout:4/820: write d0/da/d42/d8b/fa8 [1952075,12845] 0 2024-09-16T00:50:37.934 INFO:tasks.workunit.client.0.smithi053.stdout:9/906: dwrite d8/fc [0,4194304] 0 2024-09-16T00:50:37.953 INFO:tasks.workunit.client.0.smithi053.stdout:9/907: dwrite d8/f30 [0,4194304] 0 2024-09-16T00:50:37.954 INFO:tasks.workunit.client.0.smithi053.stdout:9/908: symlink d8/d19/d51/d6d/d7a/db2/l127 0 2024-09-16T00:50:37.955 INFO:tasks.workunit.client.0.smithi053.stdout:8/874: dwrite d10/d1c/d92/f11a [0,4194304] 0 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:8/875: readlink d10/d1c/le5 0 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:8/876: read d10/d21/d28/d3c/d63/d6a/f107 [1579450,11262] 0 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:8/877: getdents d10/d1c/d2b/d40/d76/d10f 0 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:9/909: getdents d8/d1c/d2b/d5c 0 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:9/910: dread - d8/d1c/d2b/d8b/f112 zero size 2024-09-16T00:50:37.956 INFO:tasks.workunit.client.0.smithi053.stdout:1/881: dwrite d5/dd/f1a [0,4194304] 0 2024-09-16T00:50:37.958 INFO:tasks.workunit.client.0.smithi053.stdout:8/878: mknod d10/d4a/dac/c11e 0 2024-09-16T00:50:37.959 INFO:tasks.workunit.client.0.smithi053.stdout:9/911: getdents d8/d22/d26/d83 0 2024-09-16T00:50:37.961 INFO:tasks.workunit.client.0.smithi053.stdout:8/879: stat d10/d21/d28/cbc 0 2024-09-16T00:50:37.965 INFO:tasks.workunit.client.0.smithi053.stdout:1/882: getdents d5/d7/d39/d57/d82 0 2024-09-16T00:50:37.965 INFO:tasks.workunit.client.0.smithi053.stdout:9/912: dread d8/d1c/f63 [0,4194304] 0 2024-09-16T00:50:37.965 INFO:tasks.workunit.client.0.smithi053.stdout:9/913: chown d8/d4c/d5a/d99/dc8/df6 2913 1 2024-09-16T00:50:37.972 INFO:tasks.workunit.client.0.smithi053.stdout:9/914: dread d8/d4c/d5b/f64 [0,4194304] 0 2024-09-16T00:50:37.975 INFO:tasks.workunit.client.0.smithi053.stdout:9/915: rmdir d8/d22/d26/d121 0 2024-09-16T00:50:37.975 INFO:tasks.workunit.client.0.smithi053.stdout:9/916: write d8/d4c/d5a/d99/fb4 [1139017,122695] 0 2024-09-16T00:50:37.975 INFO:tasks.workunit.client.0.smithi053.stdout:8/880: write d10/d1c/d2b/f72 [4073808,84326] 0 2024-09-16T00:50:37.980 INFO:tasks.workunit.client.0.smithi053.stdout:9/917: unlink d8/d22/f72 0 2024-09-16T00:50:37.980 INFO:tasks.workunit.client.0.smithi053.stdout:9/918: fdatasync d8/d22/d26/d83/f88 0 2024-09-16T00:50:37.987 INFO:tasks.workunit.client.0.smithi053.stdout:1/883: dwrite d5/dd/f114 [0,4194304] 0 2024-09-16T00:50:37.987 INFO:tasks.workunit.client.0.smithi053.stdout:8/881: dread d10/d1c/d2b/f72 [0,4194304] 0 2024-09-16T00:50:37.989 INFO:tasks.workunit.client.0.smithi053.stdout:9/919: dread d8/d19/d51/d6d/fd7 [0,4194304] 0 2024-09-16T00:50:37.989 INFO:tasks.workunit.client.0.smithi053.stdout:9/920: write d8/d19/d51/d6d/d7a/ff1 [350356,66910] 0 2024-09-16T00:50:37.989 INFO:tasks.workunit.client.0.smithi053.stdout:9/921: write d8/fc7 [420112,22679] 0 2024-09-16T00:50:37.991 INFO:tasks.workunit.client.0.smithi053.stdout:8/882: rmdir d10/d4a/dac 39 2024-09-16T00:50:37.994 INFO:tasks.workunit.client.0.smithi053.stdout:8/883: dread d10/d4a/dac/f90 [0,4194304] 0 2024-09-16T00:50:37.995 INFO:tasks.workunit.client.0.smithi053.stdout:8/884: truncate d10/d21/d28/fb7 620546 0 2024-09-16T00:50:37.996 INFO:tasks.workunit.client.0.smithi053.stdout:8/885: mknod d10/dbe/c11f 0 2024-09-16T00:50:38.009 INFO:tasks.workunit.client.0.smithi053.stdout:1/884: dwrite d5/de3/f11d [0,4194304] 0 2024-09-16T00:50:38.009 INFO:tasks.workunit.client.0.smithi053.stdout:8/886: dwrite d10/d4a/dbf/fe9 [0,4194304] 0 2024-09-16T00:50:38.018 INFO:tasks.workunit.client.0.smithi053.stdout:1/885: dread d5/dd/d7f/f93 [4194304,4194304] 0 2024-09-16T00:50:38.020 INFO:tasks.workunit.client.0.smithi053.stdout:1/886: mknod d5/d7/d39/d57/c11f 0 2024-09-16T00:50:38.022 INFO:tasks.workunit.client.0.smithi053.stdout:1/887: creat d5/d9/d4c/de5/f120 x:0 0 0 2024-09-16T00:50:38.036 INFO:tasks.workunit.client.0.smithi053.stdout:8/887: dwrite d10/d1c/d92/f7d [4194304,4194304] 0 2024-09-16T00:50:38.037 INFO:tasks.workunit.client.0.smithi053.stdout:1/888: write d5/dd/f114 [3534460,95517] 0 2024-09-16T00:50:38.037 INFO:tasks.workunit.client.0.smithi053.stdout:8/888: symlink d10/d1c/d92/d66/l120 0 2024-09-16T00:50:38.037 INFO:tasks.workunit.client.0.smithi053.stdout:8/889: chown d10/d1c/d92/f11a 425 1 2024-09-16T00:50:38.038 INFO:tasks.workunit.client.0.smithi053.stdout:9/922: dwrite d8/d4c/d5b/f9c [0,4194304] 0 2024-09-16T00:50:38.038 INFO:tasks.workunit.client.0.smithi053.stdout:1/889: rmdir d5/d9/d73 39 2024-09-16T00:50:38.040 INFO:tasks.workunit.client.0.smithi053.stdout:8/890: symlink d10/d1c/d49/l121 0 2024-09-16T00:50:38.044 INFO:tasks.workunit.client.0.smithi053.stdout:9/923: mknod d8/d4c/c128 0 2024-09-16T00:50:38.046 INFO:tasks.workunit.client.0.smithi053.stdout:9/924: dread d8/d4c/d5a/fd0 [0,4194304] 0 2024-09-16T00:50:38.046 INFO:tasks.workunit.client.0.smithi053.stdout:1/890: dread d5/d9/d4c/dff/fe6 [0,4194304] 0 2024-09-16T00:50:38.046 INFO:tasks.workunit.client.0.smithi053.stdout:1/891: truncate d5/d9/d77/ffa 1459158 0 2024-09-16T00:50:38.046 INFO:tasks.workunit.client.0.smithi053.stdout:8/891: symlink d10/d4a/l122 0 2024-09-16T00:50:38.048 INFO:tasks.workunit.client.0.smithi053.stdout:8/892: truncate d10/d1c/f73 3762424 0 2024-09-16T00:50:38.053 INFO:tasks.workunit.client.0.smithi053.stdout:9/925: write d8/f1d [24858,70970] 0 2024-09-16T00:50:38.054 INFO:tasks.workunit.client.0.smithi053.stdout:1/892: write d5/de3/f71 [2238246,21429] 0 2024-09-16T00:50:38.056 INFO:tasks.workunit.client.0.smithi053.stdout:8/893: creat d10/d21/f123 x:0 0 0 2024-09-16T00:50:38.063 INFO:tasks.workunit.client.0.smithi053.stdout:9/926: rename d8/d1c/d2b/d5c/fb8 to d8/d1c/d2b/d2c/dbb/f129 0 2024-09-16T00:50:38.067 INFO:tasks.workunit.client.0.smithi053.stdout:8/894: mkdir d10/d1c/d2b/d40/d76/d124 0 2024-09-16T00:50:38.078 INFO:tasks.workunit.client.0.smithi053.stdout:9/927: mkdir d8/df9/d12a 0 2024-09-16T00:50:38.078 INFO:tasks.workunit.client.0.smithi053.stdout:9/928: readlink d8/d1c/d2b/d2c/lc9 0 2024-09-16T00:50:38.207 INFO:tasks.workunit.client.0.smithi053.stdout:8/895: rename d10/d1c/d2b/d40/d76/fc0 to d10/d1c/d2b/d40/d76/f125 0 2024-09-16T00:50:38.210 INFO:tasks.workunit.client.0.smithi053.stdout:9/929: rename d8/d4c/d5a/d99/dc8 to d8/d19/d12b 0 2024-09-16T00:50:38.214 INFO:tasks.workunit.client.0.smithi053.stdout:9/930: dread d8/d1c/d2b/d49/fa1 [4194304,4194304] 0 2024-09-16T00:50:38.216 INFO:tasks.workunit.client.0.smithi053.stdout:9/931: dread d8/d1c/f33 [0,4194304] 0 2024-09-16T00:50:38.226 INFO:tasks.workunit.client.0.smithi053.stdout:8/896: rmdir d10/d1c/d2b/d40/ddc/dfb 0 2024-09-16T00:50:38.227 INFO:tasks.workunit.client.0.smithi053.stdout:9/932: mknod d8/d22/dc2/c12c 0 2024-09-16T00:50:38.227 INFO:tasks.workunit.client.0.smithi053.stdout:9/933: write d8/d22/d54/f9a [828429,37436] 0 2024-09-16T00:50:38.229 INFO:tasks.workunit.client.0.smithi053.stdout:9/934: creat d8/d13/f12d x:0 0 0 2024-09-16T00:50:38.230 INFO:tasks.workunit.client.0.smithi053.stdout:9/935: write d8/d22/fdf [18946,96301] 0 2024-09-16T00:50:38.239 INFO:tasks.workunit.client.0.smithi053.stdout:9/936: rename d8/d13/lb9 to d8/d19/d51/d6d/d7a/d113/l12e 0 2024-09-16T00:50:38.243 INFO:tasks.workunit.client.0.smithi053.stdout:8/897: dwrite d10/d4a/dbf/f79 [0,4194304] 0 2024-09-16T00:50:38.243 INFO:tasks.workunit.client.0.smithi053.stdout:8/898: chown d10/d21/d28/d3c/d63/d6a/cd8 893 1 2024-09-16T00:50:38.250 INFO:tasks.workunit.client.0.smithi053.stdout:8/899: mkdir d10/d4a/dc2/dcd/d11b/d126 0 2024-09-16T00:50:38.253 INFO:tasks.workunit.client.0.smithi053.stdout:8/900: link d10/d4a/dac/c11e d10/d1c/d2b/d40/d76/c127 0 2024-09-16T00:50:38.257 INFO:tasks.workunit.client.0.smithi053.stdout:8/901: rmdir d10/d1c/d92/d66/d9d/da6/ddf 39 2024-09-16T00:50:38.258 INFO:tasks.workunit.client.0.smithi053.stdout:8/902: stat d10/f3a 0 2024-09-16T00:50:38.258 INFO:tasks.workunit.client.0.smithi053.stdout:8/903: write d10/d4a/dac/f90 [812452,103804] 0 2024-09-16T00:50:38.263 INFO:tasks.workunit.client.0.smithi053.stdout:8/904: dread d10/d1c/d92/d66/d9d/da6/fbb [0,4194304] 0 2024-09-16T00:50:38.265 INFO:tasks.workunit.client.0.smithi053.stdout:9/937: dwrite d8/d19/f4a [0,4194304] 0 2024-09-16T00:50:38.274 INFO:tasks.workunit.client.0.smithi053.stdout:9/938: rename d8/d19/d31/f71 to d8/d1c/d2b/d2c/dbb/d103/f12f 0 2024-09-16T00:50:38.274 INFO:tasks.workunit.client.0.smithi053.stdout:9/939: write d8/d19/d12b/fe3 [1914509,4272] 0 2024-09-16T00:50:38.274 INFO:tasks.workunit.client.0.smithi053.stdout:9/940: read - d8/d4c/d5b/f91 zero size 2024-09-16T00:50:38.281 INFO:tasks.workunit.client.0.smithi053.stdout:8/905: dwrite d10/d1c/d2b/f4e [0,4194304] 0 2024-09-16T00:50:38.282 INFO:tasks.workunit.client.0.smithi053.stdout:8/906: chown d10/d21/d28/d6f/fe3 66 1 2024-09-16T00:50:38.303 INFO:tasks.workunit.client.0.smithi053.stdout:4/821: sync 2024-09-16T00:50:38.303 INFO:tasks.workunit.client.0.smithi053.stdout:8/907: dwrite d10/d1c/d92/fb0 [0,4194304] 0 2024-09-16T00:50:38.304 INFO:tasks.workunit.client.0.smithi053.stdout:4/822: creat d0/da/d7c/de1/deb/f119 x:0 0 0 2024-09-16T00:50:38.305 INFO:tasks.workunit.client.0.smithi053.stdout:8/908: truncate d10/f20 7614280 0 2024-09-16T00:50:38.305 INFO:tasks.workunit.client.0.smithi053.stdout:8/909: chown d10/d21/d28/d6f 48 1 2024-09-16T00:50:38.307 INFO:tasks.workunit.client.0.smithi053.stdout:4/823: mkdir d0/d2/dd/d25/d39/dca/ddb/d11a 0 2024-09-16T00:50:38.312 INFO:tasks.workunit.client.0.smithi053.stdout:8/910: symlink d10/dbe/l128 0 2024-09-16T00:50:38.313 INFO:tasks.workunit.client.0.smithi053.stdout:4/824: rename d0/da/cb3 to d0/da/d7c/de1/deb/c11b 0 2024-09-16T00:50:38.313 INFO:tasks.workunit.client.0.smithi053.stdout:4/825: readlink d0/l29 0 2024-09-16T00:50:38.319 INFO:tasks.workunit.client.0.smithi053.stdout:4/826: dread d0/d3c/d48/f91 [0,4194304] 0 2024-09-16T00:50:38.319 INFO:tasks.workunit.client.0.smithi053.stdout:8/911: link d10/d1c/f26 d10/d9e/df2/f129 0 2024-09-16T00:50:38.320 INFO:tasks.workunit.client.0.smithi053.stdout:8/912: mkdir d10/d1c/d2b/d40/d76/d10f/d12a 0 2024-09-16T00:50:38.329 INFO:tasks.workunit.client.0.smithi053.stdout:4/827: write d0/f38 [1835404,63201] 0 2024-09-16T00:50:38.329 INFO:tasks.workunit.client.0.smithi053.stdout:4/828: stat d0/da/d42/d8b/d87/d99/cad 0 2024-09-16T00:50:38.330 INFO:tasks.workunit.client.0.smithi053.stdout:8/913: write d10/fe8 [1426091,124648] 0 2024-09-16T00:50:38.337 INFO:tasks.workunit.client.0.smithi053.stdout:4/829: rename d0/f114 to d0/d2/dd/d25/d39/f11c 0 2024-09-16T00:50:38.339 INFO:tasks.workunit.client.0.smithi053.stdout:8/914: mknod d10/d21/d28/c12b 0 2024-09-16T00:50:38.340 INFO:tasks.workunit.client.0.smithi053.stdout:8/915: mknod d10/d4a/dc2/c12c 0 2024-09-16T00:50:38.365 INFO:tasks.workunit.client.0.smithi053.stdout:4/830: dwrite d0/d2/f1b [4194304,4194304] 0 2024-09-16T00:50:38.365 INFO:tasks.workunit.client.0.smithi053.stdout:8/916: dwrite d10/d21/f2c [0,4194304] 0 2024-09-16T00:50:38.367 INFO:tasks.workunit.client.0.smithi053.stdout:4/831: symlink d0/da/d42/d8b/d87/l11d 0 2024-09-16T00:50:38.370 INFO:tasks.workunit.client.0.smithi053.stdout:4/832: symlink d0/d9f/dbd/l11e 0 2024-09-16T00:50:38.372 INFO:tasks.workunit.client.0.smithi053.stdout:4/833: creat d0/d9f/f11f x:0 0 0 2024-09-16T00:50:38.372 INFO:tasks.workunit.client.0.smithi053.stdout:4/834: write d0/d3c/d48/d95/f111 [535708,115711] 0 2024-09-16T00:50:38.374 INFO:tasks.workunit.client.0.smithi053.stdout:4/835: link d0/da/d7c/lde d0/d2/dd/d25/d39/dca/dfa/l120 0 2024-09-16T00:50:38.376 INFO:tasks.workunit.client.0.smithi053.stdout:4/836: creat d0/d2/f121 x:0 0 0 2024-09-16T00:50:38.378 INFO:tasks.workunit.client.0.smithi053.stdout:4/837: unlink d0/da/c27 0 2024-09-16T00:50:38.384 INFO:tasks.workunit.client.0.smithi053.stdout:8/917: dwrite d10/d1c/d92/d66/d9d/faa [0,4194304] 0 2024-09-16T00:50:38.386 INFO:tasks.workunit.client.0.smithi053.stdout:8/918: mkdir d10/d4a/dc2/dcd/d12d 0 2024-09-16T00:50:38.387 INFO:tasks.workunit.client.0.smithi053.stdout:4/838: write d0/d2/dd/f40 [370300,70357] 0 2024-09-16T00:50:38.387 INFO:tasks.workunit.client.0.smithi053.stdout:4/839: read d0/da/d42/d8b/fba [2336500,22274] 0 2024-09-16T00:50:38.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/919: mknod d10/d1c/d2b/d40/d76/d10f/c12e 0 2024-09-16T00:50:38.388 INFO:tasks.workunit.client.0.smithi053.stdout:8/920: write d10/d1c/f23 [1579102,47890] 0 2024-09-16T00:50:38.389 INFO:tasks.workunit.client.0.smithi053.stdout:4/840: rename d0/d2/d1e/dcc/ld0 to d0/da/d7c/de1/deb/l122 0 2024-09-16T00:50:38.391 INFO:tasks.workunit.client.0.smithi053.stdout:8/921: mknod d10/d21/d28/db4/c12f 0 2024-09-16T00:50:38.393 INFO:tasks.workunit.client.0.smithi053.stdout:8/922: mknod d10/d21/d28/da2/c130 0 2024-09-16T00:50:38.393 INFO:tasks.workunit.client.0.smithi053.stdout:8/923: fdatasync d10/d1c/f7b 0 2024-09-16T00:50:38.397 INFO:tasks.workunit.client.0.smithi053.stdout:4/841: rename d0/da/d42/d8a to d0/da/d42/d8b/d123 0 2024-09-16T00:50:38.398 INFO:tasks.workunit.client.0.smithi053.stdout:4/842: dread - d0/d2/dd/d25/d37/f10a zero size 2024-09-16T00:50:38.400 INFO:tasks.workunit.client.0.smithi053.stdout:4/843: rename d0/d3c/l5a to d0/l124 0 2024-09-16T00:50:38.400 INFO:tasks.workunit.client.0.smithi053.stdout:4/844: write d0/d2/dd/d25/f5b [3945543,88778] 0 2024-09-16T00:50:38.402 INFO:tasks.workunit.client.0.smithi053.stdout:8/924: write d10/d52/fb8 [5555221,122718] 0 2024-09-16T00:50:38.404 INFO:tasks.workunit.client.0.smithi053.stdout:8/925: write d10/d21/d28/d3c/d63/d6a/d111/fcb [4958394,113615] 0 2024-09-16T00:50:38.405 INFO:tasks.workunit.client.0.smithi053.stdout:4/845: creat d0/da/d42/d8b/d87/d99/d113/f125 x:0 0 0 2024-09-16T00:50:38.411 INFO:tasks.workunit.client.0.smithi053.stdout:4/846: rename d0/d2/dd/d25/f21 to d0/d31/d98/f126 0 2024-09-16T00:50:38.413 INFO:tasks.workunit.client.0.smithi053.stdout:4/847: dread d0/d31/f7a [0,4194304] 0 2024-09-16T00:50:38.413 INFO:tasks.workunit.client.0.smithi053.stdout:8/926: mknod d10/d1c/d92/d66/db1/c131 0 2024-09-16T00:50:38.413 INFO:tasks.workunit.client.0.smithi053.stdout:8/927: chown d10/d21/d28/d3c/d63/d6a/cbd 3097 1 2024-09-16T00:50:38.422 INFO:tasks.workunit.client.0.smithi053.stdout:8/928: mknod d10/d4a/dc2/dcd/d11b/d126/c132 0 2024-09-16T00:50:38.425 INFO:tasks.workunit.client.0.smithi053.stdout:8/929: mknod d10/d4a/d54/c133 0 2024-09-16T00:50:38.435 INFO:tasks.workunit.client.0.smithi053.stdout:4/848: write d0/d65/ff6 [201109,114314] 0 2024-09-16T00:50:38.435 INFO:tasks.workunit.client.0.smithi053.stdout:4/849: write d0/d9f/dbd/f104 [1048029,127296] 0 2024-09-16T00:50:38.437 INFO:tasks.workunit.client.0.smithi053.stdout:8/930: dwrite d10/d4a/dbf/de7/f10e [0,4194304] 0 2024-09-16T00:50:38.437 INFO:tasks.workunit.client.0.smithi053.stdout:8/931: write d10/d4a/dac/f90 [1458987,24751] 0 2024-09-16T00:50:38.437 INFO:tasks.workunit.client.0.smithi053.stdout:8/932: chown d10/d21/d28/c41 64962 1 2024-09-16T00:50:38.438 INFO:tasks.workunit.client.0.smithi053.stdout:4/850: link d0/d2/dd/d25/d41/d78/l84 d0/d3c/d48/d4d/d70/de6/l127 0 2024-09-16T00:50:38.439 INFO:tasks.workunit.client.0.smithi053.stdout:4/851: truncate d0/da/d42/d8b/d123/fc1 866173 0 2024-09-16T00:50:38.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/933: truncate d10/d52/f55 1060115 0 2024-09-16T00:50:38.440 INFO:tasks.workunit.client.0.smithi053.stdout:8/934: chown d10/d21/d28/d3c/d63/d6a/d111/c98 2 1 2024-09-16T00:50:38.442 INFO:tasks.workunit.client.0.smithi053.stdout:4/852: symlink d0/d2/dd/d25/d39/dca/ddb/l128 0 2024-09-16T00:50:38.442 INFO:tasks.workunit.client.0.smithi053.stdout:1/893: sync 2024-09-16T00:50:38.444 INFO:tasks.workunit.client.0.smithi053.stdout:8/935: unlink d10/d1c/d2b/d40/d76/fda 0 2024-09-16T00:50:38.466 INFO:tasks.workunit.client.0.smithi053.stdout:4/853: dwrite d0/d3c/d48/d58/fcb [0,4194304] 0 2024-09-16T00:50:38.470 INFO:tasks.workunit.client.0.smithi053.stdout:8/936: dwrite d10/d21/d28/d3c/f116 [0,4194304] 0 2024-09-16T00:50:38.472 INFO:tasks.workunit.client.0.smithi053.stdout:8/937: creat d10/d21/d28/d3c/d63/d6a/d111/f134 x:0 0 0 2024-09-16T00:50:38.483 INFO:tasks.workunit.client.0.smithi053.stdout:4/854: dwrite d0/d31/fb0 [0,4194304] 0 2024-09-16T00:50:38.483 INFO:tasks.workunit.client.0.smithi053.stdout:4/855: truncate d0/d3c/d48/d58/fcb 4348551 0 2024-09-16T00:50:38.490 INFO:tasks.workunit.client.0.smithi053.stdout:4/856: write d0/d2/dd/d25/d41/ff7 [3923122,27800] 0 2024-09-16T00:50:38.499 INFO:tasks.workunit.client.0.smithi053.stdout:4/857: dread d0/d31/d98/fd8 [0,4194304] 0 2024-09-16T00:50:38.501 INFO:tasks.workunit.client.0.smithi053.stdout:4/858: rename d0/d2/dd/f9b to d0/da/f129 0 2024-09-16T00:50:38.509 INFO:tasks.workunit.client.0.smithi053.stdout:4/859: dread d0/d3c/d48/d95/fed [0,4194304] 0 2024-09-16T00:50:38.509 INFO:tasks.workunit.client.0.smithi053.stdout:4/860: chown d0/da/dbf/fe2 43270248 1 2024-09-16T00:50:38.511 INFO:tasks.workunit.client.0.smithi053.stdout:4/861: rename d0/cf2 to d0/da/d42/d8b/d87/c12a 0 2024-09-16T00:50:38.511 INFO:tasks.workunit.client.0.smithi053.stdout:4/862: chown d0/d2/dd/d25/d37 51199 1 2024-09-16T00:50:38.532 INFO:tasks.workunit.client.0.smithi053.stdout:4/863: dwrite d0/d2/dd/d25/d41/d78/f50 [0,4194304] 0 2024-09-16T00:50:38.537 INFO:tasks.workunit.client.0.smithi053.stdout:4/864: truncate d0/da/d42/d8b/fa8 1083961 0 2024-09-16T00:50:38.539 INFO:tasks.workunit.client.0.smithi053.stdout:4/865: dread d0/d65/ff6 [0,4194304] 0 2024-09-16T00:50:38.542 INFO:tasks.workunit.client.0.smithi053.stdout:4/866: rmdir d0/d31 39 2024-09-16T00:50:38.548 INFO:tasks.workunit.client.0.smithi053.stdout:4/867: mkdir d0/d2/dd/d25/d41/d78/dac/d12b 0 2024-09-16T00:50:38.549 INFO:tasks.workunit.client.0.smithi053.stdout:4/868: symlink d0/da/l12c 0 2024-09-16T00:50:38.549 INFO:tasks.workunit.client.0.smithi053.stdout:4/869: creat d0/d3c/d48/d95/f12d x:0 0 0 2024-09-16T00:50:38.553 INFO:tasks.workunit.client.0.smithi053.stdout:4/870: symlink d0/da/d7c/de1/deb/l12e 0 2024-09-16T00:50:38.553 INFO:tasks.workunit.client.0.smithi053.stdout:4/871: stat d0/d3c/d48/d58/dfd 0 2024-09-16T00:50:38.565 INFO:tasks.workunit.client.0.smithi053.stdout:4/872: dwrite d0/d3c/d48/d4d/d70/ffe [0,4194304] 0 2024-09-16T00:50:38.565 INFO:tasks.workunit.client.0.smithi053.stdout:4/873: chown d0/d2/d1e/dab/f10f 5802677 1 2024-09-16T00:50:38.568 INFO:tasks.workunit.client.0.smithi053.stdout:4/874: mknod d0/da/d42/d8b/d87/c12f 0 2024-09-16T00:50:38.568 INFO:tasks.workunit.client.0.smithi053.stdout:4/875: truncate d0/da/d7c/f115 308213 0 2024-09-16T00:50:38.569 INFO:tasks.workunit.client.0.smithi053.stdout:4/876: creat d0/da/d42/f130 x:0 0 0 2024-09-16T00:50:38.569 INFO:tasks.workunit.client.0.smithi053.stdout:4/877: write d0/d2/dd/d25/d37/f10a [619304,99025] 0 2024-09-16T00:50:38.571 INFO:tasks.workunit.client.0.smithi053.stdout:4/878: rename d0/d2/d1e/dab/f10f to d0/da/d42/d8b/f131 0 2024-09-16T00:50:38.571 INFO:tasks.workunit.client.0.smithi053.stdout:4/879: truncate d0/d3c/d48/d95/ff3 319642 0 2024-09-16T00:50:38.571 INFO:tasks.workunit.client.0.smithi053.stdout:4/880: fsync d0/d31/f77 0 2024-09-16T00:50:38.572 INFO:tasks.workunit.client.0.smithi053.stdout:4/881: creat d0/d3c/d48/f132 x:0 0 0 2024-09-16T00:50:38.574 INFO:tasks.workunit.client.0.smithi053.stdout:4/882: creat d0/da/d42/d8b/d87/d99/f133 x:0 0 0 2024-09-16T00:50:38.574 INFO:tasks.workunit.client.0.smithi053.stdout:4/883: truncate d0/d2/d1e/d4b/f57 2117262 0 2024-09-16T00:50:38.576 INFO:tasks.workunit.client.0.smithi053.stdout:4/884: mkdir d0/d2/dd/d25/d37/d134 0 2024-09-16T00:50:38.576 INFO:tasks.workunit.client.0.smithi053.stdout:4/885: chown d0/d2/dd/d25/d41/d78/dac/dec 3093321 1 2024-09-16T00:50:38.577 INFO:tasks.workunit.client.0.smithi053.stdout:4/886: mknod d0/d3c/d48/d58/c135 0 2024-09-16T00:50:38.579 INFO:tasks.workunit.client.0.smithi053.stdout:4/887: rename d0/d2/dd/f6e to d0/d2/dd/d25/d37/dc5/f136 0 2024-09-16T00:50:38.580 INFO:tasks.workunit.client.0.smithi053.stdout:4/888: mkdir d0/d2/dd/d25/d39/dca/d137 0 2024-09-16T00:50:38.582 INFO:tasks.workunit.client.0.smithi053.stdout:4/889: symlink d0/da/d42/d8b/d87/d99/d113/l138 0 2024-09-16T00:50:38.595 INFO:tasks.workunit.client.0.smithi053.stdout:4/890: dwrite d0/d2/f1b [0,4194304] 0 2024-09-16T00:50:38.597 INFO:tasks.workunit.client.0.smithi053.stdout:4/891: creat d0/d31/f139 x:0 0 0 2024-09-16T00:50:38.597 INFO:tasks.workunit.client.0.smithi053.stdout:4/892: fdatasync d0/d2/f1b 0 2024-09-16T00:50:38.597 INFO:tasks.workunit.client.0.smithi053.stdout:4/893: write d0/fe5 [559440,69868] 0 2024-09-16T00:50:38.598 INFO:tasks.workunit.client.0.smithi053.stdout:4/894: mkdir d0/d2/dd/d25/d37/d13a 0 2024-09-16T00:50:38.598 INFO:tasks.workunit.client.0.smithi053.stdout:4/895: fdatasync d0/d3c/d48/d4d/d70/ffe 0 2024-09-16T00:50:38.611 INFO:tasks.workunit.client.0.smithi053.stdout:4/896: dwrite d0/da/fa5 [0,4194304] 0 2024-09-16T00:50:38.611 INFO:tasks.workunit.client.0.smithi053.stdout:4/897: truncate d0/da/fc9 4533000 0 2024-09-16T00:50:38.625 INFO:tasks.workunit.client.0.smithi053.stdout:4/898: dread d0/da/fc3 [0,4194304] 0 2024-09-16T00:50:38.626 INFO:tasks.workunit.client.0.smithi053.stdout:4/899: getdents d0/d3c/d48/d4d/d70/de6 0 2024-09-16T00:50:38.642 INFO:tasks.workunit.client.0.smithi053.stdout:4/900: dwrite d0/d3c/f80 [0,4194304] 0 2024-09-16T00:50:38.645 INFO:tasks.workunit.client.0.smithi053.stdout:4/901: read d0/d2/dd/d25/d41/d78/f50 [1743301,1802] 0 2024-09-16T00:50:38.646 INFO:tasks.workunit.client.0.smithi053.stdout:4/902: creat d0/d31/d98/f13b x:0 0 0 2024-09-16T00:50:38.660 INFO:tasks.workunit.client.0.smithi053.stdout:4/903: dwrite d0/d2/dd/d25/d41/d78/f6a [0,4194304] 0 2024-09-16T00:50:38.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/904: mkdir d0/da/d7c/de1/deb/d13c 0 2024-09-16T00:50:38.662 INFO:tasks.workunit.client.0.smithi053.stdout:4/905: link d0/da/d42/d8b/lf9 d0/da/d42/d8b/l13d 0 2024-09-16T00:50:38.663 INFO:tasks.workunit.client.0.smithi053.stdout:4/906: mkdir d0/d3c/d48/d4d/d70/de6/d13e 0 2024-09-16T00:50:38.663 INFO:tasks.workunit.client.0.smithi053.stdout:4/907: truncate d0/da/d42/d8b/d87/d99/f133 801197 0 2024-09-16T00:50:38.663 INFO:tasks.workunit.client.0.smithi053.stdout:4/908: write d0/d2/d1e/f6d [3700053,120351] 0 2024-09-16T00:50:38.665 INFO:tasks.workunit.client.0.smithi053.stdout:4/909: mknod d0/d3c/d48/d4d/d70/de6/d13e/c13f 0 2024-09-16T00:50:38.665 INFO:tasks.workunit.client.0.smithi053.stdout:4/910: creat d0/d3c/d48/f140 x:0 0 0 2024-09-16T00:50:38.665 INFO:tasks.workunit.client.0.smithi053.stdout:4/911: stat d0/d2/dd/d25/d41/d78/l6b 0 2024-09-16T00:50:38.665 INFO:tasks.workunit.client.0.smithi053.stdout:4/912: stat d0/d2/dd/d25/d41 0 2024-09-16T00:50:38.665 INFO:tasks.workunit.client.0.smithi053.stdout:4/913: chown d0/d3c/d48/d95 0 1 2024-09-16T00:50:38.666 INFO:tasks.workunit.client.0.smithi053.stdout:4/914: mknod d0/da/d42/d8b/d123/c141 0 2024-09-16T00:50:38.666 INFO:tasks.workunit.client.0.smithi053.stdout:4/915: fdatasync d0/da/fa5 0 2024-09-16T00:50:38.668 INFO:tasks.workunit.client.0.smithi053.stdout:4/916: symlink d0/da/d7c/de1/deb/l142 0 2024-09-16T00:50:38.684 INFO:tasks.workunit.client.0.smithi053.stdout:4/917: dwrite d0/d31/f81 [0,4194304] 0 2024-09-16T00:50:38.685 INFO:tasks.workunit.client.0.smithi053.stdout:4/918: link d0/d2/d1e/dcc/fdf d0/d9f/f143 0 2024-09-16T00:50:38.686 INFO:tasks.workunit.client.0.smithi053.stdout:4/919: mknod d0/d2/dd/d25/d41/d78/dac/dec/c144 0 2024-09-16T00:50:38.690 INFO:tasks.workunit.client.0.smithi053.stdout:4/920: rename d0/d9f/dbd to d0/d65/d145 0 2024-09-16T00:50:38.702 INFO:tasks.workunit.client.0.smithi053.stdout:4/921: dwrite d0/d2/dd/d25/d39/dca/f10b [0,4194304] 0 2024-09-16T00:50:38.711 INFO:tasks.workunit.client.0.smithi053.stdout:4/922: rename d0/d65/d145/f104 to d0/d3c/d48/f146 0 2024-09-16T00:50:38.712 INFO:tasks.workunit.client.0.smithi053.stdout:4/923: dread d0/da/d7c/f115 [0,4194304] 0 2024-09-16T00:50:38.712 INFO:tasks.workunit.client.0.smithi053.stdout:4/924: write d0/d3c/d48/d95/f111 [573585,25161] 0 2024-09-16T00:50:38.715 INFO:tasks.workunit.client.0.smithi053.stdout:4/925: unlink d0/d3c/d48/d4d/d70/cef 0 2024-09-16T00:50:38.716 INFO:tasks.workunit.client.0.smithi053.stdout:4/926: dread d0/d31/f63 [0,4194304] 0 2024-09-16T00:50:38.719 INFO:tasks.workunit.client.0.smithi053.stdout:9/941: sync 2024-09-16T00:50:38.719 INFO:tasks.workunit.client.0.smithi053.stdout:9/942: write d8/d1c/d2b/f76 [4509424,130946] 0 2024-09-16T00:50:38.719 INFO:tasks.workunit.client.0.smithi053.stdout:4/927: getdents d0/d65 0 2024-09-16T00:50:38.719 INFO:tasks.workunit.client.0.smithi053.stdout:4/928: fsync d0/da/d42/fa7 0 2024-09-16T00:50:38.721 INFO:tasks.workunit.client.0.smithi053.stdout:9/943: creat d8/d4c/d5b/f130 x:0 0 0 2024-09-16T00:50:38.722 INFO:tasks.workunit.client.0.smithi053.stdout:9/944: write d8/d1c/d2b/d8b/f98 [564275,124496] 0 2024-09-16T00:50:38.722 INFO:tasks.workunit.client.0.smithi053.stdout:9/945: truncate d8/d22/fdf 718204 0 2024-09-16T00:50:38.727 INFO:tasks.workunit.client.0.smithi053.stdout:4/929: dread d0/d31/d98/fd8 [0,4194304] 0 2024-09-16T00:50:38.729 INFO:tasks.workunit.client.0.smithi053.stdout:4/930: unlink d0/d3c/d48/f146 0 2024-09-16T00:50:38.730 INFO:tasks.workunit.client.0.smithi053.stdout:4/931: creat d0/da/dbf/f147 x:0 0 0 2024-09-16T00:50:38.737 INFO:tasks.workunit.client.0.smithi053.stdout:9/946: dwrite d8/d1c/d2b/d2c/f85 [0,4194304] 0 2024-09-16T00:50:38.755 INFO:tasks.workunit.client.0.smithi053.stdout:4/932: dwrite d0/d2/dd/d25/d39/dca/ddb/d10e/f117 [0,4194304] 0 2024-09-16T00:50:38.755 INFO:tasks.workunit.client.0.smithi053.stdout:4/933: chown d0/da/l6c 2 1 2024-09-16T00:50:38.755 INFO:tasks.workunit.client.0.smithi053.stdout:4/934: write d0/d3c/d48/d95/ff3 [1194030,6163] 0 2024-09-16T00:50:38.755 INFO:tasks.workunit.client.0.smithi053.stdout:9/947: dwrite d8/d1c/d2b/d8b/fc5 [0,4194304] 0 2024-09-16T00:50:38.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/935: dwrite d0/d2/dd/d25/f5b [0,4194304] 0 2024-09-16T00:50:38.769 INFO:tasks.workunit.client.0.smithi053.stdout:4/936: write d0/d2/dd/d25/d41/d78/f50 [2244920,3149] 0 2024-09-16T00:50:38.770 INFO:tasks.workunit.client.0.smithi053.stdout:9/948: unlink d8/d22/d26/d83/lfa 0 2024-09-16T00:50:38.771 INFO:tasks.workunit.client.0.smithi053.stdout:4/937: symlink d0/d2/dd/d25/d41/d78/dac/d12b/l148 0 2024-09-16T00:50:38.785 INFO:tasks.workunit.client.0.smithi053.stdout:9/949: dread d8/d19/d51/f56 [0,4194304] 0 2024-09-16T00:50:38.785 INFO:tasks.workunit.client.0.smithi053.stdout:9/950: fdatasync d8/d19/d51/d6d/f126 0 2024-09-16T00:50:38.785 INFO:tasks.workunit.client.0.smithi053.stdout:9/951: read - d8/d13/f12d zero size 2024-09-16T00:50:38.786 INFO:tasks.workunit.client.0.smithi053.stdout:9/952: rmdir d8/d19/d31 39 2024-09-16T00:50:38.787 INFO:tasks.workunit.client.0.smithi053.stdout:1/894: sync 2024-09-16T00:50:38.787 INFO:tasks.workunit.client.0.smithi053.stdout:1/895: creat d5/dd/d8e/dcf/f121 x:0 0 0 2024-09-16T00:50:38.788 INFO:tasks.workunit.client.0.smithi053.stdout:1/896: readlink d5/d5a/l68 0 2024-09-16T00:50:38.788 INFO:tasks.workunit.client.0.smithi053.stdout:9/953: mknod d8/d4c/d5a/d99/dee/c131 0 2024-09-16T00:50:38.790 INFO:tasks.workunit.client.0.smithi053.stdout:4/938: dwrite d0/d3c/d48/d4d/d70/fcd [0,4194304] 0 2024-09-16T00:50:38.790 INFO:tasks.workunit.client.0.smithi053.stdout:9/954: mknod d8/d22/d54/dd5/c132 0 2024-09-16T00:50:38.803 INFO:tasks.workunit.client.0.smithi053.stdout:8/938: sync 2024-09-16T00:50:38.804 INFO:tasks.workunit.client.0.smithi053.stdout:8/939: fsync d10/d21/f7f 0 2024-09-16T00:50:38.805 INFO:tasks.workunit.client.0.smithi053.stdout:8/940: creat d10/d4a/dbf/f135 x:0 0 0 2024-09-16T00:50:38.805 INFO:tasks.workunit.client.0.smithi053.stdout:8/941: stat d10/d21/d28/c47 0 2024-09-16T00:50:38.806 INFO:tasks.workunit.client.0.smithi053.stdout:8/942: mkdir d10/d21/d136 0 2024-09-16T00:50:38.808 INFO:tasks.workunit.client.0.smithi053.stdout:8/943: chown d10/d1c/d92/cae 17896 1 2024-09-16T00:50:38.808 INFO:tasks.workunit.client.0.smithi053.stdout:8/944: truncate d10/d21/f123 455981 0 2024-09-16T00:50:38.808 INFO:tasks.workunit.client.0.smithi053.stdout:8/945: write d10/d1c/d2b/f5d [151606,77133] 0 2024-09-16T00:50:38.809 INFO:tasks.workunit.client.0.smithi053.stdout:1/897: dwrite d5/d9/d73/fab [0,4194304] 0 2024-09-16T00:50:38.809 INFO:tasks.workunit.client.0.smithi053.stdout:1/898: fdatasync d5/d9/d73/d84/fc5 0 2024-09-16T00:50:38.811 INFO:tasks.workunit.client.0.smithi053.stdout:8/946: link d10/c65 d10/d1c/d2b/d40/d76/d10f/d12a/c137 0 2024-09-16T00:50:38.814 INFO:tasks.workunit.client.0.smithi053.stdout:8/947: rmdir d10/d1c/d2b/d40/d76/d10f/d12a 39 2024-09-16T00:50:38.815 INFO:tasks.workunit.client.0.smithi053.stdout:8/948: chown d10/d4a/d54/c133 40917 1 2024-09-16T00:50:38.815 INFO:tasks.workunit.client.0.smithi053.stdout:8/949: chown d10/d9e/df2 2 1 2024-09-16T00:50:38.815 INFO:tasks.workunit.client.0.smithi053.stdout:8/950: truncate d10/d4a/dbf/f79 3841691 0 2024-09-16T00:50:38.817 INFO:tasks.workunit.client.0.smithi053.stdout:8/951: creat d10/d1c/d2b/f138 x:0 0 0 2024-09-16T00:50:38.817 INFO:tasks.workunit.client.0.smithi053.stdout:8/952: chown d10/d4a/dbf 0 1 2024-09-16T00:50:38.818 INFO:tasks.workunit.client.0.smithi053.stdout:8/953: dread - d10/d1c/f100 zero size 2024-09-16T00:50:38.819 INFO:tasks.workunit.client.0.smithi053.stdout:8/954: creat d10/d4a/dbf/de7/f139 x:0 0 0 2024-09-16T00:50:38.821 INFO:tasks.workunit.client.0.smithi053.stdout:9/955: dwrite d8/d19/d12b/de8/ff5 [0,4194304] 0 2024-09-16T00:50:38.821 INFO:tasks.workunit.client.0.smithi053.stdout:4/939: dwrite d0/d2/d1e/d4b/f79 [0,4194304] 0 2024-09-16T00:50:38.821 INFO:tasks.workunit.client.0.smithi053.stdout:4/940: creat d0/f149 x:0 0 0 2024-09-16T00:50:38.826 INFO:tasks.workunit.client.0.smithi053.stdout:1/899: dread d5/d18/d1f/f8f [0,4194304] 0 2024-09-16T00:50:38.826 INFO:tasks.workunit.client.0.smithi053.stdout:1/900: stat d5/dd/d7f/f83 0 2024-09-16T00:50:38.826 INFO:tasks.workunit.client.0.smithi053.stdout:1/901: chown d5/d9/d4c/dff/f106 174 1 2024-09-16T00:50:38.826 INFO:tasks.workunit.client.0.smithi053.stdout:9/956: symlink d8/d22/d54/ded/l133 0 2024-09-16T00:50:38.827 INFO:tasks.workunit.client.0.smithi053.stdout:9/957: dread d8/d19/d51/d6d/d7a/ff1 [0,4194304] 0 2024-09-16T00:50:38.833 INFO:tasks.workunit.client.0.smithi053.stdout:4/941: creat d0/d2/dd/d25/d39/dca/d137/f14a x:0 0 0 2024-09-16T00:50:38.835 INFO:tasks.workunit.client.0.smithi053.stdout:8/955: dwrite d10/d52/fb5 [0,4194304] 0 2024-09-16T00:50:38.836 INFO:tasks.workunit.client.0.smithi053.stdout:1/902: truncate d5/d18/d33/d30/daf/d111/d116/d98/fb7 84854 0 2024-09-16T00:50:38.836 INFO:tasks.workunit.client.0.smithi053.stdout:1/903: chown d5/d7/d39/dc6/def/l11a 25 1 2024-09-16T00:50:38.839 INFO:tasks.workunit.client.0.smithi053.stdout:4/942: symlink d0/da/d7c/l14b 0 2024-09-16T00:50:38.849 INFO:tasks.workunit.client.0.smithi053.stdout:9/958: dwrite d8/d13/f20 [0,4194304] 0 2024-09-16T00:50:38.849 INFO:tasks.workunit.client.0.smithi053.stdout:9/959: readlink d8/d19/l25 0 2024-09-16T00:50:38.849 INFO:tasks.workunit.client.0.smithi053.stdout:4/943: fdatasync d0/d3c/d48/d95/f111 0 2024-09-16T00:50:38.853 INFO:tasks.workunit.client.0.smithi053.stdout:1/904: dwrite d5/d18/f1b [4194304,4194304] 0 2024-09-16T00:50:38.853 INFO:tasks.workunit.client.0.smithi053.stdout:1/905: fdatasync d5/d9/d88/f60 0 2024-09-16T00:50:38.855 INFO:tasks.workunit.client.0.smithi053.stdout:9/960: rmdir d8/d19/d51/d6d/d7a/d113 39 2024-09-16T00:50:38.855 INFO:tasks.workunit.client.0.smithi053.stdout:9/961: chown d8/d22/d54/df7/cd6 1175 1 2024-09-16T00:50:38.861 INFO:tasks.workunit.client.0.smithi053.stdout:8/956: link d10/d21/d28/d3c/f3d d10/d1c/d92/f13a 0 2024-09-16T00:50:38.863 INFO:tasks.workunit.client.0.smithi053.stdout:1/906: symlink d5/d9/d73/l122 0 2024-09-16T00:50:38.867 INFO:tasks.workunit.client.0.smithi053.stdout:8/957: symlink d10/d21/d28/db4/l13b 0 2024-09-16T00:50:38.868 INFO:tasks.workunit.client.0.smithi053.stdout:4/944: dwrite d0/d2/dd/d25/d41/d78/f6a [0,4194304] 0 2024-09-16T00:50:38.869 INFO:tasks.workunit.client.0.smithi053.stdout:9/962: dwrite d8/d13/fdc [0,4194304] 0 2024-09-16T00:50:38.873 INFO:tasks.workunit.client.0.smithi053.stdout:1/907: creat d5/d9/d77/f123 x:0 0 0 2024-09-16T00:50:38.876 INFO:tasks.workunit.client.0.smithi053.stdout:8/958: truncate d10/d1c/d49/f89 2150968 0 2024-09-16T00:50:38.877 INFO:tasks.workunit.client.0.smithi053.stdout:8/959: chown d10/d21/f33 3 1 2024-09-16T00:50:38.885 INFO:tasks.workunit.client.0.smithi053.stdout:4/945: rename d0/d65/cdc to d0/d2/dd/d25/d39/dca/ddb/d11a/c14c 0 2024-09-16T00:50:38.885 INFO:tasks.workunit.client.0.smithi053.stdout:1/908: rename d5/d18/d33/d30/daf/d111/d116 to d5/d18/d33/d30/daf/d111/d116/d124 22 2024-09-16T00:50:38.886 INFO:tasks.workunit.client.0.smithi053.stdout:1/909: stat d5/d9/f40 0 2024-09-16T00:50:38.886 INFO:tasks.workunit.client.0.smithi053.stdout:4/946: stat d0/d2/d1e/dcc/fdf 0 2024-09-16T00:50:38.886 INFO:tasks.workunit.client.0.smithi053.stdout:4/947: creat d0/d2/dd/d25/d37/f14d x:0 0 0 2024-09-16T00:50:38.887 INFO:tasks.workunit.client.0.smithi053.stdout:9/963: dwrite d8/d22/d26/d83/fd3 [0,4194304] 0 2024-09-16T00:50:38.895 INFO:tasks.workunit.client.0.smithi053.stdout:4/948: read d0/da/fa5 [1423550,10103] 0 2024-09-16T00:50:38.897 INFO:tasks.workunit.client.0.smithi053.stdout:8/960: creat d10/d52/f13c x:0 0 0 2024-09-16T00:50:38.901 INFO:tasks.workunit.client.0.smithi053.stdout:9/964: dwrite d8/fc [4194304,4194304] 0 2024-09-16T00:50:38.901 INFO:tasks.workunit.client.0.smithi053.stdout:9/965: fdatasync d8/d19/d12b/fe3 0 2024-09-16T00:50:38.901 INFO:tasks.workunit.client.0.smithi053.stdout:9/966: truncate d8/d13/f12d 746319 0 2024-09-16T00:50:38.901 INFO:tasks.workunit.client.0.smithi053.stdout:9/967: write d8/d13/fd1 [25092,110667] 0 2024-09-16T00:50:38.905 INFO:tasks.workunit.client.0.smithi053.stdout:4/949: mknod d0/da/d7c/dc6/c14e 0 2024-09-16T00:50:38.905 INFO:tasks.workunit.client.0.smithi053.stdout:4/950: write d0/d2/dd/d25/d41/ff7 [80154,12170] 0 2024-09-16T00:50:38.905 INFO:tasks.workunit.client.0.smithi053.stdout:4/951: chown d0/d2/dd/d25/d41/d78/dac/d12b/l148 134337813 1 2024-09-16T00:50:38.905 INFO:tasks.workunit.client.0.smithi053.stdout:4/952: creat d0/d2/dd/d25/d39/dca/ddb/d10e/f14f x:0 0 0 2024-09-16T00:50:38.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/953: truncate d0/d2/dd/f96 66455 0 2024-09-16T00:50:38.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/954: readlink d0/d2/dd/d25/d41/d78/l84 0 2024-09-16T00:50:38.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/955: readlink d0/d3c/d48/l59 0 2024-09-16T00:50:38.906 INFO:tasks.workunit.client.0.smithi053.stdout:4/956: dread d0/d31/f7a [0,4194304] 0 2024-09-16T00:50:38.910 INFO:tasks.workunit.client.0.smithi053.stdout:8/961: link d10/d21/d28/l2e d10/d1c/d2b/d40/dc8/l13d 0 2024-09-16T00:50:38.914 INFO:tasks.workunit.client.0.smithi053.stdout:9/968: creat d8/d4c/d5a/d99/dee/f134 x:0 0 0 2024-09-16T00:50:38.915 INFO:tasks.workunit.client.0.smithi053.stdout:9/969: dread d8/d22/dc2/fcd [0,4194304] 0 2024-09-16T00:50:38.920 INFO:tasks.workunit.client.0.smithi053.stdout:4/957: rmdir d0/d2/dd 39 2024-09-16T00:50:38.920 INFO:tasks.workunit.client.0.smithi053.stdout:4/958: write d0/fe5 [1163442,91553] 0 2024-09-16T00:50:38.920 INFO:tasks.workunit.client.0.smithi053.stdout:4/959: stat d0/fe5 0 2024-09-16T00:50:38.925 INFO:tasks.workunit.client.0.smithi053.stdout:8/962: mknod d10/d1c/d2b/d40/ddc/c13e 0 2024-09-16T00:50:38.925 INFO:tasks.workunit.client.0.smithi053.stdout:8/963: truncate d10/d21/f7f 4990067 0 2024-09-16T00:50:38.925 INFO:tasks.workunit.client.0.smithi053.stdout:9/970: dread d8/d19/d51/d6d/f102 [0,4194304] 0 2024-09-16T00:50:38.925 INFO:tasks.workunit.client.0.smithi053.stdout:4/960: symlink d0/da/dbf/l150 0 2024-09-16T00:50:38.926 INFO:tasks.workunit.client.0.smithi053.stdout:8/964: rename d10/d1c/d92/d66/d9d/f117 to d10/d1c/d2b/f13f 0 2024-09-16T00:50:38.927 INFO:tasks.workunit.client.0.smithi053.stdout:9/971: link d8/d1c/d2b/fda d8/d19/d12b/d109/d110/f135 0 2024-09-16T00:50:38.928 INFO:tasks.workunit.client.0.smithi053.stdout:4/961: symlink d0/d2/dd/d25/d37/d13a/l151 0 2024-09-16T00:50:38.928 INFO:tasks.workunit.client.0.smithi053.stdout:4/962: getdents d0/d2/dd/d25/d37/d134 0 2024-09-16T00:50:38.928 INFO:tasks.workunit.client.0.smithi053.stdout:4/963: chown d0/da/d42/d8b/d87/d99/ce7 249193 1 2024-09-16T00:50:38.929 INFO:tasks.workunit.client.0.smithi053.stdout:8/965: creat d10/d1c/d92/d66/d9d/da6/f140 x:0 0 0 2024-09-16T00:50:38.931 INFO:tasks.workunit.client.0.smithi053.stdout:9/972: symlink d8/d22/d54/dd5/de0/l136 0 2024-09-16T00:50:38.931 INFO:tasks.workunit.client.0.smithi053.stdout:9/973: chown d8/d19/d31 342692 1 2024-09-16T00:50:38.934 INFO:tasks.workunit.client.0.smithi053.stdout:4/964: rename d0/d31/f77 to d0/da/d7c/dc6/f152 0 2024-09-16T00:50:38.934 INFO:tasks.workunit.client.0.smithi053.stdout:4/965: chown d0/d3c/d48/d95/ff3 1869734 1 2024-09-16T00:50:38.940 INFO:tasks.workunit.client.0.smithi053.stdout:8/966: dread d10/d21/f7f [0,4194304] 0 2024-09-16T00:50:38.941 INFO:tasks.workunit.client.0.smithi053.stdout:4/966: mknod d0/da/dbf/c153 0 2024-09-16T00:50:38.946 INFO:tasks.workunit.client.0.smithi053.stdout:8/967: dread d10/d21/f7f [0,4194304] 0 2024-09-16T00:50:38.946 INFO:tasks.workunit.client.0.smithi053.stdout:8/968: dread - d10/d4a/dc2/ffa zero size 2024-09-16T00:50:38.946 INFO:tasks.workunit.client.0.smithi053.stdout:8/969: write d10/d1c/d92/ff7 [590313,28571] 0 2024-09-16T00:50:38.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/970: rmdir d10/d4a/dbf/de7 39 2024-09-16T00:50:38.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/971: truncate d10/d1c/f100 535430 0 2024-09-16T00:50:38.948 INFO:tasks.workunit.client.0.smithi053.stdout:8/972: stat d10/d52/l53 0 2024-09-16T00:50:38.960 INFO:tasks.workunit.client.0.smithi053.stdout:8/973: dwrite d10/d21/f123 [0,4194304] 0 2024-09-16T00:50:38.960 INFO:tasks.workunit.client.0.smithi053.stdout:8/974: creat d10/d4a/dc2/f141 x:0 0 0 2024-09-16T00:50:38.991 INFO:tasks.workunit.client.0.smithi053.stdout:8/975: unlink d10/f14 0 2024-09-16T00:50:38.991 INFO:tasks.workunit.client.0.smithi053.stdout:8/976: fsync d10/d1c/d2b/f13f 0 2024-09-16T00:50:38.991 INFO:tasks.workunit.client.0.smithi053.stdout:8/977: truncate d10/f109 890414 0 2024-09-16T00:50:39.005 INFO:tasks.workunit.client.0.smithi053.stdout:8/978: rename d10/d21/d28/d3c/d63 to d10/d4a/dc2/dcd/d11b/d142 0 2024-09-16T00:50:39.018 INFO:tasks.workunit.client.0.smithi053.stdout:8/979: dwrite d10/d4a/dc2/dcd/d11b/d142/fab [0,4194304] 0 2024-09-16T00:50:39.020 INFO:tasks.workunit.client.0.smithi053.stdout:8/980: symlink d10/d21/d28/d3c/l143 0 2024-09-16T00:50:39.020 INFO:tasks.workunit.client.0.smithi053.stdout:8/981: chown d10/d4a/dc2/dcd/d11b/d142/cf0 4 1 2024-09-16T00:50:39.022 INFO:tasks.workunit.client.0.smithi053.stdout:8/982: creat d10/d1c/d92/d66/d9d/da6/ddf/d10b/f144 x:0 0 0 2024-09-16T00:50:39.024 INFO:tasks.workunit.client.0.smithi053.stdout:8/983: truncate d10/f39 2114373 0 2024-09-16T00:50:39.025 INFO:tasks.workunit.client.0.smithi053.stdout:8/984: mkdir d10/d21/d28/d145 0 2024-09-16T00:50:39.027 INFO:tasks.workunit.client.0.smithi053.stdout:8/985: rename d10/d4a/dc2/dcd/d11b/d142/d6a/d111/f134 to d10/d1c/d2b/d40/d76/d10f/f146 0 2024-09-16T00:50:39.045 INFO:tasks.workunit.client.0.smithi053.stdout:8/986: dwrite d10/d1c/d2b/d40/ddc/fe6 [4194304,4194304] 0 2024-09-16T00:50:39.045 INFO:tasks.workunit.client.0.smithi053.stdout:8/987: chown d10/d4a/dc2/dcd 10141 1 2024-09-16T00:50:39.047 INFO:tasks.workunit.client.0.smithi053.stdout:8/988: truncate d10/d4a/dc2/dcd/d11b/d142/d6a/d111/fcb 1388881 0 2024-09-16T00:50:39.069 INFO:tasks.workunit.client.0.smithi053.stdout:8/989: dwrite d10/d4a/dbf/f9b [0,4194304] 0 2024-09-16T00:50:39.070 INFO:tasks.workunit.client.0.smithi053.stdout:8/990: rename d10/d1c/d2b/f13f to d10/d4a/f147 0 2024-09-16T00:50:39.072 INFO:tasks.workunit.client.0.smithi053.stdout:8/991: rmdir d10/d4a/dac/dec 0 2024-09-16T00:50:39.074 INFO:tasks.workunit.client.0.smithi053.stdout:8/992: fsync d10/d4a/dc2/dcd/d11b/d142/d6a/d111/fcb 0 2024-09-16T00:50:39.076 INFO:tasks.workunit.client.0.smithi053.stdout:8/993: unlink d10/d21/d28/l29 0 2024-09-16T00:50:39.078 INFO:tasks.workunit.client.0.smithi053.stdout:8/994: write d10/d21/d28/d3c/f3d [1259986,118104] 0 2024-09-16T00:50:39.078 INFO:tasks.workunit.client.0.smithi053.stdout:8/995: fdatasync d10/d1c/d2b/d40/fa3 0 2024-09-16T00:50:39.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/996: mknod d10/dbe/c148 0 2024-09-16T00:50:39.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/997: chown d10/d21/d28 93 1 2024-09-16T00:50:39.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/998: creat d10/d4a/d54/f149 x:0 0 0 2024-09-16T00:50:39.082 INFO:tasks.workunit.client.0.smithi053.stdout:8/999: readlink d10/d21/d28/l71 0 2024-09-16T00:50:39.163 INFO:tasks.workunit.client.0.smithi053.stdout:1/910: sync 2024-09-16T00:50:39.163 INFO:tasks.workunit.client.0.smithi053.stdout:9/974: sync 2024-09-16T00:50:39.163 INFO:tasks.workunit.client.0.smithi053.stdout:4/967: sync 2024-09-16T00:50:39.169 INFO:tasks.workunit.client.0.smithi053.stdout:4/968: link d0/d2/d1e/d4b/f57 d0/da/d42/d8b/d87/d99/f154 0 2024-09-16T00:50:39.170 INFO:tasks.workunit.client.0.smithi053.stdout:4/969: dread d0/d2/dd/d25/d37/f10a [0,4194304] 0 2024-09-16T00:50:39.173 INFO:tasks.workunit.client.0.smithi053.stdout:1/911: rename d5/d7/fa5 to d5/d18/d33/d30/daf/d111/d116/d98/f125 0 2024-09-16T00:50:39.175 INFO:tasks.workunit.client.0.smithi053.stdout:9/975: mkdir d8/df9/d12a/d137 0 2024-09-16T00:50:39.178 INFO:tasks.workunit.client.0.smithi053.stdout:9/976: mknod d8/c138 0 2024-09-16T00:50:39.178 INFO:tasks.workunit.client.0.smithi053.stdout:9/977: readlink d8/d19/d51/d6d/d7a/db2/l127 0 2024-09-16T00:50:39.181 INFO:tasks.workunit.client.0.smithi053.stdout:4/970: read d0/d3c/d48/d4d/d70/f85 [4012208,130084] 0 2024-09-16T00:50:39.181 INFO:tasks.workunit.client.0.smithi053.stdout:4/971: fdatasync d0/d3c/d48/d58/fcb 0 2024-09-16T00:50:39.181 INFO:tasks.workunit.client.0.smithi053.stdout:4/972: creat d0/d2/dd/d25/d39/f155 x:0 0 0 2024-09-16T00:50:39.184 INFO:tasks.workunit.client.0.smithi053.stdout:1/912: write d5/d18/d33/d30/daf/d111/d116/f96 [2948283,64331] 0 2024-09-16T00:50:39.185 INFO:tasks.workunit.client.0.smithi053.stdout:4/973: mknod d0/d65/c156 0 2024-09-16T00:50:39.185 INFO:tasks.workunit.client.0.smithi053.stdout:4/974: creat d0/d3c/d48/f157 x:0 0 0 2024-09-16T00:50:39.186 INFO:tasks.workunit.client.0.smithi053.stdout:4/975: dread d0/d2/dd/d25/d37/f10a [0,4194304] 0 2024-09-16T00:50:39.186 INFO:tasks.workunit.client.0.smithi053.stdout:4/976: chown d0/d3c/d48/d4d/d70/de6/d13e 4291092 1 2024-09-16T00:50:39.186 INFO:tasks.workunit.client.0.smithi053.stdout:4/977: dread - d0/d3c/d48/f157 zero size 2024-09-16T00:50:39.187 INFO:tasks.workunit.client.0.smithi053.stdout:9/978: dread d8/d13/fae [0,4194304] 0 2024-09-16T00:50:39.189 INFO:tasks.workunit.client.0.smithi053.stdout:1/913: symlink d5/dd/d8e/dcf/l126 0 2024-09-16T00:50:39.193 INFO:tasks.workunit.client.0.smithi053.stdout:9/979: symlink d8/d19/d12b/d109/l139 0 2024-09-16T00:50:39.197 INFO:tasks.workunit.client.0.smithi053.stdout:9/980: rmdir d8/d19/d51/d6d/d7a/db2/de4 0 2024-09-16T00:50:39.199 INFO:tasks.workunit.client.0.smithi053.stdout:9/981: getdents d8/d22/d54/dd5 0 2024-09-16T00:50:39.200 INFO:tasks.workunit.client.0.smithi053.stdout:9/982: write d8/d22/f11b [240814,80548] 0 2024-09-16T00:50:39.200 INFO:tasks.workunit.client.0.smithi053.stdout:9/983: chown d8/d19/d51/d6d/d7a/faf 6 1 2024-09-16T00:50:39.200 INFO:tasks.workunit.client.0.smithi053.stdout:9/984: chown d8/d1c/d2b/d2c/f85 141615 1 2024-09-16T00:50:39.201 INFO:tasks.workunit.client.0.smithi053.stdout:4/978: dwrite d0/d65/ff6 [0,4194304] 0 2024-09-16T00:50:39.201 INFO:tasks.workunit.client.0.smithi053.stdout:9/985: read d8/d22/d54/fd2 [144570,61753] 0 2024-09-16T00:50:39.203 INFO:tasks.workunit.client.0.smithi053.stdout:9/986: dread d8/d4c/d5a/d99/fb4 [0,4194304] 0 2024-09-16T00:50:39.208 INFO:tasks.workunit.client.0.smithi053.stdout:9/987: unlink d8/d4c/d5b/fe1 0 2024-09-16T00:50:39.213 INFO:tasks.workunit.client.0.smithi053.stdout:1/914: dwrite d5/d9/f4b [8388608,4194304] 0 2024-09-16T00:50:39.213 INFO:tasks.workunit.client.0.smithi053.stdout:1/915: chown d5/d18/d33/d30/daf/d111/d116/d98/dd0/df2/f102 460 1 2024-09-16T00:50:39.213 INFO:tasks.workunit.client.0.smithi053.stdout:1/916: readlink d5/d18/d1f/l36 0 2024-09-16T00:50:39.221 INFO:tasks.workunit.client.0.smithi053.stdout:4/979: rmdir d0 39 2024-09-16T00:50:39.221 INFO:tasks.workunit.client.0.smithi053.stdout:4/980: write d0/da/fa5 [750069,85447] 0 2024-09-16T00:50:39.223 INFO:tasks.workunit.client.0.smithi053.stdout:1/917: rename d5/cda to d5/d7/d39/c127 0 2024-09-16T00:50:39.223 INFO:tasks.workunit.client.0.smithi053.stdout:1/918: fsync d5/dd/dbb/fdb 0 2024-09-16T00:50:39.224 INFO:tasks.workunit.client.0.smithi053.stdout:9/988: dwrite d8/d1c/fa8 [0,4194304] 0 2024-09-16T00:50:39.224 INFO:tasks.workunit.client.0.smithi053.stdout:4/981: creat d0/d3c/f158 x:0 0 0 2024-09-16T00:50:39.224 INFO:tasks.workunit.client.0.smithi053.stdout:1/919: getdents d5/de3 0 2024-09-16T00:50:39.226 INFO:tasks.workunit.client.0.smithi053.stdout:1/920: dread d5/de3/f2a [0,4194304] 0 2024-09-16T00:50:39.226 INFO:tasks.workunit.client.0.smithi053.stdout:1/921: write d5/d9/d77/ffa [125043,47485] 0 2024-09-16T00:50:39.228 INFO:tasks.workunit.client.0.smithi053.stdout:9/989: rename d8/d19/d51/d6d/d7a/l123 to d8/d19/d51/d6d/d7a/l13a 0 2024-09-16T00:50:39.228 INFO:tasks.workunit.client.0.smithi053.stdout:9/990: write d8/d22/f11b [778302,36726] 0 2024-09-16T00:50:39.229 INFO:tasks.workunit.client.0.smithi053.stdout:4/982: creat d0/da/d7c/dc6/f159 x:0 0 0 2024-09-16T00:50:39.229 INFO:tasks.workunit.client.0.smithi053.stdout:4/983: chown d0/d3c/d48/d95/ld1 122696667 1 2024-09-16T00:50:39.229 INFO:tasks.workunit.client.0.smithi053.stdout:4/984: dread - d0/d3c/d48/f157 zero size 2024-09-16T00:50:39.230 INFO:tasks.workunit.client.0.smithi053.stdout:1/922: link d5/d9/d73/fe4 d5/d7/d39/f128 0 2024-09-16T00:50:39.233 INFO:tasks.workunit.client.0.smithi053.stdout:9/991: rename d8/d4c/d5b/d10b to d8/d19/d12b/d109/d110/d13b 0 2024-09-16T00:50:39.233 INFO:tasks.workunit.client.0.smithi053.stdout:4/985: write d0/da/fc3 [1874122,127816] 0 2024-09-16T00:50:39.234 INFO:tasks.workunit.client.0.smithi053.stdout:1/923: symlink d5/d7/l129 0 2024-09-16T00:50:39.234 INFO:tasks.workunit.client.0.smithi053.stdout:1/924: truncate d5/d5a/fa4 4474554 0 2024-09-16T00:50:39.234 INFO:tasks.workunit.client.0.smithi053.stdout:1/925: read - d5/dd/d8e/dcf/ff0 zero size 2024-09-16T00:50:39.242 INFO:tasks.workunit.client.0.smithi053.stdout:9/992: getdents d8/d1c/d2b/d5c 0 2024-09-16T00:50:39.245 INFO:tasks.workunit.client.0.smithi053.stdout:4/986: mkdir d0/d2/dd/d25/d39/d15a 0 2024-09-16T00:50:39.247 INFO:tasks.workunit.client.0.smithi053.stdout:1/926: rename d5/d9/f44 to d5/dd/dbb/f12a 0 2024-09-16T00:50:39.247 INFO:tasks.workunit.client.0.smithi053.stdout:1/927: chown d5/d9/d73/d84 6846633 1 2024-09-16T00:50:39.247 INFO:tasks.workunit.client.0.smithi053.stdout:9/993: creat d8/d19/f13c x:0 0 0 2024-09-16T00:50:39.249 INFO:tasks.workunit.client.0.smithi053.stdout:1/928: dread d5/d9/d77/f7b [0,4194304] 0 2024-09-16T00:50:39.249 INFO:tasks.workunit.client.0.smithi053.stdout:4/987: unlink d0/d2/dd/lb7 0 2024-09-16T00:50:39.250 INFO:tasks.workunit.client.0.smithi053.stdout:9/994: mkdir d8/d1c/d2b/d49/d13d 0 2024-09-16T00:50:39.253 INFO:tasks.workunit.client.0.smithi053.stdout:4/988: mkdir d0/d3c/d48/d15b 0 2024-09-16T00:50:39.253 INFO:tasks.workunit.client.0.smithi053.stdout:4/989: fdatasync d0/d3c/d48/d58/f73 0 2024-09-16T00:50:39.253 INFO:tasks.workunit.client.0.smithi053.stdout:4/990: fdatasync d0/d2/dd/d25/f108 0 2024-09-16T00:50:39.256 INFO:tasks.workunit.client.0.smithi053.stdout:9/995: creat d8/d22/d26/d83/f13e x:0 0 0 2024-09-16T00:50:39.262 INFO:tasks.workunit.client.0.smithi053.stdout:1/929: rename d5/d9/d77 to d5/dd/d8e/d12b 0 2024-09-16T00:50:39.264 INFO:tasks.workunit.client.0.smithi053.stdout:1/930: link d5/d7/d39/d57/c10f d5/d9/d88/c12c 0 2024-09-16T00:50:39.270 INFO:tasks.workunit.client.0.smithi053.stdout:1/931: mknod d5/dd/dd5/c12d 0 2024-09-16T00:50:39.273 INFO:tasks.workunit.client.0.smithi053.stdout:1/932: mkdir d5/d9/d88/d12e 0 2024-09-16T00:50:39.279 INFO:tasks.workunit.client.0.smithi053.stdout:4/991: dwrite d0/d3c/d48/d58/fcb [0,4194304] 0 2024-09-16T00:50:39.281 INFO:tasks.workunit.client.0.smithi053.stdout:9/996: dwrite d8/f1f [0,4194304] 0 2024-09-16T00:50:39.281 INFO:tasks.workunit.client.0.smithi053.stdout:9/997: truncate d8/d22/d54/ded/d106/f122 312993 0 2024-09-16T00:50:39.281 INFO:tasks.workunit.client.0.smithi053.stdout:9/998: getdents d8/d19/d12b/d109/d110/d13b 0 2024-09-16T00:50:39.281 INFO:tasks.workunit.client.0.smithi053.stdout:4/992: creat d0/da/dd5/f15c x:0 0 0 2024-09-16T00:50:39.285 INFO:tasks.workunit.client.0.smithi053.stdout:9/999: readlink d8/lf 0 2024-09-16T00:50:39.286 INFO:tasks.workunit.client.0.smithi053.stdout:4/993: mkdir d0/d3c/d48/d15b/d15d 0 2024-09-16T00:50:39.290 INFO:tasks.workunit.client.0.smithi053.stdout:4/994: dread d0/d2/dd/d25/d37/dc5/f136 [0,4194304] 0 2024-09-16T00:50:39.291 INFO:tasks.workunit.client.0.smithi053.stdout:4/995: write d0/d2/dd/d25/d39/f11c [24575,86478] 0 2024-09-16T00:50:39.292 INFO:tasks.workunit.client.0.smithi053.stdout:4/996: unlink d0/d2/d1e/d4b/f57 0 2024-09-16T00:50:39.293 INFO:tasks.workunit.client.0.smithi053.stdout:4/997: truncate d0/f38 2273024 0 2024-09-16T00:50:39.303 INFO:tasks.workunit.client.0.smithi053.stdout:4/998: read d0/d2/dd/d25/d41/d78/f2c [5483475,57591] 0 2024-09-16T00:50:39.304 INFO:tasks.workunit.client.0.smithi053.stdout:4/999: creat d0/d2/dd/d25/d37/d13a/f15e x:0 0 0 2024-09-16T00:50:39.513 INFO:tasks.workunit.client.0.smithi053.stdout:1/933: sync 2024-09-16T00:50:39.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/934: unlink d5/d18/d33/d30/daf/d111/d116/d98/dd0/df2/lfe 0 2024-09-16T00:50:39.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/935: dread - d5/dd/d47/f113 zero size 2024-09-16T00:50:39.516 INFO:tasks.workunit.client.0.smithi053.stdout:1/936: stat d5/d18/d33/d30/daf/d111/d116/d98/dd0/f3a 0 2024-09-16T00:50:39.517 INFO:tasks.workunit.client.0.smithi053.stdout:1/937: unlink d5/c6 0 2024-09-16T00:50:39.519 INFO:tasks.workunit.client.0.smithi053.stdout:1/938: creat d5/d7/d39/d57/d82/f12f x:0 0 0 2024-09-16T00:50:39.521 INFO:tasks.workunit.client.0.smithi053.stdout:1/939: creat d5/d9/d88/dea/f130 x:0 0 0 2024-09-16T00:50:39.522 INFO:tasks.workunit.client.0.smithi053.stdout:1/940: symlink d5/dd/dd5/l131 0 2024-09-16T00:50:39.541 INFO:tasks.workunit.client.0.smithi053.stdout:1/941: dwrite d5/de3/f11d [0,4194304] 0 2024-09-16T00:50:39.541 INFO:tasks.workunit.client.0.smithi053.stdout:1/942: unlink d5/d18/d33/d30/daf/d111/d116/d98/dd0/f72 0 2024-09-16T00:50:39.546 INFO:tasks.workunit.client.0.smithi053.stdout:1/943: dread d5/d18/d1f/f8f [0,4194304] 0 2024-09-16T00:50:39.548 INFO:tasks.workunit.client.0.smithi053.stdout:1/944: write d5/d9/d73/d84/fd7 [620576,90566] 0 2024-09-16T00:50:39.548 INFO:tasks.workunit.client.0.smithi053.stdout:1/945: readlink d5/dd/d8e/dcf/l126 0 2024-09-16T00:50:39.549 INFO:tasks.workunit.client.0.smithi053.stdout:1/946: mknod d5/d9/d88/d12e/c132 0 2024-09-16T00:50:39.551 INFO:tasks.workunit.client.0.smithi053.stdout:1/947: unlink f2 0 2024-09-16T00:50:39.554 INFO:tasks.workunit.client.0.smithi053.stdout:1/948: link d5/d9/d73/f81 d5/dd/d8e/f133 0 2024-09-16T00:50:39.577 INFO:tasks.workunit.client.0.smithi053.stdout:1/949: dwrite d5/d9/f40 [0,4194304] 0 2024-09-16T00:50:39.577 INFO:tasks.workunit.client.0.smithi053.stdout:1/950: chown d5/d18/d33/d30/f9b 8851 1 2024-09-16T00:50:39.595 INFO:tasks.workunit.client.0.smithi053.stdout:1/951: dwrite d5/d9/d88/dea/f130 [0,4194304] 0 2024-09-16T00:50:39.599 INFO:tasks.workunit.client.0.smithi053.stdout:1/952: mkdir d5/d18/d33/d30/daf/d111/d116/d134 0 2024-09-16T00:50:39.599 INFO:tasks.workunit.client.0.smithi053.stdout:1/953: chown d5/d7/d39/c127 3022037 1 2024-09-16T00:50:39.607 INFO:tasks.workunit.client.0.smithi053.stdout:1/954: dread d5/d9/d73/fab [0,4194304] 0 2024-09-16T00:50:39.609 INFO:tasks.workunit.client.0.smithi053.stdout:1/955: getdents d5/d9/d88 0 2024-09-16T00:50:39.614 INFO:tasks.workunit.client.0.smithi053.stdout:1/956: rename d5/d7/d39/dc6/f11e to d5/d9/d73/db2/f135 0 2024-09-16T00:50:39.615 INFO:tasks.workunit.client.0.smithi053.stdout:1/957: mkdir d5/de3/d136 0 2024-09-16T00:50:39.617 INFO:tasks.workunit.client.0.smithi053.stdout:1/958: read d5/d18/d33/d30/daf/d111/d116/d98/dd0/f15 [135844,82774] 0 2024-09-16T00:50:39.618 INFO:tasks.workunit.client.0.smithi053.stdout:1/959: mknod d5/dd/d7f/c137 0 2024-09-16T00:50:39.620 INFO:tasks.workunit.client.0.smithi053.stdout:1/960: creat d5/d9/d4c/dcd/f138 x:0 0 0 2024-09-16T00:50:39.620 INFO:tasks.workunit.client.0.smithi053.stdout:1/961: fsync d5/d18/f7c 0 2024-09-16T00:50:39.620 INFO:tasks.workunit.client.0.smithi053.stdout:1/962: write d5/d18/f7c [247261,63694] 0 2024-09-16T00:50:39.620 INFO:tasks.workunit.client.0.smithi053.stdout:1/963: dread - d5/dd/d19/ff1 zero size 2024-09-16T00:50:39.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:39 smithi152 ceph-mon[33237]: pgmap v20: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 133 MiB/s rd, 147 MiB/s wr, 279 op/s 2024-09-16T00:50:40.019 INFO:tasks.workunit.client.0.smithi053.stdout:1/964: sync 2024-09-16T00:50:40.021 INFO:tasks.workunit.client.0.smithi053.stdout:1/965: unlink d5/dd/dd5/ff3 0 2024-09-16T00:50:40.021 INFO:tasks.workunit.client.0.smithi053.stdout:1/966: stat d5/dd/fb0 0 2024-09-16T00:50:40.022 INFO:tasks.workunit.client.0.smithi053.stdout:1/967: chown d5/d9/f40 20 1 2024-09-16T00:50:40.022 INFO:tasks.workunit.client.0.smithi053.stdout:1/968: mkdir d5/d18/d33/d30/daf/d111/d116/d98/dd0/df2/d139 0 2024-09-16T00:50:40.024 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:39 smithi053 ceph-mon[27950]: pgmap v20: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 133 MiB/s rd, 147 MiB/s wr, 279 op/s 2024-09-16T00:50:40.038 INFO:tasks.workunit.client.0.smithi053.stdout:1/969: dwrite d5/de3/f2a [0,4194304] 0 2024-09-16T00:50:40.038 INFO:tasks.workunit.client.0.smithi053.stdout:1/970: chown d5/d18/d33/d30/daf/d111/d116/d98/dd0/l9c 5 1 2024-09-16T00:50:40.047 INFO:tasks.workunit.client.0.smithi053.stdout:1/971: dread d5/d9/d88/dea/f130 [0,4194304] 0 2024-09-16T00:50:40.080 INFO:tasks.workunit.client.0.smithi053.stdout:1/972: readlink d5/d18/d1f/l36 0 2024-09-16T00:50:40.145 INFO:tasks.workunit.client.0.smithi053.stdout:1/973: creat d5/d18/d33/d30/daf/d111/d116/f13a x:0 0 0 2024-09-16T00:50:40.146 INFO:tasks.workunit.client.0.smithi053.stdout:1/974: mkdir d5/d18/d33/d30/daf/d111/d116/d98/dd0/df2/d139/d13b 0 2024-09-16T00:50:40.159 INFO:tasks.workunit.client.0.smithi053.stdout:1/975: dwrite d5/d18/f7c [0,4194304] 0 2024-09-16T00:50:40.159 INFO:tasks.workunit.client.0.smithi053.stdout:1/976: readlink d5/dd/dd5/l101 0 2024-09-16T00:50:40.166 INFO:tasks.workunit.client.0.smithi053.stdout:1/977: creat d5/dd/d8e/d12b/f13c x:0 0 0 2024-09-16T00:50:40.169 INFO:tasks.workunit.client.0.smithi053.stdout:1/978: mknod d5/d18/d33/d30/daf/d111/d116/d134/c13d 0 2024-09-16T00:50:40.169 INFO:tasks.workunit.client.0.smithi053.stdout:1/979: chown d5/d9/d73/db2/dd8/ldc 731735 1 2024-09-16T00:50:40.169 INFO:tasks.workunit.client.0.smithi053.stdout:1/980: chown d5/d9/l117 1483 1 2024-09-16T00:50:40.169 INFO:tasks.workunit.client.0.smithi053.stdout:1/981: dread d5/dd/fb0 [4194304,4194304] 0 2024-09-16T00:50:40.191 INFO:tasks.workunit.client.0.smithi053.stdout:1/982: dwrite d5/d18/d33/d30/daf/f107 [0,4194304] 0 2024-09-16T00:50:40.207 INFO:tasks.workunit.client.0.smithi053.stdout:1/983: dwrite d5/dd/dbb/fdb [4194304,4194304] 0 2024-09-16T00:50:40.209 INFO:tasks.workunit.client.0.smithi053.stdout:1/984: symlink d5/d18/d33/d30/daf/l13e 0 2024-09-16T00:50:40.209 INFO:tasks.workunit.client.0.smithi053.stdout:1/985: creat d5/d9/d4c/dff/f13f x:0 0 0 2024-09-16T00:50:40.211 INFO:tasks.workunit.client.0.smithi053.stdout:1/986: mkdir d5/d9/d4c/dff/d140 0 2024-09-16T00:50:40.213 INFO:tasks.workunit.client.0.smithi053.stdout:1/987: rmdir d5/dd/d19 39 2024-09-16T00:50:40.610 INFO:tasks.workunit.client.0.smithi053.stdout:1/988: sync 2024-09-16T00:50:40.611 INFO:tasks.workunit.client.0.smithi053.stdout:1/989: mkdir d5/d18/d33/d30/daf/d141 0 2024-09-16T00:50:40.613 INFO:tasks.workunit.client.0.smithi053.stdout:1/990: mkdir d5/d18/d142 0 2024-09-16T00:50:40.614 INFO:tasks.workunit.client.0.smithi053.stdout:1/991: mkdir d5/dd/d8e/d12b/d143 0 2024-09-16T00:50:40.616 INFO:tasks.workunit.client.0.smithi053.stdout:1/992: mkdir d5/de3/d144 0 2024-09-16T00:50:40.618 INFO:tasks.workunit.client.0.smithi053.stdout:1/993: unlink d5/d18/d33/d30/f9b 0 2024-09-16T00:50:40.618 INFO:tasks.workunit.client.0.smithi053.stdout:1/994: creat d5/d5a/f145 x:0 0 0 2024-09-16T00:50:40.618 INFO:tasks.workunit.client.0.smithi053.stdout:1/995: write d5/d18/d33/d30/daf/d111/d116/d98/dd0/f12 [380086,34992] 0 2024-09-16T00:50:40.618 INFO:tasks.workunit.client.0.smithi053.stdout:1/996: truncate d5/d18/d33/d30/daf/d111/d116/f13a 819532 0 2024-09-16T00:50:40.619 INFO:tasks.workunit.client.0.smithi053.stdout:1/997: chown d5/d18/d33/d30/daf/d111/d116/d134 306169 1 2024-09-16T00:50:40.619 INFO:tasks.workunit.client.0.smithi053.stdout:1/998: dread d5/d18/d33/d30/daf/d111/d116/d98/fb7 [0,4194304] 0 2024-09-16T00:50:40.621 INFO:tasks.workunit.client.0.smithi053.stdout:1/999: creat d5/d9/d73/f146 x:0 0 0 2024-09-16T00:50:40.624 INFO:tasks.workunit.client.0.smithi053.stderr:+ rm -rf -- ./tmp.0I73QLF5OY 2024-09-16T00:50:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:41 smithi053 ceph-mon[27950]: pgmap v21: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 133 MiB/s rd, 147 MiB/s wr, 279 op/s 2024-09-16T00:50:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:41 smithi152 ceph-mon[33237]: pgmap v21: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 133 MiB/s rd, 147 MiB/s wr, 279 op/s 2024-09-16T00:50:44.027 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 189 MiB/s wr, 383 op/s 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: Upgrade: Need to upgrade myself (mgr.smithi152.nlmwrx) 2024-09-16T00:50:44.028 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:43 smithi053 ceph-mon[27950]: Upgrade: Need to upgrade myself (mgr.smithi152.nlmwrx) 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 189 MiB/s wr, 383 op/s 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: Upgrade: Need to upgrade myself (mgr.smithi152.nlmwrx) 2024-09-16T00:50:44.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:43 smithi152 ceph-mon[33237]: Upgrade: Need to upgrade myself (mgr.smithi152.nlmwrx) 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: Upgrade: Updating mgr.smithi053.cjiiek 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: Deploying daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:50:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:45 smithi152 ceph-mon[33237]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 109 MiB/s wr, 233 op/s 2024-09-16T00:50:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: Upgrade: Updating mgr.smithi053.cjiiek 2024-09-16T00:50:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:50:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:50:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:50:45.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:45.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: Deploying daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:50:45.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:45 smithi053 ceph-mon[27950]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 109 MiB/s wr, 233 op/s 2024-09-16T00:50:47.050 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T00:50:47.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-16T00:50:47.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:47 smithi152 ceph-mon[33237]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 109 MiB/s wr, 317 op/s 2024-09-16T00:50:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:47 smithi053 ceph-mon[27950]: pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 89 MiB/s rd, 109 MiB/s wr, 317 op/s 2024-09-16T00:50:49.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:49 smithi053 ceph-mon[27950]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 43 MiB/s wr, 188 op/s 2024-09-16T00:50:49.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:49 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:49.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:49 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:49.815 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:49 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:49.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.813+0000 7ff0edd85700 1 -- 172.21.15.53:0/1846137837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e81014b0 msgr2=0x7ff0e8103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.813+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1846137837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e81014b0 0x7ff0e8103930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009910 tx=0x7ff0dc009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 -- 172.21.15.53:0/1846137837 shutdown_connections 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1846137837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e81014b0 0x7ff0e8103930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1846137837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e80feb50 0x7ff0e8100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 -- 172.21.15.53:0/1846137837 >> 172.21.15.53:0/1846137837 conn(0x7ff0e80fa780 msgr2=0x7ff0e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 -- 172.21.15.53:0/1846137837 shutdown_connections 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 -- 172.21.15.53:0/1846137837 wait complete. 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.814+0000 7ff0edd85700 1 Processor -- start 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0edd85700 1 -- start start 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0edd85700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0edd85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 0x7ff0e819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0edd85700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e819cc00 con 0x7ff0e80feb50 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0edd85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e819cd40 con 0x7ff0e81014b0 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0e6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 0x7ff0e819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0e77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0e77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44906/0 (socket says 172.21.15.53:44906) 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.815+0000 7ff0e77fe700 1 -- 172.21.15.53:0/1881218801 learned_addr learned my addr 172.21.15.53:0/1881218801 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e6ffd700 1 -- 172.21.15.53:0/1881218801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 msgr2=0x7ff0e819c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e6ffd700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e6ffd700 1 -- 172.21.15.53:0/1881218801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0095f0 con 0x7ff0e81014b0 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e77fe700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e6ffd700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 0x7ff0e819c5e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc000c00 tx=0x7ff0dc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:49.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc01d070 con 0x7ff0e81014b0 2024-09-16T00:50:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0dc005dc0 con 0x7ff0e81014b0 2024-09-16T00:50:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0dc017400 con 0x7ff0e81014b0 2024-09-16T00:50:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e81a1790 con 0x7ff0e81014b0 2024-09-16T00:50:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.816+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e81a1c80 con 0x7ff0e81014b0 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.817+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e81961c0 con 0x7ff0e81014b0 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.818+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7ff0dc00fa40 con 0x7ff0e81014b0 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.818+0000 7ff0e4ff9700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 0x7ff0d006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.819+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff0dc08e1e0 con 0x7ff0e81014b0 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.819+0000 7ff0e77fe700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 0x7ff0d006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.819+0000 7ff0e77fe700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 0x7ff0d006fab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8005950 tx=0x7ff0d8009260 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:49.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:49.823+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff0dc05b350 con 0x7ff0e81014b0 2024-09-16T00:50:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.141+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0e8061190 con 0x7ff0d006d600 2024-09-16T00:50:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.142+0000 7ff0e4ff9700 1 -- 172.21.15.53:0/1881218801 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7ff0e8061190 con 0x7ff0d006d600 2024-09-16T00:50:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.145+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 msgr2=0x7ff0d006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.145+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 0x7ff0d006fab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8005950 tx=0x7ff0d8009260 comp rx=0 tx=0).stop 2024-09-16T00:50:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.145+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 msgr2=0x7ff0e819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.145+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 0x7ff0e819c5e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc000c00 tx=0x7ff0dc00f690 comp rx=0 tx=0).stop 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.145+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 shutdown_connections 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff0d006d600 0x7ff0d006fab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0e80feb50 0x7ff0e819c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 --2- 172.21.15.53:0/1881218801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e81014b0 0x7ff0e819c5e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 >> 172.21.15.53:0/1881218801 conn(0x7ff0e80fa780 msgr2=0x7ff0e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 shutdown_connections 2024-09-16T00:50:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.146+0000 7ff0edd85700 1 -- 172.21.15.53:0/1881218801 wait complete. 2024-09-16T00:50:50.158 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:50:50.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:49 smithi152 ceph-mon[33237]: pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 43 MiB/s wr, 188 op/s 2024-09-16T00:50:50.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:49 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:50.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:49 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:50.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:49 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:50.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 -- 172.21.15.53:0/3270220980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 msgr2=0x7f4f08103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 --2- 172.21.15.53:0/3270220980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f08103a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009870 tx=0x7f4ef8009b80 comp rx=0 tx=0).stop 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 -- 172.21.15.53:0/3270220980 shutdown_connections 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 --2- 172.21.15.53:0/3270220980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f08103a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 --2- 172.21.15.53:0/3270220980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f081028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 -- 172.21.15.53:0/3270220980 >> 172.21.15.53:0/3270220980 conn(0x7f4f080fda60 msgr2=0x7f4f080ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 -- 172.21.15.53:0/3270220980 shutdown_connections 2024-09-16T00:50:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.284+0000 7f4f0f643700 1 -- 172.21.15.53:0/3270220980 wait complete. 2024-09-16T00:50:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.285+0000 7f4f0f643700 1 Processor -- start 2024-09-16T00:50:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.285+0000 7f4f0f643700 1 -- start start 2024-09-16T00:50:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0f643700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0f643700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f081981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0f643700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f081987f0 con 0x7f4f08102490 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0f643700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08198960 con 0x7f4f08103640 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44918/0 (socket says 172.21.15.53:44918) 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 -- 172.21.15.53:0/1949437293 learned_addr learned my addr 172.21.15.53:0/1949437293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0cbde700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f081981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 -- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 msgr2=0x7f4f081981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f081981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.286+0000 7f4f0d3df700 1 -- 172.21.15.53:0/1949437293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009520 con 0x7f4f08102490 2024-09-16T00:50:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4f0d3df700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e970 tx=0x7f4f0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f040041f0 con 0x7f4f08102490 2024-09-16T00:50:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0819d3f0 con 0x7f4f08102490 2024-09-16T00:50:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0819d910 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f0400cc70 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.287+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f04003cb0 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.289+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0810af90 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.290+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f4f0400c7c0 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.290+0000 7f4efe7fc700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 0x7f4ef406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.290+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4f04014070 con 0x7f4f08102490 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.291+0000 7f4f0cbde700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 0x7f4ef406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.291+0000 7f4f0cbde700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 0x7f4ef406fab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009f50 tx=0x7f4ef8019040 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:50.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.297+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4f040567b0 con 0x7f4f08102490 2024-09-16T00:50:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.680+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f0819e060 con 0x7f4ef406d600 2024-09-16T00:50:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.682+0000 7f4efe7fc700 1 -- 172.21.15.53:0/1949437293 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f4f0819e060 con 0x7f4ef406d600 2024-09-16T00:50:50.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 msgr2=0x7f4ef406fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 0x7f4ef406fab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009f50 tx=0x7f4ef8019040 comp rx=0 tx=0).stop 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 msgr2=0x7f4f08197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e970 tx=0x7f4f0400ec80 comp rx=0 tx=0).stop 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 shutdown_connections 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f4ef406d600 0x7f4ef406fab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f08102490 0x7f4f08197cb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 --2- 172.21.15.53:0/1949437293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f08103640 0x7f4f081981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 >> 172.21.15.53:0/1949437293 conn(0x7f4f080fda60 msgr2=0x7f4f08106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 shutdown_connections 2024-09-16T00:50:50.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.685+0000 7f4f0f643700 1 -- 172.21.15.53:0/1949437293 wait complete. 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 -- 172.21.15.53:0/459902773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec1010a0 msgr2=0x7f69ec0ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 --2- 172.21.15.53:0/459902773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec1010a0 0x7f69ec0ff4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009870 tx=0x7f69e0009b80 comp rx=0 tx=0).stop 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 -- 172.21.15.53:0/459902773 shutdown_connections 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 --2- 172.21.15.53:0/459902773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec1010a0 0x7f69ec0ff4b0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009870 tx=0x7f69e0009b80 comp rx=0 tx=0).stop 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 --2- 172.21.15.53:0/459902773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 -- 172.21.15.53:0/459902773 >> 172.21.15.53:0/459902773 conn(0x7f69ec0f9f10 msgr2=0x7f69ec0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:50.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 -- 172.21.15.53:0/459902773 shutdown_connections 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.866+0000 7f69f16ab700 1 -- 172.21.15.53:0/459902773 wait complete. 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 Processor -- start 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 -- start start 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 0x7f69ec1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec19cd60 con 0x7f69ec100750 2024-09-16T00:50:50.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.867+0000 7f69f16ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec19ced0 con 0x7f69ec19c860 2024-09-16T00:50:50.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69eaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69eaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec19c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44932/0 (socket says 172.21.15.53:44932) 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69eaffd700 1 -- 172.21.15.53:0/2465708599 learned_addr learned my addr 172.21.15.53:0/2465708599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69ea7fc700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 0x7f69ec1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69ea7fc700 1 -- 172.21.15.53:0/2465708599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 msgr2=0x7f69ec19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69ea7fc700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec19c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69ea7fc700 1 -- 172.21.15.53:0/2465708599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0095f0 con 0x7f69ec19c860 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.868+0000 7f69ea7fc700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 0x7f69ec1a18d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69e0008000 tx=0x7f69e000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.869+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e001c070 con 0x7f69ec19c860 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.869+0000 7f69f16ab700 1 -- 172.21.15.53:0/2465708599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0009520 con 0x7f69ec19c860 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.869+0000 7f69f16ab700 1 -- 172.21.15.53:0/2465708599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec1a2140 con 0x7f69ec19c860 2024-09-16T00:50:50.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.869+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69e000fd60 con 0x7f69ec19c860 2024-09-16T00:50:50.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.870+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e0022cf0 con 0x7f69ec19c860 2024-09-16T00:50:50.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.870+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc0052f0 con 0x7f69ec19c860 2024-09-16T00:50:50.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.872+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f69e0020070 con 0x7f69ec19c860 2024-09-16T00:50:50.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.872+0000 7f69d3fff700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 0x7f69d406f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:50.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.873+0000 7f69eaffd700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 0x7f69d406f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:50.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.873+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f69e008e120 con 0x7f69ec19c860 2024-09-16T00:50:50.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.873+0000 7f69eaffd700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 0x7f69d406f890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005950 tx=0x7f69dc009310 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:50.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:50.876+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f69e005b3d0 con 0x7f69ec19c860 2024-09-16T00:50:51.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:50 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:51.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.151+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69cc000bc0 con 0x7f69d406d3e0 2024-09-16T00:50:51.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.161+0000 7f69d3fff700 1 -- 172.21.15.53:0/2465708599 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f69cc000bc0 con 0x7f69d406d3e0 2024-09-16T00:50:51.161 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (7m) 29s ago 8m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (9m) 29s ago 9m 7734k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (8m) 37s ago 8m 7327k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (8m) 29s ago 8m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (7m) 37s ago 7m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (7m) 29s ago 8m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:50:51.162 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (3m) 29s ago 3m 195M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (3m) 29s ago 3m 124M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (3m) 37s ago 3m 14.4M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (3m) 37s ago 3m 13.1M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 starting - - - - 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (71s) 37s ago 7m 484M - 19.1.1-326-g8921c8ef f1455bd0219c 9e697fb152d1 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (10m) 29s ago 10m 49.5M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (7m) 37s ago 7m 39.4M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:50:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (8m) 29s ago 8m 16.1M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 37s ago 7m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (6m) 29s ago 6m 192M 1217M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (6m) 29s ago 6m 204M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (5m) 29s ago 5m 162M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (5m) 37s ago 5m 202M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (5m) 37s ago 5m 186M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (4m) 37s ago 4m 210M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:50:51.164 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 starting - - - - 2024-09-16T00:50:51.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 msgr2=0x7f69d406f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 0x7f69d406f890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005950 tx=0x7f69dc009310 comp rx=0 tx=0).stop 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 msgr2=0x7f69ec1a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 0x7f69ec1a18d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69e0008000 tx=0x7f69e000f690 comp rx=0 tx=0).stop 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 shutdown_connections 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f69d406d3e0 0x7f69d406f890 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69ec100750 0x7f69ec19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 --2- 172.21.15.53:0/2465708599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69ec19c860 0x7f69ec1a18d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 >> 172.21.15.53:0/2465708599 conn(0x7f69ec0f9f10 msgr2=0x7f69ec108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 shutdown_connections 2024-09-16T00:50:51.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.164+0000 7f69d1ffb700 1 -- 172.21.15.53:0/2465708599 wait complete. 2024-09-16T00:50:51.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:50 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:50:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 -- 172.21.15.53:0/575429947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff548102430 msgr2=0x7ff548102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 --2- 172.21.15.53:0/575429947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff548102430 0x7ff548102840 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff544009910 tx=0x7ff544009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 -- 172.21.15.53:0/575429947 shutdown_connections 2024-09-16T00:50:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 --2- 172.21.15.53:0/575429947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5481036d0 0x7ff548103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 --2- 172.21.15.53:0/575429947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff548102430 0x7ff548102840 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 -- 172.21.15.53:0/575429947 >> 172.21.15.53:0/575429947 conn(0x7ff5480fda80 msgr2=0x7ff5480ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.320+0000 7ff55058c700 1 -- 172.21.15.53:0/575429947 shutdown_connections 2024-09-16T00:50:51.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.321+0000 7ff55058c700 1 -- 172.21.15.53:0/575429947 wait complete. 2024-09-16T00:50:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 Processor -- start 2024-09-16T00:50:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 -- start start 2024-09-16T00:50:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff548102430 0x7ff548197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:51.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548198850 con 0x7ff5481036d0 2024-09-16T00:50:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff55058c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54819d260 con 0x7ff548102430 2024-09-16T00:50:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff54db27700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff54db27700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44946/0 (socket says 172.21.15.53:44946) 2024-09-16T00:50:51.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff54e328700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff548102430 0x7ff548197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:51.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.322+0000 7ff54db27700 1 -- 172.21.15.53:0/412203808 learned_addr learned my addr 172.21.15.53:0/412203808 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:51.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff54db27700 1 -- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff548102430 msgr2=0x7ff548197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff54db27700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff548102430 0x7ff548197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff54db27700 1 -- 172.21.15.53:0/412203808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538009520 con 0x7ff5481036d0 2024-09-16T00:50:51.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff54db27700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff53800eab0 tx=0x7ff53800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:51.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53800cc60 con 0x7ff5481036d0 2024-09-16T00:50:51.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5440095f0 con 0x7ff5481036d0 2024-09-16T00:50:51.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5380044d0 con 0x7ff5481036d0 2024-09-16T00:50:51.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54819d7f0 con 0x7ff5481036d0 2024-09-16T00:50:51.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.323+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5380051f0 con 0x7ff5481036d0 2024-09-16T00:50:51.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.325+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7ff538004930 con 0x7ff5481036d0 2024-09-16T00:50:51.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.325+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54810af10 con 0x7ff5481036d0 2024-09-16T00:50:51.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.326+0000 7ff53f7fe700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 0x7ff53406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:51.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.326+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff538014070 con 0x7ff5481036d0 2024-09-16T00:50:51.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.326+0000 7ff54e328700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 0x7ff53406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:51.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.328+0000 7ff54e328700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 0x7ff53406faa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff544005b40 tx=0x7ff544005a90 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:51.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.336+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff5380565c0 con 0x7ff5481036d0 2024-09-16T00:50:51.803 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:51 smithi053 ceph-mon[27950]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:51.803 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:51 smithi053 ceph-mon[27950]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 43 MiB/s wr, 188 op/s 2024-09-16T00:50:51.804 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:51 smithi053 ceph-mon[27950]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:51.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.846+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff54819deb0 con 0x7ff5481036d0 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.847+0000 7ff53f7fe700 1 -- 172.21.15.53:0/412203808 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7ff53801c320 con 0x7ff5481036d0 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:50:51.848 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:50:51.849 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 msgr2=0x7ff53406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 0x7ff53406faa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff544005b40 tx=0x7ff544005a90 comp rx=0 tx=0).stop 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 msgr2=0x7ff548198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff53800eab0 tx=0x7ff53800ee70 comp rx=0 tx=0).stop 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 shutdown_connections 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7ff53406d5f0 0x7ff53406faa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff548102430 0x7ff548197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 --2- 172.21.15.53:0/412203808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5481036d0 0x7ff548198230 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.851+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 >> 172.21.15.53:0/412203808 conn(0x7ff5480fda80 msgr2=0x7ff548106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.852+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 shutdown_connections 2024-09-16T00:50:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:51.852+0000 7ff55058c700 1 -- 172.21.15.53:0/412203808 wait complete. 2024-09-16T00:50:52.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 -- 172.21.15.53:0/801090175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a880ff150 msgr2=0x7f5a880ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 --2- 172.21.15.53:0/801090175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a880ff150 0x7f5a880ff560 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009910 tx=0x7f5a7c009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 -- 172.21.15.53:0/801090175 shutdown_connections 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 --2- 172.21.15.53:0/801090175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a881003f0 0x7f5a88100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 --2- 172.21.15.53:0/801090175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a880ff150 0x7f5a880ff560 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 -- 172.21.15.53:0/801090175 >> 172.21.15.53:0/801090175 conn(0x7f5a880fa7a0 msgr2=0x7f5a880fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 -- 172.21.15.53:0/801090175 shutdown_connections 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.004+0000 7f5a8eba4700 1 -- 172.21.15.53:0/801090175 wait complete. 2024-09-16T00:50:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 Processor -- start 2024-09-16T00:50:52.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 -- start start 2024-09-16T00:50:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 0x7f5a8819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8819b110 con 0x7f5a881003f0 2024-09-16T00:50:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8eba4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8819b250 con 0x7f5a880ff150 2024-09-16T00:50:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a8c940700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.005+0000 7f5a87fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 0x7f5a8819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a8c940700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:60356/0 (socket says 172.21.15.53:60356) 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a8c940700 1 -- 172.21.15.53:0/268669138 learned_addr learned my addr 172.21.15.53:0/268669138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a87fff700 1 -- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 msgr2=0x7f5a88069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a87fff700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a87fff700 1 -- 172.21.15.53:0/268669138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0095f0 con 0x7f5a881003f0 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a8c940700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:50:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a87fff700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 0x7f5a8819aaf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400e970 tx=0x7f5a7400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7400c9d0 con 0x7f5a881003f0 2024-09-16T00:50:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a8eba4700 1 -- 172.21.15.53:0/268669138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a88194920 con 0x7f5a881003f0 2024-09-16T00:50:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.006+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a74010430 con 0x7f5a881003f0 2024-09-16T00:50:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.007+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a74018650 con 0x7f5a881003f0 2024-09-16T00:50:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.007+0000 7f5a8eba4700 1 -- 172.21.15.53:0/268669138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a88194db0 con 0x7f5a881003f0 2024-09-16T00:50:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.009+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88196880 con 0x7f5a881003f0 2024-09-16T00:50:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.009+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f5a740105a0 con 0x7f5a881003f0 2024-09-16T00:50:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.010+0000 7f5a85ffb700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 0x7f5a7806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.010+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5a74014070 con 0x7f5a881003f0 2024-09-16T00:50:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.010+0000 7f5a8c940700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 0x7f5a7806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.011+0000 7f5a8c940700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 0x7f5a7806fab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009fd0 tx=0x7f5a7c005940 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.019+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5a74092060 con 0x7f5a881003f0 2024-09-16T00:50:52.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:51 smithi152 ceph-mon[33237]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:52.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:51 smithi152 ceph-mon[33237]: pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 28 MiB/s rd, 43 MiB/s wr, 188 op/s 2024-09-16T00:50:52.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:51 smithi152 ceph-mon[33237]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.355+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a88068ab0 con 0x7f5a881003f0 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.356+0000 7f5a85ffb700 1 -- 172.21.15.53:0/268669138 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f5a74092750 con 0x7f5a881003f0 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:50:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:50:52.358 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:50:52.359 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:50:52.360 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:52.360 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:50:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 msgr2=0x7f5a7806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 0x7f5a7806fab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009fd0 tx=0x7f5a7c005940 comp rx=0 tx=0).stop 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 msgr2=0x7f5a8819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 0x7f5a8819aaf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400e970 tx=0x7f5a7400ec80 comp rx=0 tx=0).stop 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 shutdown_connections 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f5a7806d600 0x7f5a7806fab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a880ff150 0x7f5a88069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 --2- 172.21.15.53:0/268669138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a881003f0 0x7f5a8819aaf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 >> 172.21.15.53:0/268669138 conn(0x7f5a880fa7a0 msgr2=0x7f5a881036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 shutdown_connections 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.359+0000 7f5a737fe700 1 -- 172.21.15.53:0/268669138 wait complete. 2024-09-16T00:50:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 -- 172.21.15.53:0/249423193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 msgr2=0x7f2f801018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 --2- 172.21.15.53:0/249423193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f801018a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009910 tx=0x7f2f74009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 -- 172.21.15.53:0/249423193 shutdown_connections 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 --2- 172.21.15.53:0/249423193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f801018a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 --2- 172.21.15.53:0/249423193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 -- 172.21.15.53:0/249423193 >> 172.21.15.53:0/249423193 conn(0x7f2f800fb7e0 msgr2=0x7f2f800fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:52.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 -- 172.21.15.53:0/249423193 shutdown_connections 2024-09-16T00:50:52.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.517+0000 7f2f86610700 1 -- 172.21.15.53:0/249423193 wait complete. 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.518+0000 7f2f86610700 1 Processor -- start 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.518+0000 7f2f86610700 1 -- start start 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f86610700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f86610700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f80195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f86610700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80196600 con 0x7f2f80101450 2024-09-16T00:50:52.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f86610700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80196740 con 0x7f2f80100250 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f80195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f80195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55998/0 (socket says 172.21.15.53:55998) 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7f7fe700 1 -- 172.21.15.53:0/3432684575 learned_addr learned my addr 172.21.15.53:0/3432684575 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7ffff700 1 -- 172.21.15.53:0/3432684575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 msgr2=0x7f2f80195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7ffff700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f80195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.519+0000 7f2f7ffff700 1 -- 172.21.15.53:0/3432684575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f740095f0 con 0x7f2f80100250 2024-09-16T00:50:52.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f7ffff700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80195aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000e940 tx=0x7f2f7000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:52.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f700041f0 con 0x7f2f80100250 2024-09-16T00:50:52.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f70004350 con 0x7f2f80100250 2024-09-16T00:50:52.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8019b1f0 con 0x7f2f80100250 2024-09-16T00:50:52.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8019b740 con 0x7f2f80100250 2024-09-16T00:50:52.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.520+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f70003c80 con 0x7f2f80100250 2024-09-16T00:50:52.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.521+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c005320 con 0x7f2f80100250 2024-09-16T00:50:52.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.522+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f2f70018430 con 0x7f2f80100250 2024-09-16T00:50:52.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.523+0000 7f2f7d7fa700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 0x7f2f6806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:52.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.523+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2f70014070 con 0x7f2f80100250 2024-09-16T00:50:52.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.523+0000 7f2f7f7fe700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 0x7f2f6806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:52.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.523+0000 7f2f7f7fe700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 0x7f2f6806faa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009fd0 tx=0x7f2f74005a90 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.527+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f2f7005a500 con 0x7f2f80100250 2024-09-16T00:50:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:52 smithi053 ceph-mon[27950]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:52 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/412203808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:50:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:52 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/268669138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:50:52.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.931+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 --> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f6c000bf0 con 0x7f2f6806d5f0 2024-09-16T00:50:52.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.933+0000 7f2f7d7fa700 1 -- 172.21.15.53:0/3432684575 <== mgr.24385 v2:172.21.15.152:6828/3166645188 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f2f6c000bf0 con 0x7f2f6806d5f0 2024-09-16T00:50:52.933 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:50:52.933 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:50:52.933 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "", 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:50:52.934 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:50:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 msgr2=0x7f2f6806faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 0x7f2f6806faa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009fd0 tx=0x7f2f74005a90 comp rx=0 tx=0).stop 2024-09-16T00:50:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 msgr2=0x7f2f80195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80195aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000e940 tx=0x7f2f7000ec50 comp rx=0 tx=0).stop 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 shutdown_connections 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f2f6806d5f0 0x7f2f6806faa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f80100250 0x7f2f80195aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 --2- 172.21.15.53:0/3432684575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80101450 0x7f2f80195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 >> 172.21.15.53:0/3432684575 conn(0x7f2f800fb7e0 msgr2=0x7f2f80104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 shutdown_connections 2024-09-16T00:50:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:52.935+0000 7f2f86610700 1 -- 172.21.15.53:0/3432684575 wait complete. 2024-09-16T00:50:53.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 -- 172.21.15.53:0/2905909351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 msgr2=0x7f9a40073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/2905909351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a40073180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009910 tx=0x7f9a3c009c20 comp rx=0 tx=0).stop 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 -- 172.21.15.53:0/2905909351 shutdown_connections 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/2905909351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/2905909351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a40073180 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.075+0000 7f9a47fc1700 1 -- 172.21.15.53:0/2905909351 >> 172.21.15.53:0/2905909351 conn(0x7f9a400fb7f0 msgr2=0x7f9a400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.076+0000 7f9a47fc1700 1 -- 172.21.15.53:0/2905909351 shutdown_connections 2024-09-16T00:50:53.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.076+0000 7f9a47fc1700 1 -- 172.21.15.53:0/2905909351 wait complete. 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 Processor -- start 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 -- start start 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a401981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40198750 con 0x7f9a40073750 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.077+0000 7f9a47fc1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a401988c0 con 0x7f9a40074d20 2024-09-16T00:50:53.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a45d5d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:53.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a4555c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a401981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:53.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a45d5d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56022/0 (socket says 172.21.15.53:56022) 2024-09-16T00:50:53.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a45d5d700 1 -- 172.21.15.53:0/306397920 learned_addr learned my addr 172.21.15.53:0/306397920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a4555c700 1 -- 172.21.15.53:0/306397920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 msgr2=0x7f9a40197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a4555c700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a4555c700 1 -- 172.21.15.53:0/306397920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0095f0 con 0x7f9a40074d20 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a4555c700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a401981e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c8f0 tx=0x7f9a3000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.078+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a30004410 con 0x7f9a40074d20 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.079+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4019d360 con 0x7f9a40074d20 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.079+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4019d8b0 con 0x7f9a40074d20 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.079+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a30004570 con 0x7f9a40074d20 2024-09-16T00:50:53.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.079+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a300038b0 con 0x7f9a40074d20 2024-09-16T00:50:53.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.080+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24005320 con 0x7f9a40074d20 2024-09-16T00:50:53.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.080+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91263+0+0 (secure 0 0 0) 0x7f9a30003a10 con 0x7f9a40074d20 2024-09-16T00:50:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.081+0000 7f9a36ffd700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 0x7f9a2c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:50:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.081+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9a3008c650 con 0x7f9a40074d20 2024-09-16T00:50:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.081+0000 7f9a45d5d700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 0x7f9a2c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:50:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.082+0000 7f9a45d5d700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 0x7f9a2c06faf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c00b560 comp rx=0 tx=0).ready entity=mgr.24385 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:50:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.085+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9a30055e10 con 0x7f9a40074d20 2024-09-16T00:50:53.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:52 smithi152 ceph-mon[33237]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:53.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:52 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/412203808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:50:53.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:52 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/268669138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:50:53.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.549+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9a24005190 con 0x7f9a40074d20 2024-09-16T00:50:53.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.549+0000 7f9a36ffd700 1 -- 172.21.15.53:0/306397920 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9a300594d0 con 0x7f9a40074d20 2024-09-16T00:50:53.550 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 msgr2=0x7f9a2c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 0x7f9a2c06faf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c00b560 comp rx=0 tx=0).stop 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 msgr2=0x7f9a401981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a401981e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c8f0 tx=0x7f9a3000cc00 comp rx=0 tx=0).stop 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 shutdown_connections 2024-09-16T00:50:53.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:6828/3166645188,v1:172.21.15.152:6829/3166645188] conn(0x7f9a2c06d640 0x7f9a2c06faf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a40073750 0x7f9a40197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 --2- 172.21.15.53:0/306397920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a40074d20 0x7f9a401981e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:50:53.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.553+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 >> 172.21.15.53:0/306397920 conn(0x7f9a400fb7f0 msgr2=0x7f9a40106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:50:53.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.554+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 shutdown_connections 2024-09-16T00:50:53.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:50:53.554+0000 7f9a47fc1700 1 -- 172.21.15.53:0/306397920 wait complete. 2024-09-16T00:50:53.807 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:53 smithi053 ceph-mon[27950]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 43 MiB/s wr, 278 op/s 2024-09-16T00:50:53.807 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:53 smithi053 ceph-mon[27950]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:53.807 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:53 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/306397920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:50:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:53 smithi152 ceph-mon[33237]: pgmap v27: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 29 MiB/s rd, 43 MiB/s wr, 278 op/s 2024-09-16T00:50:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:53 smithi152 ceph-mon[33237]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:50:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:53 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/306397920' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:50:56.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 174 op/s 2024-09-16T00:50:56.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: Standby manager daemon smithi053.cjiiek restarted 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: Standby manager daemon smithi053.cjiiek started 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/crt"}]: dispatch 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/key"}]: dispatch 2024-09-16T00:50:56.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:55 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: pgmap v28: 65 pgs: 65 active+clean; 1.3 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 174 op/s 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:56.252 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: Standby manager daemon smithi053.cjiiek restarted 2024-09-16T00:50:56.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: Standby manager daemon smithi053.cjiiek started 2024-09-16T00:50:56.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/crt"}]: dispatch 2024-09-16T00:50:56.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:50:56.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi053.cjiiek/key"}]: dispatch 2024-09-16T00:50:56.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:55 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:50:58.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:57 smithi053 ceph-mon[27950]: pgmap v29: 65 pgs: 65 active+clean; 910 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 261 op/s 2024-09-16T00:50:58.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:57 smithi053 ceph-mon[27950]: mgrmap e26: smithi152.nlmwrx(active, since 52s), standbys: smithi053.cjiiek 2024-09-16T00:50:58.196 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:57 smithi152 ceph-mon[33237]: pgmap v29: 65 pgs: 65 active+clean; 910 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 261 op/s 2024-09-16T00:50:58.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:57 smithi152 ceph-mon[33237]: mgrmap e26: smithi152.nlmwrx(active, since 52s), standbys: smithi053.cjiiek 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: pgmap v30: 65 pgs: 65 active+clean; 910 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 176 op/s 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:50:59.908 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: osdmap e48: 6 total, 6 up, 6 in 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd='[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]': finished 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: mgrmap e27: smithi053.cjiiek(active, starting, since 0.00766488s) 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:50:59.909 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:50:59.910 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:50:59 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: pgmap v30: 65 pgs: 65 active+clean; 910 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 176 op/s 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:00.008 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 172.21.15.152:0/1836410229' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:00.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:00.009 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: osdmap e48: 6 total, 6 up, 6 in 2024-09-16T00:51:00.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24385 ' entity='mgr.smithi152.nlmwrx' cmd='[{"prefix": "mgr fail", "who": "smithi152.nlmwrx"}]': finished 2024-09-16T00:51:00.012 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: mgrmap e27: smithi053.cjiiek(active, starting, since 0.00766488s) 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:51:00.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:51:00.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:51:00.014 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:50:59 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:51:00.811 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:00 smithi152 ceph-mon[33237]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:51:00.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:00 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:00.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:00 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:00.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:00 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:51:00.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:00 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:51:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:00 smithi053 ceph-mon[27950]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:51:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:00 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:00 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:00 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:51:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:00 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:51:02.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:01 smithi152 ceph-mon[33237]: mgrmap e28: smithi053.cjiiek(active, since 1.29344s) 2024-09-16T00:51:02.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:01 smithi152 ceph-mon[33237]: pgmap v3: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:02.006 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:01 smithi152 ceph-mon[33237]: pgmap v4: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:02.051 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:01 smithi053 ceph-mon[27950]: mgrmap e28: smithi053.cjiiek(active, since 1.29344s) 2024-09-16T00:51:02.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:01 smithi053 ceph-mon[27950]: pgmap v3: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:02.052 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:01 smithi053 ceph-mon[27950]: pgmap v4: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:02.847 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:02 smithi152 ceph-mon[33237]: [16/Sep/2024:00:51:02] ENGINE Bus STARTING 2024-09-16T00:51:02.960 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T00:51:02.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T00:51:02.972 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:02 smithi053 ceph-mon[27950]: [16/Sep/2024:00:51:02] ENGINE Bus STARTING 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: [16/Sep/2024:00:51:02] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: [16/Sep/2024:00:51:02] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: [16/Sep/2024:00:51:02] ENGINE Bus STARTED 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: [16/Sep/2024:00:51:02] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-16T00:51:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: mgrmap e29: smithi053.cjiiek(active, since 3s) 2024-09-16T00:51:03.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:03.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:03.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:03 smithi152 ceph-mon[33237]: pgmap v5: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: [16/Sep/2024:00:51:02] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: [16/Sep/2024:00:51:02] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: [16/Sep/2024:00:51:02] ENGINE Bus STARTED 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: [16/Sep/2024:00:51:02] ENGINE Error in HTTPServer.serve 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Traceback (most recent call last): 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:51:04.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._run(expiration_interval) 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s = self.context.wrap_socket( 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: return self.sslsocket_class._create( 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self.do_handshake() 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:51:04.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._sslobj.do_handshake() 2024-09-16T00:51:04.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:51:04.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: mgrmap e29: smithi053.cjiiek(active, since 3s) 2024-09-16T00:51:04.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:04.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:04.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:03 smithi053 ceph-mon[27950]: pgmap v5: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:05.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:05.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:05.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:51:05.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:51:05.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:51:05.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:51:05.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:51:05.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: mgrmap e30: smithi053.cjiiek(active, since 5s), standbys: smithi152.nlmwrx 2024-09-16T00:51:05.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:05 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:05.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/763861537' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: mgrmap e30: smithi053.cjiiek(active, since 5s), standbys: smithi152.nlmwrx 2024-09-16T00:51:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:05 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:06.268 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:06 smithi053 ceph-mon[27950]: pgmap v6: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:06.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:06 smithi152 ceph-mon[33237]: pgmap v6: 65 pgs: 65 active+clean; 390 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:51:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:08 smithi053 ceph-mon[27950]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 145 op/s 2024-09-16T00:51:08.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:08 smithi152 ceph-mon[33237]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 145 op/s 2024-09-16T00:51:10.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:10 smithi053 ceph-mon[27950]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-09-16T00:51:10.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:10 smithi152 ceph-mon[33237]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-09-16T00:51:12.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:12 smithi152 ceph-mon[33237]: pgmap v9: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-16T00:51:12.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:12 smithi053 ceph-mon[27950]: pgmap v9: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-16T00:51:14.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:14 smithi053 ceph-mon[27950]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-09-16T00:51:14.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:14 smithi152 ceph-mon[33237]: pgmap v10: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:15 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:16.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:16.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:16.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:16.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: pgmap v11: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-09-16T00:51:16.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:16.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:15 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:18.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:18 smithi053 ceph-mon[27950]: pgmap v12: 65 pgs: 65 active+clean; 328 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 267 op/s 2024-09-16T00:51:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:18 smithi152 ceph-mon[33237]: pgmap v12: 65 pgs: 65 active+clean; 328 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 267 op/s 2024-09-16T00:51:20.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:20 smithi053 ceph-mon[27950]: pgmap v13: 65 pgs: 65 active+clean; 328 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-09-16T00:51:20.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:20 smithi152 ceph-mon[33237]: pgmap v13: 65 pgs: 65 active+clean; 328 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-09-16T00:51:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:22 smithi053 ceph-mon[27950]: pgmap v14: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 325 op/s 2024-09-16T00:51:22.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:22 smithi152 ceph-mon[33237]: pgmap v14: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 325 op/s 2024-09-16T00:51:23.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 -- 172.21.15.53:0/802749764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 msgr2=0x7f5fc40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 --2- 172.21.15.53:0/802749764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc40ff560 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009910 tx=0x7f5fb4009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 -- 172.21.15.53:0/802749764 shutdown_connections 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 --2- 172.21.15.53:0/802749764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 0x7f5fc4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 --2- 172.21.15.53:0/802749764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc40ff560 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 -- 172.21.15.53:0/802749764 >> 172.21.15.53:0/802749764 conn(0x7f5fc40fa7a0 msgr2=0x7f5fc40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.710+0000 7f5fc971b700 1 -- 172.21.15.53:0/802749764 shutdown_connections 2024-09-16T00:51:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.711+0000 7f5fc971b700 1 -- 172.21.15.53:0/802749764 wait complete. 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.711+0000 7f5fc971b700 1 Processor -- start 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc971b700 1 -- start start 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc971b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc971b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 0x7f5fc41017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc971b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4101d10 con 0x7f5fc40ff150 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc971b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4101e50 con 0x7f5fc41003f0 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49778/0 (socket says 172.21.15.53:49778) 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 -- 172.21.15.53:0/3870605030 learned_addr learned my addr 172.21.15.53:0/3870605030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc27fc700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 0x7f5fc41017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 -- 172.21.15.53:0/3870605030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 msgr2=0x7f5fc41017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 0x7f5fc41017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.712+0000 7f5fc2ffd700 1 -- 172.21.15.53:0/3870605030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40095f0 con 0x7f5fc40ff150 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fc2ffd700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40092e0 tx=0x7f5fb400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb401d070 con 0x7f5fc40ff150 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc41020d0 con 0x7f5fc40ff150 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc41025c0 con 0x7f5fc40ff150 2024-09-16T00:51:23.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fb4005dc0 con 0x7f5fc40ff150 2024-09-16T00:51:23.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.713+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb4017630 con 0x7f5fc40ff150 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.714+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0005320 con 0x7f5fc40ff150 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.715+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f5fb400faf0 con 0x7f5fc40ff150 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.716+0000 7f5fabfff700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 0x7f5fac0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.716+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5fb408f650 con 0x7f5fc40ff150 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.716+0000 7f5fc27fc700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 0x7f5fac0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.716+0000 7f5fc27fc700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 0x7f5fac0708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009c60 tx=0x7f5fb8009260 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:23.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:23.724+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5fb405c660 con 0x7f5fc40ff150 2024-09-16T00:51:24.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.003+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fb0000bf0 con 0x7f5fac06e440 2024-09-16T00:51:24.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.005+0000 7f5fabfff700 1 -- 172.21.15.53:0/3870605030 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5fb0000bf0 con 0x7f5fac06e440 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 msgr2=0x7f5fac0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 0x7f5fac0708f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009c60 tx=0x7f5fb8009260 comp rx=0 tx=0).stop 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 msgr2=0x7f5fc4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40092e0 tx=0x7f5fb400f690 comp rx=0 tx=0).stop 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 shutdown_connections 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5fac06e440 0x7f5fac0708f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fc40ff150 0x7f5fc4103180 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 --2- 172.21.15.53:0/3870605030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fc41003f0 0x7f5fc41017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 >> 172.21.15.53:0/3870605030 conn(0x7f5fc40fa7a0 msgr2=0x7f5fc4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 shutdown_connections 2024-09-16T00:51:24.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.008+0000 7f5fc971b700 1 -- 172.21.15.53:0/3870605030 wait complete. 2024-09-16T00:51:24.019 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:51:24.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 -- 172.21.15.53:0/3526540059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b81003d0 msgr2=0x7f19b8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 --2- 172.21.15.53:0/3526540059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b81003d0 0x7f19b8100840 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009910 tx=0x7f19a8009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:24.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 -- 172.21.15.53:0/3526540059 shutdown_connections 2024-09-16T00:51:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 --2- 172.21.15.53:0/3526540059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b81003d0 0x7f19b8100840 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 --2- 172.21.15.53:0/3526540059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b80ff130 0x7f19b80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 -- 172.21.15.53:0/3526540059 >> 172.21.15.53:0/3526540059 conn(0x7f19b80fa780 msgr2=0x7f19b80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 -- 172.21.15.53:0/3526540059 shutdown_connections 2024-09-16T00:51:24.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.153+0000 7f19c0436700 1 -- 172.21.15.53:0/3526540059 wait complete. 2024-09-16T00:51:24.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 Processor -- start 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 -- start start 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 0x7f19b8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8072910 con 0x7f19b80ff130 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.154+0000 7f19c0436700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81a1610 con 0x7f19b81003d0 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:56706/0 (socket says 172.21.15.53:56706) 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 -- 172.21.15.53:0/3107672170 learned_addr learned my addr 172.21.15.53:0/3107672170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19be1d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 0x7f19b8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 -- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 msgr2=0x7f19b8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 0x7f19b8071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 -- 172.21.15.53:0/3107672170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80095f0 con 0x7f19b81003d0 2024-09-16T00:51:24.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19be1d2700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 0x7f19b8071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19bd9d1700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19a800bd70 tx=0x7f19a800bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.155+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a801d070 con 0x7f19b81003d0 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.156+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19a8005dc0 con 0x7f19b81003d0 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.156+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b81a17b0 con 0x7f19b81003d0 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.156+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a8021410 con 0x7f19b81003d0 2024-09-16T00:51:24.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.156+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81a1c50 con 0x7f19b81003d0 2024-09-16T00:51:24.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.157+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8106ae0 con 0x7f19b81003d0 2024-09-16T00:51:24.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.158+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f19a800f7d0 con 0x7f19b81003d0 2024-09-16T00:51:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.158+0000 7f19af7fe700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 0x7f19a4072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.158+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f19a808f640 con 0x7f19b81003d0 2024-09-16T00:51:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.158+0000 7f19be1d2700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 0x7f19a4072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.159+0000 7f19be1d2700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 0x7f19a4072ae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005950 tx=0x7f19b400b410 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.163+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f19a805c5d0 con 0x7f19b81003d0 2024-09-16T00:51:24.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.522+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b81a22e0 con 0x7f19a4070630 2024-09-16T00:51:24.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.523+0000 7f19af7fe700 1 -- 172.21.15.53:0/3107672170 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f19b81a22e0 con 0x7f19a4070630 2024-09-16T00:51:24.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 msgr2=0x7f19a4072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 0x7f19a4072ae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005950 tx=0x7f19b400b410 comp rx=0 tx=0).stop 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 msgr2=0x7f19b80722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19a800bd70 tx=0x7f19a800bda0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 shutdown_connections 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f19a4070630 0x7f19a4072ae0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b80ff130 0x7f19b8071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 --2- 172.21.15.53:0/3107672170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19b81003d0 0x7f19b80722f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 >> 172.21.15.53:0/3107672170 conn(0x7f19b80fa780 msgr2=0x7f19b8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 shutdown_connections 2024-09-16T00:51:24.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.526+0000 7f19c0436700 1 -- 172.21.15.53:0/3107672170 wait complete. 2024-09-16T00:51:24.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 -- 172.21.15.53:0/632085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c0ff150 msgr2=0x7fbf4c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 --2- 172.21.15.53:0/632085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c0ff560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009910 tx=0x7fbf48009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 -- 172.21.15.53:0/632085775 shutdown_connections 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 --2- 172.21.15.53:0/632085775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 --2- 172.21.15.53:0/632085775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c0ff560 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.655+0000 7fbf53e44700 1 -- 172.21.15.53:0/632085775 >> 172.21.15.53:0/632085775 conn(0x7fbf4c0fa7a0 msgr2=0x7fbf4c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.656+0000 7fbf53e44700 1 -- 172.21.15.53:0/632085775 shutdown_connections 2024-09-16T00:51:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.656+0000 7fbf53e44700 1 -- 172.21.15.53:0/632085775 wait complete. 2024-09-16T00:51:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 Processor -- start 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 -- start start 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c1968c0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf53e44700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c196a00 con 0x7fbf4c0ff150 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49824/0 (socket says 172.21.15.53:49824) 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 -- 172.21.15.53:0/349098464 learned_addr learned my addr 172.21.15.53:0/349098464 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf51be0700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 -- 172.21.15.53:0/349098464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c0ff150 msgr2=0x7fbf4c195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.657+0000 7fbf513df700 1 -- 172.21.15.53:0/349098464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480095f0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf513df700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c930 tx=0x7fbf3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c007ad0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf3c00ce80 con 0x7fbf4c1003f0 2024-09-16T00:51:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c19b4c0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c018630 con 0x7fbf4c1003f0 2024-09-16T00:51:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.658+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c19b9e0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.659+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c04f2a0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.660+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fbf3c007c30 con 0x7fbf4c1003f0 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.660+0000 7fbf42ffd700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 0x7fbf380708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.660+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbf3c08e2d0 con 0x7fbf4c1003f0 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.660+0000 7fbf51be0700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 0x7fbf380708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.661+0000 7fbf51be0700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 0x7fbf380708f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800b5c0 tx=0x7fbf480052a0 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:24.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.666+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbf3c05b300 con 0x7fbf4c1003f0 2024-09-16T00:51:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:24 smithi053 ceph-mon[27950]: pgmap v15: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-09-16T00:51:24.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:24 smithi152 ceph-mon[33237]: pgmap v15: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-09-16T00:51:24.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.947+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf4c104e20 con 0x7fbf3806e440 2024-09-16T00:51:24.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.959+0000 7fbf42ffd700 1 -- 172.21.15.53:0/349098464 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbf4c104e20 con 0x7fbf3806e440 2024-09-16T00:51:24.960 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (7m) 10s ago 9m 25.8M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (9m) 10s ago 9m 7810k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (8m) 21s ago 8m 7440k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (9m) 10s ago 9m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (8m) 21s ago 8m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (7m) 10s ago 9m 86.2M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (3m) 10s ago 3m 233M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (3m) 10s ago 3m 157M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (3m) 21s ago 3m 15.0M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (3m) 21s ago 3m 13.6M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (36s) 10s ago 10m 473M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (105s) 21s ago 8m 130M - 19.1.1-326-g8921c8ef f1455bd0219c 9e697fb152d1 2024-09-16T00:51:24.961 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (10m) 10s ago 10m 52.5M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (8m) 21s ago 8m 42.8M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (9m) 10s ago 9m 15.6M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (8m) 21s ago 8m 16.2M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (7m) 10s ago 7m 212M 1217M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (7m) 10s ago 7m 223M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (6m) 10s ago 6m 179M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (6m) 21s ago 6m 228M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (5m) 21s ago 5m 223M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (5m) 21s ago 5m 207M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:51:24.962 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (42s) 10s ago 8m 49.4M - 2.43.0 a07b618ecd1d 4423e3758bae 2024-09-16T00:51:24.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 msgr2=0x7fbf380708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 0x7fbf380708f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800b5c0 tx=0x7fbf480052a0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 msgr2=0x7fbf4c196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:24.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c930 tx=0x7fbf3c00cc40 comp rx=0 tx=0).stop 2024-09-16T00:51:24.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 shutdown_connections 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fbf3806e440 0x7fbf380708f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf4c0ff150 0x7fbf4c195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 --2- 172.21.15.53:0/349098464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf4c1003f0 0x7fbf4c196330 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 >> 172.21.15.53:0/349098464 conn(0x7fbf4c0fa7a0 msgr2=0x7fbf4c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 shutdown_connections 2024-09-16T00:51:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:24.962+0000 7fbf53e44700 1 -- 172.21.15.53:0/349098464 wait complete. 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 -- 172.21.15.53:0/1662653572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 msgr2=0x7f4c00100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 --2- 172.21.15.53:0/1662653572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c00100f70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009910 tx=0x7f4bf0009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 -- 172.21.15.53:0/1662653572 shutdown_connections 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 --2- 172.21.15.53:0/1662653572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 0x7f4c00103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 --2- 172.21.15.53:0/1662653572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c00100f70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 -- 172.21.15.53:0/1662653572 >> 172.21.15.53:0/1662653572 conn(0x7f4c000fa780 msgr2=0x7f4c000fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 -- 172.21.15.53:0/1662653572 shutdown_connections 2024-09-16T00:51:25.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.110+0000 7f4c0672b700 1 -- 172.21.15.53:0/1662653572 wait complete. 2024-09-16T00:51:25.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 Processor -- start 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 -- start start 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 0x7f4c0019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0019cc10 con 0x7f4c000feb50 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4c0672b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0019cd50 con 0x7f4c001014b0 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4bfffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4bfffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49854/0 (socket says 172.21.15.53:49854) 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4bfffff700 1 -- 172.21.15.53:0/2462978399 learned_addr learned my addr 172.21.15.53:0/2462978399 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.111+0000 7f4bff7fe700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 0x7f4c0019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfffff700 1 -- 172.21.15.53:0/2462978399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 msgr2=0x7f4c0019c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfffff700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 0x7f4c0019c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfffff700 1 -- 172.21.15.53:0/2462978399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00095f0 con 0x7f4c000feb50 2024-09-16T00:51:25.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfffff700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000bda0 tx=0x7f4bf000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf001d070 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c001a17a0 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bf0022470 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf000f650 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.112+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c001a1c90 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.114+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c001961c0 con 0x7f4c000feb50 2024-09-16T00:51:25.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.114+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f4bf00225e0 con 0x7f4c000feb50 2024-09-16T00:51:25.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.114+0000 7f4bfd7fa700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 0x7f4be80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.115+0000 7f4bff7fe700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 0x7f4be80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.115+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4bf008f7f0 con 0x7f4c000feb50 2024-09-16T00:51:25.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.116+0000 7f4bff7fe700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 0x7f4be80708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005950 tx=0x7f4bf400a300 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.121+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f4bf005c950 con 0x7f4c000feb50 2024-09-16T00:51:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.697+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c0002cc30 con 0x7f4c000feb50 2024-09-16T00:51:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.698+0000 7f4bfd7fa700 1 -- 172.21.15.53:0/2462978399 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f4bf0027070 con 0x7f4c000feb50 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:25.699 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:51:25.700 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:51:25.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 msgr2=0x7f4be80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 0x7f4be80708f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005950 tx=0x7f4bf400a300 comp rx=0 tx=0).stop 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 msgr2=0x7f4c0019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000bda0 tx=0x7f4bf000bdd0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 shutdown_connections 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f4be806e440 0x7f4be80708f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c000feb50 0x7f4c0019c0b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 --2- 172.21.15.53:0/2462978399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c001014b0 0x7f4c0019c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.700+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 >> 172.21.15.53:0/2462978399 conn(0x7f4c000fa780 msgr2=0x7f4c000fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.701+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 shutdown_connections 2024-09-16T00:51:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.701+0000 7f4c0672b700 1 -- 172.21.15.53:0/2462978399 wait complete. 2024-09-16T00:51:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:25 smithi053 ceph-mon[27950]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:25.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:25 smithi053 ceph-mon[27950]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:25.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 -- 172.21.15.53:0/3836304547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 msgr2=0x7f141c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 --2- 172.21.15.53:0/3836304547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c101890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1408009910 tx=0x7f1408009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 -- 172.21.15.53:0/3836304547 shutdown_connections 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 --2- 172.21.15.53:0/3836304547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c101890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 --2- 172.21.15.53:0/3836304547 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 -- 172.21.15.53:0/3836304547 >> 172.21.15.53:0/3836304547 conn(0x7f141c0fb7f0 msgr2=0x7f141c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:25.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 -- 172.21.15.53:0/3836304547 shutdown_connections 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.832+0000 7f1422ed1700 1 -- 172.21.15.53:0/3836304547 wait complete. 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 Processor -- start 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 -- start start 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c196610 con 0x7f141c101440 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f1422ed1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c196750 con 0x7f141c100240 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f141bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f141bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49874/0 (socket says 172.21.15.53:49874) 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.833+0000 7f141bfff700 1 -- 172.21.15.53:0/4262687910 learned_addr learned my addr 172.21.15.53:0/4262687910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1420c6d700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f141bfff700 1 -- 172.21.15.53:0/4262687910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 msgr2=0x7f141c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f141bfff700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f141bfff700 1 -- 172.21.15.53:0/4262687910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080095f0 con 0x7f141c101440 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1420c6d700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:51:25.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f141bfff700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f140800bd70 tx=0x7f140800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140801d070 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1408022470 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c19b1a0 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f140800f670 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.834+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c19b690 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.835+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c108d90 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.836+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f1408022a50 con 0x7f141c101440 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.837+0000 7f1419ffb700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 0x7f140c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.837+0000 7f1420c6d700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 0x7f140c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:25.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.837+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f140808f900 con 0x7f141c101440 2024-09-16T00:51:25.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.837+0000 7f1420c6d700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 0x7f140c0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1410005fd0 tx=0x7f1410005f00 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:25.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:25.841+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f140805c940 con 0x7f141c101440 2024-09-16T00:51:25.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:25 smithi152 ceph-mon[33237]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:25.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:25 smithi152 ceph-mon[33237]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:26.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.167+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f141c108f80 con 0x7f141c101440 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.167+0000 7f1419ffb700 1 -- 172.21.15.53:0/4262687910 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f140805c4d0 con 0x7f141c101440 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:51:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:51:26.169 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:26.170 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:26.171 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:26.171 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:51:26.171 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:26.171 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:26.171 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 msgr2=0x7f140c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 0x7f140c0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1410005fd0 tx=0x7f1410005f00 comp rx=0 tx=0).stop 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 msgr2=0x7f141c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f140800bd70 tx=0x7f140800be50 comp rx=0 tx=0).stop 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 shutdown_connections 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f140c06e440 0x7f140c0708f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f141c100240 0x7f141c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 --2- 172.21.15.53:0/4262687910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f141c101440 0x7f141c195ff0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 >> 172.21.15.53:0/4262687910 conn(0x7f141c0fb7f0 msgr2=0x7f141c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 shutdown_connections 2024-09-16T00:51:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.170+0000 7f1422ed1700 1 -- 172.21.15.53:0/4262687910 wait complete. 2024-09-16T00:51:26.173 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.348+0000 7fca60e60700 1 -- 172.21.15.53:0/903493703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c0723e0 msgr2=0x7fca5c10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.348+0000 7fca60e60700 1 --2- 172.21.15.53:0/903493703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c0723e0 0x7fca5c10be10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca44009910 tx=0x7fca44009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 -- 172.21.15.53:0/903493703 shutdown_connections 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 --2- 172.21.15.53:0/903493703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c0723e0 0x7fca5c10be10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 --2- 172.21.15.53:0/903493703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c071a00 0x7fca5c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 -- 172.21.15.53:0/903493703 >> 172.21.15.53:0/903493703 conn(0x7fca5c06d110 msgr2=0x7fca5c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 -- 172.21.15.53:0/903493703 shutdown_connections 2024-09-16T00:51:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.349+0000 7fca60e60700 1 -- 172.21.15.53:0/903493703 wait complete. 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 Processor -- start 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 -- start start 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c071a00 0x7fca5c07a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c07b080 con 0x7fca5c0723e0 2024-09-16T00:51:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.350+0000 7fca60e60700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c07b1c0 con 0x7fca5c071a00 2024-09-16T00:51:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.351+0000 7fca59d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.352+0000 7fca59d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49888/0 (socket says 172.21.15.53:49888) 2024-09-16T00:51:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.352+0000 7fca59d9b700 1 -- 172.21.15.53:0/2100290879 learned_addr learned my addr 172.21.15.53:0/2100290879 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.352+0000 7fca5a59c700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c071a00 0x7fca5c07a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.353+0000 7fca59d9b700 1 -- 172.21.15.53:0/2100290879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c071a00 msgr2=0x7fca5c07a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.353+0000 7fca59d9b700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c071a00 0x7fca5c07a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.353+0000 7fca59d9b700 1 -- 172.21.15.53:0/2100290879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5401ac50 con 0x7fca5c0723e0 2024-09-16T00:51:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.354+0000 7fca59d9b700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca440092e0 tx=0x7fca4400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.354+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4401d070 con 0x7fca5c0723e0 2024-09-16T00:51:26.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.354+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440095f0 con 0x7fca5c0723e0 2024-09-16T00:51:26.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.354+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c07ff70 con 0x7fca5c0723e0 2024-09-16T00:51:26.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.355+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca44005dc0 con 0x7fca5c0723e0 2024-09-16T00:51:26.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.355+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca44017630 con 0x7fca5c0723e0 2024-09-16T00:51:26.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.356+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c005320 con 0x7fca5c0723e0 2024-09-16T00:51:26.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.357+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fca4400faf0 con 0x7fca5c0723e0 2024-09-16T00:51:26.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.358+0000 7fca537fe700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 0x7fca48070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.358+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fca4408f5f0 con 0x7fca5c0723e0 2024-09-16T00:51:26.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.358+0000 7fca5a59c700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 0x7fca48070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.359+0000 7fca5a59c700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 0x7fca48070930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca5401afd0 tx=0x7fca5401c040 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:26.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.367+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fca4405c600 con 0x7fca5c0723e0 2024-09-16T00:51:26.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.656+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca3c000bf0 con 0x7fca4806e480 2024-09-16T00:51:26.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.658+0000 7fca537fe700 1 -- 172.21.15.53:0/2100290879 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fca3c000bf0 con 0x7fca4806e480 2024-09-16T00:51:26.658 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:51:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:51:26.658 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr" 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "2/23 daemons upgraded", 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "", 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:51:26.659 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 msgr2=0x7fca48070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 0x7fca48070930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca5401afd0 tx=0x7fca5401c040 comp rx=0 tx=0).stop 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 msgr2=0x7fca5c07aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca440092e0 tx=0x7fca4400f690 comp rx=0 tx=0).stop 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 shutdown_connections 2024-09-16T00:51:26.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fca4806e480 0x7fca48070930 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca5c071a00 0x7fca5c07a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 --2- 172.21.15.53:0/2100290879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca5c0723e0 0x7fca5c07aa60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.661+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 >> 172.21.15.53:0/2100290879 conn(0x7fca5c06d110 msgr2=0x7fca5c10b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.662+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 shutdown_connections 2024-09-16T00:51:26.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.662+0000 7fca60e60700 1 -- 172.21.15.53:0/2100290879 wait complete. 2024-09-16T00:51:26.793 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:26 smithi053 ceph-mon[27950]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:26.793 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:26 smithi053 ceph-mon[27950]: pgmap v16: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-09-16T00:51:26.793 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:26 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2462978399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:26.793 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:26 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4262687910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 -- 172.21.15.53:0/3667318783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c94100340 msgr2=0x7f0c94100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 --2- 172.21.15.53:0/3667318783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c94100340 0x7f0c94100790 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009910 tx=0x7f0c88009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 -- 172.21.15.53:0/3667318783 shutdown_connections 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 --2- 172.21.15.53:0/3667318783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c94100340 0x7f0c94100790 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 --2- 172.21.15.53:0/3667318783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c940ff140 0x7f0c940ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 -- 172.21.15.53:0/3667318783 >> 172.21.15.53:0/3667318783 conn(0x7f0c940fa6d0 msgr2=0x7f0c940fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:26.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 -- 172.21.15.53:0/3667318783 shutdown_connections 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.796+0000 7f0c9881d700 1 -- 172.21.15.53:0/3667318783 wait complete. 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.797+0000 7f0c9881d700 1 Processor -- start 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.797+0000 7f0c9881d700 1 -- start start 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9881d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9881d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 0x7f0c940722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9881d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940728e0 con 0x7f0c940ff140 2024-09-16T00:51:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9881d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941a2760 con 0x7f0c94100340 2024-09-16T00:51:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49906/0 (socket says 172.21.15.53:49906) 2024-09-16T00:51:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9259c700 1 -- 172.21.15.53:0/2334272236 learned_addr learned my addr 172.21.15.53:0/2334272236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c91d9b700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 0x7f0c940722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c91d9b700 1 -- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 msgr2=0x7f0c94071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c91d9b700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c91d9b700 1 -- 172.21.15.53:0/2334272236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880095f0 con 0x7f0c94100340 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.798+0000 7f0c9259c700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c91d9b700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 0x7f0c940722c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c880098e0 tx=0x7f0c8800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c8801d070 con 0x7f0c94100340 2024-09-16T00:51:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c8800f460 con 0x7f0c94100340 2024-09-16T00:51:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c88021640 con 0x7f0c94100340 2024-09-16T00:51:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c941a2900 con 0x7f0c94100340 2024-09-16T00:51:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.799+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c941a2da0 con 0x7f0c94100340 2024-09-16T00:51:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.801+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94107c90 con 0x7f0c94100340 2024-09-16T00:51:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.801+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 30) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f0c8800fa60 con 0x7f0c94100340 2024-09-16T00:51:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.801+0000 7f0c837fe700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 0x7f0c7c070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.801+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0c8808f3f0 con 0x7f0c94100340 2024-09-16T00:51:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.801+0000 7f0c9259c700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 0x7f0c7c070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.802+0000 7f0c9259c700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 0x7f0c7c070930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c840105c0 tx=0x7f0c8400b4a0 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:26.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:26.806+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0c8805c440 con 0x7f0c94100340 2024-09-16T00:51:26.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:26 smithi152 ceph-mon[33237]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:26 smithi152 ceph-mon[33237]: pgmap v16: 65 pgs: 65 active+clean; 330 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-09-16T00:51:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:26 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2462978399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:26 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/4262687910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:51:27.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.150+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0c94107e50 con 0x7f0c94100340 2024-09-16T00:51:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.150+0000 7f0c837fe700 1 -- 172.21.15.53:0/2334272236 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0c8805bfd0 con 0x7f0c94100340 2024-09-16T00:51:27.151 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.153+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 msgr2=0x7f0c7c070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.153+0000 7f0c9881d700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 0x7f0c7c070930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c840105c0 tx=0x7f0c8400b4a0 comp rx=0 tx=0).stop 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.153+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 msgr2=0x7f0c940722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.153+0000 7f0c9881d700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 0x7f0c940722c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c880098e0 tx=0x7f0c8800bd70 comp rx=0 tx=0).stop 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 shutdown_connections 2024-09-16T00:51:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0c7c06e480 0x7f0c7c070930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c940ff140 0x7f0c94071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 --2- 172.21.15.53:0/2334272236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c94100340 0x7f0c940722c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 >> 172.21.15.53:0/2334272236 conn(0x7f0c940fa6d0 msgr2=0x7f0c94103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 shutdown_connections 2024-09-16T00:51:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:27.154+0000 7f0c9881d700 1 -- 172.21.15.53:0/2334272236 wait complete. 2024-09-16T00:51:27.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:27 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2334272236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:51:27.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:27 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2334272236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: pgmap v17: 65 pgs: 65 active+clean; 326 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 597 op/s 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:51:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:51:28.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:28 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:51:28.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: pgmap v17: 65 pgs: 65 active+clean; 326 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 597 op/s 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:51:28.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:28 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:51:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: pgmap v18: 65 pgs: 65 active+clean; 326 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 527 op/s 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:51:30.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:30 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: pgmap v18: 65 pgs: 65 active+clean; 326 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 527 op/s 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: Reconfiguring prometheus.smithi053 (dependencies changed)... 2024-09-16T00:51:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:30 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:31.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:31 smithi152 ceph-mon[33237]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:51:31.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:31 smithi053 ceph-mon[27950]: Reconfiguring daemon prometheus.smithi053 on smithi053 2024-09-16T00:51:32.719 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:32 smithi053 ceph-mon[27950]: pgmap v19: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 764 op/s 2024-09-16T00:51:32.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:32 smithi152 ceph-mon[33237]: pgmap v19: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 764 op/s 2024-09-16T00:51:34.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:34 smithi053 ceph-mon[27950]: pgmap v20: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 624 op/s 2024-09-16T00:51:34.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:34 smithi152 ceph-mon[33237]: pgmap v20: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 624 op/s 2024-09-16T00:51:36.792 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:36 smithi053 ceph-mon[27950]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 624 op/s 2024-09-16T00:51:36.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:36 smithi152 ceph-mon[33237]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 624 op/s 2024-09-16T00:51:38.782 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:38 smithi053 ceph-mon[27950]: pgmap v22: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.02k op/s 2024-09-16T00:51:38.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:38 smithi152 ceph-mon[33237]: pgmap v22: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.02k op/s 2024-09-16T00:51:40.655 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:40 smithi053 ceph-mon[27950]: pgmap v23: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 637 op/s 2024-09-16T00:51:40.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:40 smithi152 ceph-mon[33237]: pgmap v23: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 637 op/s 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:41.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:41 smithi152 ceph-mon[33237]: pgmap v24: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.09k op/s 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:42.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:41 smithi053 ceph-mon[27950]: pgmap v24: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.09k op/s 2024-09-16T00:51:43.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:42 smithi152 ceph-mon[33237]: Upgrade: Updating mgr.smithi152.nlmwrx 2024-09-16T00:51:43.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:42 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:51:43.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:42 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:51:43.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:42 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:43.031 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:42 smithi152 ceph-mon[33237]: Deploying daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:51:43.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:42 smithi053 ceph-mon[27950]: Upgrade: Updating mgr.smithi152.nlmwrx 2024-09-16T00:51:43.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:42 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:51:43.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:42 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:51:43.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:42 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:43.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:42 smithi053 ceph-mon[27950]: Deploying daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:51:44.091 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:43 smithi152 ceph-mon[33237]: pgmap v25: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-09-16T00:51:44.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:43 smithi053 ceph-mon[27950]: pgmap v25: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-09-16T00:51:45.309 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:45 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:45.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:45 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:51:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:46 smithi053 ceph-mon[27950]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-09-16T00:51:46.347 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:46 smithi152 ceph-mon[33237]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 854 op/s 2024-09-16T00:51:47.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:47 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:47 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:47 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:47.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:47 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:47 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:47 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:47 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:47 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:47.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:47 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:47.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:47 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:48.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:48 smithi152 ceph-mon[33237]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 1.27k op/s 2024-09-16T00:51:48.818 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:48 smithi053 ceph-mon[27950]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 1.27k op/s 2024-09-16T00:51:49.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:49 smithi053 ceph-mon[27950]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 867 op/s 2024-09-16T00:51:49.836 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:49 smithi152 ceph-mon[33237]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 867 op/s 2024-09-16T00:51:50.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:50 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:50.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:50 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:50.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:50 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:50.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:50 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:51.033 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:50 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:51.033 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:50 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:51.033 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:50 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:51.033 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:50 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.28k op/s 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:51:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:52 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.28k op/s 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:51:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:51:52.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:52 smithi053 ceph-mon[27950]: from='mgr.? 172.21.15.152:0/1904733377' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:51:53.746 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:53 smithi053 ceph-mon[27950]: mgrmap e31: smithi053.cjiiek(active, since 53s), standbys: smithi152.nlmwrx 2024-09-16T00:51:53.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:53 smithi152 ceph-mon[33237]: mgrmap e31: smithi053.cjiiek(active, since 53s), standbys: smithi152.nlmwrx 2024-09-16T00:51:54.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:54 smithi053 ceph-mon[27950]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 822 op/s 2024-09-16T00:51:54.724 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:54 smithi152 ceph-mon[33237]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 822 op/s 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 822 op/s 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: Upgrade: Setting container_image for all mgr 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi053.cjiiek"}]: dispatch 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi053.cjiiek"}]': finished 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.nlmwrx"}]': finished 2024-09-16T00:51:56.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:56 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T00:51:56.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 822 op/s 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: Upgrade: Setting container_image for all mgr 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi053.cjiiek"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi053.cjiiek"}]': finished 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.nlmwrx"}]: dispatch 2024-09-16T00:51:56.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.nlmwrx"}]': finished 2024-09-16T00:51:56.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:56 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 -- 172.21.15.53:0/2831476235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 msgr2=0x7f6698102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 --2- 172.21.15.53:0/2831476235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698102860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f669000b0a0 tx=0x7f669000b3b0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 -- 172.21.15.53:0/2831476235 shutdown_connections 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 --2- 172.21.15.53:0/2831476235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 0x7f6698103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 --2- 172.21.15.53:0/2831476235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698102860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 -- 172.21.15.53:0/2831476235 >> 172.21.15.53:0/2831476235 conn(0x7f66980fdac0 msgr2=0x7f66980ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:57.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 -- 172.21.15.53:0/2831476235 shutdown_connections 2024-09-16T00:51:57.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.293+0000 7f669fae8700 1 -- 172.21.15.53:0/2831476235 wait complete. 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 Processor -- start 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 -- start start 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 0x7f6698198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698198850 con 0x7f6698102450 2024-09-16T00:51:57.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.294+0000 7f669fae8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669819d260 con 0x7f66981036f0 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d083700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 0x7f6698198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43084/0 (socket says 172.21.15.53:43084) 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 -- 172.21.15.53:0/3367122620 learned_addr learned my addr 172.21.15.53:0/3367122620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 -- 172.21.15.53:0/3367122620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 msgr2=0x7f6698198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 0x7f6698198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 -- 172.21.15.53:0/3367122620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690009d00 con 0x7f6698102450 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f669d884700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f669000d010 tx=0x7f6690009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.295+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669000e040 con 0x7f6698102450 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.296+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6690003de0 con 0x7f6698102450 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.296+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669819d400 con 0x7f6698102450 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.296+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669001d840 con 0x7f6698102450 2024-09-16T00:51:57.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.296+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669819d8c0 con 0x7f6698102450 2024-09-16T00:51:57.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.297+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669810af30 con 0x7f6698102450 2024-09-16T00:51:57.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.298+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f6690004810 con 0x7f6698102450 2024-09-16T00:51:57.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.299+0000 7f668effd700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 0x7f6684070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.299+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f669008fca0 con 0x7f6698102450 2024-09-16T00:51:57.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.299+0000 7f669d083700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 0x7f6684070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.300+0000 7f669d083700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 0x7f6684070940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6688009c60 tx=0x7f6688009260 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:57.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.306+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6690059100 con 0x7f6698102450 2024-09-16T00:51:57.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.664+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6698108040 con 0x7f668406e490 2024-09-16T00:51:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.665+0000 7f668effd700 1 -- 172.21.15.53:0/3367122620 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6698108040 con 0x7f668406e490 2024-09-16T00:51:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 msgr2=0x7f6684070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 0x7f6684070940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6688009c60 tx=0x7f6688009260 comp rx=0 tx=0).stop 2024-09-16T00:51:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 msgr2=0x7f6698197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f669000d010 tx=0x7f6690009750 comp rx=0 tx=0).stop 2024-09-16T00:51:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 shutdown_connections 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f668406e490 0x7f6684070940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6698102450 0x7f6698197cf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 --2- 172.21.15.53:0/3367122620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66981036f0 0x7f6698198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.667+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 >> 172.21.15.53:0/3367122620 conn(0x7f66980fdac0 msgr2=0x7f6698106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.668+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 shutdown_connections 2024-09-16T00:51:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.668+0000 7f669fae8700 1 -- 172.21.15.53:0/3367122620 wait complete. 2024-09-16T00:51:57.684 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:51:57.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 -- 172.21.15.53:0/273397378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf80ff130 msgr2=0x7f0bf80ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 --2- 172.21.15.53:0/273397378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf80ff130 0x7f0bf80ff540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009910 tx=0x7f0bec009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:57.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 -- 172.21.15.53:0/273397378 shutdown_connections 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 --2- 172.21.15.53:0/273397378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf81003d0 0x7f0bf8100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 --2- 172.21.15.53:0/273397378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf80ff130 0x7f0bf80ff540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 -- 172.21.15.53:0/273397378 >> 172.21.15.53:0/273397378 conn(0x7f0bf80fa780 msgr2=0x7f0bf80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 -- 172.21.15.53:0/273397378 shutdown_connections 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.797+0000 7f0bfec13700 1 -- 172.21.15.53:0/273397378 wait complete. 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 Processor -- start 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 -- start start 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 0x7f0bf8103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8101cf0 con 0x7f0bf81003d0 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.798+0000 7f0bfec13700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8101e30 con 0x7f0bf80ff130 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43110/0 (socket says 172.21.15.53:43110) 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 -- 172.21.15.53:0/146239567 learned_addr learned my addr 172.21.15.53:0/146239567 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:57.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bfc9af700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 0x7f0bf8103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 -- 172.21.15.53:0/146239567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 msgr2=0x7f0bf8103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 0x7f0bf8103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 -- 172.21.15.53:0/146239567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0095f0 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bfc9af700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 0x7f0bf8103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf7fff700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c930 tx=0x7f0be400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.799+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4007ad0 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.800+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0be400ce80 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.800+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf8102110 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.800+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4018630 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.800+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf819db00 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.801+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8107c10 con 0x7f0bf81003d0 2024-09-16T00:51:57.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.801+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f0be4007c30 con 0x7f0bf81003d0 2024-09-16T00:51:57.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.802+0000 7f0bf5ffb700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 0x7f0be80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:57.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.802+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0be408e270 con 0x7f0bf81003d0 2024-09-16T00:51:57.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.802+0000 7f0bfc9af700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 0x7f0be80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:57.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.803+0000 7f0bfc9af700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 0x7f0be80708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b5c0 tx=0x7f0bec005690 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:57.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:57.808+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0be405b2a0 con 0x7f0bf81003d0 2024-09-16T00:51:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.102+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bf8068c50 con 0x7f0be806e440 2024-09-16T00:51:58.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.103+0000 7f0bf5ffb700 1 -- 172.21.15.53:0/146239567 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0bf8068c50 con 0x7f0be806e440 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 msgr2=0x7f0be80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 0x7f0be80708f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b5c0 tx=0x7f0bec005690 comp rx=0 tx=0).stop 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 msgr2=0x7f0bf81017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c930 tx=0x7f0be400cc40 comp rx=0 tx=0).stop 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 shutdown_connections 2024-09-16T00:51:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f0be806e440 0x7f0be80708f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bf80ff130 0x7f0bf8103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 --2- 172.21.15.53:0/146239567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bf81003d0 0x7f0bf81017b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 >> 172.21.15.53:0/146239567 conn(0x7f0bf80fa780 msgr2=0x7f0bf8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:58.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 shutdown_connections 2024-09-16T00:51:58.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.107+0000 7f0bfec13700 1 -- 172.21.15.53:0/146239567 wait complete. 2024-09-16T00:51:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 -- 172.21.15.53:0/1466019581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 msgr2=0x7fa3441007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 --2- 172.21.15.53:0/1466019581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa3441007a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa334009910 tx=0x7fa334009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 -- 172.21.15.53:0/1466019581 shutdown_connections 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 --2- 172.21.15.53:0/1466019581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa3441007a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 --2- 172.21.15.53:0/1466019581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 0x7fa3440ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 -- 172.21.15.53:0/1466019581 >> 172.21.15.53:0/1466019581 conn(0x7fa3440fa700 msgr2=0x7fa3440fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 -- 172.21.15.53:0/1466019581 shutdown_connections 2024-09-16T00:51:58.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.243+0000 7fa34c36d700 1 -- 172.21.15.53:0/1466019581 wait complete. 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.244+0000 7fa34c36d700 1 Processor -- start 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.244+0000 7fa34c36d700 1 -- start start 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa34c36d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 0x7fa344069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa34c36d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa34c36d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34419adb0 con 0x7fa344100350 2024-09-16T00:51:58.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa34c36d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34419af20 con 0x7fa3440ff150 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43130/0 (socket says 172.21.15.53:43130) 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 -- 172.21.15.53:0/573932411 learned_addr learned my addr 172.21.15.53:0/573932411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa34a109700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 0x7fa344069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 -- 172.21.15.53:0/573932411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 msgr2=0x7fa344069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 0x7fa344069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 -- 172.21.15.53:0/573932411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340095f0 con 0x7fa344100350 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.245+0000 7fa349908700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bd70 tx=0x7fa33400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.246+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33401d070 con 0x7fa344100350 2024-09-16T00:51:58.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.246+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa334005dc0 con 0x7fa344100350 2024-09-16T00:51:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.246+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34419b1a0 con 0x7fa344100350 2024-09-16T00:51:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.246+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa334021410 con 0x7fa344100350 2024-09-16T00:51:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.246+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34419b690 con 0x7fa344100350 2024-09-16T00:51:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.247+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa344107ca0 con 0x7fa344100350 2024-09-16T00:51:58.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.248+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fa33400f7d0 con 0x7fa344100350 2024-09-16T00:51:58.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.249+0000 7fa33b7fe700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 0x7fa3300708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.249+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa33408f530 con 0x7fa344100350 2024-09-16T00:51:58.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.249+0000 7fa34a109700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 0x7fa3300708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.250+0000 7fa34a109700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 0x7fa3300708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3441001b0 tx=0x7fa34000b410 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:58.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.257+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa33405c560 con 0x7fa344100350 2024-09-16T00:51:58.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.538+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa34419bde0 con 0x7fa33006e440 2024-09-16T00:51:58.539 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: Upgrade: Updating mon.smithi053 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: Deploying daemon mon.smithi053 on smithi053 2024-09-16T00:51:58.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:58 smithi053 ceph-mon[27950]: pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 971 op/s 2024-09-16T00:51:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.553+0000 7fa33b7fe700 1 -- 172.21.15.53:0/573932411 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa34419bde0 con 0x7fa33006e440 2024-09-16T00:51:58.554 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (8m) 3s ago 9m 25.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (10m) 3s ago 10m 7868k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (9m) 8s ago 9m 7503k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (10m) 3s ago 10m 6656k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (9m) 8s ago 9m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (8m) 3s ago 9m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (4m) 3s ago 4m 260M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (4m) 3s ago 4m 141M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (4m) 8s ago 4m 15.4M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (4m) 8s ago 4m 14.0M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (70s) 3s ago 11m 491M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (12s) 8s ago 8m 69.5M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:51:58.555 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (11m) 3s ago 11m 53.3M 2048M 18.2.0 dc2bc1663786 c52dff4d835c 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (8m) 8s ago 8m 42.4M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (10m) 3s ago 9m 15.8M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (9m) 8s ago 9m 15.8M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (8m) 3s ago 8m 241M 1217M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (7m) 3s ago 7m 253M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (7m) 3s ago 7m 204M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (6m) 8s ago 6m 265M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (6m) 8s ago 6m 256M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (5m) 8s ago 5m 228M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:51:58.556 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (18s) 3s ago 9m 49.8M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:51:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 msgr2=0x7fa3300708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 0x7fa3300708f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3441001b0 tx=0x7fa34000b410 comp rx=0 tx=0).stop 2024-09-16T00:51:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 msgr2=0x7fa34419a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bd70 tx=0x7fa33400bda0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 shutdown_connections 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fa33006e440 0x7fa3300708f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3440ff150 0x7fa344069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 --2- 172.21.15.53:0/573932411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa344100350 0x7fa34419a7e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.556+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 >> 172.21.15.53:0/573932411 conn(0x7fa3440fa700 msgr2=0x7fa344103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.557+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 shutdown_connections 2024-09-16T00:51:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.557+0000 7fa34c36d700 1 -- 172.21.15.53:0/573932411 wait complete. 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: Upgrade: Updating mon.smithi053 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: Deploying daemon mon.smithi053 on smithi053 2024-09-16T00:51:58.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:58 smithi152 ceph-mon[33237]: pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 971 op/s 2024-09-16T00:51:58.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.727+0000 7fefa2630700 1 -- 172.21.15.53:0/1627219668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 msgr2=0x7fef9c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.727+0000 7fefa2630700 1 --2- 172.21.15.53:0/1627219668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c109d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00ba80 tx=0x7fef8c00bd90 comp rx=0 tx=0).stop 2024-09-16T00:51:58.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.729+0000 7fefa2630700 1 -- 172.21.15.53:0/1627219668 shutdown_connections 2024-09-16T00:51:58.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.729+0000 7fefa2630700 1 --2- 172.21.15.53:0/1627219668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c10c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.729+0000 7fefa2630700 1 --2- 172.21.15.53:0/1627219668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c109d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.729+0000 7fefa2630700 1 -- 172.21.15.53:0/1627219668 >> 172.21.15.53:0/1627219668 conn(0x7fef9c06d110 msgr2=0x7fef9c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:58.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.731+0000 7fefa2630700 1 -- 172.21.15.53:0/1627219668 shutdown_connections 2024-09-16T00:51:58.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.731+0000 7fefa2630700 1 -- 172.21.15.53:0/1627219668 wait complete. 2024-09-16T00:51:58.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.732+0000 7fefa2630700 1 Processor -- start 2024-09-16T00:51:58.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.732+0000 7fefa2630700 1 -- start start 2024-09-16T00:51:58.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.733+0000 7fefa2630700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.733+0000 7fefa2630700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.733+0000 7fefa2630700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c19cc80 con 0x7fef9c10a2a0 2024-09-16T00:51:58.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.733+0000 7fefa2630700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c19cdc0 con 0x7fef9c072ab0 2024-09-16T00:51:58.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.736+0000 7fef9b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.736+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.736+0000 7fef9b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43156/0 (socket says 172.21.15.53:43156) 2024-09-16T00:51:58.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.736+0000 7fef9b7fe700 1 -- 172.21.15.53:0/2807356773 learned_addr learned my addr 172.21.15.53:0/2807356773 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:58.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.737+0000 7fef9bfff700 1 -- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 msgr2=0x7fef9c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:58.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.737+0000 7fef9bfff700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:58.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.737+0000 7fef9bfff700 1 -- 172.21.15.53:0/2807356773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c00b730 con 0x7fef9c072ab0 2024-09-16T00:51:58.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.740+0000 7fef9bfff700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c19c120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef8c000c00 tx=0x7fef8c015a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:58.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.742+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c010070 con 0x7fef9c072ab0 2024-09-16T00:51:58.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.742+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef8c00de40 con 0x7fef9c072ab0 2024-09-16T00:51:58.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.742+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef8c01d770 con 0x7fef9c072ab0 2024-09-16T00:51:58.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.743+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c1a1810 con 0x7fef9c072ab0 2024-09-16T00:51:58.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.743+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c1a1c40 con 0x7fef9c072ab0 2024-09-16T00:51:58.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.745+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c1962c0 con 0x7fef9c072ab0 2024-09-16T00:51:58.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.746+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7fef8c01d8d0 con 0x7fef9c072ab0 2024-09-16T00:51:58.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.747+0000 7fef997fa700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 0x7fef88074e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:58.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.747+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fef8c08f9e0 con 0x7fef9c072ab0 2024-09-16T00:51:58.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.747+0000 7fef9b7fe700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 0x7fef88074e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:58.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.750+0000 7fef9b7fe700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 0x7fef88074e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fef84005b40 tx=0x7fef84005a90 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:58.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:58.754+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fef8c05ca70 con 0x7fef9c072ab0 2024-09-16T00:51:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.137+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef9c02ce50 con 0x7fef9c072ab0 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.138+0000 7fef997fa700 1 -- 172.21.15.53:0/2807356773 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fef8c05c600 con 0x7fef9c072ab0 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:51:59.139 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:51:59.140 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 msgr2=0x7fef88074e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 0x7fef88074e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fef84005b40 tx=0x7fef84005a90 comp rx=0 tx=0).stop 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 msgr2=0x7fef9c19c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c19c120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef8c000c00 tx=0x7fef8c015a90 comp rx=0 tx=0).stop 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 shutdown_connections 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7fef880729a0 0x7fef88074e50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef9c072ab0 0x7fef9c19c120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 --2- 172.21.15.53:0/2807356773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef9c10a2a0 0x7fef9c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 >> 172.21.15.53:0/2807356773 conn(0x7fef9c06d110 msgr2=0x7fef9c10bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 shutdown_connections 2024-09-16T00:51:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.141+0000 7fefa2630700 1 -- 172.21.15.53:0/2807356773 wait complete. 2024-09-16T00:51:59.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/3897537432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40feb30 msgr2=0x7f7ec40fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/3897537432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40feb30 0x7f7ec40fef40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009910 tx=0x7f7eb4009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:59.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/3897537432 shutdown_connections 2024-09-16T00:51:59.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/3897537432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40ff480 0x7f7ec40ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/3897537432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40feb30 0x7f7ec40fef40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/3897537432 >> 172.21.15.53:0/3897537432 conn(0x7f7ec40fa700 msgr2=0x7f7ec40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:59.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/3897537432 shutdown_connections 2024-09-16T00:51:59.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.286+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/3897537432 wait complete. 2024-09-16T00:51:59.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.287+0000 7f7ec8f8b700 1 Processor -- start 2024-09-16T00:51:59.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.287+0000 7f7ec8f8b700 1 -- start start 2024-09-16T00:51:59.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec8f8b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 0x7f7ec4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec8f8b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec8f8b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41987e0 con 0x7f7ec40ff480 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec8f8b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4198950 con 0x7f7ec40feb30 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43166/0 (socket says 172.21.15.53:43166) 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 -- 172.21.15.53:0/1348168103 learned_addr learned my addr 172.21.15.53:0/1348168103 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec259c700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 0x7f7ec4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 -- 172.21.15.53:0/1348168103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 msgr2=0x7f7ec4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 0x7f7ec4197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 -- 172.21.15.53:0/1348168103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40095f0 con 0x7f7ec40ff480 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec259c700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 0x7f7ec4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7ec1d9b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800e920 tx=0x7f7eb800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.288+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb8009790 con 0x7f7ec40ff480 2024-09-16T00:51:59.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.289+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec419d3e0 con 0x7f7ec40ff480 2024-09-16T00:51:59.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.289+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7eb800cba0 con 0x7f7ec40ff480 2024-09-16T00:51:59.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.289+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb8018630 con 0x7f7ec40ff480 2024-09-16T00:51:59.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.289+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec419d8e0 con 0x7f7ec40ff480 2024-09-16T00:51:59.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.290+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec410af80 con 0x7f7ec40ff480 2024-09-16T00:51:59.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.291+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f7eb800cd10 con 0x7f7ec40ff480 2024-09-16T00:51:59.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.291+0000 7f7eb37fe700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 0x7f7eac070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.291+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7eb8014070 con 0x7f7ec40ff480 2024-09-16T00:51:59.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.291+0000 7f7ec259c700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 0x7f7eac070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.292+0000 7f7ec259c700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 0x7f7eac070940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40059d0 tx=0x7f7eb4005960 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:59.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.299+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7eb80539d0 con 0x7f7ec40ff480 2024-09-16T00:51:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:59 smithi053 ceph-mon[27950]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:59 smithi053 ceph-mon[27950]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:51:59 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/2807356773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:59.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.648+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7ec410b170 con 0x7f7ec40ff480 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.649+0000 7f7eb37fe700 1 -- 172.21.15.53:0/1348168103 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f7eb805b660 con 0x7f7ec40ff480 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:51:59.650 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:51:59.651 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:59.652 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:59.653 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 msgr2=0x7f7eac070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 0x7f7eac070940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40059d0 tx=0x7f7eb4005960 comp rx=0 tx=0).stop 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 msgr2=0x7f7ec41981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800e920 tx=0x7f7eb800ece0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 shutdown_connections 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f7eac06e490 0x7f7eac070940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec40feb30 0x7f7ec4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 --2- 172.21.15.53:0/1348168103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ec40ff480 0x7f7ec41981e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 >> 172.21.15.53:0/1348168103 conn(0x7f7ec40fa700 msgr2=0x7f7ec4107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.651+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 shutdown_connections 2024-09-16T00:51:59.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.652+0000 7f7ec8f8b700 1 -- 172.21.15.53:0/1348168103 wait complete. 2024-09-16T00:51:59.655 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:51:59.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:59 smithi152 ceph-mon[33237]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:59 smithi152 ceph-mon[33237]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:51:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:51:59 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/2807356773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:51:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 -- 172.21.15.53:0/3363836089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c107e50 msgr2=0x7f791c1082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 --2- 172.21.15.53:0/3363836089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c107e50 0x7f791c1082a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c009c20 comp rx=0 tx=0).stop 2024-09-16T00:51:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 -- 172.21.15.53:0/3363836089 shutdown_connections 2024-09-16T00:51:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 --2- 172.21.15.53:0/3363836089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c107e50 0x7f791c1082a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 --2- 172.21.15.53:0/3363836089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c071eb0 0x7f791c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.816+0000 7f79228da700 1 -- 172.21.15.53:0/3363836089 >> 172.21.15.53:0/3363836089 conn(0x7f791c06d440 msgr2=0x7f791c06f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:51:59.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.818+0000 7f79228da700 1 -- 172.21.15.53:0/3363836089 shutdown_connections 2024-09-16T00:51:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.818+0000 7f79228da700 1 -- 172.21.15.53:0/3363836089 wait complete. 2024-09-16T00:51:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 Processor -- start 2024-09-16T00:51:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 -- start start 2024-09-16T00:51:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 0x7f791c1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 0x7f791c1a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c1a53b0 con 0x7f791c071eb0 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.819+0000 7f79228da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c1a54f0 con 0x7f791c107e50 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.820+0000 7f791bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 0x7f791c1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.820+0000 7f791bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 0x7f791c1a4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43190/0 (socket says 172.21.15.53:43190) 2024-09-16T00:51:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.820+0000 7f791bfff700 1 -- 172.21.15.53:0/3759041945 learned_addr learned my addr 172.21.15.53:0/3759041945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:51:59.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.820+0000 7f791b7fe700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 0x7f791c1a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.821+0000 7f791b7fe700 1 -- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 msgr2=0x7f791c1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:51:59.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.821+0000 7f791b7fe700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 0x7f791c1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:51:59.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.821+0000 7f791b7fe700 1 -- 172.21.15.53:0/3759041945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0095f0 con 0x7f791c107e50 2024-09-16T00:51:59.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.822+0000 7f791b7fe700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 0x7f791c1a4d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f790c009fd0 tx=0x7f790c004fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.823+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c01d070 con 0x7f791c107e50 2024-09-16T00:51:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.823+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f790c022470 con 0x7f791c107e50 2024-09-16T00:51:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.823+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c004a00 con 0x7f791c107e50 2024-09-16T00:51:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.823+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c1a9f40 con 0x7f791c107e50 2024-09-16T00:51:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.823+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c1aa400 con 0x7f791c107e50 2024-09-16T00:51:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.827+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7908005320 con 0x7f791c107e50 2024-09-16T00:51:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.827+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f790c00f670 con 0x7f791c107e50 2024-09-16T00:51:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.828+0000 7f79197fa700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 0x7f79040709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:51:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.828+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f790c0906f0 con 0x7f791c107e50 2024-09-16T00:51:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.829+0000 7f791bfff700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 0x7f79040709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:51:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.830+0000 7f791bfff700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 0x7f79040709f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f791000bd70 tx=0x7f791000b4a0 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:51:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:51:59.835+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f790c05d7b0 con 0x7f791c107e50 2024-09-16T00:52:00.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.185+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 --> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7908000bf0 con 0x7f790406e540 2024-09-16T00:52:00.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.188+0000 7f79197fa700 1 -- 172.21.15.53:0/3759041945 <== mgr.24463 v2:172.21.15.53:6800/3494092676 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7908000bf0 con 0x7f790406e540 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr" 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "2/23 daemons upgraded", 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mon daemons", 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:52:00.189 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.192+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 msgr2=0x7f79040709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.192+0000 7f79228da700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 0x7f79040709f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f791000bd70 tx=0x7f791000b4a0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 msgr2=0x7f791c1a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 0x7f791c1a4d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f790c009fd0 tx=0x7f790c004fa0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 shutdown_connections 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f790406e540 0x7f79040709f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f791c071eb0 0x7f791c1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 --2- 172.21.15.53:0/3759041945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f791c107e50 0x7f791c1a4d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 >> 172.21.15.53:0/3759041945 conn(0x7f791c06d440 msgr2=0x7f791c10b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.193+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 shutdown_connections 2024-09-16T00:52:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.194+0000 7f79228da700 1 -- 172.21.15.53:0/3759041945 wait complete. 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 -- 172.21.15.53:0/463680798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10101450 msgr2=0x7f5b101018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 --2- 172.21.15.53:0/463680798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10101450 0x7f5b101018a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009910 tx=0x7f5b04009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 -- 172.21.15.53:0/463680798 shutdown_connections 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 --2- 172.21.15.53:0/463680798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10101450 0x7f5b101018a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 --2- 172.21.15.53:0/463680798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10100250 0x7f5b10100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.361+0000 7f5b1852d700 1 -- 172.21.15.53:0/463680798 >> 172.21.15.53:0/463680798 conn(0x7f5b100fb7e0 msgr2=0x7f5b100fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 -- 172.21.15.53:0/463680798 shutdown_connections 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 -- 172.21.15.53:0/463680798 wait complete. 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 Processor -- start 2024-09-16T00:52:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 -- start start 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.362+0000 7f5b1852d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10101450 0x7f5b10073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b1852d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10073680 con 0x7f5b10100250 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b1852d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100737c0 con 0x7f5b10101450 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43200/0 (socket says 172.21.15.53:43200) 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 -- 172.21.15.53:0/4178081771 learned_addr learned my addr 172.21.15.53:0/4178081771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b15ac8700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10101450 0x7f5b10073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 -- 172.21.15.53:0/4178081771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10101450 msgr2=0x7f5b10073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10101450 0x7f5b10073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 -- 172.21.15.53:0/4178081771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040095f0 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b162c9700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00e8f0 tx=0x7f5b0c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c009790 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b0c00c810 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.363+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10073aa0 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.364+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c003d20 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.364+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1019db00 con 0x7f5b10100250 2024-09-16T00:52:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.364+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10108da0 con 0x7f5b10100250 2024-09-16T00:52:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.365+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 31) v1 ==== 92506+0+0 (secure 0 0 0) 0x7f5b0c0041f0 con 0x7f5b10100250 2024-09-16T00:52:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.366+0000 7f5b037fe700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 0x7f5afc0708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:00.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.366+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5b0c014070 con 0x7f5b10100250 2024-09-16T00:52:00.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.366+0000 7f5b15ac8700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 0x7f5afc0708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:00.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.367+0000 7f5b15ac8700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 0x7f5afc0708e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400b6f0 tx=0x7f5b04005a90 comp rx=0 tx=0).ready entity=mgr.24463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:00.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.371+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5b0c05b5e0 con 0x7f5b10100250 2024-09-16T00:52:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:00 smithi053 ceph-mon[27950]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:00 smithi053 ceph-mon[27950]: pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 557 op/s 2024-09-16T00:52:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:00 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/1348168103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:52:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:00 smithi053 ceph-mon[27950]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:00 smithi152 ceph-mon[33237]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:00 smithi152 ceph-mon[33237]: pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 557 op/s 2024-09-16T00:52:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:00 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/1348168103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:52:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:00 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.817+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b10108f90 con 0x7f5b10100250 2024-09-16T00:52:00.821 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:52:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.820+0000 7f5b037fe700 1 -- 172.21.15.53:0/4178081771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5b0c05b170 con 0x7f5b10100250 2024-09-16T00:52:00.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.825+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 msgr2=0x7f5afc0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.825+0000 7f5b1852d700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 0x7f5afc0708e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400b6f0 tx=0x7f5b04005a90 comp rx=0 tx=0).stop 2024-09-16T00:52:00.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.825+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 msgr2=0x7f5b10074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:00.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.825+0000 7f5b1852d700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00e8f0 tx=0x7f5b0c00ec00 comp rx=0 tx=0).stop 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.829+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 shutdown_connections 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.829+0000 7f5b1852d700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:6800/3494092676,v1:172.21.15.53:6801/3494092676] conn(0x7f5afc06e430 0x7f5afc0708e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.829+0000 7f5b1852d700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b10100250 0x7f5b10074af0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.829+0000 7f5b1852d700 1 --2- 172.21.15.53:0/4178081771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b10101450 0x7f5b10073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.829+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 >> 172.21.15.53:0/4178081771 conn(0x7f5b100fb7e0 msgr2=0x7f5b10104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:00.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.830+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 shutdown_connections 2024-09-16T00:52:00.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:00.830+0000 7f5b1852d700 1 -- 172.21.15.53:0/4178081771 wait complete. 2024-09-16T00:52:01.466 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:01 smithi053 ceph-mon[27950]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:01.467 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:01 smithi053 ceph-mon[27950]: from='client.? 172.21.15.53:0/4178081771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:52:01.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:01 smithi152 ceph-mon[33237]: from='client.24567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:01 smithi152 ceph-mon[33237]: from='client.? 172.21.15.53:0/4178081771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:52:02.720 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:02 smithi053 ceph-mon[27950]: pgmap v34: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 831 op/s 2024-09-16T00:52:02.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:02 smithi152 ceph-mon[33237]: pgmap v34: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 831 op/s 2024-09-16T00:52:04.159 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:03 smithi053 systemd[1]: Stopping Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:52:04.449 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:04 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[27946]: 2024-09-16T00:52:04.157+0000 7fa580f2a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi053 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:52:04.449 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:04 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[27946]: 2024-09-16T00:52:04.157+0000 7fa580f2a700 -1 mon.smithi053@0(leader) e2 *** Got Signal Terminated *** 2024-09-16T00:52:04.449 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:04 smithi053 podman[77316]: 2024-09-16 00:52:04.393565817 +0000 UTC m=+0.363145425 container died c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2024-09-16T00:52:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:04 smithi053 podman[77316]: 2024-09-16 00:52:04.924907607 +0000 UTC m=+0.894487211 container cleanup c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212) 2024-09-16T00:52:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:04 smithi053 bash[77316]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053 2024-09-16T00:52:05.498 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:05 smithi053 podman[77342]: 2024-09-16 00:52:05.189477246 +0000 UTC m=+0.794245409 container remove c52dff4d835ca70911ba6f9e74b05ce1c9be659fb8f35fbc2203832ddcdd34c5 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD) 2024-09-16T00:52:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:05 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Deactivated successfully. 2024-09-16T00:52:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:05 smithi053 systemd[1]: Stopped Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:52:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:05 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Consumed 13.677s CPU time. 2024-09-16T00:52:06.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:05 smithi053 systemd[1]: Starting Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:52:06.253 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 podman[77473]: 2024-09-16 00:52:06.122983334 +0000 UTC m=+0.019388239 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:52:06.523 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 podman[77473]: 2024-09-16 00:52:06.253098689 +0000 UTC m=+0.149503587 container create e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 podman[77473]: 2024-09-16 00:52:06.523397112 +0000 UTC m=+0.419802010 container init e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 podman[77473]: 2024-09-16 00:52:06.528564207 +0000 UTC m=+0.424969098 container start e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: pidfile_write: ignore empty --pid-file 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: load: jerasure load: lrc 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Git sha 0 2024-09-16T00:52:06.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: DB SUMMARY 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: DB Session ID: WVYEUPFXT81JYPQRVZ18 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi053/store.db dir, Total Num: 1, files: 000032.sst 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi053/store.db: 000030.log size: 1081855 ; 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:52:06.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:52:06.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.env: 0x563044c7d940 2024-09-16T00:52:06.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:52:06.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.info_log: 0x563045e098c0 2024-09-16T00:52:06.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:52:06.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.statistics: (nil) 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.use_fsync: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:52:06.823 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.db_log_dir: 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.wal_dir: 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.write_buffer_manager: 0x563045e18dc0 2024-09-16T00:52:06.824 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.unordered_write: 0 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:52:06.825 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.row_cache: None 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.wal_filter: None 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.wal_compression: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:52:06.826 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:52:06.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_open_files: -1 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Compression algorithms supported: 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kZSTD supported: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:52:06.828 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi053/store.db/MANIFEST-000015 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.merge_operator: 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_filter: None 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:52:06.829 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563045e09520) 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_type: 0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: data_block_index_type: 0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_shortening: 1 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: checksum: 4 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: no_block_cache: 0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache: 0x563045dfd1f0 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_options: 2024-09-16T00:52:06.830 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: capacity : 536870912 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: num_shard_bits : 4 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: strict_capacity_limit : 0 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_cache_compressed: (nil) 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: persistent_cache: (nil) 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_size: 4096 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_size_deviation: 10 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_restart_interval: 16 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: index_block_restart_interval: 1 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: metadata_block_size: 4096 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: partition_filters: 0 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: use_delta_encoding: 1 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: filter_policy: bloomfilter 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: whole_key_filtering: 1 2024-09-16T00:52:06.831 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: verify_compression: 0 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: format_version: 5 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: enable_index_compression: 1 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: block_align: 0 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: max_auto_readahead_size: 262144 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: prepopulate_block_cache: 0 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:52:06.832 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression: NoCompression 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.num_levels: 7 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:06.833 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:52:06.834 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:52:06.835 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:52:06.836 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:52:06.837 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:52:06.838 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.ttl: 2592000 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:52:06.839 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi053/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12121, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 240ad471-4529-42cf-864a-0db4e26b2ab2 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447926558354, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447926565460, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 958480, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12122, "largest_seqno": 12822, "table_properties": {"data_size": 954753, "index_size": 1919, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 7105, "raw_average_key_size": 23, "raw_value_size": 948215, "raw_average_value_size": 3139, "num_data_blocks": 87, "num_entries": 302, "num_filter_entries": 302, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447926, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "240ad471-4529-42cf-864a-0db4e26b2ab2", "db_session_id": "WVYEUPFXT81JYPQRVZ18", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447926565593, "job": 1, "event": "recovery_finished"} 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi053/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563045e2ae00 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: DB pointer 0x563045f26000 2024-09-16T00:52:06.840 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** DB Stats ** 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:52:06.841 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: L0 1/0 936.02 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 225.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: L6 1/0 5.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Sum 2/0 6.74 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 225.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 225.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 225.1 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-16T00:52:06.842 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Cumulative compaction: 0.00 GB write, 91.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Interval compaction: 0.00 GB write, 91.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Block cache BinnedLRUCache@0x563045dfd1f0#2 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: starting mon.smithi053 rank 0 at public addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] at bind addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi053 fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???) e2 preinit fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).mds e16 new map 2024-09-16T00:52:06.843 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).mds e16 print_map 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: e16 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: legacy client fscid: 1 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Filesystem 'cephfs' (1) 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: fs_name cephfs 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: epoch 16 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: tableserver 0 2024-09-16T00:52:06.844 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: root 0 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: session_timeout 60 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: session_autoclose 300 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: max_file_size 1099511627776 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: max_xattr_size 65536 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: required_client_features {} 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: last_failure 0 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: last_failure_osd_epoch 0 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: max_mds 1 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: in 0 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: up {0=14470} 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: failed 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: damaged 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: stopped 2024-09-16T00:52:06.845 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: data_pools [3] 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: metadata_pool 2 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: inline_data disabled 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: balancer 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: bal_rank_mask -1 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: standby_count_wanted 1 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: qdb_cluster leader: 0 members: 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: [mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: [mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Standby daemons: 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: [mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:06.846 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: [mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:06.847 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T00:52:06.847 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:06.847 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:06.847 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:06.847 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 ceph-mon[77492]: mon.smithi053@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-16T00:52:07.241 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 bash[77473]: e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 2024-09-16T00:52:07.241 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:06 smithi053 systemd[1]: Started Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: pgmap v36: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: mon.smithi053 calling monitor election 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: mon.smithi053 is new leader, mons smithi053,smithi152 in quorum (ranks 0,1) 2024-09-16T00:52:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: monmap epoch 2 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: last_changed 2024-09-16T00:43:05.912723+0000 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: created 2024-09-16T00:40:26.906097+0000 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: min_mon_release 18 (reef) 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: election_strategy: 1 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.smithi053 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: osdmap e48: 6 total, 6 up, 6 in 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: mgrmap e31: smithi053.cjiiek(active, since 67s), standbys: smithi152.nlmwrx 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: overall HEALTH_OK 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: mgrmap e32: smithi053.cjiiek(active, since 67s), standbys: smithi152.nlmwrx 2024-09-16T00:52:07.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:07 smithi053 ceph-mon[77492]: from='mgr.24463 ' entity='' 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: from='mgr.24463 172.21.15.53:0/1171746709' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: pgmap v36: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 422 op/s 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: mon.smithi053 calling monitor election 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: mon.smithi053 is new leader, mons smithi053,smithi152 in quorum (ranks 0,1) 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: monmap epoch 2 2024-09-16T00:52:07.576 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: last_changed 2024-09-16T00:43:05.912723+0000 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: created 2024-09-16T00:40:26.906097+0000 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: min_mon_release 18 (reef) 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: election_strategy: 1 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.smithi053 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: osdmap e48: 6 total, 6 up, 6 in 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: mgrmap e31: smithi053.cjiiek(active, since 67s), standbys: smithi152.nlmwrx 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: overall HEALTH_OK 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: mgrmap e32: smithi053.cjiiek(active, since 67s), standbys: smithi152.nlmwrx 2024-09-16T00:52:07.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:07 smithi152 ceph-mon[33237]: from='mgr.24463 ' entity='' 2024-09-16T00:52:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:52:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:52:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:52:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:52:13.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:12 smithi053 ceph-mon[77492]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx restarted 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: Standby manager daemon smithi152.nlmwrx started 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/crt"}]: dispatch 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.nlmwrx/key"}]: dispatch 2024-09-16T00:52:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:12 smithi152 ceph-mon[33237]: from='mgr.? 172.21.15.152:0/1080229432' entity='mgr.smithi152.nlmwrx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T00:52:14.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:13 smithi053 ceph-mon[77492]: mgrmap e33: smithi053.cjiiek(active, since 73s), standbys: smithi152.nlmwrx 2024-09-16T00:52:14.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:13 smithi152 ceph-mon[33237]: mgrmap e33: smithi053.cjiiek(active, since 73s), standbys: smithi152.nlmwrx 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: Active manager daemon smithi053.cjiiek restarted 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: mgrmap e34: smithi053.cjiiek(active, starting, since 0.00598005s), standbys: smithi152.nlmwrx 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:52:15.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:15.071 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:15.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:52:15.072 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:52:15.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: Active manager daemon smithi053.cjiiek restarted 2024-09-16T00:52:15.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: Activating manager daemon smithi053.cjiiek 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: mgrmap e34: smithi053.cjiiek(active, starting, since 0.00598005s), standbys: smithi152.nlmwrx 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi053.cjiiek", "id": "smithi053.cjiiek"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr metadata", "who": "smithi152.nlmwrx", "id": "smithi152.nlmwrx"}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:52:15.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: Manager daemon smithi053.cjiiek is now available 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/mirror_snapshot_schedule"}]: dispatch 2024-09-16T00:52:15.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:14 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi053.cjiiek/trash_purge_schedule"}]: dispatch 2024-09-16T00:52:16.127 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-16T00:52:16.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-16T00:52:16.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:16 smithi152 ceph-mon[33237]: mgrmap e35: smithi053.cjiiek(active, since 1.01789s), standbys: smithi152.nlmwrx 2024-09-16T00:52:16.473 DEBUG:teuthology.parallel:result is None 2024-09-16T00:52:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:16 smithi053 ceph-mon[77492]: mgrmap e35: smithi053.cjiiek(active, since 1.01789s), standbys: smithi152.nlmwrx 2024-09-16T00:52:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:17 smithi152 ceph-mon[33237]: pgmap v3: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:17 smithi152 ceph-mon[33237]: pgmap v4: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:17 smithi152 ceph-mon[33237]: mgrmap e36: smithi053.cjiiek(active, since 2s), standbys: smithi152.nlmwrx 2024-09-16T00:52:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:17 smithi053 ceph-mon[77492]: pgmap v3: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:17 smithi053 ceph-mon[77492]: pgmap v4: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:17 smithi053 ceph-mon[77492]: mgrmap e36: smithi053.cjiiek(active, since 2s), standbys: smithi152.nlmwrx 2024-09-16T00:52:18.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: [16/Sep/2024:00:52:16] ENGINE Bus STARTING 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: [16/Sep/2024:00:52:17] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: [16/Sep/2024:00:52:17] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: [16/Sep/2024:00:52:17] ENGINE Bus STARTED 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: [16/Sep/2024:00:52:17] ENGINE Error in HTTPServer.serve 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:52:18.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:18.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:18 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: [16/Sep/2024:00:52:16] ENGINE Bus STARTING 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: [16/Sep/2024:00:52:17] ENGINE Serving on http://172.21.15.53:8765 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: [16/Sep/2024:00:52:17] ENGINE Serving on https://172.21.15.53:7150 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: [16/Sep/2024:00:52:17] ENGINE Bus STARTED 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: [16/Sep/2024:00:52:17] ENGINE Error in HTTPServer.serve 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: Traceback (most recent call last): 2024-09-16T00:52:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._connections.run(self.expiration_interval) 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._run(expiration_interval) 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: s = self.context.wrap_socket( 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: return self.sslsocket_class._create( 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T00:52:18.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self.do_handshake() 2024-09-16T00:52:18.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T00:52:18.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: self._sslobj.do_handshake() 2024-09-16T00:52:18.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T00:52:18.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:18.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:19.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:19 smithi152 ceph-mon[33237]: pgmap v5: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:19.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:19 smithi152 ceph-mon[33237]: mgrmap e37: smithi053.cjiiek(active, since 4s), standbys: smithi152.nlmwrx 2024-09-16T00:52:19.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:19 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:19.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:19 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:19.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:19 smithi053 ceph-mon[77492]: pgmap v5: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:19.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:19 smithi053 ceph-mon[77492]: mgrmap e37: smithi053.cjiiek(active, since 4s), standbys: smithi152.nlmwrx 2024-09-16T00:52:19.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:19.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:21.294 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:21 smithi152 ceph-mon[33237]: pgmap v6: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:21.395 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:21 smithi053 ceph-mon[77492]: pgmap v6: 65 pgs: 65 active+clean; 232 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-16T00:52:22.139 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-16T00:52:22.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T00:52:22.508 DEBUG:teuthology.parallel:result is None 2024-09-16T00:52:22.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T00:52:22.545 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T00:52:22.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T00:52:22.583 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T00:52:22.584 DEBUG:teuthology.parallel:result is None 2024-09-16T00:52:23.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:23 smithi152 ceph-mon[33237]: pgmap v7: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 424 op/s 2024-09-16T00:52:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:23 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:23.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:23 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:23 smithi053 ceph-mon[77492]: pgmap v7: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 424 op/s 2024-09-16T00:52:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:25.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:25 smithi152 ceph-mon[33237]: pgmap v8: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 904 KiB/s rd, 814 KiB/s wr, 327 op/s 2024-09-16T00:52:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:25 smithi053 ceph-mon[77492]: pgmap v8: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 904 KiB/s rd, 814 KiB/s wr, 327 op/s 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: pgmap v9: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 966 KiB/s wr, 368 op/s 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: pgmap v9: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 966 KiB/s wr, 368 op/s 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:26.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:26 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:28.261 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:52:28.261 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:28.262 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.conf 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: Updating smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T00:52:28.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:52:28.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:28 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T00:52:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T00:52:29.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: pgmap v10: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 KiB/s rd, 869 KiB/s wr, 331 op/s 2024-09-16T00:52:29.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:29.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:29.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:29.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:29.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:29 smithi152 ceph-mon[33237]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: pgmap v10: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 KiB/s rd, 869 KiB/s wr, 331 op/s 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 ceph-mon[33237]: Upgrade: Updating mon.smithi152 2024-09-16T00:52:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 ceph-mon[33237]: Deploying daemon mon.smithi152 on smithi152 2024-09-16T00:52:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:52:30.532 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:30 smithi053 ceph-mon[77492]: Upgrade: Updating mon.smithi152 2024-09-16T00:52:30.532 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:30 smithi053 ceph-mon[77492]: Deploying daemon mon.smithi152 on smithi152 2024-09-16T00:52:30.864 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152[33218]: 2024-09-16T00:52:30.530+0000 7f218ab07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:52:30.864 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152[33218]: 2024-09-16T00:52:30.530+0000 7f218ab07700 -1 mon.smithi152@1(peon) e2 *** Got Signal Terminated *** 2024-09-16T00:52:30.864 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 podman[63449]: 2024-09-16 00:52:30.63834718 +0000 UTC m=+0.206640725 container died 1fed748ad32f9441cc4d34a986074e37ab6ed91420ea9a6290973e707c930cc6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, RELEASE=HEAD, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 -- 172.21.15.53:0/239697189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 msgr2=0x7f8f101007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 --2- 172.21.15.53:0/239697189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f101007a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009910 tx=0x7f8f04009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 -- 172.21.15.53:0/239697189 shutdown_connections 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 --2- 172.21.15.53:0/239697189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f101007a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 --2- 172.21.15.53:0/239697189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 0x7f8f100ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 -- 172.21.15.53:0/239697189 >> 172.21.15.53:0/239697189 conn(0x7f8f100fa700 msgr2=0x7f8f100fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 -- 172.21.15.53:0/239697189 shutdown_connections 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.963+0000 7f8f176fd700 1 -- 172.21.15.53:0/239697189 wait complete. 2024-09-16T00:52:30.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 Processor -- start 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 -- start start 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 0x7f8f101030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10101c70 con 0x7f8f10100350 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f176fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10101db0 con 0x7f8f100ff150 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.964+0000 7f8f14c98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59496/0 (socket says 172.21.15.53:59496) 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 -- 172.21.15.53:0/4226212293 learned_addr learned my addr 172.21.15.53:0/4226212293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f15499700 1 -- 172.21.15.53:0/4226212293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 msgr2=0x7f8f101030e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:3300/0 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f15499700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 0x7f8f101030e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 -- 172.21.15.53:0/4226212293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 msgr2=0x7f8f101030e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 0x7f8f101030e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:30.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 -- 172.21.15.53:0/4226212293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040095f0 con 0x7f8f10100350 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f14c98700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400bd70 tx=0x7f8f0400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0401d070 con 0x7f8f10100350 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f04022470 con 0x7f8f10100350 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f176fd700 1 -- 172.21.15.53:0/4226212293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f10102030 con 0x7f8f10100350 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0400f690 con 0x7f8f10100350 2024-09-16T00:52:30.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.965+0000 7f8f176fd700 1 -- 172.21.15.53:0/4226212293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f10102520 con 0x7f8f10100350 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.967+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f10107d40 con 0x7f8f10100350 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.967+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f8f040225e0 con 0x7f8f10100350 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.967+0000 7f8f0e7fc700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 0x7f8ef8070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.968+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8f04090050 con 0x7f8f10100350 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.968+0000 7f8f15499700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 0x7f8ef8070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:30.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.968+0000 7f8f15499700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 0x7f8ef8070bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8f101001b0 tx=0x7f8f00009290 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:30.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:30.972+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f0405cc30 con 0x7f8f10100350 2024-09-16T00:52:31.140 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 podman[63449]: 2024-09-16 00:52:30.972018498 +0000 UTC m=+0.540312040 container cleanup 1fed748ad32f9441cc4d34a986074e37ab6ed91420ea9a6290973e707c930cc6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.29.1) 2024-09-16T00:52:31.140 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:30 smithi152 bash[63449]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152 2024-09-16T00:52:31.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.212+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f10107ed0 con 0x7f8ef806e700 2024-09-16T00:52:31.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.213+0000 7f8f0e7fc700 1 -- 172.21.15.53:0/4226212293 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8f10107ed0 con 0x7f8ef806e700 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 msgr2=0x7f8ef8070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 0x7f8ef8070bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8f101001b0 tx=0x7f8f00009290 comp rx=0 tx=0).stop 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 msgr2=0x7f8f10101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400bd70 tx=0x7f8f0400be50 comp rx=0 tx=0).stop 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 shutdown_connections 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8ef806e700 0x7f8ef8070bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f100ff150 0x7f8f101030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 --2- 172.21.15.53:0/4226212293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f10100350 0x7f8f10101730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 >> 172.21.15.53:0/4226212293 conn(0x7f8f100fa700 msgr2=0x7f8f10068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 shutdown_connections 2024-09-16T00:52:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.216+0000 7f8ef7fff700 1 -- 172.21.15.53:0/4226212293 wait complete. 2024-09-16T00:52:31.228 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 -- 172.21.15.53:0/3188753223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c100240 msgr2=0x7f9b9c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/3188753223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c100240 0x7f9b9c100650 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009910 tx=0x7f9b98009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 -- 172.21.15.53:0/3188753223 shutdown_connections 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/3188753223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c101440 0x7f9b9c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/3188753223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c100240 0x7f9b9c100650 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 -- 172.21.15.53:0/3188753223 >> 172.21.15.53:0/3188753223 conn(0x7f9b9c0fb7f0 msgr2=0x7f9b9c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 -- 172.21.15.53:0/3188753223 shutdown_connections 2024-09-16T00:52:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.327+0000 7f9ba36b0700 1 -- 172.21.15.53:0/3188753223 wait complete. 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 Processor -- start 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 -- start start 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 0x7f9b9c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1988f0 con 0x7f9b9c101440 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba36b0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c19d300 con 0x7f9b9c100240 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba144c700 1 -- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 msgr2=0x7f9b9c197d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:3300/0 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba144c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 0x7f9b9c197d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59512/0 (socket says 172.21.15.53:59512) 2024-09-16T00:52:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 -- 172.21.15.53:0/951215748 learned_addr learned my addr 172.21.15.53:0/951215748 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 -- 172.21.15.53:0/951215748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 msgr2=0x7f9b9c197d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 0x7f9b9c197d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 -- 172.21.15.53:0/951215748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980095f0 con 0x7f9b9c101440 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.328+0000 7f9ba0c4b700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00b700 tx=0x7f9b8c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.329+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c011800 con 0x7f9b9c101440 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.329+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b8c011e10 con 0x7f9b9c101440 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.329+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c19d500 con 0x7f9b9c101440 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.329+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c00f2e0 con 0x7f9b9c101440 2024-09-16T00:52:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.329+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c19da20 con 0x7f9b9c101440 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.330+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c105520 con 0x7f9b9c101440 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.330+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f9b8c010380 con 0x7f9b9c101440 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.331+0000 7f9b927fc700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 0x7f9b88070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.331+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9b8c08e320 con 0x7f9b9c101440 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.331+0000 7f9ba144c700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 0x7f9b88070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.331+0000 7f9ba144c700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 0x7f9b88070bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b98005090 tx=0x7f9b98009fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.335+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9b8c0574e0 con 0x7f9b9c101440 2024-09-16T00:52:31.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 podman[63461]: 2024-09-16 00:52:31.140261753 +0000 UTC m=+0.503570758 container remove 1fed748ad32f9441cc4d34a986074e37ab6ed91420ea9a6290973e707c930cc6 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True) 2024-09-16T00:52:31.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service: Deactivated successfully. 2024-09-16T00:52:31.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:52:31.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service: Consumed 6.553s CPU time. 2024-09-16T00:52:31.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.570+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b9c061190 con 0x7f9b8806e700 2024-09-16T00:52:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.571+0000 7f9b927fc700 1 -- 172.21.15.53:0/951215748 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9b9c061190 con 0x7f9b8806e700 2024-09-16T00:52:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 msgr2=0x7f9b88070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 0x7f9b88070bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b98005090 tx=0x7f9b98009fd0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 msgr2=0x7f9b9c1982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00b700 tx=0x7f9b8c00bac0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 shutdown_connections 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9b8806e700 0x7f9b88070bb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b9c100240 0x7f9b9c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 --2- 172.21.15.53:0/951215748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b9c101440 0x7f9b9c1982d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 >> 172.21.15.53:0/951215748 conn(0x7f9b9c0fb7f0 msgr2=0x7f9b9c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 shutdown_connections 2024-09-16T00:52:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.574+0000 7f9ba36b0700 1 -- 172.21.15.53:0/951215748 wait complete. 2024-09-16T00:52:31.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 -- 172.21.15.53:0/715541060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 msgr2=0x7f0034073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 --2- 172.21.15.53:0/715541060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034073c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0024009940 tx=0x7f0024009c50 comp rx=0 tx=0).stop 2024-09-16T00:52:31.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 -- 172.21.15.53:0/715541060 shutdown_connections 2024-09-16T00:52:31.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 --2- 172.21.15.53:0/715541060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034073c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 --2- 172.21.15.53:0/715541060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 0x7f00340731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 -- 172.21.15.53:0/715541060 >> 172.21.15.53:0/715541060 conn(0x7f00340fb7f0 msgr2=0x7f00340fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 -- 172.21.15.53:0/715541060 shutdown_connections 2024-09-16T00:52:31.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.683+0000 7f003b65d700 1 -- 172.21.15.53:0/715541060 wait complete. 2024-09-16T00:52:31.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 Processor -- start 2024-09-16T00:52:31.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 -- start start 2024-09-16T00:52:31.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 0x7f0034198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034198920 con 0x7f00340737b0 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f003b65d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034198a60 con 0x7f0034074d80 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f00393f9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f00393f9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59532/0 (socket says 172.21.15.53:59532) 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f00393f9700 1 -- 172.21.15.53:0/1827499508 learned_addr learned my addr 172.21.15.53:0/1827499508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f0038bf8700 1 -- 172.21.15.53:0/1827499508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 msgr2=0x7f0034198300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:3300/0 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.684+0000 7f0038bf8700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 0x7f0034198300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f00393f9700 1 -- 172.21.15.53:0/1827499508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 msgr2=0x7f0034198300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f00393f9700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 0x7f0034198300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f00393f9700 1 -- 172.21.15.53:0/1827499508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240095f0 con 0x7f00340737b0 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f00393f9700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f003000b9e0 tx=0x7f003000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0030006ea0 con 0x7f00340737b0 2024-09-16T00:52:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f003000ce30 con 0x7f00340737b0 2024-09-16T00:52:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003419d510 con 0x7f00340737b0 2024-09-16T00:52:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00300135d0 con 0x7f00340737b0 2024-09-16T00:52:31.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.685+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003419da60 con 0x7f00340737b0 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.686+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003410b020 con 0x7f00340737b0 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.687+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f0030014440 con 0x7f00340737b0 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.687+0000 7f002a7fc700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 0x7f0020070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.687+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f003008e020 con 0x7f00340737b0 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.687+0000 7f0038bf8700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 0x7f0020070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:31.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.688+0000 7f0038bf8700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 0x7f0020070bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f002400b540 tx=0x7f0024000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:31.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.692+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f003005ac90 con 0x7f00340737b0 2024-09-16T00:52:31.871 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:52:31.872 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 podman[63588]: 2024-09-16 00:52:31.667355001 +0000 UTC m=+0.015413302 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:52:31.872 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 podman[63588]: 2024-09-16 00:52:31.766724804 +0000 UTC m=+0.114783139 container create 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:52:31.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.914+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f003419e100 con 0x7f002006e700 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.924+0000 7f002a7fc700 1 -- 172.21.15.53:0/1827499508 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f003419e100 con 0x7f002006e700 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (9m) 6s ago 10m 25.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (10m) 6s ago 10m 7902k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (9m) 13s ago 9m 7541k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (10m) 6s ago 10m 6660k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (9m) 13s ago 9m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (8m) 6s ago 10m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:52:31.925 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (4m) 6s ago 4m 185M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (4m) 6s ago 4m 118M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (4m) 13s ago 4m 15.8M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (4m) 13s ago 4m 14.4M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (103s) 6s ago 11m 473M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (45s) 13s ago 9m 437M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (25s) 6s ago 12m 32.6M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (9m) 13s ago 9m 48.1M 2048M 18.2.0 dc2bc1663786 1fed748ad32f 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (10m) 6s ago 10m 16.1M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (9m) 13s ago 9m 16.4M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (8m) 6s ago 8m 265M 1217M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (8m) 6s ago 8m 275M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (7m) 6s ago 7m 228M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:52:31.926 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (7m) 13s ago 7m 286M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:52:31.927 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (6m) 13s ago 6m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:52:31.927 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (6m) 13s ago 6m 249M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:52:31.927 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (51s) 6s ago 9m 62.8M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 msgr2=0x7f0020070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 0x7f0020070bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f002400b540 tx=0x7f0024000bc0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 msgr2=0x7f0034197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f003000b9e0 tx=0x7f003000bda0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 shutdown_connections 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f002006e700 0x7f0020070bb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00340737b0 0x7f0034197dc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 --2- 172.21.15.53:0/1827499508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0034074d80 0x7f0034198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 >> 172.21.15.53:0/1827499508 conn(0x7f00340fb7f0 msgr2=0x7f0034106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 shutdown_connections 2024-09-16T00:52:31.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:31.927+0000 7f003b65d700 1 -- 172.21.15.53:0/1827499508 wait complete. 2024-09-16T00:52:32.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.034+0000 7f79b0ccc700 1 -- 172.21.15.53:0/2330967656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 msgr2=0x7f79ac0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.034+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/2330967656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac0ff560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009910 tx=0x7f79a0009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.034+0000 7f79b0ccc700 1 -- 172.21.15.53:0/2330967656 shutdown_connections 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/2330967656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/2330967656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac0ff560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 -- 172.21.15.53:0/2330967656 >> 172.21.15.53:0/2330967656 conn(0x7f79ac0fa7a0 msgr2=0x7f79ac0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 -- 172.21.15.53:0/2330967656 shutdown_connections 2024-09-16T00:52:32.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 -- 172.21.15.53:0/2330967656 wait complete. 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 Processor -- start 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.035+0000 7f79b0ccc700 1 -- start start 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79b0ccc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79b0ccc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79b0ccc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac198b20 con 0x7f79ac0ff150 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79b0ccc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac198c60 con 0x7f79ac1003f0 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59546/0 (socket says 172.21.15.53:59546) 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 -- 172.21.15.53:0/963885413 learned_addr learned my addr 172.21.15.53:0/963885413 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:32.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79a9d9b700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79a9d9b700 1 -- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 msgr2=0x7f79ac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79a9d9b700 1 -- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 msgr2=0x7f79ac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79a9d9b700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 -- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 msgr2=0x7f79ac198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79a9d9b700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 -- 172.21.15.53:0/963885413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00095f0 con 0x7f79ac0ff150 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79aa59c700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79a0005b40 tx=0x7f79a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79a001d070 con 0x7f79ac0ff150 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79a000f460 con 0x7f79ac0ff150 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79a0021640 con 0x7f79ac0ff150 2024-09-16T00:52:32.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.036+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac19d6b0 con 0x7f79ac0ff150 2024-09-16T00:52:32.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.037+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac19dba0 con 0x7f79ac0ff150 2024-09-16T00:52:32.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.037+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac068ab0 con 0x7f79ac0ff150 2024-09-16T00:52:32.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.038+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f79a000fa90 con 0x7f79ac0ff150 2024-09-16T00:52:32.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.039+0000 7f799b7fe700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 0x7f7994070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.039+0000 7f79a9d9b700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 0x7f7994070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.039+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f79a008fb50 con 0x7f79ac0ff150 2024-09-16T00:52:32.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.039+0000 7f79a9d9b700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 0x7f7994070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f799c005920 tx=0x7f799c00b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.043+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f79a005c6b0 con 0x7f79ac0ff150 2024-09-16T00:52:32.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 podman[63588]: 2024-09-16 00:52:31.969645343 +0000 UTC m=+0.317703642 container init 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T00:52:32.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 podman[63588]: 2024-09-16 00:52:31.97279342 +0000 UTC m=+0.320851714 container start 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T00:52:32.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: pidfile_write: ignore empty --pid-file 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: load: jerasure load: lrc 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: RocksDB version: 7.9.2 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Git sha 0 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: DB SUMMARY 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: DB Session ID: M8IFKGOJ407OOP8MPMC6 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: CURRENT file: CURRENT 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000027.sst 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000025.log size: 4548992 ; 2024-09-16T00:52:32.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.error_if_exists: 0 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.create_if_missing: 0 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.paranoid_checks: 1 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.env: 0x55acb0afa940 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.info_log: 0x55acb1bb78c0 2024-09-16T00:52:32.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.statistics: (nil) 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.use_fsync: 0 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_log_file_size: 0 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_fallocate: 1 2024-09-16T00:52:32.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.use_direct_reads: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.db_log_dir: 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.wal_dir: 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T00:52:32.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.write_buffer_manager: 0x55acb1bc6dc0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.unordered_write: 0 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T00:52:32.203 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.row_cache: None 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.wal_filter: None 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.two_write_queues: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.wal_compression: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.atomic_flush: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.log_readahead_size: 0 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T00:52:32.204 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_background_jobs: 2 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_background_compactions: -1 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_subcompactions: 1 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T00:52:32.205 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_open_files: -1 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_background_flushes: -1 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Compression algorithms supported: 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kZSTD supported: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kXpressCompression supported: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kBZip2Compression supported: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T00:52:32.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kLZ4Compression supported: 1 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kZlibCompression supported: 1 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: kSnappyCompression supported: 1 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000010 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.merge_operator: 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_filter: None 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T00:52:32.207 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55acb1bb7520) 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 4 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x55acb1bab1f0 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-09-16T00:52:32.208 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2024-09-16T00:52:32.209 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: bloomfilter 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 5 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_auto_readahead_size: 262144 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: prepopulate_block_cache: 0 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: initial_auto_readahead_size: 8192 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression: NoCompression 2024-09-16T00:52:32.210 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.num_levels: 7 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:32.211 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T00:52:32.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T00:52:32.213 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T00:52:32.214 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.inplace_update_support: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.bloom_locality: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.max_successive_merges: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.ttl: 2592000 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T00:52:32.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enable_blob_files: false 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.min_blob_size: 0 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T00:52:32.216 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12187, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca1882a7-2728-4fbc-93a5-3d64a13501a7 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447951999860, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:31 smithi152 ceph-mon[63606]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447952012057, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2801445, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12192, "largest_seqno": 13474, "table_properties": {"data_size": 2795635, "index_size": 3421, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1349, "raw_key_size": 12161, "raw_average_key_size": 23, "raw_value_size": 2784438, "raw_average_value_size": 5365, "num_data_blocks": 156, "num_entries": 519, "num_filter_entries": 519, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726447952, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca1882a7-2728-4fbc-93a5-3d64a13501a7", "db_session_id": "M8IFKGOJ407OOP8MPMC6", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726447952012187, "job": 1, "event": "recovery_finished"} 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55acb1bd8e00 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: DB pointer 0x55acb1cd4000 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T00:52:32.217 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 2.67 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L6 1/0 5.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T00:52:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 8.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 657.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 657.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T00:52:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 176.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 176.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache BinnedLRUCache@0x55acb1bab1f0#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: starting mon.smithi152 rank 1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???) e2 preinit fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).mds e16 new map 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).mds e16 print_map 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e16 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:52:32.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: 1 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Filesystem 'cephfs' (1) 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: fs_name cephfs 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: epoch 16 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: tableserver 0 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: root 0 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_timeout 60 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_autoclose 300 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_file_size 1099511627776 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_xattr_size 65536 2024-09-16T00:52:32.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: required_client_features {} 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure 0 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure_osd_epoch 0 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_mds 1 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: in 0 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: up {0=14470} 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: failed 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: damaged 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: stopped 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_pools [3] 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_pool 2 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: inline_data disabled 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: balancer 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: bal_rank_mask -1 2024-09-16T00:52:32.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: standby_count_wanted 1 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: qdb_cluster leader: 0 members: 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Standby daemons: 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: mon.smithi152@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-16T00:52:32.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 bash[63588]: 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 2024-09-16T00:52:32.224 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 systemd[1]: Started Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:52:32.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.353+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f79ac1065c0 con 0x7f79ac0ff150 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.353+0000 7f799b7fe700 1 -- 172.21.15.53:0/963885413 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+785 (secure 0 0 0) 0x7f79a005c240 con 0x7f79ac0ff150 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:52:32.354 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 11, 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 3 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:52:32.355 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:52:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 msgr2=0x7f7994070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 0x7f7994070c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f799c005920 tx=0x7f799c00b2c0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 msgr2=0x7f79ac197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79a0005b40 tx=0x7f79a000be20 comp rx=0 tx=0).stop 2024-09-16T00:52:32.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 shutdown_connections 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f799406e7b0 0x7f7994070c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79ac0ff150 0x7f79ac197fc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 --2- 172.21.15.53:0/963885413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79ac1003f0 0x7f79ac198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.355+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 >> 172.21.15.53:0/963885413 conn(0x7f79ac0fa7a0 msgr2=0x7f79ac1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.356+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 shutdown_connections 2024-09-16T00:52:32.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.356+0000 7f79b0ccc700 1 -- 172.21.15.53:0/963885413 wait complete. 2024-09-16T00:52:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 -- 172.21.15.53:0/3537281430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c101450 msgr2=0x7f919c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 --2- 172.21.15.53:0/3537281430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c101450 0x7f919c1018a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9198009910 tx=0x7f9198009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 -- 172.21.15.53:0/3537281430 shutdown_connections 2024-09-16T00:52:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 --2- 172.21.15.53:0/3537281430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c101450 0x7f919c1018a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 --2- 172.21.15.53:0/3537281430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c100250 0x7f919c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 -- 172.21.15.53:0/3537281430 >> 172.21.15.53:0/3537281430 conn(0x7f919c0fb7e0 msgr2=0x7f919c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 -- 172.21.15.53:0/3537281430 shutdown_connections 2024-09-16T00:52:32.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.466+0000 7f91a3f82700 1 -- 172.21.15.53:0/3537281430 wait complete. 2024-09-16T00:52:32.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 Processor -- start 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 -- start start 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c101450 0x7f919c196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c196620 con 0x7f919c100250 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a3f82700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c196760 con 0x7f919c101450 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a1d1e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a1d1e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38310/0 (socket says 172.21.15.53:38310) 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a1d1e700 1 -- 172.21.15.53:0/2739282989 learned_addr learned my addr 172.21.15.53:0/2739282989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.467+0000 7f91a151d700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c101450 0x7f919c196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a1d1e700 1 -- 172.21.15.53:0/2739282989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c101450 msgr2=0x7f919c196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a1d1e700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c101450 0x7f919c196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a1d1e700 1 -- 172.21.15.53:0/2739282989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980095f0 con 0x7f919c100250 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a1d1e700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f919000d8d0 tx=0x7f919000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9190004a00 con 0x7f919c100250 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c19b210 con 0x7f919c100250 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91900054d0 con 0x7f919c100250 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9190009d60 con 0x7f919c100250 2024-09-16T00:52:32.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.468+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c19b760 con 0x7f919c100250 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.469+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c108dc0 con 0x7f919c100250 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.470+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f9190005020 con 0x7f919c100250 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.470+0000 7f918effd700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 0x7f9188070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.470+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f919008e770 con 0x7f919c100250 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.470+0000 7f91a151d700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 0x7f9188070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.471+0000 7f91a151d700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 0x7f9188070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9198005b40 tx=0x7f9198005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.475+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f919005b2d0 con 0x7f919c100250 2024-09-16T00:52:32.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.695+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f919005b2d0 con 0x7f919c100250 2024-09-16T00:52:32.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.767+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f919c0733a0 con 0x7f919c100250 2024-09-16T00:52:32.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.768+0000 7f918effd700 1 -- 172.21.15.53:0/2739282989 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f91900177b0 con 0x7f919c100250 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:52:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:52:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:52:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.772 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 msgr2=0x7f9188070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 0x7f9188070c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9198005b40 tx=0x7f9198005a90 comp rx=0 tx=0).stop 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 msgr2=0x7f919c195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f919000d8d0 tx=0x7f919000dc90 comp rx=0 tx=0).stop 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 shutdown_connections 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f918806e7c0 0x7f9188070c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f919c100250 0x7f919c195ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 --2- 172.21.15.53:0/2739282989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f919c101450 0x7f919c196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 >> 172.21.15.53:0/2739282989 conn(0x7f919c0fb7e0 msgr2=0x7f919c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 shutdown_connections 2024-09-16T00:52:32.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.771+0000 7f91a3f82700 1 -- 172.21.15.53:0/2739282989 wait complete. 2024-09-16T00:52:32.774 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:52:32.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 -- 172.21.15.53:0/1535981267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 msgr2=0x7f10e80fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:32.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1535981267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e80fef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009910 tx=0x7f10d8009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:32.888 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:32 smithi053 ceph-mon[77492]: pgmap v11: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 KiB/s rd, 869 KiB/s wr, 331 op/s 2024-09-16T00:52:32.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 -- 172.21.15.53:0/1535981267 shutdown_connections 2024-09-16T00:52:32.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1535981267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e80ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1535981267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e80fef60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.887+0000 7f10ec8db700 1 -- 172.21.15.53:0/1535981267 >> 172.21.15.53:0/1535981267 conn(0x7f10e80fa700 msgr2=0x7f10e80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.888+0000 7f10ec8db700 1 -- 172.21.15.53:0/1535981267 shutdown_connections 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.888+0000 7f10ec8db700 1 -- 172.21.15.53:0/1535981267 wait complete. 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.888+0000 7f10ec8db700 1 Processor -- start 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.888+0000 7f10ec8db700 1 -- start start 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10ec8db700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10ec8db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10ec8db700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8198840 con 0x7f10e80feb50 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10ec8db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e819d250 con 0x7f10e80ff4a0 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38324/0 (socket says 172.21.15.53:38324) 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 -- 172.21.15.53:0/1820707732 learned_addr learned my addr 172.21.15.53:0/1820707732 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:32.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e5d9b700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e5d9b700 1 -- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 msgr2=0x7f10e8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e5d9b700 1 -- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 msgr2=0x7f10e8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e5d9b700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e5d9b700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 -- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 msgr2=0x7f10e8198220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 -- 172.21.15.53:0/1820707732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80095f0 con 0x7f10e80feb50 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.889+0000 7f10e659c700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006010 tx=0x7f10d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.890+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d801d070 con 0x7f10e80feb50 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.890+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10d800f460 con 0x7f10e80feb50 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.890+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e819d3f0 con 0x7f10e80feb50 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.890+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10d8017630 con 0x7f10e80feb50 2024-09-16T00:52:32.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.890+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e819d8b0 con 0x7f10e80feb50 2024-09-16T00:52:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.891+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e810afa0 con 0x7f10e80feb50 2024-09-16T00:52:32.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.891+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f10d8003a60 con 0x7f10e80feb50 2024-09-16T00:52:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.892+0000 7f10df7fe700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 0x7f10d4070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.892+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f10d808fce0 con 0x7f10e80feb50 2024-09-16T00:52:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.892+0000 7f10e5d9b700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 0x7f10d4070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:32.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.893+0000 7f10e5d9b700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 0x7f10d4070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10d0005950 tx=0x7f10d00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:32.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:32.897+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f10d8058d10 con 0x7f10e80feb50 2024-09-16T00:52:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:32 smithi152 ceph-mon[63606]: pgmap v11: 65 pgs: 65 active+clean; 200 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 957 KiB/s rd, 869 KiB/s wr, 331 op/s 2024-09-16T00:52:33.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.138+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10e81088a0 con 0x7f10d406e7c0 2024-09-16T00:52:33.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.140+0000 7f10df7fe700 1 -- 172.21.15.53:0/1820707732 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f10e81088a0 con 0x7f10d406e7c0 2024-09-16T00:52:33.140 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:52:33.140 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr" 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "3/23 daemons upgraded", 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mon daemons", 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:52:33.141 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:52:33.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 msgr2=0x7f10d4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:33.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 0x7f10d4070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10d0005950 tx=0x7f10d00058e0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 msgr2=0x7f10e8197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006010 tx=0x7f10d800be20 comp rx=0 tx=0).stop 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 shutdown_connections 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f10d406e7c0 0x7f10d4070c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e80feb50 0x7f10e8197ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 --2- 172.21.15.53:0/1820707732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e80ff4a0 0x7f10e8198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.142+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 >> 172.21.15.53:0/1820707732 conn(0x7f10e80fa700 msgr2=0x7f10e8107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.143+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 shutdown_connections 2024-09-16T00:52:33.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.143+0000 7f10ec8db700 1 -- 172.21.15.53:0/1820707732 wait complete. 2024-09-16T00:52:33.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.251+0000 7fede10ce700 1 -- 172.21.15.53:0/1942493111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 msgr2=0x7feddc100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.251+0000 7fede10ce700 1 --2- 172.21.15.53:0/1942493111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc100660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009910 tx=0x7fedcc009c20 comp rx=0 tx=0).stop 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 -- 172.21.15.53:0/1942493111 shutdown_connections 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 --2- 172.21.15.53:0/1942493111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 --2- 172.21.15.53:0/1942493111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc100660 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 -- 172.21.15.53:0/1942493111 >> 172.21.15.53:0/1942493111 conn(0x7feddc0fb7e0 msgr2=0x7feddc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 -- 172.21.15.53:0/1942493111 shutdown_connections 2024-09-16T00:52:33.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 -- 172.21.15.53:0/1942493111 wait complete. 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.252+0000 7fede10ce700 1 Processor -- start 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fede10ce700 1 -- start start 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fede10ce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fede10ce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fede10ce700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1988c0 con 0x7feddc100250 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fede10ce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc198a00 con 0x7feddc101450 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38332/0 (socket says 172.21.15.53:38332) 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 -- 172.21.15.53:0/3891646173 learned_addr learned my addr 172.21.15.53:0/3891646173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fedda59c700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:33.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fedda59c700 1 -- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 msgr2=0x7feddc1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fedda59c700 1 -- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 msgr2=0x7feddc1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fedda59c700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7fedda59c700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 -- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 msgr2=0x7feddc1982a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.253+0000 7feddad9d700 1 -- 172.21.15.53:0/3891646173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0095f0 con 0x7feddc100250 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7feddad9d700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bda0 tx=0x7fedcc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedcc01d070 con 0x7feddc100250 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fedcc004c50 con 0x7feddc100250 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc19d450 con 0x7feddc100250 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedcc00f690 con 0x7feddc100250 2024-09-16T00:52:33.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.254+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc19d940 con 0x7feddc100250 2024-09-16T00:52:33.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.255+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc105530 con 0x7feddc100250 2024-09-16T00:52:33.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.256+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fedcc022a20 con 0x7feddc100250 2024-09-16T00:52:33.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.256+0000 7fedd3fff700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 0x7fedc8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:52:33.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.256+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fedcc090070 con 0x7feddc100250 2024-09-16T00:52:33.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.256+0000 7fedda59c700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 0x7fedc8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:52:33.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.257+0000 7fedda59c700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 0x7fedc8070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006f50 tx=0x7fedc4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:52:33.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.261+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fedcc05cbd0 con 0x7feddc100250 2024-09-16T00:52:33.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.568+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feddc02cde0 con 0x7feddc100250 2024-09-16T00:52:33.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.568+0000 7fedd3fff700 1 -- 172.21.15.53:0/3891646173 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fedcc05c760 con 0x7feddc100250 2024-09-16T00:52:33.569 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:52:33.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 msgr2=0x7fedc8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:33.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 0x7fedc8070c70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006f50 tx=0x7fedc4008040 comp rx=0 tx=0).stop 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 msgr2=0x7feddc197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bda0 tx=0x7fedcc00be80 comp rx=0 tx=0).stop 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 shutdown_connections 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fedc806e7c0 0x7fedc8070c70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feddc100250 0x7feddc197d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 --2- 172.21.15.53:0/3891646173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feddc101450 0x7feddc1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.570+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 >> 172.21.15.53:0/3891646173 conn(0x7feddc0fb7e0 msgr2=0x7feddc102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.571+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 shutdown_connections 2024-09-16T00:52:33.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:52:33.571+0000 7fede10ce700 1 -- 172.21.15.53:0/3891646173 wait complete. 2024-09-16T00:52:33.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: mgrmap e37: smithi053.cjiiek(active, since 18s), standbys: smithi152.nlmwrx 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: overall HEALTH_OK 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: mon.smithi053 calling monitor election 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: mon.smithi152 calling monitor election 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: mon.smithi053 is new leader, mons smithi053,smithi152 in quorum (ranks 0,1) 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: monmap epoch 3 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: last_changed 2024-09-16T00:52:32.693255+0000 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: created 2024-09-16T00:40:26.906097+0000 2024-09-16T00:52:33.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: min_mon_release 19 (squid) 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: election_strategy: 1 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.smithi053 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: mgrmap e37: smithi053.cjiiek(active, since 18s), standbys: smithi152.nlmwrx 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: overall HEALTH_OK 2024-09-16T00:52:33.821 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2739282989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:33.822 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:33 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3891646173' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:52:34.051 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: mgrmap e37: smithi053.cjiiek(active, since 18s), standbys: smithi152.nlmwrx 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: overall HEALTH_OK 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: mon.smithi053 calling monitor election 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: mon.smithi152 calling monitor election 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: mon.smithi053 is new leader, mons smithi053,smithi152 in quorum (ranks 0,1) 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi053"}]: dispatch 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: monmap epoch 3 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: fsid 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T00:52:34.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: last_changed 2024-09-16T00:52:32.693255+0000 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: created 2024-09-16T00:40:26.906097+0000 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: min_mon_release 19 (squid) 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: election_strategy: 1 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.smithi053 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: mgrmap e37: smithi053.cjiiek(active, since 18s), standbys: smithi152.nlmwrx 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: overall HEALTH_OK 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:34.053 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:52:34.054 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2739282989' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:52:34.054 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:52:34.054 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:33 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3891646173' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:52:34.946 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:34 smithi152 ceph-mon[63606]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 303 KiB/s rd, 274 KiB/s wr, 93 op/s 2024-09-16T00:52:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:34 smithi053 ceph-mon[77492]: pgmap v13: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 303 KiB/s rd, 274 KiB/s wr, 93 op/s 2024-09-16T00:52:36.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:36 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:36 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:36 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:36 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:36 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:36 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:36 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:36.566 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:36 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:37.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:37 smithi053 ceph-mon[77492]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 303 KiB/s rd, 274 KiB/s wr, 94 op/s 2024-09-16T00:52:37.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:37 smithi152 ceph-mon[63606]: pgmap v14: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 303 KiB/s rd, 274 KiB/s wr, 94 op/s 2024-09-16T00:52:39.392 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:39.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:39 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: pgmap v15: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:39 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:40.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: Reconfiguring mon.smithi053 (monmap changed)... 2024-09-16T00:52:40.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: Reconfiguring daemon mon.smithi053 on smithi053 2024-09-16T00:52:40.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:40.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:40.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:40.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:40.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: Reconfiguring mon.smithi053 (monmap changed)... 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: Reconfiguring daemon mon.smithi053 on smithi053 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi053.cjiiek", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:41 smithi053 ceph-mon[77492]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:52:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:41 smithi053 ceph-mon[77492]: Reconfiguring mgr.smithi053.cjiiek (monmap changed)... 2024-09-16T00:52:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:41 smithi053 ceph-mon[77492]: Reconfiguring daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:52:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:41 smithi152 ceph-mon[63606]: pgmap v16: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.0 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-16T00:52:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:41 smithi152 ceph-mon[63606]: Reconfiguring mgr.smithi053.cjiiek (monmap changed)... 2024-09-16T00:52:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:41 smithi152 ceph-mon[63606]: Reconfiguring daemon mgr.smithi053.cjiiek on smithi053 2024-09-16T00:52:43.120 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: Reconfiguring ceph-exporter.smithi053 (monmap changed)... 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: Unable to update caps for client.ceph-exporter.smithi053 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi053"}]: dispatch 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: Reconfiguring daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:52:43.121 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:42 smithi053 ceph-mon[77492]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: Reconfiguring ceph-exporter.smithi053 (monmap changed)... 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:52:43.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: Unable to update caps for client.ceph-exporter.smithi053 2024-09-16T00:52:43.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi053"}]: dispatch 2024-09-16T00:52:43.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:43.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: Reconfiguring daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:52:43.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:42 smithi152 ceph-mon[63606]: pgmap v17: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.4 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-16T00:52:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: Reconfiguring crash.smithi053 (monmap changed)... 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: Reconfiguring daemon crash.smithi053 on smithi053 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:52:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:44.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:44.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: Reconfiguring crash.smithi053 (monmap changed)... 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: Reconfiguring daemon crash.smithi053 on smithi053 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: pgmap v18: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:52:44.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: Reconfiguring osd.0 (monmap changed)... 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:46.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:46 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.0 on smithi053 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: Reconfiguring osd.0 (monmap changed)... 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:46.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:46 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.0 on smithi053 2024-09-16T00:52:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:47 smithi053 ceph-mon[77492]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-16T00:52:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:47 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:47 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:47 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:52:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:47 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:47.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:47 smithi152 ceph-mon[63606]: pgmap v19: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-16T00:52:47.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:47 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:47.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:47 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:47.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:47 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:52:47.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:47 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:48.165 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:48 smithi053 ceph-mon[77492]: Reconfiguring osd.1 (monmap changed)... 2024-09-16T00:52:48.166 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:48 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.1 on smithi053 2024-09-16T00:52:48.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:48 smithi152 ceph-mon[63606]: Reconfiguring osd.1 (monmap changed)... 2024-09-16T00:52:48.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:48 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.1 on smithi053 2024-09-16T00:52:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: Reconfiguring osd.2 (monmap changed)... 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:49 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.2 on smithi053 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: pgmap v20: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: Reconfiguring osd.2 (monmap changed)... 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:49 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.2 on smithi053 2024-09-16T00:52:51.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:51.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:51.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: Reconfiguring mds.cephfs.smithi053.cdsuag (monmap changed)... 2024-09-16T00:52:51.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:52:51.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:51.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: Reconfiguring daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:52:51.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:50 smithi152 ceph-mon[63606]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: Reconfiguring mds.cephfs.smithi053.cdsuag (monmap changed)... 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:51.272 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: Reconfiguring daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:52:51.273 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:50 smithi053 ceph-mon[77492]: pgmap v21: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: Reconfiguring mds.cephfs.smithi053.jsdknu (monmap changed)... 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: Reconfiguring daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:52:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:52 smithi152 ceph-mon[63606]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:52:52.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:52.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:52.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: Reconfiguring mds.cephfs.smithi053.jsdknu (monmap changed)... 2024-09-16T00:52:52.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:52:52.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:52.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: Reconfiguring daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:52:52.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:52 smithi053 ceph-mon[77492]: pgmap v22: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:52:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: Reconfiguring ceph-exporter.smithi152 (monmap changed)... 2024-09-16T00:52:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:54.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:54.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:52:54.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: Unable to update caps for client.ceph-exporter.smithi152 2024-09-16T00:52:54.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi152"}]: dispatch 2024-09-16T00:52:54.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:54.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:53 smithi152 ceph-mon[63606]: Reconfiguring daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:52:54.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: Reconfiguring ceph-exporter.smithi152 (monmap changed)... 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: Unable to update caps for client.ceph-exporter.smithi152 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi152"}]: dispatch 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:54.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:53 smithi053 ceph-mon[77492]: Reconfiguring daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:52:54.974 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:54 smithi152 ceph-mon[63606]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:54.975 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.975 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:54.975 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:52:54.975 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:54 smithi053 ceph-mon[77492]: pgmap v23: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:52:55.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.nlmwrx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T00:52:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T00:52:56.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:57.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:56 smithi053 ceph-mon[77492]: Reconfiguring mgr.smithi152.nlmwrx (monmap changed)... 2024-09-16T00:52:57.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:56 smithi053 ceph-mon[77492]: Reconfiguring daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:52:57.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:56 smithi053 ceph-mon[77492]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:52:57.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:56 smithi152 ceph-mon[63606]: Reconfiguring mgr.smithi152.nlmwrx (monmap changed)... 2024-09-16T00:52:57.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:56 smithi152 ceph-mon[63606]: Reconfiguring daemon mgr.smithi152.nlmwrx on smithi152 2024-09-16T00:52:57.173 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:56 smithi152 ceph-mon[63606]: pgmap v24: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:58.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:58 smithi152 ceph-mon[63606]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T00:52:58.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:58.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:58 smithi053 ceph-mon[77492]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-16T00:52:59.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:59 smithi152 ceph-mon[63606]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:59.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:59.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:59.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:52:59.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:52:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:52:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:59 smithi053 ceph-mon[77492]: pgmap v25: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:52:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:52:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:52:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:52:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:00.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: Reconfiguring osd.3 (monmap changed)... 2024-09-16T00:53:00.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.3 on smithi152 2024-09-16T00:53:00.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:00.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:00.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:00.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:53:00.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: Reconfiguring osd.3 (monmap changed)... 2024-09-16T00:53:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.3 on smithi152 2024-09-16T00:53:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:53:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:01.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: Reconfiguring osd.4 (monmap changed)... 2024-09-16T00:53:01.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.4 on smithi152 2024-09-16T00:53:01.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:01.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:01.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:01.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:53:01.423 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: Reconfiguring osd.4 (monmap changed)... 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.4 on smithi152 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: pgmap v26: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:53:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:02.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:02 smithi152 ceph-mon[63606]: Reconfiguring osd.5 (monmap changed)... 2024-09-16T00:53:02.284 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:02 smithi152 ceph-mon[63606]: Reconfiguring daemon osd.5 on smithi152 2024-09-16T00:53:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:02 smithi053 ceph-mon[77492]: Reconfiguring osd.5 (monmap changed)... 2024-09-16T00:53:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:02 smithi053 ceph-mon[77492]: Reconfiguring daemon osd.5 on smithi152 2024-09-16T00:53:03.373 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:03 smithi053 ceph-mon[77492]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:03.373 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:03 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:03.373 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:03 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:03.373 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:03 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:53:03.373 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:03 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:03.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:03 smithi152 ceph-mon[63606]: pgmap v27: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:03.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:03 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:03.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:03 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:03.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:03 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:53:03.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:03 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 -- 172.21.15.53:0/560925504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 msgr2=0x7fbf980ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/560925504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980ff540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009910 tx=0x7fbf94009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 -- 172.21.15.53:0/560925504 shutdown_connections 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/560925504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 0x7fbf98100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/560925504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980ff540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 -- 172.21.15.53:0/560925504 >> 172.21.15.53:0/560925504 conn(0x7fbf980fa780 msgr2=0x7fbf980fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 -- 172.21.15.53:0/560925504 shutdown_connections 2024-09-16T00:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.684+0000 7fbf9f90f700 1 -- 172.21.15.53:0/560925504 wait complete. 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 Processor -- start 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 -- start start 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 0x7fbf9819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9819ade0 con 0x7fbf980ff130 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9f90f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9819af20 con 0x7fbf981003d0 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9d6ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9d6ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36490/0 (socket says 172.21.15.53:36490) 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9d6ab700 1 -- 172.21.15.53:0/3529817727 learned_addr learned my addr 172.21.15.53:0/3529817727 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.685+0000 7fbf9ceaa700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 0x7fbf9819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9d6ab700 1 -- 172.21.15.53:0/3529817727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 msgr2=0x7fbf9819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9d6ab700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 0x7fbf9819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9d6ab700 1 -- 172.21.15.53:0/3529817727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940095f0 con 0x7fbf980ff130 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9d6ab700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf9400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9401d070 con 0x7fbf980ff130 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9819b1a0 con 0x7fbf980ff130 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf9400f460 con 0x7fbf980ff130 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf94021640 con 0x7fbf980ff130 2024-09-16T00:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.686+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9819b690 con 0x7fbf980ff130 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.687+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf98107c10 con 0x7fbf980ff130 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.688+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fbf94003a60 con 0x7fbf980ff130 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.688+0000 7fbf8e7fc700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 0x7fbf84070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.688+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbf9408fa30 con 0x7fbf980ff130 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.688+0000 7fbf9ceaa700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 0x7fbf84070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.689+0000 7fbf9ceaa700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 0x7fbf84070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf98069620 tx=0x7fbf8800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.693+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbf9405c590 con 0x7fbf980ff130 2024-09-16T00:53:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.949+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf98104d20 con 0x7fbf8406e7c0 2024-09-16T00:53:03.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.951+0000 7fbf8e7fc700 1 -- 172.21.15.53:0/3529817727 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbf98104d20 con 0x7fbf8406e7c0 2024-09-16T00:53:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 msgr2=0x7fbf84070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 0x7fbf84070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf98069620 tx=0x7fbf8800b410 comp rx=0 tx=0).stop 2024-09-16T00:53:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 msgr2=0x7fbf980690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf9400bd70 comp rx=0 tx=0).stop 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 shutdown_connections 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fbf8406e7c0 0x7fbf84070c70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf980ff130 0x7fbf980690a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 --2- 172.21.15.53:0/3529817727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf981003d0 0x7fbf9819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.953+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 >> 172.21.15.53:0/3529817727 conn(0x7fbf980fa780 msgr2=0x7fbf98103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.954+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 shutdown_connections 2024-09-16T00:53:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:03.954+0000 7fbf9f90f700 1 -- 172.21.15.53:0/3529817727 wait complete. 2024-09-16T00:53:03.965 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:53:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 -- 172.21.15.53:0/2082603668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 msgr2=0x7fb658100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/2082603668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb658100790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb648009910 tx=0x7fb648009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 -- 172.21.15.53:0/2082603668 shutdown_connections 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/2082603668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb658100790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/2082603668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb6580ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 -- 172.21.15.53:0/2082603668 >> 172.21.15.53:0/2082603668 conn(0x7fb6580fa6d0 msgr2=0x7fb6580fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.064+0000 7fb65f3d8700 1 -- 172.21.15.53:0/2082603668 shutdown_connections 2024-09-16T00:53:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.065+0000 7fb65f3d8700 1 -- 172.21.15.53:0/2082603668 wait complete. 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.065+0000 7fb65f3d8700 1 Processor -- start 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.065+0000 7fb65f3d8700 1 -- start start 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65f3d8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65f3d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65f3d8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65819adc0 con 0x7fb658100340 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65f3d8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65819af00 con 0x7fb6580ff140 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65d174700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36510/0 (socket says 172.21.15.53:36510) 2024-09-16T00:53:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65d174700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:41280/0 (socket says 172.21.15.53:41280) 2024-09-16T00:53:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 -- 172.21.15.53:0/206056029 learned_addr learned my addr 172.21.15.53:0/206056029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 -- 172.21.15.53:0/206056029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 msgr2=0x7fb658069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 -- 172.21.15.53:0/206056029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480095f0 con 0x7fb658100340 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65d174700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.066+0000 7fb65c973700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb648005b40 tx=0x7fb64800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.067+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb64801d070 con 0x7fb658100340 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.067+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb64800f460 con 0x7fb658100340 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.067+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65819b180 con 0x7fb658100340 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.067+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb648021600 con 0x7fb658100340 2024-09-16T00:53:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.067+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65819b670 con 0x7fb658100340 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.068+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb658107c90 con 0x7fb658100340 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.068+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb64800f5d0 con 0x7fb658100340 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.069+0000 7fb64e7fc700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 0x7fb644070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.069+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb64808fba0 con 0x7fb658100340 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.069+0000 7fb65d174700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 0x7fb644070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.070+0000 7fb65d174700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 0x7fb644070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6581001a0 tx=0x7fb654007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.073+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb64805c660 con 0x7fb658100340 2024-09-16T00:53:04.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.311+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb658104c90 con 0x7fb64406e7b0 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: Reconfiguring mds.cephfs.smithi152.gatezw (monmap changed)... 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: Reconfiguring daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:53:04.312 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:04 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.312+0000 7fb64e7fc700 1 -- 172.21.15.53:0/206056029 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb658104c90 con 0x7fb64406e7b0 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 msgr2=0x7fb644070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 0x7fb644070c60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6581001a0 tx=0x7fb654007400 comp rx=0 tx=0).stop 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 msgr2=0x7fb65819a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb648005b40 tx=0x7fb64800bd70 comp rx=0 tx=0).stop 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 shutdown_connections 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb64406e7b0 0x7fb644070c60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6580ff140 0x7fb658069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 --2- 172.21.15.53:0/206056029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb658100340 0x7fb65819a7f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 >> 172.21.15.53:0/206056029 conn(0x7fb6580fa6d0 msgr2=0x7fb658103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 shutdown_connections 2024-09-16T00:53:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.315+0000 7fb65f3d8700 1 -- 172.21.15.53:0/206056029 wait complete. 2024-09-16T00:53:04.347 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: Reconfiguring mds.cephfs.smithi152.gatezw (monmap changed)... 2024-09-16T00:53:04.347 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: Reconfiguring daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:53:04.347 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:04.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:04.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:53:04.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:04 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 -- 172.21.15.53:0/1127305042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f41003d0 msgr2=0x7f57f4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 --2- 172.21.15.53:0/1127305042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f41003d0 0x7f57f4100840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009910 tx=0x7f57e0009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 -- 172.21.15.53:0/1127305042 shutdown_connections 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 --2- 172.21.15.53:0/1127305042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f41003d0 0x7f57f4100840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 --2- 172.21.15.53:0/1127305042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f40ff130 0x7f57f40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 -- 172.21.15.53:0/1127305042 >> 172.21.15.53:0/1127305042 conn(0x7f57f40fa780 msgr2=0x7f57f40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.425+0000 7f57fad82700 1 -- 172.21.15.53:0/1127305042 shutdown_connections 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 -- 172.21.15.53:0/1127305042 wait complete. 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 Processor -- start 2024-09-16T00:53:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 -- start start 2024-09-16T00:53:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f41003d0 0x7f57f4195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f41965c0 con 0x7f57f40ff130 2024-09-16T00:53:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57fad82700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4196700 con 0x7f57f41003d0 2024-09-16T00:53:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.426+0000 7f57f8b1e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36528/0 (socket says 172.21.15.53:36528) 2024-09-16T00:53:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 -- 172.21.15.53:0/1968044734 learned_addr learned my addr 172.21.15.53:0/1968044734 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f3fff700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f41003d0 0x7f57f4195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 -- 172.21.15.53:0/1968044734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f41003d0 msgr2=0x7f57f4195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f41003d0 0x7f57f4195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 -- 172.21.15.53:0/1968044734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00095f0 con 0x7f57f40ff130 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f8b1e700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57e800d8d0 tx=0x7f57e800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e80098a0 con 0x7f57f40ff130 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f419b1b0 con 0x7f57f40ff130 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57e8010460 con 0x7f57f40ff130 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57e800f5f0 con 0x7f57f40ff130 2024-09-16T00:53:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.427+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f419b700 con 0x7f57f40ff130 2024-09-16T00:53:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.428+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f4107c10 con 0x7f57f40ff130 2024-09-16T00:53:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.429+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f57e8009a00 con 0x7f57f40ff130 2024-09-16T00:53:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.429+0000 7f57f1ffb700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 0x7f57e4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.430+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f57e808e720 con 0x7f57f40ff130 2024-09-16T00:53:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.430+0000 7f57f3fff700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 0x7f57e4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.430+0000 7f57f3fff700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 0x7f57e4070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006010 tx=0x7f57e000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.434+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f57e805b280 con 0x7f57f40ff130 2024-09-16T00:53:04.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.658+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57f4068c50 con 0x7f57e406e7b0 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.668+0000 7f57f1ffb700 1 -- 172.21.15.53:0/1968044734 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f57f4068c50 con 0x7f57e406e7b0 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (9m) 38s ago 10m 25.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (11m) 38s ago 11m 7902k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (10m) 29s ago 10m 7562k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (11m) 38s ago 11m 6660k - 18.2.0 dc2bc1663786 af354b8be614 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (10m) 29s ago 10m 6660k - 18.2.0 dc2bc1663786 1b7f5b1f5b39 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (9m) 38s ago 10m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:53:04.669 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (5m) 38s ago 5m 185M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (5m) 38s ago 5m 118M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (5m) 29s ago 5m 16.3M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (5m) 29s ago 5m 14.6M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (2m) 38s ago 12m 473M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (78s) 29s ago 10m 438M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (58s) 38s ago 12m 32.6M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (32s) 29s ago 9m 22.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (11m) 38s ago 11m 16.1M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (10m) 29s ago 10m 16.1M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:53:04.670 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (9m) 38s ago 9m 265M 1217M 18.2.0 dc2bc1663786 b2b2b8c75490 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (8m) 38s ago 8m 275M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (8m) 38s ago 8m 228M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (7m) 29s ago 7m 289M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (7m) 29s ago 7m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (6m) 29s ago 6m 258M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:53:04.671 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (84s) 38s ago 10m 62.8M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 msgr2=0x7f57e4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 0x7f57e4070c60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006010 tx=0x7f57e000b560 comp rx=0 tx=0).stop 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 msgr2=0x7f57f4195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57e800d8d0 tx=0x7f57e800dbe0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 shutdown_connections 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f57e406e7b0 0x7f57e4070c60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57f40ff130 0x7f57f4195a60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 --2- 172.21.15.53:0/1968044734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f41003d0 0x7f57f4195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 >> 172.21.15.53:0/1968044734 conn(0x7f57f40fa780 msgr2=0x7f57f4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 shutdown_connections 2024-09-16T00:53:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.670+0000 7f57fad82700 1 -- 172.21.15.53:0/1968044734 wait complete. 2024-09-16T00:53:04.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 -- 172.21.15.53:0/1569382398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c073730 msgr2=0x7fd91c073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1569382398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c073730 0x7fd91c073ba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd910009910 tx=0x7fd910009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 -- 172.21.15.53:0/1569382398 shutdown_connections 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1569382398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c073730 0x7fd91c073ba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1569382398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c074d00 0x7fd91c073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 -- 172.21.15.53:0/1569382398 >> 172.21.15.53:0/1569382398 conn(0x7fd91c0fb7f0 msgr2=0x7fd91c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 -- 172.21.15.53:0/1569382398 shutdown_connections 2024-09-16T00:53:04.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.779+0000 7fd9226e8700 1 -- 172.21.15.53:0/1569382398 wait complete. 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 Processor -- start 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 -- start start 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c073730 0x7fd91c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1987b0 con 0x7fd91c074d00 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd9226e8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c198920 con 0x7fd91c073730 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd91b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd91b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36542/0 (socket says 172.21.15.53:36542) 2024-09-16T00:53:04.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd91b7fe700 1 -- 172.21.15.53:0/1924950204 learned_addr learned my addr 172.21.15.53:0/1924950204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:04.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.780+0000 7fd91bfff700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c073730 0x7fd91c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd91b7fe700 1 -- 172.21.15.53:0/1924950204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c073730 msgr2=0x7fd91c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:04.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd91b7fe700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c073730 0x7fd91c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:04.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd91b7fe700 1 -- 172.21.15.53:0/1924950204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100095f0 con 0x7fd91c074d00 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd91b7fe700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd910006010 tx=0x7fd91000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd91001d070 con 0x7fd91c074d00 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd91000f460 con 0x7fd91c074d00 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c19d350 con 0x7fd91c074d00 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd910021640 con 0x7fd91c074d00 2024-09-16T00:53:04.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.781+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c19d840 con 0x7fd91c074d00 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.782+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c10af70 con 0x7fd91c074d00 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.783+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fd91000fab0 con 0x7fd91c074d00 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.783+0000 7fd9197fa700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 0x7fd904070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.783+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd91008fb10 con 0x7fd91c074d00 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.783+0000 7fd91bfff700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 0x7fd904070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:04.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.784+0000 7fd91bfff700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 0x7fd904070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005950 tx=0x7fd90c00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:04.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:04.788+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd910058bc0 con 0x7fd91c074d00 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.093+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd91c19dee0 con 0x7fd91c074d00 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.093+0000 7fd9197fa700 1 -- 172.21.15.53:0/1924950204 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7fd910061e60 con 0x7fd91c074d00 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:53:05.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-16T00:53:05.095 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:53:05.096 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:53:05.096 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 msgr2=0x7fd904070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 0x7fd904070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005950 tx=0x7fd90c00a300 comp rx=0 tx=0).stop 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 msgr2=0x7fd91c1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd910006010 tx=0x7fd91000bd70 comp rx=0 tx=0).stop 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 shutdown_connections 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd90406e7c0 0x7fd904070c70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd91c073730 0x7fd91c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 --2- 172.21.15.53:0/1924950204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c074d00 0x7fd91c1981b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 >> 172.21.15.53:0/1924950204 conn(0x7fd91c0fb7f0 msgr2=0x7fd91c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 shutdown_connections 2024-09-16T00:53:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.096+0000 7fd9226e8700 1 -- 172.21.15.53:0/1924950204 wait complete. 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 -- 172.21.15.53:0/214168119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84103680 msgr2=0x7f7b84105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/214168119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84103680 0x7f7b84105a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009910 tx=0x7f7b70009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 -- 172.21.15.53:0/214168119 shutdown_connections 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/214168119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84103680 0x7f7b84105a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/214168119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84100d60 0x7f7b84103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 -- 172.21.15.53:0/214168119 >> 172.21.15.53:0/214168119 conn(0x7f7b840fa780 msgr2=0x7f7b840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 -- 172.21.15.53:0/214168119 shutdown_connections 2024-09-16T00:53:05.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 -- 172.21.15.53:0/214168119 wait complete. 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.210+0000 7f7b8ab51700 1 Processor -- start 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b8ab51700 1 -- start start 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b8ab51700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b8ab51700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 0x7f7b840fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b8ab51700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840ff250 con 0x7f7b84100d60 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b8ab51700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840ff390 con 0x7f7b84103680 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36562/0 (socket says 172.21.15.53:36562) 2024-09-16T00:53:05.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 -- 172.21.15.53:0/4257224654 learned_addr learned my addr 172.21.15.53:0/4257224654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b83fff700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 0x7f7b840fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 -- 172.21.15.53:0/4257224654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 msgr2=0x7f7b840fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 0x7f7b840fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 -- 172.21.15.53:0/4257224654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b700095f0 con 0x7f7b84100d60 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b83fff700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 0x7f7b840fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.211+0000 7f7b888ed700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800d8d0 tx=0x7f7b7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.212+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b780041f0 con 0x7f7b84100d60 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.212+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b840ff670 con 0x7f7b84100d60 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.212+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b78007620 con 0x7f7b84100d60 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.212+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b78003be0 con 0x7f7b84100d60 2024-09-16T00:53:05.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.212+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8419db40 con 0x7f7b84100d60 2024-09-16T00:53:05.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.213+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8418fbe0 con 0x7f7b84100d60 2024-09-16T00:53:05.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.213+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7b78004350 con 0x7f7b84100d60 2024-09-16T00:53:05.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.214+0000 7f7b81ffb700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 0x7f7b74070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.214+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7b7808e3e0 con 0x7f7b84100d60 2024-09-16T00:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.214+0000 7f7b83fff700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 0x7f7b74070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.215+0000 7f7b83fff700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 0x7f7b74070c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b70005b40 tx=0x7f7b70005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.218+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7b7805af40 con 0x7f7b84100d60 2024-09-16T00:53:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: Reconfiguring mds.cephfs.smithi152.ocdywv (monmap changed)... 2024-09-16T00:53:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: Reconfiguring daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:53:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:05.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:05.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:05 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1924950204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.484+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b8402ce70 con 0x7f7b84100d60 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: Reconfiguring mds.cephfs.smithi152.ocdywv (monmap changed)... 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: Reconfiguring daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: pgmap v28: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:05.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:05.487 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:05 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1924950204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:05.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.484+0000 7f7b81ffb700 1 -- 172.21.15.53:0/4257224654 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f7b7805aad0 con 0x7f7b84100d60 2024-09-16T00:53:05.487 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:53:05.487 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:53:05.487 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:53:05.487 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:53:05.488 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:53:05.489 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:53:05.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:05.491 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:05.491 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:05.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 msgr2=0x7f7b74070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 0x7f7b74070c70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b70005b40 tx=0x7f7b70005ab0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 msgr2=0x7f7b841006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800d8d0 tx=0x7f7b7800dc90 comp rx=0 tx=0).stop 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 shutdown_connections 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7b7406e7c0 0x7f7b74070c70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b84100d60 0x7f7b841006c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 --2- 172.21.15.53:0/4257224654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b84103680 0x7f7b840fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 >> 172.21.15.53:0/4257224654 conn(0x7f7b840fa780 msgr2=0x7f7b840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 shutdown_connections 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.488+0000 7f7b8ab51700 1 -- 172.21.15.53:0/4257224654 wait complete. 2024-09-16T00:53:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:53:05.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 -- 172.21.15.53:0/1683909662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 msgr2=0x7fa84c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 --2- 172.21.15.53:0/1683909662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c0ff540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009910 tx=0x7fa83c009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:05.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 -- 172.21.15.53:0/1683909662 shutdown_connections 2024-09-16T00:53:05.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 --2- 172.21.15.53:0/1683909662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 0x7fa84c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 --2- 172.21.15.53:0/1683909662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c0ff540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 -- 172.21.15.53:0/1683909662 >> 172.21.15.53:0/1683909662 conn(0x7fa84c0fa780 msgr2=0x7fa84c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 -- 172.21.15.53:0/1683909662 shutdown_connections 2024-09-16T00:53:05.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.599+0000 7fa8509e3700 1 -- 172.21.15.53:0/1683909662 wait complete. 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 Processor -- start 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 -- start start 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 0x7fa84c195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c196600 con 0x7fa84c0ff130 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa8509e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c196740 con 0x7fa84c1003d0 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36582/0 (socket says 172.21.15.53:36582) 2024-09-16T00:53:05.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 -- 172.21.15.53:0/411519842 learned_addr learned my addr 172.21.15.53:0/411519842 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa849d9b700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 0x7fa84c195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 -- 172.21.15.53:0/411519842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 msgr2=0x7fa84c195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 0x7fa84c195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.600+0000 7fa84a59c700 1 -- 172.21.15.53:0/411519842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0095f0 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa84a59c700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa83c006010 tx=0x7fa83c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83c01d070 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa83c00f460 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c19b190 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83c017630 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.601+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c19b680 con 0x7fa84c0ff130 2024-09-16T00:53:05.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.602+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c107c10 con 0x7fa84c0ff130 2024-09-16T00:53:05.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.602+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa83c017790 con 0x7fa84c0ff130 2024-09-16T00:53:05.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.603+0000 7fa83b7fe700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 0x7fa834070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.603+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa83c08fd30 con 0x7fa84c0ff130 2024-09-16T00:53:05.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.603+0000 7fa849d9b700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 0x7fa834070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.603+0000 7fa849d9b700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 0x7fa834070c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa840005950 tx=0x7fa8400058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.607+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa83c05c890 con 0x7fa84c0ff130 2024-09-16T00:53:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.849+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa84c19bcc0 con 0x7fa83406e7c0 2024-09-16T00:53:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.850+0000 7fa83b7fe700 1 -- 172.21.15.53:0/411519842 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa84c19bcc0 con 0x7fa83406e7c0 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "mon" 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "4/23 daemons upgraded", 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading crash daemons", 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:53:05.851 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:53:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 msgr2=0x7fa834070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 0x7fa834070c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa840005950 tx=0x7fa8400058e0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 msgr2=0x7fa84c195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa83c006010 tx=0x7fa83c00be20 comp rx=0 tx=0).stop 2024-09-16T00:53:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 shutdown_connections 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa83406e7c0 0x7fa834070c70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa84c0ff130 0x7fa84c195aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 --2- 172.21.15.53:0/411519842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa84c1003d0 0x7fa84c195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 >> 172.21.15.53:0/411519842 conn(0x7fa84c0fa780 msgr2=0x7fa84c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 shutdown_connections 2024-09-16T00:53:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.852+0000 7fa8509e3700 1 -- 172.21.15.53:0/411519842 wait complete. 2024-09-16T00:53:05.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- 172.21.15.53:0/2966506142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 msgr2=0x7f95600ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 --2- 172.21.15.53:0/2966506142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f95600ff560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f955c009910 tx=0x7f955c009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- 172.21.15.53:0/2966506142 shutdown_connections 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 --2- 172.21.15.53:0/2966506142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 0x7f9560100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 --2- 172.21.15.53:0/2966506142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f95600ff560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- 172.21.15.53:0/2966506142 >> 172.21.15.53:0/2966506142 conn(0x7f95600fa7a0 msgr2=0x7f95600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- 172.21.15.53:0/2966506142 shutdown_connections 2024-09-16T00:53:05.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- 172.21.15.53:0/2966506142 wait complete. 2024-09-16T00:53:05.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 Processor -- start 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.966+0000 7f9567d7a700 1 -- start start 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9567d7a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9567d7a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 0x7f956019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9567d7a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019b090 con 0x7f95600ff150 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9567d7a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019b1d0 con 0x7f95601003f0 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36602/0 (socket says 172.21.15.53:36602) 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 -- 172.21.15.53:0/4048812335 learned_addr learned my addr 172.21.15.53:0/4048812335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565315700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 0x7f956019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 -- 172.21.15.53:0/4048812335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 msgr2=0x7f956019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 0x7f956019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 -- 172.21.15.53:0/4048812335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0095f0 con 0x7f95600ff150 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.967+0000 7f9565b16700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f955c00bd70 tx=0x7f955c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.968+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f955c01d070 con 0x7f95600ff150 2024-09-16T00:53:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.968+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956019b450 con 0x7f95600ff150 2024-09-16T00:53:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.968+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f955c005940 con 0x7f95600ff150 2024-09-16T00:53:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.968+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f955c021430 con 0x7f95600ff150 2024-09-16T00:53:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.968+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956019b940 con 0x7f95600ff150 2024-09-16T00:53:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.969+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560068ab0 con 0x7f95600ff150 2024-09-16T00:53:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.969+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f955c00f860 con 0x7f95600ff150 2024-09-16T00:53:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.970+0000 7f9556ffd700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 0x7f954c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.970+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f955c08fbc0 con 0x7f95600ff150 2024-09-16T00:53:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.970+0000 7f9565315700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 0x7f954c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.971+0000 7f9565315700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 0x7f954c070c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9560069eb0 tx=0x7f955000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:05.974+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f955c05c720 con 0x7f95600ff150 2024-09-16T00:53:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.283+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f956019bc20 con 0x7f95600ff150 2024-09-16T00:53:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.284+0000 7f9556ffd700 1 -- 172.21.15.53:0/4048812335 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f955c05c2b0 con 0x7f95600ff150 2024-09-16T00:53:06.285 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:53:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 msgr2=0x7f954c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 0x7f954c070c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9560069eb0 tx=0x7f955000a380 comp rx=0 tx=0).stop 2024-09-16T00:53:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 msgr2=0x7f9560069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f955c00bd70 tx=0x7f955c00bda0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 shutdown_connections 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f954c06e7c0 0x7f954c070c70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600ff150 0x7f9560069930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 --2- 172.21.15.53:0/4048812335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95601003f0 0x7f956019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 >> 172.21.15.53:0/4048812335 conn(0x7f95600fa7a0 msgr2=0x7f95601036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 shutdown_connections 2024-09-16T00:53:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:06.286+0000 7f9567d7a700 1 -- 172.21.15.53:0/4048812335 wait complete. 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all mon 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi053"}]: dispatch 2024-09-16T00:53:06.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi053"}]': finished 2024-09-16T00:53:06.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-09-16T00:53:06.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-09-16T00:53:06.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:06 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/4257224654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:53:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all mon 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi053"}]: dispatch 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi053"}]': finished 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-09-16T00:53:06.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:06 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/4257224654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: pgmap v29: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/4048812335' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:53:07.158 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: pgmap v29: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/4048812335' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi053", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:53:07.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:08.382 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:08 smithi053 ceph-mon[77492]: Upgrade: Updating crash.smithi053 (1/2) 2024-09-16T00:53:08.382 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:08 smithi053 ceph-mon[77492]: Deploying daemon crash.smithi053 on smithi053 2024-09-16T00:53:08.446 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:08 smithi152 ceph-mon[63606]: Upgrade: Updating crash.smithi053 (1/2) 2024-09-16T00:53:08.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:08 smithi152 ceph-mon[63606]: Deploying daemon crash.smithi053 on smithi053 2024-09-16T00:53:09.278 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:09 smithi053 ceph-mon[77492]: pgmap v30: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:09.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:09 smithi152 ceph-mon[63606]: pgmap v30: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:11.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:11 smithi152 ceph-mon[63606]: pgmap v31: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:11.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:11 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:11.288 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:11 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:11 smithi053 ceph-mon[77492]: pgmap v31: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:11 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:11 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: Upgrade: Updating crash.smithi152 (2/2) 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: Deploying daemon crash.smithi152 on smithi152 2024-09-16T00:53:13.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:12 smithi152 ceph-mon[63606]: pgmap v32: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: Upgrade: Updating crash.smithi152 (2/2) 2024-09-16T00:53:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T00:53:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:13.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: Deploying daemon crash.smithi152 on smithi152 2024-09-16T00:53:13.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:12 smithi053 ceph-mon[77492]: pgmap v32: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:15 smithi152 ceph-mon[63606]: pgmap v33: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:15.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:15 smithi053 ceph-mon[77492]: pgmap v33: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:16.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:16.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:16.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:17.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:17 smithi053 ceph-mon[77492]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:17.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:17 smithi152 ceph-mon[63606]: pgmap v34: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:19 smithi053 ceph-mon[77492]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:19 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:19 smithi152 ceph-mon[63606]: pgmap v35: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:19 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:19 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:19 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:19 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:21 smithi152 ceph-mon[63606]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:21 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:21 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:21 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:21 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:21 smithi053 ceph-mon[77492]: pgmap v36: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:21.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:21 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:21 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:21 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:21.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:21 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:22.804 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:22.804 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:22.805 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:22 smithi053 ceph-mon[77492]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:22.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:22.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:22.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:22 smithi152 ceph-mon[63606]: pgmap v37: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:25.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:25.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi053"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi053"}]': finished 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-09-16T00:53:25.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: pgmap v38: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi053"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi053"}]': finished 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-09-16T00:53:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all crash 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: Upgrade: osd.0 is safe to restart 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:53:26.511 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all crash 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: Upgrade: osd.0 is safe to restart 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T00:53:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:27 smithi053 ceph-mon[77492]: Upgrade: Updating osd.0 2024-09-16T00:53:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:27 smithi053 ceph-mon[77492]: Deploying daemon osd.0 on smithi053 2024-09-16T00:53:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:27 smithi053 ceph-mon[77492]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:27 smithi152 ceph-mon[63606]: Upgrade: Updating osd.0 2024-09-16T00:53:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:27 smithi152 ceph-mon[63606]: Deploying daemon osd.0 on smithi053 2024-09-16T00:53:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:27 smithi152 ceph-mon[63606]: pgmap v39: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:29.438 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:29 smithi053 systemd[1]: Stopping Ceph osd.0 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:53:29.439 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:29 smithi053 ceph-mon[77492]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:29.439 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:29 smithi152 ceph-mon[63606]: pgmap v40: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:29.819 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:29 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[43046]: 2024-09-16T00:53:29.436+0000 7f031c4a0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:53:29.819 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:29 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[43046]: 2024-09-16T00:53:29.436+0000 7f031c4a0700 -1 osd.0 49 *** Got signal Terminated *** 2024-09-16T00:53:29.819 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:29 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[43046]: 2024-09-16T00:53:29.436+0000 7f031c4a0700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:53:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:30 smithi053 ceph-mon[77492]: osd.0 marked itself down and dead 2024-09-16T00:53:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:30 smithi152 ceph-mon[63606]: osd.0 marked itself down and dead 2024-09-16T00:53:31.130 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:30 smithi053 podman[83266]: 2024-09-16 00:53:30.829720755 +0000 UTC m=+1.519582934 container died b2b2b8c75490abbf5c711909c6776b8912f8d8a7423466e535d00e44ab271d11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=HEAD, io.buildah.version=1.29.1) 2024-09-16T00:53:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:31 smithi053 ceph-mon[77492]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:31 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:53:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:31 smithi053 ceph-mon[77492]: osdmap e50: 6 total, 5 up, 6 in 2024-09-16T00:53:31.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:31 smithi053 podman[83266]: 2024-09-16 00:53:31.337680363 +0000 UTC m=+2.027542574 container cleanup b2b2b8c75490abbf5c711909c6776b8912f8d8a7423466e535d00e44ab271d11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, maintainer=Guillaume Abrioux ) 2024-09-16T00:53:31.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:31 smithi053 bash[83266]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0 2024-09-16T00:53:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:31 smithi152 ceph-mon[63606]: pgmap v41: 65 pgs: 65 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:53:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:31 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:53:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:31 smithi152 ceph-mon[63606]: osdmap e50: 6 total, 5 up, 6 in 2024-09-16T00:53:31.923 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:31 smithi053 podman[83282]: 2024-09-16 00:53:31.589135426 +0000 UTC m=+0.753461461 container remove b2b2b8c75490abbf5c711909c6776b8912f8d8a7423466e535d00e44ab271d11 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, ceph=True) 2024-09-16T00:53:32.252 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:31 smithi053 podman[83369]: 2024-09-16 00:53:31.923603766 +0000 UTC m=+0.111394622 container create 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-16T00:53:32.252 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:31 smithi053 podman[83369]: 2024-09-16 00:53:31.829049178 +0000 UTC m=+0.016840035 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:53:32.252 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:32 smithi053 podman[83369]: 2024-09-16 00:53:32.251994093 +0000 UTC m=+0.439784952 container init 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-16T00:53:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:32 smithi053 ceph-mon[77492]: osdmap e51: 6 total, 5 up, 6 in 2024-09-16T00:53:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:32 smithi053 ceph-mon[77492]: pgmap v44: 65 pgs: 12 peering, 8 stale+active+clean, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:32.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:32 smithi053 podman[83369]: 2024-09-16 00:53:32.256380209 +0000 UTC m=+0.444171067 container start 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T00:53:32.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:32 smithi053 podman[83369]: 2024-09-16 00:53:32.34348887 +0000 UTC m=+0.531279752 container attach 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T00:53:32.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:32 smithi053 podman[83369]: 2024-09-16 00:53:32.446988664 +0000 UTC m=+0.634779521 container died 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T00:53:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:32 smithi152 ceph-mon[63606]: osdmap e51: 6 total, 5 up, 6 in 2024-09-16T00:53:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:32 smithi152 ceph-mon[63606]: pgmap v44: 65 pgs: 12 peering, 8 stale+active+clean, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:53:33.379 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 podman[83393]: 2024-09-16 00:53:33.12281369 +0000 UTC m=+0.670032885 container remove 5dbe916b682db23b97fbc83050383231ae12bdf322600cc6c9ed79d17f9f4be2 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T00:53:33.379 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-16T00:53:33.379 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 systemd[1]: Stopped Ceph osd.0 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:53:33.379 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.0.service: Consumed 1min 7.390s CPU time. 2024-09-16T00:53:33.379 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:33 smithi053 ceph-mon[77492]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-09-16T00:53:33.639 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 systemd[1]: Starting Ceph osd.0 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:53:33.639 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 podman[83495]: 2024-09-16 00:53:33.500267802 +0000 UTC m=+0.017185750 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:53:33.640 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:33 smithi053 podman[83495]: 2024-09-16 00:53:33.639645485 +0000 UTC m=+0.156563417 container create ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T00:53:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:33 smithi152 ceph-mon[63606]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-09-16T00:53:34.209 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 podman[83495]: 2024-09-16 00:53:34.068735215 +0000 UTC m=+0.585653148 container init ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-16T00:53:34.209 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 podman[83495]: 2024-09-16 00:53:34.072436987 +0000 UTC m=+0.589354922 container start ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T00:53:34.210 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 podman[83495]: 2024-09-16 00:53:34.160397678 +0000 UTC m=+0.677315619 container attach ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T00:53:34.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:34 smithi053 ceph-mon[77492]: pgmap v45: 65 pgs: 12 peering, 8 stale+active+clean, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:53:34.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:53:34.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 bash[83495]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:53:34.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:53:34.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 bash[83495]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:53:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:34 smithi152 ceph-mon[63606]: pgmap v45: 65 pgs: 12 peering, 8 stale+active+clean, 45 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:53:34.962 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T00:53:34.962 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 bash[83495]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T00:53:34.962 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T00:53:34.962 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:34 smithi053 bash[83495]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 bash[83495]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 bash[83495]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 bash[83495]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 bash[83495]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate[83520]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 bash[83495]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T00:53:35.570 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 podman[83495]: 2024-09-16 00:53:35.27717519 +0000 UTC m=+1.794093142 container died ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T00:53:36.257 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:35 smithi053 podman[83656]: 2024-09-16 00:53:35.914907475 +0000 UTC m=+0.631154368 container remove ca537e69ade00fc6f43960568bca6c347c8bb508b79fbc47c43820bab0753b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-16T00:53:36.257 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 podman[83716]: 2024-09-16 00:53:36.040193942 +0000 UTC m=+0.017414243 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:53:36.257 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 podman[83716]: 2024-09-16 00:53:36.15765182 +0000 UTC m=+0.134872115 container create b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3899064924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 msgr2=0x7f3c880ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3899064924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c880ff560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b0a0 tx=0x7f3c7800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3899064924 shutdown_connections 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3899064924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c881003f0 0x7f3c88100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3899064924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c880ff560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3899064924 >> 172.21.15.53:0/3899064924 conn(0x7f3c880fa7a0 msgr2=0x7f3c880fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3899064924 shutdown_connections 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3899064924 wait complete. 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.401+0000 7f3c8d4bc700 1 Processor -- start 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c8d4bc700 1 -- start start 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c8d4bc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c8d4bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c881003f0 0x7f3c881017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c8d4bc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88101d10 con 0x7f3c880ff150 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c8d4bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88101e50 con 0x7f3c881003f0 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48288/0 (socket says 172.21.15.53:48288) 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 -- 172.21.15.53:0/3965788546 learned_addr learned my addr 172.21.15.53:0/3965788546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 -- 172.21.15.53:0/3965788546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c881003f0 msgr2=0x7f3c881017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c881003f0 0x7f3c881017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 -- 172.21.15.53:0/3965788546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78009d00 con 0x7f3c880ff150 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.402+0000 7f3c86ffd700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c780077b0 tx=0x7f3c78003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.403+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c7800e040 con 0x7f3c880ff150 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.403+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c7800ce60 con 0x7f3c880ff150 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.403+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c7801daf0 con 0x7f3c880ff150 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.403+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c881020d0 con 0x7f3c880ff150 2024-09-16T00:53:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.403+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c881025c0 con 0x7f3c880ff150 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.404+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c88068ab0 con 0x7f3c880ff150 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.404+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3c78004250 con 0x7f3c880ff150 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.405+0000 7f3c7ffff700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 0x7f3c74070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.405+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3c780902e0 con 0x7f3c880ff150 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.405+0000 7f3c867fc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 0x7f3c74070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.406+0000 7f3c867fc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 0x7f3c74070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a990 tx=0x7f3c70005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.410+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3c7805ce40 con 0x7f3c880ff150 2024-09-16T00:53:36.518 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:36 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T00:53:36.518 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:36 smithi053 ceph-mon[77492]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs peering) 2024-09-16T00:53:36.519 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 podman[83716]: 2024-09-16 00:53:36.41874475 +0000 UTC m=+0.395965042 container init b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T00:53:36.519 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 podman[83716]: 2024-09-16 00:53:36.422453769 +0000 UTC m=+0.399674059 container start b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-16T00:53:36.519 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 ceph-osd[83759]: -- 172.21.15.53:0/2579567235 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b9d48161e0 con 0x55b9d39bfc00 2024-09-16T00:53:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.662+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c880694e0 con 0x7f3c7406e7c0 2024-09-16T00:53:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.663+0000 7f3c7ffff700 1 -- 172.21.15.53:0/3965788546 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3c880694e0 con 0x7f3c7406e7c0 2024-09-16T00:53:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 msgr2=0x7f3c74070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 0x7f3c74070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a990 tx=0x7f3c70005c80 comp rx=0 tx=0).stop 2024-09-16T00:53:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 msgr2=0x7f3c88103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c780077b0 tx=0x7f3c78003ce0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 shutdown_connections 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3c7406e7c0 0x7f3c74070c70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c880ff150 0x7f3c88103180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 --2- 172.21.15.53:0/3965788546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c881003f0 0x7f3c881017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.665+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 >> 172.21.15.53:0/3965788546 conn(0x7f3c880fa7a0 msgr2=0x7f3c88068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.666+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 shutdown_connections 2024-09-16T00:53:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.666+0000 7f3c8d4bc700 1 -- 172.21.15.53:0/3965788546 wait complete. 2024-09-16T00:53:36.677 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:53:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:36 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T00:53:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:36 smithi152 ceph-mon[63606]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 11 pgs peering) 2024-09-16T00:53:36.780 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 bash[83716]: b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd 2024-09-16T00:53:36.780 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:36 smithi053 systemd[1]: Started Ceph osd.0 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 -- 172.21.15.53:0/1977396533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b601010a0 msgr2=0x7f6b600ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/1977396533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b601010a0 0x7f6b600ff4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009910 tx=0x7f6b54009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 -- 172.21.15.53:0/1977396533 shutdown_connections 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/1977396533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b601010a0 0x7f6b600ff4b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/1977396533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b60100750 0x7f6b60100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 -- 172.21.15.53:0/1977396533 >> 172.21.15.53:0/1977396533 conn(0x7f6b600f9f10 msgr2=0x7f6b600fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 -- 172.21.15.53:0/1977396533 shutdown_connections 2024-09-16T00:53:36.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.779+0000 7f6b64ffb700 1 -- 172.21.15.53:0/1977396533 wait complete. 2024-09-16T00:53:36.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 Processor -- start 2024-09-16T00:53:36.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 -- start start 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 0x7f6b6019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019add0 con 0x7f6b60100750 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.780+0000 7f6b64ffb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019af10 con 0x7f6b601010a0 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48316/0 (socket says 172.21.15.53:48316) 2024-09-16T00:53:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 -- 172.21.15.53:0/194834372 learned_addr learned my addr 172.21.15.53:0/194834372 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5dd9b700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 0x7f6b6019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 -- 172.21.15.53:0/194834372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 msgr2=0x7f6b6019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 0x7f6b6019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 -- 172.21.15.53:0/194834372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540095f0 con 0x7f6b60100750 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5dd9b700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 0x7f6b6019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b5e59c700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d900 tx=0x7f6b5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5000b920 con 0x7f6b60100750 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b50010460 con 0x7f6b60100750 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5000f5d0 con 0x7f6b60100750 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.781+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6019b1f0 con 0x7f6b60100750 2024-09-16T00:53:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.782+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6019b6f0 con 0x7f6b60100750 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.783+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60107c00 con 0x7f6b60100750 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.783+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f6b5000ba80 con 0x7f6b60100750 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.784+0000 7f6b4f7fe700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 0x7f6b48070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.784+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6b5008e710 con 0x7f6b60100750 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.784+0000 7f6b5dd9b700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 0x7f6b48070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.785+0000 7f6b5dd9b700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 0x7f6b48070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ff420 tx=0x7f6b54005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:36.789+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6b5005b2f0 con 0x7f6b60100750 2024-09-16T00:53:37.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.040+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b60104db0 con 0x7f6b4806e7c0 2024-09-16T00:53:37.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.041+0000 7f6b4f7fe700 1 -- 172.21.15.53:0/194834372 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6b60104db0 con 0x7f6b4806e7c0 2024-09-16T00:53:37.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.043+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 msgr2=0x7f6b48070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.043+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 0x7f6b48070c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ff420 tx=0x7f6b54005a90 comp rx=0 tx=0).stop 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.043+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 msgr2=0x7f6b600feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.043+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d900 tx=0x7f6b5000dcc0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 shutdown_connections 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6b4806e7c0 0x7f6b48070c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b60100750 0x7f6b600feea0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 --2- 172.21.15.53:0/194834372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b601010a0 0x7f6b6019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 >> 172.21.15.53:0/194834372 conn(0x7f6b600f9f10 msgr2=0x7f6b60103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 shutdown_connections 2024-09-16T00:53:37.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.044+0000 7f6b64ffb700 1 -- 172.21.15.53:0/194834372 wait complete. 2024-09-16T00:53:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 -- 172.21.15.53:0/1706657825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 msgr2=0x7fa258100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 --2- 172.21.15.53:0/1706657825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258100840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa248009910 tx=0x7fa248009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 -- 172.21.15.53:0/1706657825 shutdown_connections 2024-09-16T00:53:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 --2- 172.21.15.53:0/1706657825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258100840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 --2- 172.21.15.53:0/1706657825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa2580ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 -- 172.21.15.53:0/1706657825 >> 172.21.15.53:0/1706657825 conn(0x7fa2580fa780 msgr2=0x7fa2580fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 -- 172.21.15.53:0/1706657825 shutdown_connections 2024-09-16T00:53:37.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.152+0000 7fa26057a700 1 -- 172.21.15.53:0/1706657825 wait complete. 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 Processor -- start 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 -- start start 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa258195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258196600 con 0x7fa2581003d0 2024-09-16T00:53:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa26057a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258196740 con 0x7fa2580ff130 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48332/0 (socket says 172.21.15.53:48332) 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 -- 172.21.15.53:0/2485336786 learned_addr learned my addr 172.21.15.53:0/2485336786 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25e316700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa258195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 -- 172.21.15.53:0/2485336786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 msgr2=0x7fa258195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa258195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25db15700 1 -- 172.21.15.53:0/2485336786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480095f0 con 0x7fa2581003d0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.153+0000 7fa25e316700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa258195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa25db15700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa248006010 tx=0x7fa24800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24801d070 con 0x7fa2581003d0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa24800f460 con 0x7fa2581003d0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa248017630 con 0x7fa2581003d0 2024-09-16T00:53:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25819b190 con 0x7fa2581003d0 2024-09-16T00:53:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.154+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25819b680 con 0x7fa2581003d0 2024-09-16T00:53:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.155+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258107c30 con 0x7fa2581003d0 2024-09-16T00:53:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.156+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa24800f5d0 con 0x7fa2581003d0 2024-09-16T00:53:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.156+0000 7fa24f7fe700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 0x7fa244070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.156+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa24808fd00 con 0x7fa2581003d0 2024-09-16T00:53:37.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.156+0000 7fa25e316700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 0x7fa244070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.157+0000 7fa25e316700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 0x7fa244070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa254005fd0 tx=0x7fa254005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.160+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa248093030 con 0x7fa2581003d0 2024-09-16T00:53:37.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:37 smithi053 ceph-mon[77492]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:37.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:37.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:37.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.409+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa258068c50 con 0x7fa24406e7c0 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.419+0000 7fa24f7fe700 1 -- 172.21.15.53:0/2485336786 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa258068c50 con 0x7fa24406e7c0 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (10m) 17s ago 11m 25.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (11m) 17s ago 11m 7982k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (10m) 19s ago 10m 7620k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:53:37.420 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (27s) 17s ago 11m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (22s) 19s ago 10m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (10m) 17s ago 11m 86.4M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (5m) 17s ago 5m 153M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (5m) 17s ago 5m 98.7M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (5m) 19s ago 5m 16.6M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (5m) 19s ago 5m 14.9M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (2m) 17s ago 12m 492M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (111s) 19s ago 10m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (91s) 17s ago 13m 44.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (65s) 19s ago 10m 33.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (11m) 17s ago 11m 16.1M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (10m) 19s ago 10m 15.8M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:53:37.421 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 starting - - - 1217M 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (9m) 17s ago 9m 279M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (8m) 17s ago 8m 233M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (8m) 19s ago 8m 289M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (7m) 19s ago 7m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (7m) 19s ago 7m 258M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:53:37.422 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (117s) 17s ago 11m 74.2M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.421+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 msgr2=0x7fa244070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.421+0000 7fa26057a700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 0x7fa244070c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa254005fd0 tx=0x7fa254005ee0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 msgr2=0x7fa258195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa248006010 tx=0x7fa24800be20 comp rx=0 tx=0).stop 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 shutdown_connections 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa24406e7c0 0x7fa244070c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2580ff130 0x7fa258195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 --2- 172.21.15.53:0/2485336786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2581003d0 0x7fa258195fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 >> 172.21.15.53:0/2485336786 conn(0x7fa2580fa780 msgr2=0x7fa258068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 shutdown_connections 2024-09-16T00:53:37.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.422+0000 7fa26057a700 1 -- 172.21.15.53:0/2485336786 wait complete. 2024-09-16T00:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 -- 172.21.15.53:0/2002362925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600ff150 msgr2=0x7f73600ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 --2- 172.21.15.53:0/2002362925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600ff150 0x7f73600ff560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7350009910 tx=0x7f7350009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 -- 172.21.15.53:0/2002362925 shutdown_connections 2024-09-16T00:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 --2- 172.21.15.53:0/2002362925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73601003f0 0x7f7360100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 --2- 172.21.15.53:0/2002362925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600ff150 0x7f73600ff560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 -- 172.21.15.53:0/2002362925 >> 172.21.15.53:0/2002362925 conn(0x7f73600fa7a0 msgr2=0x7f73600fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 -- 172.21.15.53:0/2002362925 shutdown_connections 2024-09-16T00:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.531+0000 7f7364aad700 1 -- 172.21.15.53:0/2002362925 wait complete. 2024-09-16T00:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.532+0000 7f7364aad700 1 Processor -- start 2024-09-16T00:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.532+0000 7f7364aad700 1 -- start start 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7364aad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73600ff150 0x7f7360103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7364aad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7364aad700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7360101d10 con 0x7f73601003f0 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7364aad700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7360101e50 con 0x7f73600ff150 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48358/0 (socket says 172.21.15.53:48358) 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 -- 172.21.15.53:0/1255855983 learned_addr learned my addr 172.21.15.53:0/1255855983 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f735e59c700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73600ff150 0x7f7360103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 -- 172.21.15.53:0/1255855983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73600ff150 msgr2=0x7f7360103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73600ff150 0x7f7360103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 -- 172.21.15.53:0/1255855983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73500095f0 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.533+0000 7f7355d9b700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f734800d8d0 tx=0x7f734800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.534+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73480098a0 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.534+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7348010460 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.534+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360102130 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.534+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f734800f5f0 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.534+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736019de70 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.535+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360068ab0 con 0x7f73601003f0 2024-09-16T00:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.535+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7348009a00 con 0x7f73601003f0 2024-09-16T00:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.536+0000 7f7357fff700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 0x7f734c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.536+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f734808e630 con 0x7f73601003f0 2024-09-16T00:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.536+0000 7f735e59c700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 0x7f734c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.536+0000 7f735e59c700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 0x7f734c070c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f735000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.540+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f734805b210 con 0x7f73601003f0 2024-09-16T00:53:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:37 smithi152 ceph-mon[63606]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:37.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.851+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f736019e000 con 0x7f73601003f0 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.852+0000 7f7357fff700 1 -- 172.21.15.53:0/1255855983 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7f734805ada0 con 0x7f73601003f0 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:37.853 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:53:37.854 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 msgr2=0x7f734c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 0x7f734c070c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f735000b540 comp rx=0 tx=0).stop 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 msgr2=0x7f73601017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f734800d8d0 tx=0x7f734800dbe0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 shutdown_connections 2024-09-16T00:53:37.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f734c06e7c0 0x7f734c070c70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73600ff150 0x7f7360103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 --2- 172.21.15.53:0/1255855983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73601003f0 0x7f73601017d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 >> 172.21.15.53:0/1255855983 conn(0x7f73600fa7a0 msgr2=0x7f7360068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 shutdown_connections 2024-09-16T00:53:37.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.855+0000 7f7364aad700 1 -- 172.21.15.53:0/1255855983 wait complete. 2024-09-16T00:53:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 -- 172.21.15.53:0/360161687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 msgr2=0x7f3ae0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/360161687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0101890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009910 tx=0x7f3ad4009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 -- 172.21.15.53:0/360161687 shutdown_connections 2024-09-16T00:53:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/360161687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0101890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/360161687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 0x7f3ae0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 -- 172.21.15.53:0/360161687 >> 172.21.15.53:0/360161687 conn(0x7f3ae00fb7f0 msgr2=0x7f3ae00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 -- 172.21.15.53:0/360161687 shutdown_connections 2024-09-16T00:53:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.964+0000 7f3ae87ec700 1 -- 172.21.15.53:0/360161687 wait complete. 2024-09-16T00:53:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 Processor -- start 2024-09-16T00:53:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 -- start start 2024-09-16T00:53:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 0x7f3ae0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0073680 con 0x7f3ae0101440 2024-09-16T00:53:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae87ec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00737c0 con 0x7f3ae0100240 2024-09-16T00:53:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48382/0 (socket says 172.21.15.53:48382) 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 -- 172.21.15.53:0/2178213665 learned_addr learned my addr 172.21.15.53:0/2178213665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae6588700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 0x7f3ae0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 -- 172.21.15.53:0/2178213665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 msgr2=0x7f3ae0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 0x7f3ae0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 -- 172.21.15.53:0/2178213665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40095f0 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3ae5d87700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.965+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad401d070 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.966+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ad400f460 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.966+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae0073a40 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.966+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4021640 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.966+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae0073f30 con 0x7f3ae0101440 2024-09-16T00:53:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.966+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0108d90 con 0x7f3ae0101440 2024-09-16T00:53:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.967+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3ad400fab0 con 0x7f3ae0101440 2024-09-16T00:53:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.968+0000 7f3adf7fe700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 0x7f3ac8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.968+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3ad408fa20 con 0x7f3ae0101440 2024-09-16T00:53:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.968+0000 7f3ae6588700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 0x7f3ac8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.968+0000 7f3ae6588700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 0x7f3ac8070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009550 tx=0x7f3ad00091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:37.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:37.972+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3ad405c600 con 0x7f3ae0101440 2024-09-16T00:53:38.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.235+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ae019dfd0 con 0x7f3ae0101440 2024-09-16T00:53:38.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.236+0000 7f3adf7fe700 1 -- 172.21.15.53:0/2178213665 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f3ad405c190 con 0x7f3ae0101440 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:53:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:53:38.238 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:38.239 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:38.240 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:53:38.240 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:53:38.240 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:38.240 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 msgr2=0x7f3ac8070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 0x7f3ac8070c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009550 tx=0x7f3ad00091b0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 msgr2=0x7f3ae0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad400bd70 comp rx=0 tx=0).stop 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 shutdown_connections 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3ac806e7c0 0x7f3ac8070c70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ae0100240 0x7f3ae0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 --2- 172.21.15.53:0/2178213665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ae0101440 0x7f3ae0073140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 >> 172.21.15.53:0/2178213665 conn(0x7f3ae00fb7f0 msgr2=0x7f3ae0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 shutdown_connections 2024-09-16T00:53:38.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.239+0000 7f3ae87ec700 1 -- 172.21.15.53:0/2178213665 wait complete. 2024-09-16T00:53:38.242 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:53:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 -- 172.21.15.53:0/3516778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 msgr2=0x7ff38c102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 --2- 172.21.15.53:0/3516778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c102e50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff380009910 tx=0x7ff380009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 -- 172.21.15.53:0/3516778367 shutdown_connections 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 --2- 172.21.15.53:0/3516778367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 0x7ff38c1057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 --2- 172.21.15.53:0/3516778367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c102e50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 -- 172.21.15.53:0/3516778367 >> 172.21.15.53:0/3516778367 conn(0x7ff38c0fa7a0 msgr2=0x7ff38c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 -- 172.21.15.53:0/3516778367 shutdown_connections 2024-09-16T00:53:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.350+0000 7ff392fa1700 1 -- 172.21.15.53:0/3516778367 wait complete. 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 Processor -- start 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 -- start start 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 0x7ff38c196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c196940 con 0x7ff38c069aa0 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.351+0000 7ff392fa1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c196a80 con 0x7ff38c103390 2024-09-16T00:53:38.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48408/0 (socket says 172.21.15.53:48408) 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 -- 172.21.15.53:0/399348672 learned_addr learned my addr 172.21.15.53:0/399348672 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff38bfff700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 0x7ff38c196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 -- 172.21.15.53:0/399348672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 msgr2=0x7ff38c196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 0x7ff38c196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 -- 172.21.15.53:0/399348672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800095f0 con 0x7ff38c069aa0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff390d3d700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380000c00 tx=0x7ff38000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38001d070 con 0x7ff38c069aa0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff380005dc0 con 0x7ff38c069aa0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff380022470 con 0x7ff38c069aa0 2024-09-16T00:53:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.352+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c19b4d0 con 0x7ff38c069aa0 2024-09-16T00:53:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.353+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c19b9c0 con 0x7ff38c069aa0 2024-09-16T00:53:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.353+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c18fbf0 con 0x7ff38c069aa0 2024-09-16T00:53:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.354+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff380003810 con 0x7ff38c069aa0 2024-09-16T00:53:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.354+0000 7ff389ffb700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 0x7ff37c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.355+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff38008fd40 con 0x7ff38c069aa0 2024-09-16T00:53:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.355+0000 7ff38bfff700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 0x7ff37c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.355+0000 7ff38bfff700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 0x7ff37c070c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff378009c60 tx=0x7ff378009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.359+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff38005c8a0 con 0x7ff38c069aa0 2024-09-16T00:53:38.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:38 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T00:53:38.309+0000 7fce4b73b640 -1 Falling back to public interface 2024-09-16T00:53:38.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:38 smithi053 ceph-mon[77492]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:38.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:38 smithi053 ceph-mon[77492]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:38.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:38 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1255855983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:38.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:38 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2178213665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:53:38.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.623+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff38c02d0e0 con 0x7ff37c06e7c0 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.624+0000 7ff389ffb700 1 -- 172.21.15.53:0/399348672 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff38c02d0e0 con 0x7ff37c06e7c0 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:53:38.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "6/23 daemons upgraded", 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:53:38.626 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 msgr2=0x7ff37c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 0x7ff37c070c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff378009c60 tx=0x7ff378009260 comp rx=0 tx=0).stop 2024-09-16T00:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 msgr2=0x7ff38c195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380000c00 tx=0x7ff38000f690 comp rx=0 tx=0).stop 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 shutdown_connections 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff37c06e7c0 0x7ff37c070c70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38c069aa0 0x7ff38c195de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 --2- 172.21.15.53:0/399348672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c103390 0x7ff38c196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.626+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 >> 172.21.15.53:0/399348672 conn(0x7ff38c0fa7a0 msgr2=0x7ff38c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.627+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 shutdown_connections 2024-09-16T00:53:38.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.627+0000 7ff392fa1700 1 -- 172.21.15.53:0/399348672 wait complete. 2024-09-16T00:53:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:38 smithi152 ceph-mon[63606]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:38 smithi152 ceph-mon[63606]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:38 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1255855983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:38 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2178213665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 -- 172.21.15.53:0/2629010515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830101440 msgr2=0x7f8830101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2629010515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830101440 0x7f8830101890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8818009910 tx=0x7f8818009c20 comp rx=0 tx=0).stop 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 -- 172.21.15.53:0/2629010515 shutdown_connections 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2629010515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830101440 0x7f8830101890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2629010515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830100240 0x7f8830100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.737+0000 7f8835ee7700 1 -- 172.21.15.53:0/2629010515 >> 172.21.15.53:0/2629010515 conn(0x7f88300fb7f0 msgr2=0x7f88300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.738+0000 7f8835ee7700 1 -- 172.21.15.53:0/2629010515 shutdown_connections 2024-09-16T00:53:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.738+0000 7f8835ee7700 1 -- 172.21.15.53:0/2629010515 wait complete. 2024-09-16T00:53:38.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.738+0000 7f8835ee7700 1 Processor -- start 2024-09-16T00:53:38.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.738+0000 7f8835ee7700 1 -- start start 2024-09-16T00:53:38.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830101440 0x7f8830073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830073680 con 0x7f8830100240 2024-09-16T00:53:38.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300737c0 con 0x7f8830101440 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48428/0 (socket says 172.21.15.53:48428) 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 -- 172.21.15.53:0/2568095516 learned_addr learned my addr 172.21.15.53:0/2568095516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882effd700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830101440 0x7f8830073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 -- 172.21.15.53:0/2568095516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830101440 msgr2=0x7f8830073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830101440 0x7f8830073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 -- 172.21.15.53:0/2568095516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180095f0 con 0x7f8830100240 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882f7fe700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f882000c910 tx=0x7f882000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88200041f0 con 0x7f8830100240 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8820007db0 con 0x7f8830100240 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8830073aa0 con 0x7f8830100240 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8820003d60 con 0x7f8830100240 2024-09-16T00:53:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.739+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883019daf0 con 0x7f8830100240 2024-09-16T00:53:38.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.740+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8830108d90 con 0x7f8830100240 2024-09-16T00:53:38.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.741+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f8820007900 con 0x7f8830100240 2024-09-16T00:53:38.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.741+0000 7f882cff9700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 0x7f881c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:53:38.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.742+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f882008e4e0 con 0x7f8830100240 2024-09-16T00:53:38.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.742+0000 7f882effd700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 0x7f881c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:53:38.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.742+0000 7f882effd700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 0x7f881c070c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8818006010 tx=0x7f881800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:53:38.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:38.746+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f882005b0c0 con 0x7f8830100240 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.057+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8830108f80 con 0x7f8830100240 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.057+0000 7f882cff9700 1 -- 172.21.15.53:0/2568095516 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7f882001d4d0 con 0x7f8830100240 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stdout: osd.0 (root=default,host=smithi053) is down 2024-09-16T00:53:39.058 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-16T00:53:39.059 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-16T00:53:39.060 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 msgr2=0x7f881c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 0x7f881c070c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8818006010 tx=0x7f881800b580 comp rx=0 tx=0).stop 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 msgr2=0x7f8830074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f882000c910 tx=0x7f882000ccd0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 shutdown_connections 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f881c06e7c0 0x7f881c070c70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8830100240 0x7f8830074af0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 --2- 172.21.15.53:0/2568095516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8830101440 0x7f8830073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:53:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 >> 172.21.15.53:0/2568095516 conn(0x7f88300fb7f0 msgr2=0x7f8830104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:53:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 shutdown_connections 2024-09-16T00:53:39.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:53:39.059+0000 7f8835ee7700 1 -- 172.21.15.53:0/2568095516 wait complete. 2024-09-16T00:53:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:39 smithi053 ceph-mon[77492]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:39 smithi053 ceph-mon[77492]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:39 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2568095516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:53:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:39 smithi152 ceph-mon[63606]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:39 smithi152 ceph-mon[63606]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:39 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2568095516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:53:40.548 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:40 smithi053 ceph-mon[77492]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:40 smithi152 ceph-mon[63606]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:53:41.378 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:41 smithi053 ceph-mon[77492]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 415 B/s rd, 0 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:41 smithi152 ceph-mon[63606]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 415 B/s rd, 0 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:43.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:42 smithi053 ceph-mon[77492]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 848 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:43.123 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.124 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:42 smithi152 ceph-mon[63606]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 848 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:43.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:44.175 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:43 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T00:53:43.875+0000 7fce4b73b640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-16T00:53:44.490 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:44 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T00:53:44.411+0000 7fce4b73b640 -1 osd.0 49 log_to_monitors true 2024-09-16T00:53:45.554 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:45 smithi053 ceph-mon[77492]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:45.554 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:45.554 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:45.554 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:45 smithi053 ceph-mon[77492]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:53:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:45 smithi152 ceph-mon[63606]: pgmap v50: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:45 smithi152 ceph-mon[63606]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T00:53:46.218 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T00:53:46.004+0000 7fce3f4cd640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:53:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:53:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: osdmap e52: 6 total, 5 up, 6 in 2024-09-16T00:53:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:53:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:53:46.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:46 smithi053 ceph-mon[77492]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' 2024-09-16T00:53:46.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T00:53:46.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: osdmap e52: 6 total, 5 up, 6 in 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:53:46.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:46 smithi152 ceph-mon[63606]: from='osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935]' entity='osd.0' 2024-09-16T00:53:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:53:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T00:53:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: pgmap v52: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:47.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:53:47.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935] boot 2024-09-16T00:53:47.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: osdmap e53: 6 total, 6 up, 6 in 2024-09-16T00:53:47.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: mgrmap e38: smithi053.cjiiek(active, since 92s), standbys: smithi152.nlmwrx 2024-09-16T00:53:47.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:47 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: pgmap v52: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: osd.0 [v2:172.21.15.53:6802/3133414935,v1:172.21.15.53:6803/3133414935] boot 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: osdmap e53: 6 total, 6 up, 6 in 2024-09-16T00:53:47.616 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: mgrmap e38: smithi053.cjiiek(active, since 92s), standbys: smithi152.nlmwrx 2024-09-16T00:53:47.617 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:47 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T00:53:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:49 smithi152 ceph-mon[63606]: osdmap e54: 6 total, 6 up, 6 in 2024-09-16T00:53:49.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:49 smithi152 ceph-mon[63606]: pgmap v55: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:49.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:49 smithi053 ceph-mon[77492]: osdmap e54: 6 total, 6 up, 6 in 2024-09-16T00:53:49.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:49 smithi053 ceph-mon[77492]: pgmap v55: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:51 smithi053 ceph-mon[77492]: pgmap v56: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:51 smithi152 ceph-mon[63606]: pgmap v56: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 43/222 objects degraded (19.369%) 2024-09-16T00:53:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:52 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded) 2024-09-16T00:53:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:52 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:53:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:52 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/222 objects degraded (19.369%), 17 pgs degraded) 2024-09-16T00:53:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:52 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:53:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:53 smithi053 ceph-mon[77492]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 442 B/s wr, 3 op/s 2024-09-16T00:53:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:53 smithi152 ceph-mon[63606]: pgmap v57: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 442 B/s wr, 3 op/s 2024-09-16T00:53:55.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:55 smithi152 ceph-mon[63606]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:53:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:55 smithi053 ceph-mon[77492]: pgmap v58: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:53:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:57 smithi053 ceph-mon[77492]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T00:53:57.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:57 smithi152 ceph-mon[63606]: pgmap v59: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T00:53:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:59 smithi053 ceph-mon[77492]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1008 B/s rd, 1 op/s 2024-09-16T00:53:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:53:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:59 smithi152 ceph-mon[63606]: pgmap v60: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1008 B/s rd, 1 op/s 2024-09-16T00:53:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:53:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:53:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:53:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:01.492 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:01 smithi053 ceph-mon[77492]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:01.492 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:54:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:01 smithi152 ceph-mon[63606]: pgmap v61: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:54:02.488 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:02 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:54:02.488 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:02 smithi053 ceph-mon[77492]: Upgrade: osd.1 is safe to restart 2024-09-16T00:54:02.488 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:02.488 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:54:02.488 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:02 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T00:54:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:02 smithi152 ceph-mon[63606]: Upgrade: osd.1 is safe to restart 2024-09-16T00:54:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T00:54:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:03 smithi053 ceph-mon[77492]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:03 smithi053 ceph-mon[77492]: Upgrade: Updating osd.1 2024-09-16T00:54:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:03 smithi053 ceph-mon[77492]: Deploying daemon osd.1 on smithi053 2024-09-16T00:54:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:03 smithi152 ceph-mon[63606]: pgmap v62: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:03 smithi152 ceph-mon[63606]: Upgrade: Updating osd.1 2024-09-16T00:54:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:03 smithi152 ceph-mon[63606]: Deploying daemon osd.1 on smithi053 2024-09-16T00:54:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:05 smithi152 ceph-mon[63606]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:05 smithi053 ceph-mon[77492]: pgmap v63: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:05.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:05 smithi053 systemd[1]: Stopping Ceph osd.1 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:54:06.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:05 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[48438]: 2024-09-16T00:54:05.615+0000 7ff259906700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:54:06.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:05 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[48438]: 2024-09-16T00:54:05.615+0000 7ff259906700 -1 osd.1 54 *** Got signal Terminated *** 2024-09-16T00:54:06.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:05 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[48438]: 2024-09-16T00:54:05.615+0000 7ff259906700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:54:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:06 smithi053 ceph-mon[77492]: osd.1 marked itself down and dead 2024-09-16T00:54:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:06 smithi152 ceph-mon[63606]: osd.1 marked itself down and dead 2024-09-16T00:54:07.017 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:06 smithi053 podman[86647]: 2024-09-16 00:54:06.708026511 +0000 UTC m=+1.216381290 container died 0acf2b9e0beb653f371e7f4c98c0e60efe2847e7421fa83c5acc56b9712aebc4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T00:54:07.287 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:07 smithi053 podman[86647]: 2024-09-16 00:54:07.115523299 +0000 UTC m=+1.623878077 container cleanup 0acf2b9e0beb653f371e7f4c98c0e60efe2847e7421fa83c5acc56b9712aebc4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-16T00:54:07.287 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:07 smithi053 bash[86647]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1 2024-09-16T00:54:07.539 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:07 smithi053 ceph-mon[77492]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:07.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:07 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:54:07.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:07 smithi053 ceph-mon[77492]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T00:54:07.540 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:07 smithi053 podman[86664]: 2024-09-16 00:54:07.375326932 +0000 UTC m=+0.666956235 container remove 0acf2b9e0beb653f371e7f4c98c0e60efe2847e7421fa83c5acc56b9712aebc4 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.29.1, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-16T00:54:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:07 smithi152 ceph-mon[63606]: pgmap v64: 65 pgs: 65 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:07 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:54:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:07 smithi152 ceph-mon[63606]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T00:54:08.146 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:07 smithi053 podman[86753]: 2024-09-16 00:54:07.748059888 +0000 UTC m=+0.016562838 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:08.146 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:07 smithi053 podman[86753]: 2024-09-16 00:54:07.859599799 +0000 UTC m=+0.128102734 container create ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:54:08.146 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 podman[86753]: 2024-09-16 00:54:08.145817064 +0000 UTC m=+0.414320006 container init ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:54:08.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:08 smithi053 ceph-mon[77492]: osdmap e56: 6 total, 5 up, 6 in 2024-09-16T00:54:08.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 podman[86753]: 2024-09-16 00:54:08.149562281 +0000 UTC m=+0.418065215 container start ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:54:08.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 podman[86753]: 2024-09-16 00:54:08.245778765 +0000 UTC m=+0.514281715 container attach ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:54:08.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 podman[86753]: 2024-09-16 00:54:08.343427406 +0000 UTC m=+0.611930356 container died ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:08 smithi152 ceph-mon[63606]: osdmap e56: 6 total, 5 up, 6 in 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 -- 172.21.15.53:0/1657278645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8100ce0 msgr2=0x7f25a81030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/1657278645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8100ce0 0x7f25a81030c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2598009910 tx=0x7f2598009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 -- 172.21.15.53:0/1657278645 shutdown_connections 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/1657278645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8103600 0x7f25a81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/1657278645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8100ce0 0x7f25a81030c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 -- 172.21.15.53:0/1657278645 >> 172.21.15.53:0/1657278645 conn(0x7f25a80fa700 msgr2=0x7f25a80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 -- 172.21.15.53:0/1657278645 shutdown_connections 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.176+0000 7f25ae9e1700 1 -- 172.21.15.53:0/1657278645 wait complete. 2024-09-16T00:54:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 Processor -- start 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 -- start start 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8100ce0 0x7f25a8195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81965b0 con 0x7f25a8103600 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.177+0000 7f25ae9e1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81966f0 con 0x7f25a8100ce0 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43458/0 (socket says 172.21.15.53:43458) 2024-09-16T00:54:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 -- 172.21.15.53:0/3745526051 learned_addr learned my addr 172.21.15.53:0/3745526051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a7fff700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8100ce0 0x7f25a8195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 -- 172.21.15.53:0/3745526051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8100ce0 msgr2=0x7f25a8195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8100ce0 0x7f25a8195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 -- 172.21.15.53:0/3745526051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980095f0 con 0x7f25a8103600 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a77fe700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f259c00e920 tx=0x7f259c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f259c00c9d0 con 0x7f25a8103600 2024-09-16T00:54:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f259c010430 con 0x7f25a8103600 2024-09-16T00:54:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.178+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a819b1a0 con 0x7f25a8103600 2024-09-16T00:54:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.179+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f259c018650 con 0x7f25a8103600 2024-09-16T00:54:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.179+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a819b6f0 con 0x7f25a8103600 2024-09-16T00:54:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.180+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a818fc70 con 0x7f25a8103600 2024-09-16T00:54:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.180+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f259c0105a0 con 0x7f25a8103600 2024-09-16T00:54:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.181+0000 7f25a57fa700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 0x7f2590070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.181+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f259c014070 con 0x7f25a8103600 2024-09-16T00:54:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.181+0000 7f25a7fff700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 0x7f2590070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.181+0000 7f25a7fff700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 0x7f2590070b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2598009fd0 tx=0x7f2598005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.187+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f259c0541b0 con 0x7f25a8103600 2024-09-16T00:54:09.188 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 podman[86775]: 2024-09-16 00:54:08.933177176 +0000 UTC m=+0.580786709 container remove ca253a12965ba7b2d4ebaeae71b44a8becc7cb01bb80fcfd5b778a26927d4622 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T00:54:09.188 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-16T00:54:09.188 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 systemd[1]: Stopped Ceph osd.1 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:54:09.188 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:08 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 16.220s CPU time. 2024-09-16T00:54:09.188 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 systemd[1]: Starting Ceph osd.1 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:54:09.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.441+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a8061190 con 0x7f259006e6d0 2024-09-16T00:54:09.443 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:09 smithi053 ceph-mon[77492]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:09.443 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 podman[86898]: 2024-09-16 00:54:09.303390843 +0000 UTC m=+0.023252478 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:09.443 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 podman[86898]: 2024-09-16 00:54:09.434664361 +0000 UTC m=+0.154525974 container create 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T00:54:09.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.443+0000 7f25a57fa700 1 -- 172.21.15.53:0/3745526051 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f25a8061190 con 0x7f259006e6d0 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 msgr2=0x7f2590070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 0x7f2590070b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2598009fd0 tx=0x7f2598005fd0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 msgr2=0x7f25a8195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f259c00e920 tx=0x7f259c00ec30 comp rx=0 tx=0).stop 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 shutdown_connections 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f259006e6d0 0x7f2590070b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25a8100ce0 0x7f25a8195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 --2- 172.21.15.53:0/3745526051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25a8103600 0x7f25a8195f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 >> 172.21.15.53:0/3745526051 conn(0x7f25a80fa700 msgr2=0x7f25a80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 shutdown_connections 2024-09-16T00:54:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.445+0000 7f25ae9e1700 1 -- 172.21.15.53:0/3745526051 wait complete. 2024-09-16T00:54:09.456 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 -- 172.21.15.53:0/3673986690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc1003f0 msgr2=0x7f1ccc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 --2- 172.21.15.53:0/3673986690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc100860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009910 tx=0x7f1cb4009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 -- 172.21.15.53:0/3673986690 shutdown_connections 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 --2- 172.21.15.53:0/3673986690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc100860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 --2- 172.21.15.53:0/3673986690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 -- 172.21.15.53:0/3673986690 >> 172.21.15.53:0/3673986690 conn(0x7f1ccc0fa7a0 msgr2=0x7f1ccc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 -- 172.21.15.53:0/3673986690 shutdown_connections 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.555+0000 7f1cd2413700 1 -- 172.21.15.53:0/3673986690 wait complete. 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 Processor -- start 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 -- start start 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc198aa0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1cd2413700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc198be0 con 0x7f1ccc1003f0 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1ccbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1ccbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43482/0 (socket says 172.21.15.53:43482) 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.556+0000 7f1ccbfff700 1 -- 172.21.15.53:0/748347393 learned_addr learned my addr 172.21.15.53:0/748347393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cc3fff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1ccbfff700 1 -- 172.21.15.53:0/748347393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 msgr2=0x7f1ccc198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1ccbfff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1ccbfff700 1 -- 172.21.15.53:0/748347393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40095f0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cc3fff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1ccbfff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00d8d0 tx=0x7f1cbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc009940 con 0x7f1ccc0ff150 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1cbc010460 con 0x7f1ccc0ff150 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc00f5f0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc19d690 con 0x7f1ccc0ff150 2024-09-16T00:54:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.557+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc19dbe0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.558+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc068ab0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.559+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1cbc0105d0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.559+0000 7f1cc9ffb700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 0x7f1cb8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.559+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1cbc08e4d0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.559+0000 7f1cc3fff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 0x7f1cb8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.560+0000 7f1cc3fff700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 0x7f1cb8070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b5c0 tx=0x7f1cb4005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.564+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1cbc05b2d0 con 0x7f1ccc0ff150 2024-09-16T00:54:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:09 smithi152 ceph-mon[63606]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.806+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ccc0694e0 con 0x7f1cb806e680 2024-09-16T00:54:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.807+0000 7f1cc9ffb700 1 -- 172.21.15.53:0/748347393 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1ccc0694e0 con 0x7f1cb806e680 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 msgr2=0x7f1cb8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 0x7f1cb8070b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400b5c0 tx=0x7f1cb4005e20 comp rx=0 tx=0).stop 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 msgr2=0x7f1ccc197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00d8d0 tx=0x7f1cbc00dc90 comp rx=0 tx=0).stop 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 shutdown_connections 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1cb806e680 0x7f1cb8070b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc0ff150 0x7f1ccc197f40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 --2- 172.21.15.53:0/748347393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ccc1003f0 0x7f1ccc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 >> 172.21.15.53:0/748347393 conn(0x7f1ccc0fa7a0 msgr2=0x7f1ccc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 shutdown_connections 2024-09-16T00:54:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.811+0000 7f1cd2413700 1 -- 172.21.15.53:0/748347393 wait complete. 2024-09-16T00:54:09.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- 172.21.15.53:0/3787994709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 msgr2=0x7ffbb4101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3787994709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4101950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009910 tx=0x7ffba8009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- 172.21.15.53:0/3787994709 shutdown_connections 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3787994709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4101950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3787994709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 0x7ffbb4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- 172.21.15.53:0/3787994709 >> 172.21.15.53:0/3787994709 conn(0x7ffbb40fb890 msgr2=0x7ffbb40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- 172.21.15.53:0/3787994709 shutdown_connections 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- 172.21.15.53:0/3787994709 wait complete. 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 Processor -- start 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.928+0000 7ffbba89b700 1 -- start start 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbba89b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 0x7ffbb4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbba89b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbba89b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4073680 con 0x7ffbb41014e0 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbba89b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40737c0 con 0x7ffbb4100240 2024-09-16T00:54:09.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43494/0 (socket says 172.21.15.53:43494) 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 -- 172.21.15.53:0/3220714947 learned_addr learned my addr 172.21.15.53:0/3220714947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb3fff700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 0x7ffbb4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 -- 172.21.15.53:0/3220714947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 msgr2=0x7ffbb4074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 0x7ffbb4074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.929+0000 7ffbb37fe700 1 -- 172.21.15.53:0/3220714947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80095f0 con 0x7ffbb41014e0 2024-09-16T00:54:09.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbb37fe700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffba8006010 tx=0x7ffba800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba801d070 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffba800f460 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4073a40 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba8017630 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.930+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb4073f30 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.931+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb4108d20 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.931+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ffba800f5d0 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.932+0000 7ffbb17fa700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 0x7ffb9c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.932+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffba808fa60 con 0x7ffbb41014e0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.932+0000 7ffbb3fff700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 0x7ffb9c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:09.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.932+0000 7ffbb3fff700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 0x7ffb9c070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffba4005950 tx=0x7ffba40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:09.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:09.937+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffba805c7e0 con 0x7ffbb41014e0 2024-09-16T00:54:10.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 podman[86898]: 2024-09-16 00:54:09.695842287 +0000 UTC m=+0.415703905 container init 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:54:10.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 podman[86898]: 2024-09-16 00:54:09.699673727 +0000 UTC m=+0.419535346 container start 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:54:10.070 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 podman[86898]: 2024-09-16 00:54:09.804199074 +0000 UTC m=+0.524060703 container attach 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T00:54:10.070 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:10.070 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 bash[86898]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:10.070 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:10.070 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:09 smithi053 bash[86898]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:10.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.166+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbb4105e30 con 0x7ffb9c06e680 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.176+0000 7ffbb17fa700 1 -- 172.21.15.53:0/3220714947 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7ffbb4105e30 con 0x7ffb9c06e680 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (10m) 28s ago 12m 25.4M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (12m) 28s ago 12m 8006k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (11m) 51s ago 11m 7620k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (60s) 28s ago 12m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:54:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (55s) 51s ago 11m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (10m) 28s ago 11m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (6m) 28s ago 6m 153M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (6m) 28s ago 6m 98.7M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (6m) 51s ago 6m 16.6M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (6m) 51s ago 6m 14.9M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (3m) 28s ago 13m 494M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (2m) 51s ago 11m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (2m) 28s ago 13m 46.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (98s) 51s ago 11m 33.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (12m) 28s ago 12m 16.3M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (11m) 51s ago 11m 15.8M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (34s) 28s ago 10m 14.3M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:54:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (9m) 28s ago 9m 280M 1217M 18.2.0 dc2bc1663786 0acf2b9e0beb 2024-09-16T00:54:10.179 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (9m) 28s ago 9m 230M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:54:10.179 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (8m) 51s ago 8m 289M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:54:10.179 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (8m) 51s ago 8m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:54:10.179 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (8m) 51s ago 8m 258M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:54:10.179 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (2m) 28s ago 11m 74.2M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:54:10.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 msgr2=0x7ffb9c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 0x7ffb9c070b30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffba4005950 tx=0x7ffba40058e0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 msgr2=0x7ffbb4073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffba8006010 tx=0x7ffba800be20 comp rx=0 tx=0).stop 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 shutdown_connections 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ffb9c06e680 0x7ffb9c070b30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbb4100240 0x7ffbb4074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 --2- 172.21.15.53:0/3220714947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbb41014e0 0x7ffbb4073140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.178+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 >> 172.21.15.53:0/3220714947 conn(0x7ffbb40fb890 msgr2=0x7ffbb4104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.179+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 shutdown_connections 2024-09-16T00:54:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.179+0000 7ffbba89b700 1 -- 172.21.15.53:0/3220714947 wait complete. 2024-09-16T00:54:10.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.289+0000 7f988c4e8700 1 -- 172.21.15.53:0/2823328247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884101440 msgr2=0x7f9884101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.289+0000 7f988c4e8700 1 --2- 172.21.15.53:0/2823328247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884101440 0x7f9884101890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9874009910 tx=0x7f9874009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:10.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- 172.21.15.53:0/2823328247 shutdown_connections 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 --2- 172.21.15.53:0/2823328247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884101440 0x7f9884101890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 --2- 172.21.15.53:0/2823328247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884100240 0x7f9884100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- 172.21.15.53:0/2823328247 >> 172.21.15.53:0/2823328247 conn(0x7f98840fb7f0 msgr2=0x7f98840fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- 172.21.15.53:0/2823328247 shutdown_connections 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- 172.21.15.53:0/2823328247 wait complete. 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 Processor -- start 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- start start 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884101440 0x7f9884198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98841988b0 con 0x7f9884100240 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.290+0000 7f988c4e8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98841989f0 con 0x7f9884101440 2024-09-16T00:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43516/0 (socket says 172.21.15.53:43516) 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 -- 172.21.15.53:0/3633393687 learned_addr learned my addr 172.21.15.53:0/3633393687 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f9889a83700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884101440 0x7f9884198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 -- 172.21.15.53:0/3633393687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884101440 msgr2=0x7f9884198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884101440 0x7f9884198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 -- 172.21.15.53:0/3633393687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740095f0 con 0x7f9884100240 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988a284700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f988000b480 tx=0x7f988000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9880011800 con 0x7f9884100240 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9880011e10 con 0x7f9884100240 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988419d4a0 con 0x7f9884100240 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9880010ea0 con 0x7f9884100240 2024-09-16T00:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.291+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988419d9f0 con 0x7f9884100240 2024-09-16T00:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.293+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9884105520 con 0x7f9884100240 2024-09-16T00:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.293+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9880010380 con 0x7f9884100240 2024-09-16T00:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.293+0000 7f987b7fe700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 0x7f9870070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.294+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f988008e100 con 0x7f9884100240 2024-09-16T00:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.294+0000 7f9889a83700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 0x7f9870070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.294+0000 7f9889a83700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 0x7f9870070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f987400b5c0 tx=0x7f98740052a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.298+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f988005ae80 con 0x7f9884100240 2024-09-16T00:54:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.605+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9884061960 con 0x7f9884100240 2024-09-16T00:54:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.606+0000 7f987b7fe700 1 -- 172.21.15.53:0/3633393687 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f988005aa10 con 0x7f9884100240 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:54:10.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 5 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:54:10.608 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 msgr2=0x7f9870070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 0x7f9870070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f987400b5c0 tx=0x7f98740052a0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 msgr2=0x7f9884197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f988000b480 tx=0x7f988000b790 comp rx=0 tx=0).stop 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 shutdown_connections 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f987006e680 0x7f9870070b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9884100240 0x7f9884197d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 --2- 172.21.15.53:0/3633393687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9884101440 0x7f9884198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 >> 172.21.15.53:0/3633393687 conn(0x7f98840fb7f0 msgr2=0x7f9884102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 shutdown_connections 2024-09-16T00:54:10.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.608+0000 7f988c4e8700 1 -- 172.21.15.53:0/3633393687 wait complete. 2024-09-16T00:54:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 -- 172.21.15.53:0/2946280851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a0100350 msgr2=0x7f53a01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 --2- 172.21.15.53:0/2946280851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a0100350 0x7f53a01007a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5388009910 tx=0x7f5388009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 -- 172.21.15.53:0/2946280851 shutdown_connections 2024-09-16T00:54:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 --2- 172.21.15.53:0/2946280851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a0100350 0x7f53a01007a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 --2- 172.21.15.53:0/2946280851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00ff150 0x7f53a00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 -- 172.21.15.53:0/2946280851 >> 172.21.15.53:0/2946280851 conn(0x7f53a00fa700 msgr2=0x7f53a00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:10.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 -- 172.21.15.53:0/2946280851 shutdown_connections 2024-09-16T00:54:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.717+0000 7f53a699c700 1 -- 172.21.15.53:0/2946280851 wait complete. 2024-09-16T00:54:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 Processor -- start 2024-09-16T00:54:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 -- start start 2024-09-16T00:54:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 0x7f53a019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a019adb0 con 0x7f53a00ff150 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f53a699c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a019af20 con 0x7f53a0100350 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43540/0 (socket says 172.21.15.53:43540) 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 -- 172.21.15.53:0/2554894248 learned_addr learned my addr 172.21.15.53:0/2554894248 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f5397fff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 0x7f53a019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 -- 172.21.15.53:0/2554894248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 msgr2=0x7f53a019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 0x7f53a019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f539ffff700 1 -- 172.21.15.53:0/2554894248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880095f0 con 0x7f53a00ff150 2024-09-16T00:54:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.718+0000 7f5397fff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 0x7f53a019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:54:10.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f539ffff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f539000d900 tx=0x7f539000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53900041f0 con 0x7f53a00ff150 2024-09-16T00:54:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5390004350 con 0x7f53a00ff150 2024-09-16T00:54:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a019b200 con 0x7f53a00ff150 2024-09-16T00:54:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5390003da0 con 0x7f53a00ff150 2024-09-16T00:54:10.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.719+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a019b750 con 0x7f53a00ff150 2024-09-16T00:54:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.720+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0107ca0 con 0x7f53a00ff150 2024-09-16T00:54:10.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.720+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5390009730 con 0x7f53a00ff150 2024-09-16T00:54:10.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.721+0000 7f539dffb700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 0x7f538c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:10.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.721+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f539008e730 con 0x7f53a00ff150 2024-09-16T00:54:10.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.721+0000 7f5397fff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 0x7f538c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.721+0000 7f5397fff700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 0x7f538c070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53a0069eb0 tx=0x7f5388005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:10.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.725+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f539005b4b0 con 0x7f53a00ff150 2024-09-16T00:54:10.877 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T00:54:10.877 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T00:54:10.877 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T00:54:10.877 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T00:54:10.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.990+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f53a019bdf0 con 0x7f53a00ff150 2024-09-16T00:54:10.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.990+0000 7f539dffb700 1 -- 172.21.15.53:0/2554894248 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f539005b040 con 0x7f53a00ff150 2024-09-16T00:54:10.991 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:54:10.991 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:54:10.992 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:54:10.993 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:10.994 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:10.995 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:10.995 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:54:10.995 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:10.995 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:10.995 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 msgr2=0x7f538c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 0x7f538c070b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53a0069eb0 tx=0x7f5388005a90 comp rx=0 tx=0).stop 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 msgr2=0x7f53a0069950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f539000d900 tx=0x7f539000dcc0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 shutdown_connections 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f538c06e680 0x7f538c070b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.993+0000 7f53a699c700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00ff150 0x7f53a0069950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.994+0000 7f53a699c700 1 --2- 172.21.15.53:0/2554894248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a0100350 0x7f53a019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.994+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 >> 172.21.15.53:0/2554894248 conn(0x7f53a00fa700 msgr2=0x7f53a0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.994+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 shutdown_connections 2024-09-16T00:54:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:10.994+0000 7f53a699c700 1 -- 172.21.15.53:0/2554894248 wait complete. 2024-09-16T00:54:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 -- 172.21.15.53:0/1437686114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 msgr2=0x7fc6c0073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 --2- 172.21.15.53:0/1437686114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c0073160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b0a0 tx=0x7fc6b000b3b0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 -- 172.21.15.53:0/1437686114 shutdown_connections 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 --2- 172.21.15.53:0/1437686114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 --2- 172.21.15.53:0/1437686114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c0073160 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 -- 172.21.15.53:0/1437686114 >> 172.21.15.53:0/1437686114 conn(0x7fc6c00fb7e0 msgr2=0x7fc6c00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 -- 172.21.15.53:0/1437686114 shutdown_connections 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.103+0000 7fc6c8362700 1 -- 172.21.15.53:0/1437686114 wait complete. 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 Processor -- start 2024-09-16T00:54:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 -- start start 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01987e0 con 0x7fc6c0074d00 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c8362700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0198950 con 0x7fc6c0073730 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43564/0 (socket says 172.21.15.53:43564) 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 -- 172.21.15.53:0/2954801608 learned_addr learned my addr 172.21.15.53:0/2954801608 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c60fe700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 -- 172.21.15.53:0/2954801608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 msgr2=0x7fc6c0197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c58fd700 1 -- 172.21.15.53:0/2954801608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009d00 con 0x7fc6c0074d00 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.104+0000 7fc6c60fe700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6c58fd700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c8a0 tx=0x7fc6b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b400cea0 con 0x7fc6c0074d00 2024-09-16T00:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6b4004830 con 0x7fc6c0074d00 2024-09-16T00:54:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c019d3e0 con 0x7fc6c0074d00 2024-09-16T00:54:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b40055b0 con 0x7fc6c0074d00 2024-09-16T00:54:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.105+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c019d930 con 0x7fc6c0074d00 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.106+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c010af80 con 0x7fc6c0074d00 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.106+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc6b4007ad0 con 0x7fc6c0074d00 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.107+0000 7fc6bf7fe700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 0x7fc6a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.107+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc6b408e2d0 con 0x7fc6c0074d00 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.107+0000 7fc6c60fe700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 0x7fc6a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.107+0000 7fc6c60fe700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 0x7fc6a8070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b830 tx=0x7fc6b0006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.111+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc6b4057500 con 0x7fc6c0074d00 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T00:54:11.292 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T00:54:11.293 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T00:54:11.293 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate[86938]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T00:54:11.293 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 bash[86898]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T00:54:11.293 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:10 smithi053 podman[86898]: 2024-09-16 00:54:10.906510886 +0000 UTC m=+1.626372499 container died 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.349+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c01077d0 con 0x7fc6a806e680 2024-09-16T00:54:11.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.350+0000 7fc6bf7fe700 1 -- 172.21.15.53:0/2954801608 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc6c01077d0 con 0x7fc6a806e680 2024-09-16T00:54:11.351 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:54:11.351 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "7/23 daemons upgraded", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:54:11.352 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 msgr2=0x7fc6a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 0x7fc6a8070b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b830 tx=0x7fc6b0006000 comp rx=0 tx=0).stop 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 msgr2=0x7fc6c01981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c8a0 tx=0x7fc6b400cc60 comp rx=0 tx=0).stop 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 shutdown_connections 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc6a806e680 0x7fc6a8070b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6c0073730 0x7fc6c0197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 --2- 172.21.15.53:0/2954801608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c0074d00 0x7fc6c01981e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 >> 172.21.15.53:0/2954801608 conn(0x7fc6c00fb7e0 msgr2=0x7fc6c01060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 shutdown_connections 2024-09-16T00:54:11.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.353+0000 7fc6c8362700 1 -- 172.21.15.53:0/2954801608 wait complete. 2024-09-16T00:54:11.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 -- 172.21.15.53:0/3481791526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 msgr2=0x7ff9a4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/3481791526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4100860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff998009910 tx=0x7ff998009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 -- 172.21.15.53:0/3481791526 shutdown_connections 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/3481791526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4100860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/3481791526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 0x7ff9a40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.461+0000 7ff9aa33e700 1 -- 172.21.15.53:0/3481791526 >> 172.21.15.53:0/3481791526 conn(0x7ff9a40fa7a0 msgr2=0x7ff9a40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.462+0000 7ff9aa33e700 1 -- 172.21.15.53:0/3481791526 shutdown_connections 2024-09-16T00:54:11.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.462+0000 7ff9aa33e700 1 -- 172.21.15.53:0/3481791526 wait complete. 2024-09-16T00:54:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.462+0000 7ff9aa33e700 1 Processor -- start 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.462+0000 7ff9aa33e700 1 -- start start 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9aa33e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 0x7ff9a4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9aa33e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9aa33e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4196920 con 0x7ff9a41003f0 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9aa33e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4196a60 con 0x7ff9a40ff150 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43584/0 (socket says 172.21.15.53:43584) 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 -- 172.21.15.53:0/1138014195 learned_addr learned my addr 172.21.15.53:0/1138014195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a3fff700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 0x7ff9a4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 -- 172.21.15.53:0/1138014195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 msgr2=0x7ff9a4195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 0x7ff9a4195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 -- 172.21.15.53:0/1138014195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980095f0 con 0x7ff9a41003f0 2024-09-16T00:54:11.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a37fe700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff998006010 tx=0x7ff99800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.463+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99801d070 con 0x7ff9a41003f0 2024-09-16T00:54:11.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.464+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff99800f460 con 0x7ff9a41003f0 2024-09-16T00:54:11.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.464+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a419b4b0 con 0x7ff9a41003f0 2024-09-16T00:54:11.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.464+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff998021640 con 0x7ff9a41003f0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.464+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a419b9a0 con 0x7ff9a41003f0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.465+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a4068ab0 con 0x7ff9a41003f0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.465+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff99800fab0 con 0x7ff9a41003f0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.466+0000 7ff9a17fa700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 0x7ff98c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.466+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff99808f830 con 0x7ff9a41003f0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.466+0000 7ff9a3fff700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 0x7ff98c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:11.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.467+0000 7ff9a3fff700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 0x7ff98c070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff994005950 tx=0x7ff99400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:11.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.471+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff99805c5b0 con 0x7ff9a41003f0 2024-09-16T00:54:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: pgmap v68: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:54:11.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3633393687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:11.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:11 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2554894248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: pgmap v68: 65 pgs: 12 stale+active+clean, 53 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3633393687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:11 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2554894248' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:54:11.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.790+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9a419bbc0 con 0x7ff9a41003f0 2024-09-16T00:54:11.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.791+0000 7ff9a17fa700 1 -- 172.21.15.53:0/1138014195 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7ff99800f5d0 con 0x7ff9a41003f0 2024-09-16T00:54:11.792 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 osds down 2024-09-16T00:54:11.792 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T00:54:11.792 INFO:teuthology.orchestra.run.smithi053.stdout: osd.1 (root=default,host=smithi053) is down 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 msgr2=0x7ff98c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 0x7ff98c070b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff994005950 tx=0x7ff99400b410 comp rx=0 tx=0).stop 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 msgr2=0x7ff9a4196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff998006010 tx=0x7ff99800bd70 comp rx=0 tx=0).stop 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 shutdown_connections 2024-09-16T00:54:11.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff98c06e680 0x7ff98c070b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a40ff150 0x7ff9a4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 --2- 172.21.15.53:0/1138014195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9a41003f0 0x7ff9a4196300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:11.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 >> 172.21.15.53:0/1138014195 conn(0x7ff9a40fa7a0 msgr2=0x7ff9a4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:11.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 shutdown_connections 2024-09-16T00:54:11.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:11.793+0000 7ff9aa33e700 1 -- 172.21.15.53:0/1138014195 wait complete. 2024-09-16T00:54:12.035 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:11 smithi053 podman[87152]: 2024-09-16 00:54:11.693178226 +0000 UTC m=+0.780166719 container remove 7b4e064f8702142934469e45b19a2bfaf35237c89972ea85259d742d91666418 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-16T00:54:12.036 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:11 smithi053 podman[87259]: 2024-09-16 00:54:11.813900077 +0000 UTC m=+0.017459093 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:12.036 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:11 smithi053 podman[87259]: 2024-09-16 00:54:11.927609964 +0000 UTC m=+0.131169010 container create 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-16T00:54:12.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:12 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1138014195' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:54:12.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:12 smithi053 podman[87259]: 2024-09-16 00:54:12.338859552 +0000 UTC m=+0.542418559 container init 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T00:54:12.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:12 smithi053 podman[87259]: 2024-09-16 00:54:12.342527585 +0000 UTC m=+0.546086592 container start 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:54:12.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:12 smithi053 ceph-osd[87280]: -- 172.21.15.53:0/1707156851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615eb2021e0 con 0x5615eb198000 2024-09-16T00:54:12.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:12 smithi053 bash[87259]: 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 2024-09-16T00:54:12.570 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:12 smithi053 systemd[1]: Started Ceph osd.1 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:54:12.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:12 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1138014195' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:54:13.505 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:13.505 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:13.505 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:13.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:13.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:13.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:14.557 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:14 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T00:54:14.218+0000 7f0660923640 -1 Falling back to public interface 2024-09-16T00:54:15.456 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:15 smithi053 ceph-mon[77492]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:15.456 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:15.456 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:15 smithi152 ceph-mon[63606]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:17.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:17 smithi053 ceph-mon[77492]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 933 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:17.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:17 smithi152 ceph-mon[63606]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 933 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:18.934 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.934 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.934 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:18 smithi053 ceph-mon[77492]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:18.934 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.934 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:18 smithi152 ceph-mon[63606]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:18.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:20.069 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:19 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T00:54:19.867+0000 7f0660923640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-16T00:54:20.698 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:20 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T00:54:20.456+0000 7f0660923640 -1 osd.1 54 log_to_monitors true 2024-09-16T00:54:21.319 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 00:54:21 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T00:54:21.237+0000 7f06586bd640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:54:21.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:21 smithi053 ceph-mon[77492]: pgmap v73: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:21.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:21 smithi053 ceph-mon[77492]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:54:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:21 smithi152 ceph-mon[63606]: pgmap v73: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:21 smithi152 ceph-mon[63606]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T00:54:22.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:54:22.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: osdmap e57: 6 total, 5 up, 6 in 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:22 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: osdmap e57: 6 total, 5 up, 6 in 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:22.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:22.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:22.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:22 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T00:54:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: pgmap v75: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:23.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:54:23.507 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967] boot 2024-09-16T00:54:23.507 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: osdmap e58: 6 total, 6 up, 6 in 2024-09-16T00:54:23.507 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: pgmap v75: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: osd.1 [v2:172.21.15.53:6810/317990967,v1:172.21.15.53:6811/317990967] boot 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: osdmap e58: 6 total, 6 up, 6 in 2024-09-16T00:54:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:23 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T00:54:24.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:24 smithi053 ceph-mon[77492]: osdmap e59: 6 total, 6 up, 6 in 2024-09-16T00:54:24.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:24 smithi152 ceph-mon[63606]: osdmap e59: 6 total, 6 up, 6 in 2024-09-16T00:54:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:25 smithi053 ceph-mon[77492]: pgmap v78: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:25 smithi152 ceph-mon[63606]: pgmap v78: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:26.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:26 smithi053 ceph-mon[77492]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:26.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:26 smithi152 ceph-mon[63606]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:27 smithi053 ceph-mon[77492]: pgmap v79: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/222 objects degraded (7.207%) 2024-09-16T00:54:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:27 smithi152 ceph-mon[63606]: pgmap v79: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 16/222 objects degraded (7.207%) 2024-09-16T00:54:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:28 smithi152 ceph-mon[63606]: pgmap v80: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 736 B/s rd, 1 op/s 2024-09-16T00:54:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:28 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-16T00:54:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:28 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:54:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:28 smithi053 ceph-mon[77492]: pgmap v80: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 736 B/s rd, 1 op/s 2024-09-16T00:54:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:28 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-16T00:54:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:28 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:54:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:31 smithi053 ceph-mon[77492]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:54:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:31 smithi152 ceph-mon[63606]: pgmap v81: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:54:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:33 smithi053 ceph-mon[77492]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T00:54:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:33 smithi152 ceph-mon[63606]: pgmap v82: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T00:54:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:35 smithi053 ceph-mon[77492]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 935 B/s rd, 1 op/s 2024-09-16T00:54:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:35 smithi152 ceph-mon[63606]: pgmap v83: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 935 B/s rd, 1 op/s 2024-09-16T00:54:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:37 smithi053 ceph-mon[77492]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:37 smithi152 ceph-mon[63606]: pgmap v84: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:38.508 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:38 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:38.509 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:38 smithi053 ceph-mon[77492]: Upgrade: osd.2 is safe to restart 2024-09-16T00:54:38.509 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:38 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:38.509 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:38 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:54:38.509 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:38 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:38 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T00:54:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:38 smithi152 ceph-mon[63606]: Upgrade: osd.2 is safe to restart 2024-09-16T00:54:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:38 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:38 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T00:54:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:38 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:39.405 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:39 smithi053 ceph-mon[77492]: Upgrade: Updating osd.2 2024-09-16T00:54:39.405 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:39 smithi053 ceph-mon[77492]: Deploying daemon osd.2 on smithi053 2024-09-16T00:54:39.406 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:39 smithi053 ceph-mon[77492]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:39 smithi152 ceph-mon[63606]: Upgrade: Updating osd.2 2024-09-16T00:54:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:39 smithi152 ceph-mon[63606]: Deploying daemon osd.2 on smithi053 2024-09-16T00:54:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:39 smithi152 ceph-mon[63606]: pgmap v85: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:41.246 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:40 smithi053 systemd[1]: Stopping Ceph osd.2 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:54:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:41 smithi053 ceph-mon[77492]: pgmap v86: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:41.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:41 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[53860]: 2024-09-16T00:54:41.248+0000 7f6c3a971700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:54:41.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:41 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[53860]: 2024-09-16T00:54:41.248+0000 7f6c3a971700 -1 osd.2 59 *** Got signal Terminated *** 2024-09-16T00:54:41.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:41 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[53860]: 2024-09-16T00:54:41.248+0000 7f6c3a971700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:54:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:41 smithi152 ceph-mon[63606]: pgmap v86: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:54:41.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 -- 172.21.15.53:0/2490485348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 msgr2=0x7f504c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 --2- 172.21.15.53:0/2490485348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c100860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5040009910 tx=0x7f5040009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 -- 172.21.15.53:0/2490485348 shutdown_connections 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 --2- 172.21.15.53:0/2490485348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c100860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 --2- 172.21.15.53:0/2490485348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 0x7f504c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 -- 172.21.15.53:0/2490485348 >> 172.21.15.53:0/2490485348 conn(0x7f504c0fa7a0 msgr2=0x7f504c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:41.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 -- 172.21.15.53:0/2490485348 shutdown_connections 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.916+0000 7f5051e50700 1 -- 172.21.15.53:0/2490485348 wait complete. 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 Processor -- start 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 -- start start 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 0x7f504c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c101d10 con 0x7f504c1003f0 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.917+0000 7f5051e50700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c101e50 con 0x7f504c0ff150 2024-09-16T00:54:41.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55884/0 (socket says 172.21.15.53:55884) 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 -- 172.21.15.53:0/3190926429 learned_addr learned my addr 172.21.15.53:0/3190926429 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504b7fe700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 0x7f504c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 -- 172.21.15.53:0/3190926429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 msgr2=0x7f504c103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 0x7f504c103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 -- 172.21.15.53:0/3190926429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400095f0 con 0x7f504c1003f0 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f504affd700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5040006010 tx=0x7f504000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504001d070 con 0x7f504c1003f0 2024-09-16T00:54:41.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f504000f460 con 0x7f504c1003f0 2024-09-16T00:54:41.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c1020d0 con 0x7f504c1003f0 2024-09-16T00:54:41.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5040021640 con 0x7f504c1003f0 2024-09-16T00:54:41.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.918+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c1025c0 con 0x7f504c1003f0 2024-09-16T00:54:41.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.919+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c068ab0 con 0x7f504c1003f0 2024-09-16T00:54:41.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.920+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5040003a60 con 0x7f504c1003f0 2024-09-16T00:54:41.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.920+0000 7f5048ff9700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 0x7f5034070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:41.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.920+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f504008f800 con 0x7f504c1003f0 2024-09-16T00:54:41.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.921+0000 7f504b7fe700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 0x7f5034070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:41.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.921+0000 7f504b7fe700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 0x7f5034070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f503c005950 tx=0x7f503c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:41.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:41.925+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f504005c560 con 0x7f504c1003f0 2024-09-16T00:54:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.159+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f504c0694e0 con 0x7f503406e680 2024-09-16T00:54:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.160+0000 7f5048ff9700 1 -- 172.21.15.53:0/3190926429 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f504c0694e0 con 0x7f503406e680 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 msgr2=0x7f5034070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 0x7f5034070b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f503c005950 tx=0x7f503c00b410 comp rx=0 tx=0).stop 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 msgr2=0x7f504c1017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5040006010 tx=0x7f504000bd70 comp rx=0 tx=0).stop 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 shutdown_connections 2024-09-16T00:54:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f503406e680 0x7f5034070b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504c0ff150 0x7f504c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 --2- 172.21.15.53:0/3190926429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f504c1003f0 0x7f504c1017d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 >> 172.21.15.53:0/3190926429 conn(0x7f504c0fa7a0 msgr2=0x7f504c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 shutdown_connections 2024-09-16T00:54:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.162+0000 7f5051e50700 1 -- 172.21.15.53:0/3190926429 wait complete. 2024-09-16T00:54:42.174 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:54:42.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 -- 172.21.15.53:0/1630476903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 msgr2=0x7f8e10105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/1630476903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10105a40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009910 tx=0x7f8df8009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:42.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 -- 172.21.15.53:0/1630476903 shutdown_connections 2024-09-16T00:54:42.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/1630476903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10105a40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/1630476903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 0x7f8e10103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 -- 172.21.15.53:0/1630476903 >> 172.21.15.53:0/1630476903 conn(0x7f8e100fa700 msgr2=0x7f8e100fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 -- 172.21.15.53:0/1630476903 shutdown_connections 2024-09-16T00:54:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.279+0000 7f8e14c6e700 1 -- 172.21.15.53:0/1630476903 wait complete. 2024-09-16T00:54:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 Processor -- start 2024-09-16T00:54:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 -- start start 2024-09-16T00:54:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 0x7f8e10195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10196620 con 0x7f8e10103660 2024-09-16T00:54:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e14c6e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10196760 con 0x7f8e10100d40 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55904/0 (socket says 172.21.15.53:55904) 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e0dd9b700 1 -- 172.21.15.53:0/764630826 learned_addr learned my addr 172.21.15.53:0/764630826 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.280+0000 7f8e0e59c700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 0x7f8e10195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e0dd9b700 1 -- 172.21.15.53:0/764630826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 msgr2=0x7f8e10195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e0dd9b700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 0x7f8e10195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e0dd9b700 1 -- 172.21.15.53:0/764630826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df80095f0 con 0x7f8e10103660 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e0dd9b700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005b40 tx=0x7f8df800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8df801d070 con 0x7f8e10103660 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8df800f460 con 0x7f8e10103660 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1019b160 con 0x7f8e10103660 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8df8021620 con 0x7f8e10103660 2024-09-16T00:54:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.281+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1019b650 con 0x7f8e10103660 2024-09-16T00:54:42.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.283+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1018fc70 con 0x7f8e10103660 2024-09-16T00:54:42.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.283+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8df800fa40 con 0x7f8e10103660 2024-09-16T00:54:42.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.283+0000 7f8e077fe700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 0x7f8dfc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.283+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8df808f7a0 con 0x7f8e10103660 2024-09-16T00:54:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.283+0000 7f8e0e59c700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 0x7f8dfc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.284+0000 7f8e0e59c700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 0x7f8dfc070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009550 tx=0x7f8e000091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:42.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.288+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8df805c5a0 con 0x7f8e10103660 2024-09-16T00:54:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.523+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e10061190 con 0x7f8dfc06e680 2024-09-16T00:54:42.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:42 smithi053 ceph-mon[77492]: osd.2 marked itself down and dead 2024-09-16T00:54:42.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.524+0000 7f8e077fe700 1 -- 172.21.15.53:0/764630826 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8e10061190 con 0x7f8dfc06e680 2024-09-16T00:54:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 msgr2=0x7f8dfc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 0x7f8dfc070b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009550 tx=0x7f8e000091b0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 msgr2=0x7f8e10196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005b40 tx=0x7f8df800bd70 comp rx=0 tx=0).stop 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 shutdown_connections 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f8dfc06e680 0x7f8dfc070b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e10100d40 0x7f8e10195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 --2- 172.21.15.53:0/764630826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e10103660 0x7f8e10196000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 >> 172.21.15.53:0/764630826 conn(0x7f8e100fa700 msgr2=0x7f8e100fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 shutdown_connections 2024-09-16T00:54:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.527+0000 7f8e14c6e700 1 -- 172.21.15.53:0/764630826 wait complete. 2024-09-16T00:54:42.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 -- 172.21.15.53:0/3896392032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 msgr2=0x7f60e8105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 --2- 172.21.15.53:0/3896392032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8105a60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009910 tx=0x7f60d4009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 -- 172.21.15.53:0/3896392032 shutdown_connections 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 --2- 172.21.15.53:0/3896392032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8105a60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 --2- 172.21.15.53:0/3896392032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 0x7f60e8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 -- 172.21.15.53:0/3896392032 >> 172.21.15.53:0/3896392032 conn(0x7f60e80fa780 msgr2=0x7f60e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 -- 172.21.15.53:0/3896392032 shutdown_connections 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.641+0000 7f60ef206700 1 -- 172.21.15.53:0/3896392032 wait complete. 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 Processor -- start 2024-09-16T00:54:42.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 -- start start 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 0x7f60e8195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8196640 con 0x7f60e8103680 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ef206700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8196780 con 0x7f60e8100d60 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48170/0 (socket says 172.21.15.53:48170) 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60e7fff700 1 -- 172.21.15.53:0/485996115 learned_addr learned my addr 172.21.15.53:0/485996115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.642+0000 7f60ecfa2700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 0x7f60e8195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e7fff700 1 -- 172.21.15.53:0/485996115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 msgr2=0x7f60e8195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e7fff700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 0x7f60e8195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e7fff700 1 -- 172.21.15.53:0/485996115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40095f0 con 0x7f60e8103680 2024-09-16T00:54:42.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e7fff700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d401d070 con 0x7f60e8103680 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e819b1d0 con 0x7f60e8103680 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60d400f460 con 0x7f60e8103680 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d4021640 con 0x7f60e8103680 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.643+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e819b6c0 con 0x7f60e8103680 2024-09-16T00:54:42.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.644+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e818fbe0 con 0x7f60e8103680 2024-09-16T00:54:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.645+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f60d400fab0 con 0x7f60e8103680 2024-09-16T00:54:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.645+0000 7f60e5ffb700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 0x7f60d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.645+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f60d408f870 con 0x7f60e8103680 2024-09-16T00:54:42.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.645+0000 7f60ecfa2700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 0x7f60d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.646+0000 7f60ecfa2700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 0x7f60d8070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60dc005950 tx=0x7f60dc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.650+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f60d405c5f0 con 0x7f60e8103680 2024-09-16T00:54:42.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:42 smithi152 ceph-mon[63606]: osd.2 marked itself down and dead 2024-09-16T00:54:42.819 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:42 smithi053 podman[89950]: 2024-09-16 00:54:42.614770871 +0000 UTC m=+1.490164275 container died c47adbd11b95d1e9fa87e41d00e3b8891c9fff4ac153568dff7a09372ff4501b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=HEAD) 2024-09-16T00:54:42.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.877+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60e8061190 con 0x7f60d806e680 2024-09-16T00:54:42.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.886+0000 7f60e5ffb700 1 -- 172.21.15.53:0/485996115 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f60e8061190 con 0x7f60d806e680 2024-09-16T00:54:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:54:42.887 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (11m) 25s ago 12m 25.6M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (12m) 25s ago 12m 8284k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (11m) 84s ago 11m 7620k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (92s) 25s ago 12m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (88s) 84s ago 11m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (11m) 25s ago 12m 85.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (7m) 25s ago 7m 152M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (6m) 25s ago 6m 98.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (7m) 84s ago 7m 16.6M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (6m) 84s ago 6m 14.9M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (3m) 25s ago 14m 498M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (2m) 84s ago 11m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:54:42.888 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (2m) 25s ago 14m 49.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (2m) 84s ago 11m 33.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (12m) 25s ago 12m 16.1M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (11m) 84s ago 11m 15.8M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (66s) 25s ago 10m 104M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (31s) 25s ago 10m 14.9M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (9m) 25s ago 9m 231M 1217M 18.2.0 dc2bc1663786 c47adbd11b95 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (9m) 84s ago 9m 289M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (9m) 84s ago 9m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:54:42.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (8m) 84s ago 8m 258M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:54:42.890 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (3m) 25s ago 12m 78.5M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:54:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 msgr2=0x7f60d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 0x7f60d8070b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60dc005950 tx=0x7f60dc00b410 comp rx=0 tx=0).stop 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 msgr2=0x7f60e8196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006010 tx=0x7f60d400bd70 comp rx=0 tx=0).stop 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 shutdown_connections 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f60d806e680 0x7f60d8070b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e8100d60 0x7f60e8195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 --2- 172.21.15.53:0/485996115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e8103680 0x7f60e8196020 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 >> 172.21.15.53:0/485996115 conn(0x7f60e80fa780 msgr2=0x7f60e80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 shutdown_connections 2024-09-16T00:54:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:42.889+0000 7f60ef206700 1 -- 172.21.15.53:0/485996115 wait complete. 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.003+0000 7f02a539b700 1 -- 172.21.15.53:0/3217428775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a01036a0 msgr2=0x7f02a0105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.003+0000 7f02a539b700 1 --2- 172.21.15.53:0/3217428775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a01036a0 0x7f02a0105a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0288009910 tx=0x7f0288009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.003+0000 7f02a539b700 1 -- 172.21.15.53:0/3217428775 shutdown_connections 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.003+0000 7f02a539b700 1 --2- 172.21.15.53:0/3217428775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a01036a0 0x7f02a0105a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.003+0000 7f02a539b700 1 --2- 172.21.15.53:0/3217428775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a0100d80 0x7f02a0103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.004+0000 7f02a539b700 1 -- 172.21.15.53:0/3217428775 >> 172.21.15.53:0/3217428775 conn(0x7f02a00fa7a0 msgr2=0x7f02a00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.004+0000 7f02a539b700 1 -- 172.21.15.53:0/3217428775 shutdown_connections 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.004+0000 7f02a539b700 1 -- 172.21.15.53:0/3217428775 wait complete. 2024-09-16T00:54:43.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.004+0000 7f02a539b700 1 Processor -- start 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f02a539b700 1 -- start start 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f02a539b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f02a539b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a01036a0 0x7f02a00fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f02a539b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00ff270 con 0x7f02a0100d80 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f02a539b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00ff3b0 con 0x7f02a01036a0 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48186/0 (socket says 172.21.15.53:48186) 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 -- 172.21.15.53:0/3521474044 learned_addr learned my addr 172.21.15.53:0/3521474044 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029e7fc700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a01036a0 0x7f02a00fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 -- 172.21.15.53:0/3521474044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a01036a0 msgr2=0x7f02a00fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a01036a0 0x7f02a00fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.005+0000 7f029effd700 1 -- 172.21.15.53:0/3521474044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880095f0 con 0x7f02a0100d80 2024-09-16T00:54:43.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f029effd700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f029000d900 tx=0x7f029000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0290009900 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0290010460 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a00ff690 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029000f5f0 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.006+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a019de20 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.007+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a018fc00 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.007+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f02900105d0 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.008+0000 7f0297fff700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 0x7f028c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.008+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f029008e190 con 0x7f02a0100d80 2024-09-16T00:54:43.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.008+0000 7f029e7fc700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 0x7f028c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.008+0000 7f029e7fc700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 0x7f028c070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f028800b5c0 tx=0x7f0288005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.012+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f029005af10 con 0x7f02a0100d80 2024-09-16T00:54:43.251 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[89950]: 2024-09-16 00:54:43.02481376 +0000 UTC m=+1.900207164 container cleanup c47adbd11b95d1e9fa87e41d00e3b8891c9fff4ac153568dff7a09372ff4501b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:43.251 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 bash[89950]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2 2024-09-16T00:54:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.347+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f02a002cdb0 con 0x7f02a0100d80 2024-09-16T00:54:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.347+0000 7f0297fff700 1 -- 172.21.15.53:0/3521474044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f029005aaa0 con 0x7f02a0100d80 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:54:43.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:54:43.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:54:43.351 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:54:43.351 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-16T00:54:43.351 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:54:43.351 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:54:43.351 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 msgr2=0x7f028c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 0x7f028c070b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f028800b5c0 tx=0x7f0288005ee0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 msgr2=0x7f02a01006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f029000d900 tx=0x7f029000dc10 comp rx=0 tx=0).stop 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 shutdown_connections 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f028c06e680 0x7f028c070b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02a0100d80 0x7f02a01006e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 --2- 172.21.15.53:0/3521474044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02a01036a0 0x7f02a00fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 >> 172.21.15.53:0/3521474044 conn(0x7f02a00fa7a0 msgr2=0x7f02a00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:43.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 shutdown_connections 2024-09-16T00:54:43.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.350+0000 7f02a539b700 1 -- 172.21.15.53:0/3521474044 wait complete. 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 -- 172.21.15.53:0/294131278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 msgr2=0x7f591c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 --2- 172.21.15.53:0/294131278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c0ff560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f590c009910 tx=0x7f590c009c20 comp rx=0 tx=0).stop 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 -- 172.21.15.53:0/294131278 shutdown_connections 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 --2- 172.21.15.53:0/294131278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 0x7f591c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 --2- 172.21.15.53:0/294131278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c0ff560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 -- 172.21.15.53:0/294131278 >> 172.21.15.53:0/294131278 conn(0x7f591c0fa700 msgr2=0x7f591c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:43.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 -- 172.21.15.53:0/294131278 shutdown_connections 2024-09-16T00:54:43.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.478+0000 7f5920cc7700 1 -- 172.21.15.53:0/294131278 wait complete. 2024-09-16T00:54:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 Processor -- start 2024-09-16T00:54:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 -- start start 2024-09-16T00:54:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 0x7f591c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c19ad70 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5920cc7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c19aeb0 con 0x7f591c100350 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48206/0 (socket says 172.21.15.53:48206) 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 -- 172.21.15.53:0/3322575872 learned_addr learned my addr 172.21.15.53:0/3322575872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f5919d9b700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 0x7f591c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 -- 172.21.15.53:0/3322575872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 msgr2=0x7f591c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 0x7f591c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.479+0000 7f591a59c700 1 -- 172.21.15.53:0/3322575872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0095f0 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f591a59c700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f590c00bda0 tx=0x7f590c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590c01d070 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f590c022470 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590c00f670 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c19b130 con 0x7f591c0ff150 2024-09-16T00:54:43.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.480+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c19b5d0 con 0x7f591c0ff150 2024-09-16T00:54:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.481+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c107ca0 con 0x7f591c0ff150 2024-09-16T00:54:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.482+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f590c004af0 con 0x7f591c0ff150 2024-09-16T00:54:43.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.482+0000 7f590b7fe700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 0x7f5904070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.482+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f590c08fbc0 con 0x7f591c0ff150 2024-09-16T00:54:43.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.482+0000 7f5919d9b700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 0x7f5904070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.483+0000 7f5919d9b700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 0x7f5904070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f591000ac50 tx=0x7f591000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.487+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f590c05c9f0 con 0x7f591c0ff150 2024-09-16T00:54:43.505 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[90016]: 2024-09-16 00:54:43.251193909 +0000 UTC m=+0.636008220 container remove c47adbd11b95d1e9fa87e41d00e3b8891c9fff4ac153568dff7a09372ff4501b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:43.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:43 smithi053 ceph-mon[77492]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:43.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:43 smithi053 ceph-mon[77492]: pgmap v87: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:43.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:43 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:54:43.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:43 smithi053 ceph-mon[77492]: osdmap e60: 6 total, 5 up, 6 in 2024-09-16T00:54:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:43 smithi152 ceph-mon[63606]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:43 smithi152 ceph-mon[63606]: pgmap v87: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:54:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:43 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:54:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:43 smithi152 ceph-mon[63606]: osdmap e60: 6 total, 5 up, 6 in 2024-09-16T00:54:43.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.762+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f591c19c130 con 0x7f591c0ff150 2024-09-16T00:54:43.764 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[90168]: 2024-09-16 00:54:43.735501939 +0000 UTC m=+0.112264490 container create 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-16T00:54:43.764 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[90168]: 2024-09-16 00:54:43.640296004 +0000 UTC m=+0.017058565 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:43.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.763+0000 7f590b7fe700 1 -- 172.21.15.53:0/3322575872 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f590c027070 con 0x7f591c0ff150 2024-09-16T00:54:43.764 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:54:43.764 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:54:43.765 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:54:43.766 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:54:43.767 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:43.768 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:54:43.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 msgr2=0x7f5904070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 0x7f5904070b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f591000ac50 tx=0x7f591000a380 comp rx=0 tx=0).stop 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 msgr2=0x7f591c069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f590c00bda0 tx=0x7f590c00bdd0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 shutdown_connections 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f590406e680 0x7f5904070b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f591c0ff150 0x7f591c069990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 --2- 172.21.15.53:0/3322575872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f591c100350 0x7f591c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 >> 172.21.15.53:0/3322575872 conn(0x7f591c0fa700 msgr2=0x7f591c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 shutdown_connections 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.765+0000 7f5920cc7700 1 -- 172.21.15.53:0/3322575872 wait complete. 2024-09-16T00:54:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 -- 172.21.15.53:0/49241856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 msgr2=0x7f1c7c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 --2- 172.21.15.53:0/49241856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c100650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b0a0 tx=0x7f1c6c00b3b0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 -- 172.21.15.53:0/49241856 shutdown_connections 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 --2- 172.21.15.53:0/49241856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 --2- 172.21.15.53:0/49241856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c100650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 -- 172.21.15.53:0/49241856 >> 172.21.15.53:0/49241856 conn(0x7f1c7c0fb7f0 msgr2=0x7f1c7c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:43.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 -- 172.21.15.53:0/49241856 shutdown_connections 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.882+0000 7f1c82e61700 1 -- 172.21.15.53:0/49241856 wait complete. 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 Processor -- start 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 -- start start 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1965a0 con 0x7f1c7c100240 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c82e61700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1966e0 con 0x7f1c7c101440 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48216/0 (socket says 172.21.15.53:48216) 2024-09-16T00:54:43.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 -- 172.21.15.53:0/4106650620 learned_addr learned my addr 172.21.15.53:0/4106650620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c7bfff700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 -- 172.21.15.53:0/4106650620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 msgr2=0x7f1c7c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c80bfd700 1 -- 172.21.15.53:0/4106650620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c009d00 con 0x7f1c7c100240 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.883+0000 7f1c7bfff700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c80bfd700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0077b0 tx=0x7f1c6c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c00e040 con 0x7f1c7c100240 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c19b140 con 0x7f1c7c100240 2024-09-16T00:54:43.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c6c00ce60 con 0x7f1c7c100240 2024-09-16T00:54:43.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c01db10 con 0x7f1c7c100240 2024-09-16T00:54:43.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.884+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c19b600 con 0x7f1c7c100240 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.885+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c108d90 con 0x7f1c7c100240 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.886+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1c6c01dc90 con 0x7f1c7c100240 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.886+0000 7f1c79ffb700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 0x7f1c68070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.886+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1c6c08ffd0 con 0x7f1c7c100240 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.886+0000 7f1c7bfff700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 0x7f1c68070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:43.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.887+0000 7f1c7bfff700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 0x7f1c68070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:43.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:43.891+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c6c05cdd0 con 0x7f1c7c100240 2024-09-16T00:54:44.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[90168]: 2024-09-16 00:54:43.988530236 +0000 UTC m=+0.365292787 container init 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:44.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:43 smithi053 podman[90168]: 2024-09-16 00:54:43.99218732 +0000 UTC m=+0.368949875 container start 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-16T00:54:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.148+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c7c105d90 con 0x7f1c6806e680 2024-09-16T00:54:44.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.149+0000 7f1c79ffb700 1 -- 172.21.15.53:0/4106650620 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1c7c105d90 con 0x7f1c6806e680 2024-09-16T00:54:44.150 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:54:44.150 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:54:44.150 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:54:44.150 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "8/23 daemons upgraded", 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:54:44.151 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.151+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 msgr2=0x7f1c68070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 0x7f1c68070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64005e30 comp rx=0 tx=0).stop 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 msgr2=0x7f1c7c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0077b0 tx=0x7f1c6c003ce0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 shutdown_connections 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1c6806e680 0x7f1c68070b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7c100240 0x7f1c7c195ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 --2- 172.21.15.53:0/4106650620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c7c101440 0x7f1c7c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 >> 172.21.15.53:0/4106650620 conn(0x7f1c7c0fb7f0 msgr2=0x7f1c7c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 shutdown_connections 2024-09-16T00:54:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.152+0000 7f1c82e61700 1 -- 172.21.15.53:0/4106650620 wait complete. 2024-09-16T00:54:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 -- 172.21.15.53:0/4044521578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99200ff130 msgr2=0x7f99200ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 --2- 172.21.15.53:0/4044521578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99200ff130 0x7f99200ff540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f991000b0a0 tx=0x7f991000b3b0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 -- 172.21.15.53:0/4044521578 shutdown_connections 2024-09-16T00:54:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 --2- 172.21.15.53:0/4044521578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99201003d0 0x7f9920100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 --2- 172.21.15.53:0/4044521578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99200ff130 0x7f99200ff540 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 -- 172.21.15.53:0/4044521578 >> 172.21.15.53:0/4044521578 conn(0x7f99200fa780 msgr2=0x7f99200fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 -- 172.21.15.53:0/4044521578 shutdown_connections 2024-09-16T00:54:44.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.272+0000 7f9925173700 1 -- 172.21.15.53:0/4044521578 wait complete. 2024-09-16T00:54:44.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 Processor -- start 2024-09-16T00:54:44.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 -- start start 2024-09-16T00:54:44.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99200ff130 0x7f9920195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:44.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920196600 con 0x7f99201003d0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f9925173700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920196740 con 0x7f99200ff130 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f991e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f991e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48234/0 (socket says 172.21.15.53:48234) 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.273+0000 7f991e59c700 1 -- 172.21.15.53:0/2152187389 learned_addr learned my addr 172.21.15.53:0/2152187389 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f991ed9d700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99200ff130 0x7f9920195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f991e59c700 1 -- 172.21.15.53:0/2152187389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99200ff130 msgr2=0x7f9920195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f991e59c700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99200ff130 0x7f9920195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f991e59c700 1 -- 172.21.15.53:0/2152187389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009d00 con 0x7f99201003d0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f991e59c700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f990800d900 tx=0x7f990800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99080041f0 con 0x7f99201003d0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9908004ce0 con 0x7f99201003d0 2024-09-16T00:54:44.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992019b1f0 con 0x7f99201003d0 2024-09-16T00:54:44.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990800b750 con 0x7f99201003d0 2024-09-16T00:54:44.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.274+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992019b740 con 0x7f99201003d0 2024-09-16T00:54:44.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.275+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920107c10 con 0x7f99201003d0 2024-09-16T00:54:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.276+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9908004350 con 0x7f99201003d0 2024-09-16T00:54:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.276+0000 7f9917fff700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 0x7f990c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:54:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.276+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f990808e4b0 con 0x7f99201003d0 2024-09-16T00:54:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.276+0000 7f991ed9d700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 0x7f990c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:54:44.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.277+0000 7f991ed9d700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 0x7f990c070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99100062a0 tx=0x7f99100061f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:54:44.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.281+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f990805b230 con 0x7f99201003d0 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: osdmap e61: 6 total, 5 up, 6 in 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3521474044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3322575872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:44.534 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:44.535 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 podman[90168]: 2024-09-16 00:54:44.080292768 +0000 UTC m=+0.457055326 container attach 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:54:44.535 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 podman[90168]: 2024-09-16 00:54:44.188637644 +0000 UTC m=+0.565400194 container died 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:54:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.591+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9920107e00 con 0x7f99201003d0 2024-09-16T00:54:44.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.591+0000 7f9917fff700 1 -- 172.21.15.53:0/2152187389 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f990805adc0 con 0x7f99201003d0 2024-09-16T00:54:44.593 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 osds down 2024-09-16T00:54:44.593 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T00:54:44.593 INFO:teuthology.orchestra.run.smithi053.stdout: osd.2 (root=default,host=smithi053) is down 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 msgr2=0x7f990c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 0x7f990c070b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99100062a0 tx=0x7f99100061f0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 msgr2=0x7f9920195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f990800d900 tx=0x7f990800dcc0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 shutdown_connections 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f990c06e680 0x7f990c070b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99200ff130 0x7f9920195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 --2- 172.21.15.53:0/2152187389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99201003d0 0x7f9920195fe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 >> 172.21.15.53:0/2152187389 conn(0x7f99200fa780 msgr2=0x7f9920068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:54:44.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 shutdown_connections 2024-09-16T00:54:44.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:54:44.594+0000 7f9925173700 1 -- 172.21.15.53:0/2152187389 wait complete. 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: osdmap e61: 6 total, 5 up, 6 in 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3521474044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3322575872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:54:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:44.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:54:45.264 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 podman[90216]: 2024-09-16 00:54:44.825980905 +0000 UTC m=+0.631463371 container remove 45d56834a2f04932e727445bdb20d3a03a7592eb06b686f97b2320ebc3368eac (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-16T00:54:45.264 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-16T00:54:45.264 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 systemd[1]: Stopped Ceph osd.2 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:54:45.264 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:44 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.2.service: Consumed 1min 2.502s CPU time. 2024-09-16T00:54:45.264 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 systemd[1]: Starting Ceph osd.2 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:54:45.563 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:45 smithi053 ceph-mon[77492]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:45.563 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:45 smithi053 ceph-mon[77492]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T00:54:45.563 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:45 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2152187389' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:54:45.564 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 podman[90338]: 2024-09-16 00:54:45.188615438 +0000 UTC m=+0.016556222 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:45.564 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 podman[90338]: 2024-09-16 00:54:45.327857888 +0000 UTC m=+0.155798707 container create 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T00:54:45.564 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 podman[90338]: 2024-09-16 00:54:45.563482573 +0000 UTC m=+0.391423352 container init 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-16T00:54:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:45 smithi152 ceph-mon[63606]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:54:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:45 smithi152 ceph-mon[63606]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T00:54:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:45 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2152187389' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:54:45.819 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 podman[90338]: 2024-09-16 00:54:45.566932297 +0000 UTC m=+0.394873067 container start 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:45.820 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 podman[90338]: 2024-09-16 00:54:45.672135882 +0000 UTC m=+0.500076660 container attach 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-16T00:54:45.820 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:45.820 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 bash[90338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:45.820 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:45.820 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:45 smithi053 bash[90338]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:54:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-mon[77492]: pgmap v91: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 19/222 objects degraded (8.559%) 2024-09-16T00:54:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 8 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:46.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T00:54:46.570 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T00:54:46.570 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T00:54:46.570 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T00:54:46.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:46 smithi152 ceph-mon[63606]: pgmap v91: 65 pgs: 12 active+undersized, 4 stale+active+clean, 8 active+undersized+degraded, 41 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 19/222 objects degraded (8.559%) 2024-09-16T00:54:46.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:46 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 8 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T00:54:47.070 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate[90353]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T00:54:47.071 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 bash[90338]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T00:54:47.071 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:46 smithi053 podman[90338]: 2024-09-16 00:54:46.770067289 +0000 UTC m=+1.598008066 container died 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T00:54:47.783 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 podman[90488]: 2024-09-16 00:54:47.417511223 +0000 UTC m=+0.640947059 container remove 549c8c1873176564b38a72048fbd325775ad411c6ea5a14bfa59ba707a9ac8a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T00:54:47.783 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 podman[90549]: 2024-09-16 00:54:47.537339398 +0000 UTC m=+0.016744990 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:54:47.783 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 podman[90549]: 2024-09-16 00:54:47.651903188 +0000 UTC m=+0.131308767 container create d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T00:54:48.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 podman[90549]: 2024-09-16 00:54:47.912739572 +0000 UTC m=+0.392145159 container init d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T00:54:48.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 podman[90549]: 2024-09-16 00:54:47.916475879 +0000 UTC m=+0.395881457 container start d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:54:48.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:47 smithi053 ceph-osd[90568]: -- 172.21.15.53:0/748164226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b624f661e0 con 0x55b624113c00 2024-09-16T00:54:48.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:48 smithi053 bash[90549]: d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 2024-09-16T00:54:48.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:48 smithi053 systemd[1]: Started Ceph osd.2 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:54:49.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:49.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:49.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:49.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:49 smithi152 ceph-mon[63606]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:49 smithi053 ceph-mon[77492]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:50.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:49 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T00:54:49.793+0000 7f0861431640 -1 Falling back to public interface 2024-09-16T00:54:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:51 smithi053 ceph-mon[77492]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:51 smithi152 ceph-mon[63606]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:52 smithi053 ceph-mon[77492]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:52 smithi152 ceph-mon[63606]: Health check update: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:54:53.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:53 smithi053 ceph-mon[77492]: pgmap v94: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 825 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:53 smithi152 ceph-mon[63606]: pgmap v94: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 825 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:54 smithi053 ceph-mon[77492]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 750 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:54 smithi152 ceph-mon[63606]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 750 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:55.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:55 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T00:54:55.120+0000 7f0861431640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-16T00:54:55.827 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:55 smithi053 ceph-mon[77492]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:54:55.827 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:55 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T00:54:55.575+0000 7f0861431640 -1 osd.2 59 log_to_monitors true 2024-09-16T00:54:55.828 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 00:54:55 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T00:54:55.645+0000 7f08591cb640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:54:55.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:55 smithi152 ceph-mon[63606]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T00:54:56.868 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:56 smithi053 ceph-mon[77492]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:54:56.868 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:56 smithi053 ceph-mon[77492]: osdmap e62: 6 total, 5 up, 6 in 2024-09-16T00:54:56.868 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:56 smithi053 ceph-mon[77492]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:54:56.869 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:56 smithi053 ceph-mon[77492]: pgmap v97: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:56.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:56 smithi152 ceph-mon[63606]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T00:54:56.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:56 smithi152 ceph-mon[63606]: osdmap e62: 6 total, 5 up, 6 in 2024-09-16T00:54:56.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:56 smithi152 ceph-mon[63606]: from='osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-16T00:54:56.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:56 smithi152 ceph-mon[63606]: pgmap v97: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:57.918 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:54:57.918 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069] boot 2024-09-16T00:54:57.918 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: osdmap e63: 6 total, 6 up, 6 in 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.919 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: osd.2 [v2:172.21.15.53:6818/3190032069,v1:172.21.15.53:6819/3190032069] boot 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: osdmap e63: 6 total, 6 up, 6 in 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:54:57.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:54:57.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:54:58.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:58 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:54:58.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:58 smithi152 ceph-mon[63606]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T00:54:58.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:58 smithi152 ceph-mon[63606]: osdmap e64: 6 total, 6 up, 6 in 2024-09-16T00:54:58.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:54:58 smithi152 ceph-mon[63606]: pgmap v100: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:54:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:58 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:54:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:58 smithi053 ceph-mon[77492]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T00:54:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:58 smithi053 ceph-mon[77492]: osdmap e64: 6 total, 6 up, 6 in 2024-09-16T00:54:59.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:54:58 smithi053 ceph-mon[77492]: pgmap v100: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:55:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:00.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:00.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:01 smithi053 ceph-mon[77492]: pgmap v101: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:55:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:01 smithi152 ceph-mon[63606]: pgmap v101: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-16T00:55:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:02 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded) 2024-09-16T00:55:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:02 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:55:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:02 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/222 objects degraded (13.964%), 11 pgs degraded) 2024-09-16T00:55:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:02 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:55:03.505 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:03 smithi053 ceph-mon[77492]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 782 B/s rd, 1 op/s 2024-09-16T00:55:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:03 smithi152 ceph-mon[63606]: pgmap v102: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 782 B/s rd, 1 op/s 2024-09-16T00:55:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:05 smithi053 ceph-mon[77492]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:05.664 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:05 smithi152 ceph-mon[63606]: pgmap v103: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:07 smithi053 ceph-mon[77492]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T00:55:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:07 smithi152 ceph-mon[63606]: pgmap v104: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-16T00:55:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:09 smithi053 ceph-mon[77492]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-09-16T00:55:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:09 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:09 smithi152 ceph-mon[63606]: pgmap v105: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-09-16T00:55:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:09 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:11 smithi053 ceph-mon[77492]: pgmap v106: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:55:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:11 smithi152 ceph-mon[63606]: pgmap v106: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:55:13.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:13 smithi053 ceph-mon[77492]: pgmap v107: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:13.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:55:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:13 smithi152 ceph-mon[63606]: pgmap v107: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:55:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:55:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: Upgrade: osd.3 is safe to restart 2024-09-16T00:55:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:14.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:55:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:14.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T00:55:14.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: Upgrade: osd.3 is safe to restart 2024-09-16T00:55:14.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:14.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T00:55:14.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:14.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:14.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 -- 172.21.15.53:0/3833949184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c101440 msgr2=0x7f272c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 --2- 172.21.15.53:0/3833949184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c101440 0x7f272c101890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2720009910 tx=0x7f2720009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 -- 172.21.15.53:0/3833949184 shutdown_connections 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 --2- 172.21.15.53:0/3833949184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c101440 0x7f272c101890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 --2- 172.21.15.53:0/3833949184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c100240 0x7f272c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 -- 172.21.15.53:0/3833949184 >> 172.21.15.53:0/3833949184 conn(0x7f272c0fb7f0 msgr2=0x7f272c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 -- 172.21.15.53:0/3833949184 shutdown_connections 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.720+0000 7f2732838700 1 -- 172.21.15.53:0/3833949184 wait complete. 2024-09-16T00:55:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.721+0000 7f2732838700 1 Processor -- start 2024-09-16T00:55:14.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.721+0000 7f2732838700 1 -- start start 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.721+0000 7f2732838700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.721+0000 7f2732838700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c101440 0x7f272c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f2732838700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c196610 con 0x7f272c100240 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f2732838700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c196750 con 0x7f272c101440 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59276/0 (socket says 172.21.15.53:59276) 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 -- 172.21.15.53:0/2981654062 learned_addr learned my addr 172.21.15.53:0/2981654062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272b7fe700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c101440 0x7f272c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 -- 172.21.15.53:0/2981654062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c101440 msgr2=0x7f272c195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:14.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c101440 0x7f272c195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 -- 172.21.15.53:0/2981654062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200095f0 con 0x7f272c100240 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f272bfff700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e8f0 tx=0x7f271c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c009790 con 0x7f272c100240 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f271c00c810 con 0x7f272c100240 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c19b200 con 0x7f272c100240 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.722+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c003d20 con 0x7f272c100240 2024-09-16T00:55:14.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.723+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c19b750 con 0x7f272c100240 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.724+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c108d90 con 0x7f272c100240 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.724+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f271c0041f0 con 0x7f272c100240 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.725+0000 7f27297fa700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 0x7f2714070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.725+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f271c014070 con 0x7f272c100240 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.725+0000 7f272b7fe700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 0x7f2714070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:14.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.725+0000 7f272b7fe700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 0x7f2714070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f272000b6f0 tx=0x7f2720005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:14.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.729+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f271c05b6b0 con 0x7f272c100240 2024-09-16T00:55:14.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.966+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f272c105d90 con 0x7f271406e680 2024-09-16T00:55:14.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.968+0000 7f27297fa700 1 -- 172.21.15.53:0/2981654062 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f272c105d90 con 0x7f271406e680 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 msgr2=0x7f2714070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 0x7f2714070b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f272000b6f0 tx=0x7f2720005a90 comp rx=0 tx=0).stop 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 msgr2=0x7f272c195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e8f0 tx=0x7f271c00ec00 comp rx=0 tx=0).stop 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 shutdown_connections 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f271406e680 0x7f2714070b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c100240 0x7f272c195ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 --2- 172.21.15.53:0/2981654062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f272c101440 0x7f272c195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:14.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 >> 172.21.15.53:0/2981654062 conn(0x7f272c0fb7f0 msgr2=0x7f272c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:14.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 shutdown_connections 2024-09-16T00:55:14.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:14.970+0000 7f2732838700 1 -- 172.21.15.53:0/2981654062 wait complete. 2024-09-16T00:55:14.982 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:55:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 -- 172.21.15.53:0/1511136988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 msgr2=0x7f7310102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 --2- 172.21.15.53:0/1511136988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310102e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7300009910 tx=0x7f7300009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 -- 172.21.15.53:0/1511136988 shutdown_connections 2024-09-16T00:55:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 --2- 172.21.15.53:0/1511136988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 0x7f7310105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 --2- 172.21.15.53:0/1511136988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310102e30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 -- 172.21.15.53:0/1511136988 >> 172.21.15.53:0/1511136988 conn(0x7f73100fa780 msgr2=0x7f73100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 -- 172.21.15.53:0/1511136988 shutdown_connections 2024-09-16T00:55:15.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.080+0000 7f7316293700 1 -- 172.21.15.53:0/1511136988 wait complete. 2024-09-16T00:55:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 Processor -- start 2024-09-16T00:55:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 -- start start 2024-09-16T00:55:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 0x7f73100fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100ff310 con 0x7f7310069210 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7316293700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73100ff450 con 0x7f7310103370 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f730ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f730ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59294/0 (socket says 172.21.15.53:59294) 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f730ffff700 1 -- 172.21.15.53:0/927189159 learned_addr learned my addr 172.21.15.53:0/927189159 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.081+0000 7f7307fff700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 0x7f73100fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730ffff700 1 -- 172.21.15.53:0/927189159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 msgr2=0x7f73100fedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730ffff700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 0x7f73100fedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730ffff700 1 -- 172.21.15.53:0/927189159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000095f0 con 0x7f7310069210 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730ffff700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7300005b40 tx=0x7f730000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730001d070 con 0x7f7310069210 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7300005dc0 con 0x7f7310069210 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73100ff6d0 con 0x7f7310069210 2024-09-16T00:55:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7300022470 con 0x7f7310069210 2024-09-16T00:55:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.082+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73100ffbc0 con 0x7f7310069210 2024-09-16T00:55:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.083+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731018fbd0 con 0x7f7310069210 2024-09-16T00:55:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.084+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7300003680 con 0x7f7310069210 2024-09-16T00:55:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.084+0000 7f730dffb700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 0x7f72fc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.084+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f730008fa40 con 0x7f7310069210 2024-09-16T00:55:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.085+0000 7f7307fff700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 0x7f72fc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.085+0000 7f7307fff700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 0x7f72fc070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009c60 tx=0x7f72f8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.089+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f730005c840 con 0x7f7310069210 2024-09-16T00:55:15.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.325+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7310061190 con 0x7f72fc06e680 2024-09-16T00:55:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.327+0000 7f730dffb700 1 -- 172.21.15.53:0/927189159 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7310061190 con 0x7f72fc06e680 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 msgr2=0x7f72fc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 0x7f72fc070b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009c60 tx=0x7f72f8009260 comp rx=0 tx=0).stop 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 msgr2=0x7f7310100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7300005b40 tx=0x7f730000fa00 comp rx=0 tx=0).stop 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 shutdown_connections 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f72fc06e680 0x7f72fc070b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7310069210 0x7f7310100780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 --2- 172.21.15.53:0/927189159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7310103370 0x7f73100fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 >> 172.21.15.53:0/927189159 conn(0x7f73100fa780 msgr2=0x7f73100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 shutdown_connections 2024-09-16T00:55:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.329+0000 7f7316293700 1 -- 172.21.15.53:0/927189159 wait complete. 2024-09-16T00:55:15.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 -- 172.21.15.53:0/1518416593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa310100cd0 msgr2=0x7fa3101030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 --2- 172.21.15.53:0/1518416593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa310100cd0 0x7fa3101030b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009910 tx=0x7fa2f8009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 -- 172.21.15.53:0/1518416593 shutdown_connections 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 --2- 172.21.15.53:0/1518416593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3101035f0 0x7fa3101059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 --2- 172.21.15.53:0/1518416593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa310100cd0 0x7fa3101030b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 -- 172.21.15.53:0/1518416593 >> 172.21.15.53:0/1518416593 conn(0x7fa3100fa6d0 msgr2=0x7fa3100fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 -- 172.21.15.53:0/1518416593 shutdown_connections 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.437+0000 7fa315d52700 1 -- 172.21.15.53:0/1518416593 wait complete. 2024-09-16T00:55:15.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 Processor -- start 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 -- start start 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa310100cd0 0x7fa310195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101965b0 con 0x7fa3101035f0 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa315d52700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101966f0 con 0x7fa310100cd0 2024-09-16T00:55:15.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.438+0000 7fa30effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa310100cd0 0x7fa310195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59314/0 (socket says 172.21.15.53:59314) 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 -- 172.21.15.53:0/2581324792 learned_addr learned my addr 172.21.15.53:0/2581324792 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 -- 172.21.15.53:0/2581324792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa310100cd0 msgr2=0x7fa310195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa310100cd0 0x7fa310195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 -- 172.21.15.53:0/2581324792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80095f0 con 0x7fa3101035f0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30effd700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e920 tx=0x7fa30000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa30000c9d0 con 0x7fa3101035f0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa300010430 con 0x7fa3101035f0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31019b1a0 con 0x7fa3101035f0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa300018650 con 0x7fa3101035f0 2024-09-16T00:55:15.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.439+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31019b6f0 con 0x7fa3101035f0 2024-09-16T00:55:15.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.440+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31018fc60 con 0x7fa3101035f0 2024-09-16T00:55:15.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.441+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa3000105a0 con 0x7fa3101035f0 2024-09-16T00:55:15.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.441+0000 7fa30cff9700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 0x7fa2fc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.441+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa300014070 con 0x7fa3101035f0 2024-09-16T00:55:15.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.441+0000 7fa30f7fe700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 0x7fa2fc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.442+0000 7fa30f7fe700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 0x7fa2fc070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009fd0 tx=0x7fa2f8005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.446+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa3000541b0 con 0x7fa3101035f0 2024-09-16T00:55:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:15 smithi053 ceph-mon[77492]: Upgrade: Updating osd.3 2024-09-16T00:55:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:15 smithi053 ceph-mon[77492]: Deploying daemon osd.3 on smithi152 2024-09-16T00:55:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:15 smithi053 ceph-mon[77492]: pgmap v108: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:55:15.584 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:15 smithi152 ceph-mon[63606]: Upgrade: Updating osd.3 2024-09-16T00:55:15.584 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:15 smithi152 ceph-mon[63606]: Deploying daemon osd.3 on smithi152 2024-09-16T00:55:15.584 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:15 smithi152 ceph-mon[63606]: pgmap v108: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:55:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.670+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa310061190 con 0x7fa2fc06e680 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.679+0000 7fa30cff9700 1 -- 172.21.15.53:0/2581324792 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa310061190 con 0x7fa2fc06e680 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (11m) 22s ago 13m 25.6M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (13m) 22s ago 13m 8518k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (12m) 117s ago 12m 7620k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:55:15.680 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (2m) 22s ago 13m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (2m) 117s ago 12m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (11m) 22s ago 12m 84.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (7m) 22s ago 7m 152M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (7m) 22s ago 7m 98.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (7m) 117s ago 7m 16.6M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (7m) 117s ago 7m 14.9M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (4m) 22s ago 14m 499M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (3m) 117s ago 12m 439M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (3m) 22s ago 14m 50.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (2m) 117s ago 12m 33.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (13m) 22s ago 13m 16.5M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (12m) 117s ago 12m 15.8M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (99s) 22s ago 11m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:55:15.681 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (63s) 22s ago 10m 108M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:55:15.682 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (28s) 22s ago 10m 12.7M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:55:15.682 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (9m) 117s ago 9m 289M 2240M 18.2.0 dc2bc1663786 47c1c3f0f426 2024-09-16T00:55:15.682 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (9m) 117s ago 9m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:55:15.682 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (9m) 117s ago 9m 258M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:55:15.682 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (3m) 22s ago 12m 78.5M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 msgr2=0x7fa2fc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 0x7fa2fc070b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009fd0 tx=0x7fa2f8005940 comp rx=0 tx=0).stop 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 msgr2=0x7fa310195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e920 tx=0x7fa30000ec30 comp rx=0 tx=0).stop 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 shutdown_connections 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa2fc06e680 0x7fa2fc070b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa310100cd0 0x7fa310195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 --2- 172.21.15.53:0/2581324792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3101035f0 0x7fa310195f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.681+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 >> 172.21.15.53:0/2581324792 conn(0x7fa3100fa6d0 msgr2=0x7fa3100fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:15.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.682+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 shutdown_connections 2024-09-16T00:55:15.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.682+0000 7fa315d52700 1 -- 172.21.15.53:0/2581324792 wait complete. 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 -- 172.21.15.53:0/2685217352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb901036a0 msgr2=0x7fcb90105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 --2- 172.21.15.53:0/2685217352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb901036a0 0x7fcb90105a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009910 tx=0x7fcb80009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 -- 172.21.15.53:0/2685217352 shutdown_connections 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 --2- 172.21.15.53:0/2685217352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb901036a0 0x7fcb90105a80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 --2- 172.21.15.53:0/2685217352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb90100d80 0x7fcb90103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 -- 172.21.15.53:0/2685217352 >> 172.21.15.53:0/2685217352 conn(0x7fcb900fa7a0 msgr2=0x7fcb900fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 -- 172.21.15.53:0/2685217352 shutdown_connections 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.789+0000 7fcb981c5700 1 -- 172.21.15.53:0/2685217352 wait complete. 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 Processor -- start 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 -- start start 2024-09-16T00:55:15.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb901036a0 0x7fcb90196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90196920 con 0x7fcb90100d80 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb981c5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90196a60 con 0x7fcb901036a0 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59334/0 (socket says 172.21.15.53:59334) 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 -- 172.21.15.53:0/332512040 learned_addr learned my addr 172.21.15.53:0/332512040 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95760700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb901036a0 0x7fcb90196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 -- 172.21.15.53:0/332512040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb901036a0 msgr2=0x7fcb90196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb901036a0 0x7fcb90196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.790+0000 7fcb95f61700 1 -- 172.21.15.53:0/332512040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800095f0 con 0x7fcb90100d80 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb95f61700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00d8d0 tx=0x7fcb8c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c0041f0 con 0x7fcb90100d80 2024-09-16T00:55:15.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb8c007620 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9019b510 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c0056b0 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.791+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9019ba60 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.792+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9018fc00 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.793+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcb8c004750 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.793+0000 7fcb86ffd700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 0x7fcb7c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.793+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcb8c08e460 con 0x7fcb90100d80 2024-09-16T00:55:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.793+0000 7fcb95760700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 0x7fcb7c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:15.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.794+0000 7fcb95760700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 0x7fcb7c070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000b5c0 tx=0x7fcb80005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:15.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:15.798+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcb8c05b1e0 con 0x7fcb90100d80 2024-09-16T00:55:16.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.106+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb90068ab0 con 0x7fcb90100d80 2024-09-16T00:55:16.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.106+0000 7fcb86ffd700 1 -- 172.21.15.53:0/332512040 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fcb8c05ad70 con 0x7fcb90100d80 2024-09-16T00:55:16.107 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 3 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:55:16.108 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-16T00:55:16.109 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 7 2024-09-16T00:55:16.109 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:55:16.109 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:55:16.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 msgr2=0x7fcb7c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 0x7fcb7c070b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000b5c0 tx=0x7fcb80005ee0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 msgr2=0x7fcb90195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00d8d0 tx=0x7fcb8c00dbe0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 shutdown_connections 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcb7c06e680 0x7fcb7c070b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb90100d80 0x7fcb90195dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 --2- 172.21.15.53:0/332512040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb901036a0 0x7fcb90196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 >> 172.21.15.53:0/332512040 conn(0x7fcb900fa7a0 msgr2=0x7fcb900fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 shutdown_connections 2024-09-16T00:55:16.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.109+0000 7fcb981c5700 1 -- 172.21.15.53:0/332512040 wait complete. 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 -- 172.21.15.53:0/3517028808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 msgr2=0x7f1388105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 --2- 172.21.15.53:0/3517028808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388105790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1370009910 tx=0x7f1370009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 -- 172.21.15.53:0/3517028808 shutdown_connections 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 --2- 172.21.15.53:0/3517028808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388105790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 --2- 172.21.15.53:0/3517028808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 0x7f1388102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 -- 172.21.15.53:0/3517028808 >> 172.21.15.53:0/3517028808 conn(0x7f13880fa780 msgr2=0x7f13880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 -- 172.21.15.53:0/3517028808 shutdown_connections 2024-09-16T00:55:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 -- 172.21.15.53:0/3517028808 wait complete. 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.218+0000 7f138d461700 1 Processor -- start 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f138d461700 1 -- start start 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f138d461700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 0x7f1388195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f138d461700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f138d461700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13881965d0 con 0x7f1388103370 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f138d461700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388196710 con 0x7f1388069210 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59364/0 (socket says 172.21.15.53:59364) 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 -- 172.21.15.53:0/2800262468 learned_addr learned my addr 172.21.15.53:0/2800262468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f1386ffd700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 0x7f1388195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 -- 172.21.15.53:0/2800262468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 msgr2=0x7f1388195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 0x7f1388195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 -- 172.21.15.53:0/2800262468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13700095f0 con 0x7f1388103370 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.219+0000 7f13867fc700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1370006010 tx=0x7f137000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.220+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f137001d070 con 0x7f1388103370 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.220+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f137000f460 con 0x7f1388103370 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.220+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138819b160 con 0x7f1388103370 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.220+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1370021640 con 0x7f1388103370 2024-09-16T00:55:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.220+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138819b650 con 0x7f1388103370 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.221+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138818fbd0 con 0x7f1388103370 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.221+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f137000fab0 con 0x7f1388103370 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.222+0000 7f137ffff700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 0x7f1374070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.222+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f137008f870 con 0x7f1388103370 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.222+0000 7f1386ffd700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 0x7f1374070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.222+0000 7f1386ffd700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 0x7f1374070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1388068f40 tx=0x7f1380007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.226+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f137005c5f0 con 0x7f1388103370 2024-09-16T00:55:16.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:16 smithi152 ceph-mon[63606]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:16.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:16 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/332512040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:16.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.484+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f138802cc30 con 0x7f1388103370 2024-09-16T00:55:16.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:16 smithi053 ceph-mon[77492]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:16.486 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:16 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/332512040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.485+0000 7f137ffff700 1 -- 172.21.15.53:0/2800262468 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f137000f5d0 con 0x7f1388103370 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:55:16.486 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:55:16.487 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:55:16.488 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:16.489 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 msgr2=0x7f1374070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 0x7f1374070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1388068f40 tx=0x7f1380007400 comp rx=0 tx=0).stop 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 msgr2=0x7f1388195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1370006010 tx=0x7f137000bd70 comp rx=0 tx=0).stop 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 shutdown_connections 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f137406e680 0x7f1374070b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388069210 0x7f1388195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 --2- 172.21.15.53:0/2800262468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1388103370 0x7f1388195fb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 >> 172.21.15.53:0/2800262468 conn(0x7f13880fa780 msgr2=0x7f13880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 shutdown_connections 2024-09-16T00:55:16.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.487+0000 7f138d461700 1 -- 172.21.15.53:0/2800262468 wait complete. 2024-09-16T00:55:16.491 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2224196955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 msgr2=0x7fb538105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2224196955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb538105a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb528009910 tx=0x7fb528009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2224196955 shutdown_connections 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2224196955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb538105a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2224196955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb538103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2224196955 >> 172.21.15.53:0/2224196955 conn(0x7fb5380fa780 msgr2=0x7fb5380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2224196955 shutdown_connections 2024-09-16T00:55:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.597+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2224196955 wait complete. 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 Processor -- start 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 -- start start 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb5381006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380ff250 con 0x7fb538103680 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53fa2e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380ff390 con 0x7fb538100d60 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53cfc9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53cfc9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59370/0 (socket says 172.21.15.53:59370) 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53cfc9700 1 -- 172.21.15.53:0/2688506932 learned_addr learned my addr 172.21.15.53:0/2688506932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.598+0000 7fb53d7ca700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb5381006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53cfc9700 1 -- 172.21.15.53:0/2688506932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 msgr2=0x7fb5381006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53cfc9700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb5381006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53cfc9700 1 -- 172.21.15.53:0/2688506932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280095f0 con 0x7fb538103680 2024-09-16T00:55:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53d7ca700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb5381006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53cfc9700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb528000c00 tx=0x7fb52800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52801d070 con 0x7fb538103680 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb528005dc0 con 0x7fb538103680 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380ff610 con 0x7fb538103680 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5280226a0 con 0x7fb538103680 2024-09-16T00:55:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.599+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5380ffb00 con 0x7fb538103680 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.600+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53818fbe0 con 0x7fb538103680 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.601+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb528003680 con 0x7fb538103680 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.601+0000 7fb52e7fc700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 0x7fb524070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.601+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb52808fa90 con 0x7fb538103680 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.601+0000 7fb53d7ca700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 0x7fb524070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.602+0000 7fb53d7ca700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 0x7fb524070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb538069000 tx=0x7fb53400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.605+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb52805c890 con 0x7fb538103680 2024-09-16T00:55:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.838+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb538061190 con 0x7fb52406e680 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.839+0000 7fb52e7fc700 1 -- 172.21.15.53:0/2688506932 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb538061190 con 0x7fb52406e680 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:55:16.840 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "9/23 daemons upgraded", 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:55:16.841 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:55:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 msgr2=0x7fb524070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 0x7fb524070b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb538069000 tx=0x7fb53400b040 comp rx=0 tx=0).stop 2024-09-16T00:55:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 msgr2=0x7fb5380fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb528000c00 tx=0x7fb52800f740 comp rx=0 tx=0).stop 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 shutdown_connections 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb52406e680 0x7fb524070b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb538100d60 0x7fb5381006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 --2- 172.21.15.53:0/2688506932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb538103680 0x7fb5380fed10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.841+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 >> 172.21.15.53:0/2688506932 conn(0x7fb5380fa780 msgr2=0x7fb5380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.842+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 shutdown_connections 2024-09-16T00:55:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.842+0000 7fb53fa2e700 1 -- 172.21.15.53:0/2688506932 wait complete. 2024-09-16T00:55:16.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 -- 172.21.15.53:0/2057425464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 msgr2=0x7f871c0fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 --2- 172.21.15.53:0/2057425464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c0fe300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f870c009910 tx=0x7f870c009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 -- 172.21.15.53:0/2057425464 shutdown_connections 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 --2- 172.21.15.53:0/2057425464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c0fe300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 --2- 172.21.15.53:0/2057425464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 0x7f871c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.950+0000 7f8724490700 1 -- 172.21.15.53:0/2057425464 >> 172.21.15.53:0/2057425464 conn(0x7f871c0f9e70 msgr2=0x7f871c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 -- 172.21.15.53:0/2057425464 shutdown_connections 2024-09-16T00:55:16.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 -- 172.21.15.53:0/2057425464 wait complete. 2024-09-16T00:55:16.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 Processor -- start 2024-09-16T00:55:16.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 -- start start 2024-09-16T00:55:16.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 0x7f871c195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c1966e0 con 0x7f871c102260 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.951+0000 7f8724490700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c196820 con 0x7f871c101880 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59376/0 (socket says 172.21.15.53:59376) 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 -- 172.21.15.53:0/2376781424 learned_addr learned my addr 172.21.15.53:0/2376781424 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f872222c700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 0x7f871c195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 -- 172.21.15.53:0/2376781424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 msgr2=0x7f871c195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 0x7f871c195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 -- 172.21.15.53:0/2376781424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0095f0 con 0x7f871c102260 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8721a2b700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bd70 tx=0x7f870c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c01d070 con 0x7f871c102260 2024-09-16T00:55:16.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f870c00f460 con 0x7f871c102260 2024-09-16T00:55:16.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c19b270 con 0x7f871c102260 2024-09-16T00:55:16.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870c017630 con 0x7f871c102260 2024-09-16T00:55:16.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.952+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c19b760 con 0x7f871c102260 2024-09-16T00:55:16.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.953+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c108db0 con 0x7f871c102260 2024-09-16T00:55:16.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.954+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f870c00f5d0 con 0x7f871c102260 2024-09-16T00:55:16.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.954+0000 7f87137fe700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 0x7f8708070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:16.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.955+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f870c08fa70 con 0x7f871c102260 2024-09-16T00:55:16.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.955+0000 7f872222c700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 0x7f8708070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:16.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.955+0000 7f872222c700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 0x7f8708070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f871c068b10 tx=0x7f871800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:16.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:16.959+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f870c05c7f0 con 0x7f871c102260 2024-09-16T00:55:17.118 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:16 smithi152 systemd[1]: Stopping Ceph osd.3 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:55:17.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.261+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f871c108fa0 con 0x7f871c102260 2024-09-16T00:55:17.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.262+0000 7f87137fe700 1 -- 172.21.15.53:0/2376781424 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f870c05c380 con 0x7f871c102260 2024-09-16T00:55:17.263 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 msgr2=0x7f8708070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 0x7f8708070b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f871c068b10 tx=0x7f871800b410 comp rx=0 tx=0).stop 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 msgr2=0x7f871c1960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bd70 tx=0x7f870c00bda0 comp rx=0 tx=0).stop 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 shutdown_connections 2024-09-16T00:55:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f870806e680 0x7f8708070b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f871c101880 0x7f871c195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 --2- 172.21.15.53:0/2376781424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f871c102260 0x7f871c1960c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 >> 172.21.15.53:0/2376781424 conn(0x7f871c0f9e70 msgr2=0x7f871c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 shutdown_connections 2024-09-16T00:55:17.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:17.264+0000 7f8724490700 1 -- 172.21.15.53:0/2376781424 wait complete. 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: pgmap v109: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2800262468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: osd.3 marked itself down and dead 2024-09-16T00:55:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2376781424' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:55:17.448 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:55:17.122+0000 7fbf2e27d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:55:17.448 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:55:17.122+0000 7fbf2e27d700 -1 osd.3 64 *** Got signal Terminated *** 2024-09-16T00:55:17.448 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:17 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[39234]: 2024-09-16T00:55:17.122+0000 7fbf2e27d700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: pgmap v109: 65 pgs: 65 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2800262468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: osd.3 marked itself down and dead 2024-09-16T00:55:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:17 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2376781424' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:55:18.164 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:17 smithi152 podman[68354]: 2024-09-16 00:55:17.889107183 +0000 UTC m=+0.868438433 container died 47c1c3f0f426c9069d8d841fcbac87af565798d535a871623c3491fddc38e68c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS) 2024-09-16T00:55:18.165 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:18 smithi152 podman[68354]: 2024-09-16 00:55:18.1645289 +0000 UTC m=+1.143860148 container cleanup 47c1c3f0f426c9069d8d841fcbac87af565798d535a871623c3491fddc38e68c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-16T00:55:18.425 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:18 smithi152 bash[68354]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3 2024-09-16T00:55:18.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:18 smithi152 ceph-mon[63606]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:18.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:18 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:55:18.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:18 smithi152 ceph-mon[63606]: osdmap e65: 6 total, 5 up, 6 in 2024-09-16T00:55:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:18 smithi053 ceph-mon[77492]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:18 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:55:18.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:18 smithi053 ceph-mon[77492]: osdmap e65: 6 total, 5 up, 6 in 2024-09-16T00:55:18.697 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:18 smithi152 podman[68380]: 2024-09-16 00:55:18.424671276 +0000 UTC m=+0.537055864 container remove 47c1c3f0f426c9069d8d841fcbac87af565798d535a871623c3491fddc38e68c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, GIT_BRANCH=HEAD) 2024-09-16T00:55:19.020 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:18 smithi152 podman[68468]: 2024-09-16 00:55:18.652753103 +0000 UTC m=+0.015408110 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:19.020 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:18 smithi152 podman[68468]: 2024-09-16 00:55:18.792340545 +0000 UTC m=+0.154995538 container create 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-16T00:55:19.020 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 podman[68468]: 2024-09-16 00:55:19.020205941 +0000 UTC m=+0.382860939 container init 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T00:55:19.306 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 podman[68468]: 2024-09-16 00:55:19.02377275 +0000 UTC m=+0.386427743 container start 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:55:19.306 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 podman[68468]: 2024-09-16 00:55:19.078337656 +0000 UTC m=+0.440992670 container attach 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T00:55:19.306 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 podman[68468]: 2024-09-16 00:55:19.207616338 +0000 UTC m=+0.570271331 container died 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-16T00:55:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:19 smithi053 ceph-mon[77492]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:55:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:19 smithi053 ceph-mon[77492]: osdmap e66: 6 total, 5 up, 6 in 2024-09-16T00:55:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:19 smithi152 ceph-mon[63606]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:55:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:19 smithi152 ceph-mon[63606]: osdmap e66: 6 total, 5 up, 6 in 2024-09-16T00:55:20.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 podman[68491]: 2024-09-16 00:55:19.825444889 +0000 UTC m=+0.606670881 container remove 7d23e05d6cc8095b0423e2e31ac18f8fcd26c18f08df1c73bf1716a432286387 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-16T00:55:20.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-16T00:55:20.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 systemd[1]: Stopped Ceph osd.3 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:55:20.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:19 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 17.894s CPU time. 2024-09-16T00:55:20.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 systemd[1]: Starting Ceph osd.3 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:55:20.571 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 podman[68591]: 2024-09-16 00:55:20.153730486 +0000 UTC m=+0.015558736 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:20.572 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 podman[68591]: 2024-09-16 00:55:20.260597029 +0000 UTC m=+0.122425277 container create 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:55:20.572 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 podman[68591]: 2024-09-16 00:55:20.496859539 +0000 UTC m=+0.358687790 container init 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T00:55:20.572 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 podman[68591]: 2024-09-16 00:55:20.500227413 +0000 UTC m=+0.362055668 container start 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-16T00:55:20.572 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 podman[68591]: 2024-09-16 00:55:20.571776644 +0000 UTC m=+0.433604896 container attach 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-16T00:55:20.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:20.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 bash[68591]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:20.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:20.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:20 smithi152 bash[68591]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:21 smithi053 ceph-mon[77492]: pgmap v113: 65 pgs: 16 stale+active+clean, 49 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:21.653 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-mon[63606]: pgmap v113: 65 pgs: 16 stale+active+clean, 49 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:21.653 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T00:55:21.653 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T00:55:21.653 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T00:55:21.653 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T00:55:21.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T00:55:21.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T00:55:21.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T00:55:21.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T00:55:21.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate[68605]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 bash[68591]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T00:55:21.948 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:21 smithi152 podman[68591]: 2024-09-16 00:55:21.682057175 +0000 UTC m=+1.543885422 container died 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:55:22.360 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 podman[68746]: 2024-09-16 00:55:22.22585486 +0000 UTC m=+0.532930588 container remove 220b7bb69796d10c9b7b2e9a3eb32dae3a00a461deaddc444adb0f1b7b0a703b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-16T00:55:22.687 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:22 smithi152 ceph-mon[63606]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:22.687 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:22 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:22.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 podman[68804]: 2024-09-16 00:55:22.334973168 +0000 UTC m=+0.015918623 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:22.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 podman[68804]: 2024-09-16 00:55:22.451918557 +0000 UTC m=+0.132864002 container create f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T00:55:22.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 podman[68804]: 2024-09-16 00:55:22.687580796 +0000 UTC m=+0.368526241 container init f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T00:55:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:22 smithi053 ceph-mon[77492]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:22 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:22.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 podman[68804]: 2024-09-16 00:55:22.690913934 +0000 UTC m=+0.371859380 container start f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T00:55:22.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 ceph-osd[68823]: -- 172.21.15.152:0/3832946720 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562ae0c8e1e0 con 0x562adfea3c00 2024-09-16T00:55:22.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 bash[68804]: f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 2024-09-16T00:55:22.947 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:22 smithi152 systemd[1]: Started Ceph osd.3 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:55:24.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:23 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:24.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:23 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:24.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:23 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:24.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:24.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:24.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:23 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:24.837 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:24 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T00:55:24.560+0000 7f7a4c011640 -1 Falling back to public interface 2024-09-16T00:55:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:24 smithi053 ceph-mon[77492]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:25.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:24 smithi152 ceph-mon[63606]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:26.678 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:26 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:26 smithi152 ceph-mon[63606]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:26 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:26.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:26 smithi053 ceph-mon[77492]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:29.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:29.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:29.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:30 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:30 smithi152 ceph-mon[63606]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-16T00:55:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:30 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:30 smithi053 ceph-mon[77492]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-16T00:55:30.876 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:30 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T00:55:30.467+0000 7f7a4c011640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-16T00:55:31.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:31 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T00:55:31.047+0000 7f7a4c011640 -1 osd.3 64 log_to_monitors true 2024-09-16T00:55:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:31 smithi053 ceph-mon[77492]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:31 smithi053 ceph-mon[77492]: from='osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:55:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:31 smithi053 ceph-mon[77492]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:55:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:31 smithi152 ceph-mon[63606]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-16T00:55:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:31 smithi152 ceph-mon[63606]: from='osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:55:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:31 smithi152 ceph-mon[63606]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T00:55:32.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-mon[63606]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:55:32.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-mon[63606]: from='osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:55:32.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-mon[63606]: osdmap e67: 6 total, 5 up, 6 in 2024-09-16T00:55:32.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-mon[63606]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:55:32.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-mon[63606]: from='osd.3 ' entity='osd.3' 2024-09-16T00:55:32.447 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 00:55:32 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T00:55:32.096+0000 7f7a3fda3640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:55:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:32 smithi053 ceph-mon[77492]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T00:55:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:32 smithi053 ceph-mon[77492]: from='osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:55:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:32 smithi053 ceph-mon[77492]: osdmap e67: 6 total, 5 up, 6 in 2024-09-16T00:55:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:32 smithi053 ceph-mon[77492]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:55:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:32 smithi053 ceph-mon[77492]: from='osd.3 ' entity='osd.3' 2024-09-16T00:55:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:33 smithi053 ceph-mon[77492]: pgmap v120: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-16T00:55:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:33 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:55:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:33 smithi053 ceph-mon[77492]: osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692] boot 2024-09-16T00:55:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:33 smithi053 ceph-mon[77492]: osdmap e68: 6 total, 6 up, 6 in 2024-09-16T00:55:33.506 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:55:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:33 smithi152 ceph-mon[63606]: pgmap v120: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-16T00:55:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:33 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:55:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:33 smithi152 ceph-mon[63606]: osd.3 [v2:172.21.15.152:6800/2742665692,v1:172.21.15.152:6801/2742665692] boot 2024-09-16T00:55:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:33 smithi152 ceph-mon[63606]: osdmap e68: 6 total, 6 up, 6 in 2024-09-16T00:55:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T00:55:35.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:35 smithi152 ceph-mon[63606]: osdmap e69: 6 total, 6 up, 6 in 2024-09-16T00:55:35.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:35 smithi152 ceph-mon[63606]: pgmap v123: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-16T00:55:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:35 smithi053 ceph-mon[77492]: osdmap e69: 6 total, 6 up, 6 in 2024-09-16T00:55:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:35 smithi053 ceph-mon[77492]: pgmap v123: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 196 MiB data, 969 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-16T00:55:36.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:36 smithi053 ceph-mon[77492]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:36 smithi152 ceph-mon[63606]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:37 smithi053 ceph-mon[77492]: pgmap v124: 65 pgs: 11 active+undersized, 12 active+undersized+degraded, 42 active+clean; 196 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-09-16T00:55:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:37 smithi152 ceph-mon[63606]: pgmap v124: 65 pgs: 11 active+undersized, 12 active+undersized+degraded, 42 active+clean; 196 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-09-16T00:55:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:38 smithi152 ceph-mon[63606]: pgmap v125: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-09-16T00:55:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:38 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded) 2024-09-16T00:55:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:38 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:55:38.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:38 smithi053 ceph-mon[77492]: pgmap v125: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 590 B/s rd, 1 op/s 2024-09-16T00:55:38.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:38 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded) 2024-09-16T00:55:38.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:38 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:55:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:41 smithi053 ceph-mon[77492]: pgmap v126: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T00:55:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:41 smithi152 ceph-mon[63606]: pgmap v126: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-09-16T00:55:43.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:43 smithi053 ceph-mon[77492]: pgmap v127: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 1014 B/s rd, 1 op/s 2024-09-16T00:55:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:43 smithi152 ceph-mon[63606]: pgmap v127: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 1014 B/s rd, 1 op/s 2024-09-16T00:55:44.564 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:44.564 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:44.564 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:44.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:44.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:44.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: Upgrade: osd.4 is safe to restart 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: pgmap v128: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:55:45.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T00:55:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: Upgrade: osd.4 is safe to restart 2024-09-16T00:55:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: pgmap v128: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 913 B/s rd, 1 op/s 2024-09-16T00:55:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T00:55:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:55:46.538 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:46 smithi152 ceph-mon[63606]: Upgrade: Updating osd.4 2024-09-16T00:55:46.539 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:46 smithi152 ceph-mon[63606]: Deploying daemon osd.4 on smithi152 2024-09-16T00:55:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:46 smithi053 ceph-mon[77492]: Upgrade: Updating osd.4 2024-09-16T00:55:46.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:46 smithi053 ceph-mon[77492]: Deploying daemon osd.4 on smithi152 2024-09-16T00:55:47.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 -- 172.21.15.53:0/3556847445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f81014e0 msgr2=0x7f16f8101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 --2- 172.21.15.53:0/3556847445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f81014e0 0x7f16f8101930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009910 tx=0x7f16ec009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 -- 172.21.15.53:0/3556847445 shutdown_connections 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 --2- 172.21.15.53:0/3556847445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f81014e0 0x7f16f8101930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 --2- 172.21.15.53:0/3556847445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f80fe500 0x7f16f80fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 -- 172.21.15.53:0/3556847445 >> 172.21.15.53:0/3556847445 conn(0x7f16f80f9e50 msgr2=0x7f16f80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 -- 172.21.15.53:0/3556847445 shutdown_connections 2024-09-16T00:55:47.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.389+0000 7f16fe96f700 1 -- 172.21.15.53:0/3556847445 wait complete. 2024-09-16T00:55:47.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:47 smithi152 ceph-mon[63606]: pgmap v129: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T00:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 Processor -- start 2024-09-16T00:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 -- start start 2024-09-16T00:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f81014e0 0x7f16f8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8198850 con 0x7f16f80fe500 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.390+0000 7f16fe96f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f819d260 con 0x7f16f81014e0 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54018/0 (socket says 172.21.15.53:54018) 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f81014e0 0x7f16f8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 -- 172.21.15.53:0/2360795821 learned_addr learned my addr 172.21.15.53:0/2360795821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 -- 172.21.15.53:0/2360795821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f81014e0 msgr2=0x7f16f8198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f81014e0 0x7f16f8198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 -- 172.21.15.53:0/2360795821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0095f0 con 0x7f16f80fe500 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f7fff700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d900 tx=0x7f16e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e80041f0 con 0x7f16f80fe500 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f16e8004350 con 0x7f16f80fe500 2024-09-16T00:55:47.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f819d460 con 0x7f16f80fe500 2024-09-16T00:55:47.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e8003d20 con 0x7f16f80fe500 2024-09-16T00:55:47.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.391+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f819d980 con 0x7f16f80fe500 2024-09-16T00:55:47.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.393+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f81055c0 con 0x7f16f80fe500 2024-09-16T00:55:47.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.393+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f16e8009730 con 0x7f16f80fe500 2024-09-16T00:55:47.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.393+0000 7f16f57fa700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 0x7f16e0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.394+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f16e808e470 con 0x7f16f80fe500 2024-09-16T00:55:47.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.394+0000 7f16f77fe700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 0x7f16e0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.394+0000 7f16f77fe700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 0x7f16e0070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006010 tx=0x7f16ec00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:47.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.398+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f16e80576c0 con 0x7f16f80fe500 2024-09-16T00:55:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:47 smithi053 ceph-mon[77492]: pgmap v129: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T00:55:47.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.634+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16f8061190 con 0x7f16e006e680 2024-09-16T00:55:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.636+0000 7f16f57fa700 1 -- 172.21.15.53:0/2360795821 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f16f8061190 con 0x7f16e006e680 2024-09-16T00:55:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 msgr2=0x7f16e0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 0x7f16e0070b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f16ec006010 tx=0x7f16ec00b540 comp rx=0 tx=0).stop 2024-09-16T00:55:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 msgr2=0x7f16f8197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d900 tx=0x7f16e800dc10 comp rx=0 tx=0).stop 2024-09-16T00:55:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 shutdown_connections 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f16e006e680 0x7f16e0070b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16f80fe500 0x7f16f8197cf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 --2- 172.21.15.53:0/2360795821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16f81014e0 0x7f16f8198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 >> 172.21.15.53:0/2360795821 conn(0x7f16f80f9e50 msgr2=0x7f16f8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 shutdown_connections 2024-09-16T00:55:47.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.638+0000 7f16fe96f700 1 -- 172.21.15.53:0/2360795821 wait complete. 2024-09-16T00:55:47.650 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 -- 172.21.15.53:0/220310623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac100240 msgr2=0x7f26ac100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 --2- 172.21.15.53:0/220310623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac100240 0x7f26ac100650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f269c009910 tx=0x7f269c009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 -- 172.21.15.53:0/220310623 shutdown_connections 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 --2- 172.21.15.53:0/220310623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac101440 0x7f26ac101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 --2- 172.21.15.53:0/220310623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac100240 0x7f26ac100650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 -- 172.21.15.53:0/220310623 >> 172.21.15.53:0/220310623 conn(0x7f26ac0fb7f0 msgr2=0x7f26ac0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:47.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 -- 172.21.15.53:0/220310623 shutdown_connections 2024-09-16T00:55:47.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.748+0000 7f26b114e700 1 -- 172.21.15.53:0/220310623 wait complete. 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 Processor -- start 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 -- start start 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac100240 0x7f26ac074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac073680 con 0x7f26ac101440 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26b114e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0737c0 con 0x7f26ac100240 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54036/0 (socket says 172.21.15.53:54036) 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac100240 0x7f26ac074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 -- 172.21.15.53:0/1067034999 learned_addr learned my addr 172.21.15.53:0/1067034999 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 -- 172.21.15.53:0/1067034999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac100240 msgr2=0x7f26ac074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac100240 0x7f26ac074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.749+0000 7f26aa59c700 1 -- 172.21.15.53:0/1067034999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c0095f0 con 0x7f26ac101440 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f26aa59c700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26a000e920 tx=0x7f26a000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a000c9d0 con 0x7f26ac101440 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac073aa0 con 0x7f26ac101440 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26a0010430 con 0x7f26ac101440 2024-09-16T00:55:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a0018650 con 0x7f26ac101440 2024-09-16T00:55:47.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.750+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac19db30 con 0x7f26ac101440 2024-09-16T00:55:47.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.751+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac108d90 con 0x7f26ac101440 2024-09-16T00:55:47.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.751+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f26a00105a0 con 0x7f26ac101440 2024-09-16T00:55:47.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.752+0000 7f2693fff700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 0x7f2694070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:47.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.752+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f26a0014070 con 0x7f26ac101440 2024-09-16T00:55:47.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.752+0000 7f26aad9d700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 0x7f2694070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:47.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.753+0000 7f26aad9d700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 0x7f2694070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f269c00b6f0 tx=0x7f269c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.756+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f26a00541b0 con 0x7f26ac101440 2024-09-16T00:55:47.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.994+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26ac105d90 con 0x7f269406e680 2024-09-16T00:55:47.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.995+0000 7f2693fff700 1 -- 172.21.15.53:0/1067034999 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f26ac105d90 con 0x7f269406e680 2024-09-16T00:55:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 msgr2=0x7f2694070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 0x7f2694070b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f269c00b6f0 tx=0x7f269c005940 comp rx=0 tx=0).stop 2024-09-16T00:55:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 msgr2=0x7f26ac073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:47.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26a000e920 tx=0x7f26a000ec30 comp rx=0 tx=0).stop 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 shutdown_connections 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f269406e680 0x7f2694070b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26ac100240 0x7f26ac074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 --2- 172.21.15.53:0/1067034999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26ac101440 0x7f26ac073140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.997+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 >> 172.21.15.53:0/1067034999 conn(0x7f26ac0fb7f0 msgr2=0x7f26ac104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.998+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 shutdown_connections 2024-09-16T00:55:47.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:47.998+0000 7f26b114e700 1 -- 172.21.15.53:0/1067034999 wait complete. 2024-09-16T00:55:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 -- 172.21.15.53:0/2459515827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 msgr2=0x7f403c105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 --2- 172.21.15.53:0/2459515827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c105a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4030009910 tx=0x7f4030009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 -- 172.21.15.53:0/2459515827 shutdown_connections 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 --2- 172.21.15.53:0/2459515827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c105a60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 --2- 172.21.15.53:0/2459515827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 -- 172.21.15.53:0/2459515827 >> 172.21.15.53:0/2459515827 conn(0x7f403c0fa780 msgr2=0x7f403c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 -- 172.21.15.53:0/2459515827 shutdown_connections 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.106+0000 7f4042185700 1 -- 172.21.15.53:0/2459515827 wait complete. 2024-09-16T00:55:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 Processor -- start 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 -- start start 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c198850 con 0x7f403c103680 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.107+0000 7f4042185700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c19d260 con 0x7f403c100d60 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54052/0 (socket says 172.21.15.53:54052) 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403affd700 1 -- 172.21.15.53:0/843763431 learned_addr learned my addr 172.21.15.53:0/843763431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403b7fe700 1 -- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 msgr2=0x7f403c198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403b7fe700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403b7fe700 1 -- 172.21.15.53:0/843763431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300095f0 con 0x7f403c100d60 2024-09-16T00:55:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403affd700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f403b7fe700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c197cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e940 tx=0x7f402c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402c00c990 con 0x7f403c100d60 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f402c010430 con 0x7f403c100d60 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c19d460 con 0x7f403c100d60 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402c018630 con 0x7f403c100d60 2024-09-16T00:55:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.108+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c19d980 con 0x7f403c100d60 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.110+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c0fc340 con 0x7f403c100d60 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.110+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f402c0105a0 con 0x7f403c100d60 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.110+0000 7f4038ff9700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 0x7f4024070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.111+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f402c014070 con 0x7f403c100d60 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.111+0000 7f403affd700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 0x7f4024070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.111+0000 7f403affd700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 0x7f4024070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4030009fd0 tx=0x7f4030005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.115+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f402c0541b0 con 0x7f403c100d60 2024-09-16T00:55:48.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.348+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f403c061190 con 0x7f402406e680 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.357+0000 7f4038ff9700 1 -- 172.21.15.53:0/843763431 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f403c061190 con 0x7f402406e680 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (12m) 54s ago 13m 25.6M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (13m) 54s ago 13m 8518k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (12m) 22s ago 12m 7788k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (2m) 54s ago 13m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (2m) 22s ago 12m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (12m) 54s ago 13m 84.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:55:48.361 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (8m) 54s ago 8m 152M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (8m) 54s ago 8m 98.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (8m) 22s ago 8m 17.5M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (8m) 22s ago 8m 15.8M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (5m) 54s ago 15m 499M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (4m) 22s ago 12m 441M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (3m) 54s ago 15m 50.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (3m) 22s ago 12m 38.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (13m) 54s ago 13m 16.5M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (12m) 22s ago 12m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (2m) 54s ago 11m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (96s) 54s ago 11m 108M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (60s) 54s ago 10m 12.7M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:55:48.362 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (26s) 22s ago 10m 11.4M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:55:48.363 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (10m) 22s ago 10m 274M 2240M 18.2.0 dc2bc1663786 731a633813da 2024-09-16T00:55:48.363 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (9m) 22s ago 9m 256M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:55:48.363 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (4m) 54s ago 13m 78.5M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:55:48.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 msgr2=0x7f4024070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 0x7f4024070b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4030009fd0 tx=0x7f4030005940 comp rx=0 tx=0).stop 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 msgr2=0x7f403c197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c197cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e940 tx=0x7f402c00ec50 comp rx=0 tx=0).stop 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 shutdown_connections 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f402406e680 0x7f4024070b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f403c100d60 0x7f403c197cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 --2- 172.21.15.53:0/843763431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f403c103680 0x7f403c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 >> 172.21.15.53:0/843763431 conn(0x7f403c0fa780 msgr2=0x7f403c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 shutdown_connections 2024-09-16T00:55:48.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.360+0000 7f4042185700 1 -- 172.21.15.53:0/843763431 wait complete. 2024-09-16T00:55:48.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:48 smithi152 ceph-mon[63606]: osd.4 marked itself down and dead 2024-09-16T00:55:48.399 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:48 smithi152 systemd[1]: Stopping Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:55:48.399 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:48 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:55:48.259+0000 7fa0de17b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:55:48.400 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:48 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:55:48.259+0000 7fa0de17b700 -1 osd.4 69 *** Got signal Terminated *** 2024-09-16T00:55:48.400 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:48 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[43828]: 2024-09-16T00:55:48.259+0000 7fa0de17b700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/683132516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940ffac0 msgr2=0x7f0d940fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/683132516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940ffac0 0x7f0d940fff10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009910 tx=0x7f0d88009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/683132516 shutdown_connections 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/683132516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940ffac0 0x7f0d940fff10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/683132516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940fe8c0 0x7f0d940fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/683132516 >> 172.21.15.53:0/683132516 conn(0x7f0d940f9e50 msgr2=0x7f0d940fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/683132516 shutdown_connections 2024-09-16T00:55:48.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/683132516 wait complete. 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 Processor -- start 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.467+0000 7f0d9a5ed700 1 -- start start 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d9a5ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d9a5ed700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ffac0 0x7f0d94198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d9a5ed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941988b0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d9a5ed700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941989f0 con 0x7f0d940ffac0 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54076/0 (socket says 172.21.15.53:54076) 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 -- 172.21.15.53:0/2835648560 learned_addr learned my addr 172.21.15.53:0/2835648560 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d937fe700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ffac0 0x7f0d94198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 -- 172.21.15.53:0/2835648560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ffac0 msgr2=0x7f0d94198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ffac0 0x7f0d94198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.468+0000 7f0d93fff700 1 -- 172.21.15.53:0/2835648560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d880095f0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d93fff700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b480 tx=0x7f0d8400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d84011800 con 0x7f0d940fe8c0 2024-09-16T00:55:48.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9419d4a0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d84011e10 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d84010ea0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.469+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9419d9f0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.470+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d941074b0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.470+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0d84010380 con 0x7f0d940fe8c0 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.471+0000 7f0d917fa700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 0x7f0d7c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.471+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0d8408e150 con 0x7f0d940fe8c0 2024-09-16T00:55:48.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.471+0000 7f0d937fe700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 0x7f0d7c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.472+0000 7f0d937fe700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 0x7f0d7c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d88006010 tx=0x7f0d8800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.476+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0d8405aed0 con 0x7f0d940fe8c0 2024-09-16T00:55:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:48 smithi053 ceph-mon[77492]: osd.4 marked itself down and dead 2024-09-16T00:55:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.787+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d94107670 con 0x7f0d940fe8c0 2024-09-16T00:55:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.787+0000 7f0d917fa700 1 -- 172.21.15.53:0/2835648560 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f0d8405aa60 con 0x7f0d940fe8c0 2024-09-16T00:55:48.788 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:55:48.788 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:55:48.788 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:55:48.788 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:55:48.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:55:48.790 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:55:48.790 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-16T00:55:48.790 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 8 2024-09-16T00:55:48.790 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:55:48.790 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 msgr2=0x7f0d7c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 0x7f0d7c070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d88006010 tx=0x7f0d8800b540 comp rx=0 tx=0).stop 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 msgr2=0x7f0d94197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b480 tx=0x7f0d8400b790 comp rx=0 tx=0).stop 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 shutdown_connections 2024-09-16T00:55:48.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f0d7c06e680 0x7f0d7c070b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d940fe8c0 0x7f0d94197d50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.789+0000 7f0d9a5ed700 1 --2- 172.21.15.53:0/2835648560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940ffac0 0x7f0d94198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.790+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 >> 172.21.15.53:0/2835648560 conn(0x7f0d940f9e50 msgr2=0x7f0d94102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.790+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 shutdown_connections 2024-09-16T00:55:48.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.790+0000 7f0d9a5ed700 1 -- 172.21.15.53:0/2835648560 wait complete. 2024-09-16T00:55:48.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- 172.21.15.53:0/3895104449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 msgr2=0x7f34980fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 --2- 172.21.15.53:0/3895104449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f34980fe910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f348c009910 tx=0x7f348c009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:48.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- 172.21.15.53:0/3895104449 shutdown_connections 2024-09-16T00:55:48.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 --2- 172.21.15.53:0/3895104449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 0x7f3498101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 --2- 172.21.15.53:0/3895104449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f34980fe910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- 172.21.15.53:0/3895104449 >> 172.21.15.53:0/3895104449 conn(0x7f34980f9e50 msgr2=0x7f34980fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- 172.21.15.53:0/3895104449 shutdown_connections 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- 172.21.15.53:0/3895104449 wait complete. 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 Processor -- start 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- start start 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 0x7f3498196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498196640 con 0x7f34980fe500 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.899+0000 7f34a06c8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498196780 con 0x7f34981014e0 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54098/0 (socket says 172.21.15.53:54098) 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 -- 172.21.15.53:0/1891321315 learned_addr learned my addr 172.21.15.53:0/1891321315 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:48.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349dc63700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 0x7f3498196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 -- 172.21.15.53:0/1891321315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 msgr2=0x7f3498196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 0x7f3498196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 -- 172.21.15.53:0/1891321315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0095f0 con 0x7f34980fe500 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f349e464700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f348c00bda0 tx=0x7f348c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348c01d070 con 0x7f34980fe500 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f348c00f460 con 0x7f34980fe500 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349819b1d0 con 0x7f34980fe500 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348c021620 con 0x7f34980fe500 2024-09-16T00:55:48.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.900+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349819b6c0 con 0x7f34980fe500 2024-09-16T00:55:48.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.901+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3498108d80 con 0x7f34980fe500 2024-09-16T00:55:48.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.902+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f348c00f5d0 con 0x7f34980fe500 2024-09-16T00:55:48.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.902+0000 7f348b7fe700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 0x7f3484070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:48.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.902+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f348c08f880 con 0x7f34980fe500 2024-09-16T00:55:48.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.903+0000 7f349dc63700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 0x7f3484070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:48.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.903+0000 7f349dc63700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 0x7f3484070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3494005950 tx=0x7f349400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:48.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:48.907+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f348c05c600 con 0x7f34980fe500 2024-09-16T00:55:49.061 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:48 smithi152 podman[71293]: 2024-09-16 00:55:48.779940733 +0000 UTC m=+0.616024369 container died 731a633813da302bee69bcc910e37f5b5369b411233dcbba96e5333956694b23 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-16T00:55:49.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.169+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f349819bdc0 con 0x7f34980fe500 2024-09-16T00:55:49.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.169+0000 7f348b7fe700 1 -- 172.21.15.53:0/1891321315 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f349819bdc0 con 0x7f34980fe500 2024-09-16T00:55:49.170 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:55:49.171 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:55:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:55:49.173 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:55:49.174 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:49.174 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:55:49.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 msgr2=0x7f3484070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 0x7f3484070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3494005950 tx=0x7f349400b410 comp rx=0 tx=0).stop 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 msgr2=0x7f3498195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f348c00bda0 tx=0x7f348c00bdd0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 shutdown_connections 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f348406e680 0x7f3484070b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34980fe500 0x7f3498195ae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 --2- 172.21.15.53:0/1891321315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34981014e0 0x7f3498196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 >> 172.21.15.53:0/1891321315 conn(0x7f34980f9e50 msgr2=0x7f3498104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 shutdown_connections 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.172+0000 7f34a06c8700 1 -- 172.21.15.53:0/1891321315 wait complete. 2024-09-16T00:55:49.175 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:55:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.298+0000 7f530c959700 1 -- 172.21.15.53:0/1020643166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 msgr2=0x7f5308101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.298+0000 7f530c959700 1 --2- 172.21.15.53:0/1020643166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f5308101740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009910 tx=0x7f52fc009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 -- 172.21.15.53:0/1020643166 shutdown_connections 2024-09-16T00:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 --2- 172.21.15.53:0/1020643166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f5308101740 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 --2- 172.21.15.53:0/1020643166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f5308100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 -- 172.21.15.53:0/1020643166 >> 172.21.15.53:0/1020643166 conn(0x7f53080fb680 msgr2=0x7f53080fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 -- 172.21.15.53:0/1020643166 shutdown_connections 2024-09-16T00:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.299+0000 7f530c959700 1 -- 172.21.15.53:0/1020643166 wait complete. 2024-09-16T00:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.300+0000 7f530c959700 1 Processor -- start 2024-09-16T00:55:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.300+0000 7f530c959700 1 -- start start 2024-09-16T00:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.300+0000 7f530c959700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f530810eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.300+0000 7f530c959700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f530810f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.300+0000 7f530c959700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530810f6a0 con 0x7f53081012d0 2024-09-16T00:55:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.301+0000 7f530c959700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530810f7e0 con 0x7f5308100030 2024-09-16T00:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.301+0000 7f53077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f530810eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.301+0000 7f53077fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f530810eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:54670/0 (socket says 172.21.15.53:54670) 2024-09-16T00:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.301+0000 7f53077fe700 1 -- 172.21.15.53:0/3775183598 learned_addr learned my addr 172.21.15.53:0/3775183598 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.301+0000 7f5306ffd700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f530810f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.302+0000 7f5306ffd700 1 -- 172.21.15.53:0/3775183598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 msgr2=0x7f530810eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.302+0000 7f5306ffd700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f530810eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.302+0000 7f5306ffd700 1 -- 172.21.15.53:0/3775183598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0095f0 con 0x7f53081012d0 2024-09-16T00:55:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f5306ffd700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f530810f080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098e0 tx=0x7f52fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc01d070 con 0x7f53081012d0 2024-09-16T00:55:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52fc00f460 con 0x7f53081012d0 2024-09-16T00:55:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5308112220 con 0x7f53081012d0 2024-09-16T00:55:49.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52fc021640 con 0x7f53081012d0 2024-09-16T00:55:49.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.304+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308112650 con 0x7f53081012d0 2024-09-16T00:55:49.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.306+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308074ae0 con 0x7f53081012d0 2024-09-16T00:55:49.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.306+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f52fc003b20 con 0x7f53081012d0 2024-09-16T00:55:49.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.307+0000 7f5304ff9700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 0x7f52f0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.307+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f52fc08f7f0 con 0x7f53081012d0 2024-09-16T00:55:49.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.307+0000 7f53077fe700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 0x7f52f0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.308+0000 7f53077fe700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 0x7f52f0070b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009ad0 tx=0x7f52f8009210 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:49.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.313+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f52fc05c5f0 con 0x7f53081012d0 2024-09-16T00:55:49.395 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71293]: 2024-09-16 00:55:49.15147443 +0000 UTC m=+0.987558064 container cleanup 731a633813da302bee69bcc910e37f5b5369b411233dcbba96e5333956694b23 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-16T00:55:49.395 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 bash[71293]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4 2024-09-16T00:55:49.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: pgmap v130: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:49.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:55:49.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T00:55:49.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2835648560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:49.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:49 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1891321315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:55:49.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.549+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5308105c20 con 0x7f52f006e6d0 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: pgmap v130: 65 pgs: 65 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2835648560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:55:49.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:49 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1891321315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.551+0000 7f5304ff9700 1 -- 172.21.15.53:0/3775183598 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5308105c20 con 0x7f52f006e6d0 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:55:49.552 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "10/23 daemons upgraded", 2024-09-16T00:55:49.553 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:55:49.553 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:55:49.553 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:55:49.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 msgr2=0x7f52f0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 0x7f52f0070b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009ad0 tx=0x7f52f8009210 comp rx=0 tx=0).stop 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 msgr2=0x7f530810f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f530810f080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098e0 tx=0x7f52fc00bd70 comp rx=0 tx=0).stop 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 shutdown_connections 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f52f006e6d0 0x7f52f0070b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5308100030 0x7f530810eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 --2- 172.21.15.53:0/3775183598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53081012d0 0x7f530810f080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.553+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 >> 172.21.15.53:0/3775183598 conn(0x7f53080fb680 msgr2=0x7f5308104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.554+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 shutdown_connections 2024-09-16T00:55:49.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.554+0000 7f530c959700 1 -- 172.21.15.53:0/3775183598 wait complete. 2024-09-16T00:55:49.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 -- 172.21.15.53:0/3359155492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 msgr2=0x7fb9c0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3359155492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0100650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009910 tx=0x7fb9bc009c20 comp rx=0 tx=0).stop 2024-09-16T00:55:49.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 -- 172.21.15.53:0/3359155492 shutdown_connections 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3359155492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 0x7fb9c0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3359155492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0100650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 -- 172.21.15.53:0/3359155492 >> 172.21.15.53:0/3359155492 conn(0x7fb9c00fb7f0 msgr2=0x7fb9c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 -- 172.21.15.53:0/3359155492 shutdown_connections 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.662+0000 7fb9c873e700 1 -- 172.21.15.53:0/3359155492 wait complete. 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 Processor -- start 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 -- start start 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 0x7fb9c0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0073680 con 0x7fb9c0100240 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c873e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00737c0 con 0x7fb9c0101440 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c64da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c64da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54136/0 (socket says 172.21.15.53:54136) 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c64da700 1 -- 172.21.15.53:0/3321380041 learned_addr learned my addr 172.21.15.53:0/3321380041 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.663+0000 7fb9c5cd9700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 0x7fb9c0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c64da700 1 -- 172.21.15.53:0/3321380041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 msgr2=0x7fb9c0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c64da700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 0x7fb9c0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c64da700 1 -- 172.21.15.53:0/3321380041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0095f0 con 0x7fb9c0100240 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c64da700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00bd70 tx=0x7fb9bc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9bc01d070 con 0x7fb9c0100240 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9bc005a00 con 0x7fb9c0100240 2024-09-16T00:55:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0073a40 con 0x7fb9c0100240 2024-09-16T00:55:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9bc021410 con 0x7fb9c0100240 2024-09-16T00:55:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.664+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0073f30 con 0x7fb9c0100240 2024-09-16T00:55:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.665+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c0108d90 con 0x7fb9c0100240 2024-09-16T00:55:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.666+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb9bc00f860 con 0x7fb9c0100240 2024-09-16T00:55:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.666+0000 7fb9b77fe700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 0x7fb9ac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:55:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.666+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb9bc08f870 con 0x7fb9c0100240 2024-09-16T00:55:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.666+0000 7fb9c5cd9700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 0x7fb9ac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:55:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.667+0000 7fb9c5cd9700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 0x7fb9ac070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000ac50 tx=0x7fb9b000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:55:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.670+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb9bc05c5f0 con 0x7fb9c0100240 2024-09-16T00:55:49.688 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71309]: 2024-09-16 00:55:49.395072205 +0000 UTC m=+0.612367851 container remove 731a633813da302bee69bcc910e37f5b5369b411233dcbba96e5333956694b23 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0) 2024-09-16T00:55:49.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71399]: 2024-09-16 00:55:49.688129197 +0000 UTC m=+0.086819689 container create 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T00:55:49.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71399]: 2024-09-16 00:55:49.617022874 +0000 UTC m=+0.015713378 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:49.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71399]: 2024-09-16 00:55:49.88295031 +0000 UTC m=+0.281640804 container init 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T00:55:49.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71399]: 2024-09-16 00:55:49.886953581 +0000 UTC m=+0.285644073 container start 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T00:55:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.976+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb9c0108f80 con 0x7fb9c0100240 2024-09-16T00:55:49.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.976+0000 7fb9b77fe700 1 -- 172.21.15.53:0/3321380041 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fb9bc05c180 con 0x7fb9c0100240 2024-09-16T00:55:49.977 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 osds down 2024-09-16T00:55:49.977 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T00:55:49.978 INFO:teuthology.orchestra.run.smithi053.stdout: osd.4 (root=default,host=smithi152) is down 2024-09-16T00:55:49.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 msgr2=0x7fb9ac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 0x7fb9ac070b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000ac50 tx=0x7fb9b000a380 comp rx=0 tx=0).stop 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 msgr2=0x7fb9c0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00bd70 tx=0x7fb9bc00bda0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 shutdown_connections 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb9ac06e680 0x7fb9ac070b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9c0100240 0x7fb9c0074af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.978+0000 7fb9c873e700 1 --2- 172.21.15.53:0/3321380041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0101440 0x7fb9c0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.979+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 >> 172.21.15.53:0/3321380041 conn(0x7fb9c00fb7f0 msgr2=0x7fb9c0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.979+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 shutdown_connections 2024-09-16T00:55:49.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:55:49.979+0000 7fb9c873e700 1 -- 172.21.15.53:0/3321380041 wait complete. 2024-09-16T00:55:50.275 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:49 smithi152 podman[71399]: 2024-09-16 00:55:49.96104001 +0000 UTC m=+0.359730505 container attach 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-16T00:55:50.275 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 podman[71399]: 2024-09-16 00:55:50.073900893 +0000 UTC m=+0.472591395 container died 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:55:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:50 smithi053 ceph-mon[77492]: from='client.44239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:50 smithi053 ceph-mon[77492]: osdmap e71: 6 total, 5 up, 6 in 2024-09-16T00:55:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:50 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3321380041' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:55:50.612 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:50 smithi152 ceph-mon[63606]: from='client.44239 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:50.612 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:50 smithi152 ceph-mon[63606]: osdmap e71: 6 total, 5 up, 6 in 2024-09-16T00:55:50.612 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:50 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3321380041' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:55:50.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 podman[71422]: 2024-09-16 00:55:50.611888005 +0000 UTC m=+0.532145325 container remove 27e9933e135b92bdba4cba6e363e56a924ba24713b4d79c07e89a098cc655348 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-16T00:55:50.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-16T00:55:50.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 systemd[1]: Stopped Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:55:50.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 6.445s CPU time. 2024-09-16T00:55:50.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:50 smithi152 systemd[1]: Starting Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:55:51.316 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:51 smithi152 ceph-mon[63606]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:51.316 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:51 smithi152 ceph-mon[63606]: pgmap v133: 65 pgs: 6 stale+active+clean, 59 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:51.317 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 podman[71519]: 2024-09-16 00:55:50.942060816 +0000 UTC m=+0.015784141 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:51.317 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 podman[71519]: 2024-09-16 00:55:51.055311265 +0000 UTC m=+0.129034576 container create fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-16T00:55:51.317 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 podman[71519]: 2024-09-16 00:55:51.316539446 +0000 UTC m=+0.390262758 container init fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T00:55:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:51 smithi053 ceph-mon[77492]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:55:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:51 smithi053 ceph-mon[77492]: pgmap v133: 65 pgs: 6 stale+active+clean, 59 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-16T00:55:51.697 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 podman[71519]: 2024-09-16 00:55:51.319943473 +0000 UTC m=+0.393666794 container start fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-16T00:55:51.697 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 podman[71519]: 2024-09-16 00:55:51.408145502 +0000 UTC m=+0.481868818 container attach fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T00:55:51.698 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:51.698 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 bash[71519]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:51.698 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:51.698 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:51 smithi152 bash[71519]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:55:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-mon[63606]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:52.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:52.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T00:55:52.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T00:55:52.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T00:55:52.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T00:55:52.803 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T00:55:52.804 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T00:55:52.804 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate[71535]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T00:55:52.804 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 bash[71519]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T00:55:52.804 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:52 smithi152 podman[71519]: 2024-09-16 00:55:52.498921531 +0000 UTC m=+1.572644849 container died fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-16T00:55:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:52 smithi053 ceph-mon[77492]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:52.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:52 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 36/222 objects degraded (16.216%), 14 pgs degraded (PG_DEGRADED) 2024-09-16T00:55:53.368 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 podman[71681]: 2024-09-16 00:55:53.062416278 +0000 UTC m=+0.553041206 container remove fbdcff63b697733e6598260d0892a3683f6bc4581165e0f4a3962daf4b6d137b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-16T00:55:53.369 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 podman[71739]: 2024-09-16 00:55:53.26374612 +0000 UTC m=+0.111796989 container create 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-16T00:55:53.369 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 podman[71739]: 2024-09-16 00:55:53.167558064 +0000 UTC m=+0.015608887 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:55:53.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 podman[71739]: 2024-09-16 00:55:53.482931706 +0000 UTC m=+0.330982530 container init 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:55:53.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 podman[71739]: 2024-09-16 00:55:53.48617906 +0000 UTC m=+0.334229884 container start 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T00:55:53.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 ceph-osd[71758]: -- 172.21.15.152:0/3529446591 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d323df21e0 con 0x55d322f9fc00 2024-09-16T00:55:53.948 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 bash[71739]: 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc 2024-09-16T00:55:53.948 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:53 smithi152 systemd[1]: Started Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:55:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:54.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:54 smithi152 ceph-mon[63606]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:55:55.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:54 smithi053 ceph-mon[77492]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:55.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:55:55 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T00:55:55.112+0000 7faaae720640 -1 Falling back to public interface 2024-09-16T00:55:57.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:57 smithi152 ceph-mon[63606]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-16T00:55:57.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.565 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:57 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:57 smithi053 ceph-mon[77492]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 36/222 objects degraded (16.216%) 2024-09-16T00:55:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:57 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:59.561 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:59 smithi152 ceph-mon[63606]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 206 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:59.561 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:59.561 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:55:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:55:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:59 smithi053 ceph-mon[77492]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 206 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:55:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:55:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:55:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:00.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T00:56:00.772+0000 7faaae720640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:00.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T00:56:00.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:00 smithi152 ceph-mon[63606]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 187 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:01.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-16T00:56:01.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:00 smithi053 ceph-mon[77492]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 187 B/s rd, 0 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:01.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:56:01 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T00:56:01.380+0000 7faaae720640 -1 osd.4 69 log_to_monitors true 2024-09-16T00:56:01.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:01 smithi152 ceph-mon[63606]: from='osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:01.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:01 smithi152 ceph-mon[63606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:02.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:01 smithi053 ceph-mon[77492]: from='osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:02.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:01 smithi053 ceph-mon[77492]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T00:56:02.698 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T00:56:02.412+0000 7faaa24b2640 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:02.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:56:02.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: osdmap e72: 6 total, 5 up, 6 in 2024-09-16T00:56:02.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: from='osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:02.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:02.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: pgmap v140: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:02.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:02 smithi152 ceph-mon[63606]: from='osd.4 ' entity='osd.4' 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: osdmap e72: 6 total, 5 up, 6 in 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: from='osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: pgmap v140: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:02.971 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:02 smithi053 ceph-mon[77492]: from='osd.4 ' entity='osd.4' 2024-09-16T00:56:03.874 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:03 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:56:03.874 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:03 smithi053 ceph-mon[77492]: osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562] boot 2024-09-16T00:56:03.874 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:03 smithi053 ceph-mon[77492]: osdmap e73: 6 total, 6 up, 6 in 2024-09-16T00:56:03.874 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:03 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:03 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:56:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:03 smithi152 ceph-mon[63606]: osd.4 [v2:172.21.15.152:6808/587292562,v1:172.21.15.152:6809/587292562] boot 2024-09-16T00:56:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:03 smithi152 ceph-mon[63606]: osdmap e73: 6 total, 6 up, 6 in 2024-09-16T00:56:03.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:03 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T00:56:04.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:04 smithi152 ceph-mon[63606]: pgmap v142: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:04.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:04 smithi152 ceph-mon[63606]: osdmap e74: 6 total, 6 up, 6 in 2024-09-16T00:56:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:04 smithi053 ceph-mon[77492]: pgmap v142: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 36/222 objects degraded (16.216%) 2024-09-16T00:56:05.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:04 smithi053 ceph-mon[77492]: osdmap e74: 6 total, 6 up, 6 in 2024-09-16T00:56:06.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:06 smithi053 ceph-mon[77492]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:06 smithi152 ceph-mon[63606]: Health check update: Degraded data redundancy: 26/222 objects degraded (11.712%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:07 smithi053 ceph-mon[77492]: pgmap v144: 65 pgs: 12 active+undersized, 11 active+undersized+degraded, 42 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/222 objects degraded (11.712%) 2024-09-16T00:56:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:07 smithi152 ceph-mon[63606]: pgmap v144: 65 pgs: 12 active+undersized, 11 active+undersized+degraded, 42 active+clean; 196 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 26/222 objects degraded (11.712%) 2024-09-16T00:56:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:08 smithi152 ceph-mon[63606]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 466 B/s rd, 0 op/s 2024-09-16T00:56:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:08 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/222 objects degraded (11.712%), 11 pgs degraded) 2024-09-16T00:56:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:08 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:56:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:08 smithi053 ceph-mon[77492]: pgmap v145: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 466 B/s rd, 0 op/s 2024-09-16T00:56:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:08 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/222 objects degraded (11.712%), 11 pgs degraded) 2024-09-16T00:56:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:08 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:56:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:11 smithi053 ceph-mon[77492]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-09-16T00:56:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:11 smithi152 ceph-mon[63606]: pgmap v146: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 0 op/s 2024-09-16T00:56:13.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:13 smithi053 ceph-mon[77492]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 932 B/s rd, 1 op/s 2024-09-16T00:56:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:13 smithi152 ceph-mon[63606]: pgmap v147: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 932 B/s rd, 1 op/s 2024-09-16T00:56:15.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:15 smithi152 ceph-mon[63606]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-16T00:56:15.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:15.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:15.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:15.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:15 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:15 smithi053 ceph-mon[77492]: pgmap v148: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-16T00:56:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:15 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:16.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:16 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:16.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:16 smithi152 ceph-mon[63606]: Upgrade: osd.5 is safe to restart 2024-09-16T00:56:16.301 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:16.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:56:16.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:16 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T00:56:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:16 smithi053 ceph-mon[77492]: Upgrade: osd.5 is safe to restart 2024-09-16T00:56:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T00:56:16.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:17 smithi152 ceph-mon[63606]: Upgrade: Updating osd.5 2024-09-16T00:56:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:17 smithi152 ceph-mon[63606]: Deploying daemon osd.5 on smithi152 2024-09-16T00:56:17.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:17 smithi152 ceph-mon[63606]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 695 B/s rd, 1 op/s 2024-09-16T00:56:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:17 smithi053 ceph-mon[77492]: Upgrade: Updating osd.5 2024-09-16T00:56:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:17 smithi053 ceph-mon[77492]: Deploying daemon osd.5 on smithi152 2024-09-16T00:56:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:17 smithi053 ceph-mon[77492]: pgmap v149: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 695 B/s rd, 1 op/s 2024-09-16T00:56:19.130 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:18 smithi152 systemd[1]: Stopping Ceph osd.5 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:56:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:19 smithi053 ceph-mon[77492]: pgmap v150: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T00:56:19.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:19 smithi053 ceph-mon[77492]: osd.5 marked itself down and dead 2024-09-16T00:56:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:19 smithi152 ceph-mon[63606]: pgmap v150: 65 pgs: 65 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-16T00:56:19.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:19 smithi152 ceph-mon[63606]: osd.5 marked itself down and dead 2024-09-16T00:56:19.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:19 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[48466]: 2024-09-16T00:56:19.128+0000 7fb9cb5c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T00:56:19.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:19 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[48466]: 2024-09-16T00:56:19.128+0000 7fb9cb5c1700 -1 osd.5 74 *** Got signal Terminated *** 2024-09-16T00:56:19.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:19 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[48466]: 2024-09-16T00:56:19.128+0000 7fb9cb5c1700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T00:56:20.005 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:19 smithi152 podman[74209]: 2024-09-16 00:56:19.719381974 +0000 UTC m=+0.683109276 container died 581cfabddcb63f0d8a689cbeed7c838c6e9933b426a75e426b3abc59286ca073 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.build-date=20231212, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD) 2024-09-16T00:56:20.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/1267781746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 msgr2=0x7f7f28101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/1267781746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28101890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009910 tx=0x7f7f10009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/1267781746 shutdown_connections 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/1267781746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28101890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/1267781746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 0x7f7f28100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/1267781746 >> 172.21.15.53:0/1267781746 conn(0x7f7f280fb7f0 msgr2=0x7f7f280fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/1267781746 shutdown_connections 2024-09-16T00:56:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.103+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/1267781746 wait complete. 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 Processor -- start 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 -- start start 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 0x7f7f28195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28196560 con 0x7f7f28101440 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f2dd0d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281966a0 con 0x7f7f28100240 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f1effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f1effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54644/0 (socket says 172.21.15.53:54644) 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.104+0000 7f7f1effd700 1 -- 172.21.15.53:0/221746066 learned_addr learned my addr 172.21.15.53:0/221746066 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f277fe700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 0x7f7f28195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f1effd700 1 -- 172.21.15.53:0/221746066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 msgr2=0x7f7f28195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f1effd700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 0x7f7f28195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f1effd700 1 -- 172.21.15.53:0/221746066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100095f0 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f1effd700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f10005b40 tx=0x7f7f1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1001d070 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f10022470 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2819b100 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1000f690 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.105+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2819b5c0 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.106+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f28108d90 con 0x7f7f28101440 2024-09-16T00:56:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.107+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f10022a10 con 0x7f7f28101440 2024-09-16T00:56:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.107+0000 7f7f257fa700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 0x7f7f14070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.108+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7f1008fba0 con 0x7f7f28101440 2024-09-16T00:56:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.108+0000 7f7f277fe700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 0x7f7f14070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.108+0000 7f7f277fe700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 0x7f7f14070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f281012a0 tx=0x7f7f1800a3b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.112+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f1005c9d0 con 0x7f7f28101440 2024-09-16T00:56:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.364+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f28105d90 con 0x7f7f1406e680 2024-09-16T00:56:20.365 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:20 smithi053 ceph-mon[77492]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:56:20.365 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:20 smithi053 ceph-mon[77492]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-16T00:56:20.365 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:20 smithi053 ceph-mon[77492]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T00:56:20.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.365+0000 7f7f257fa700 1 -- 172.21.15.53:0/221746066 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7f28105d90 con 0x7f7f1406e680 2024-09-16T00:56:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 msgr2=0x7f7f14070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 0x7f7f14070b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f281012a0 tx=0x7f7f1800a3b0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 msgr2=0x7f7f28195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f10005b40 tx=0x7f7f1000bd70 comp rx=0 tx=0).stop 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 shutdown_connections 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f1406e680 0x7f7f14070b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f28100240 0x7f7f28195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 --2- 172.21.15.53:0/221746066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f28101440 0x7f7f28195fd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 >> 172.21.15.53:0/221746066 conn(0x7f7f280fb7f0 msgr2=0x7f7f28104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 shutdown_connections 2024-09-16T00:56:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.367+0000 7f7f2dd0d700 1 -- 172.21.15.53:0/221746066 wait complete. 2024-09-16T00:56:20.379 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:56:20.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:20 smithi152 ceph-mon[63606]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T00:56:20.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:20 smithi152 ceph-mon[63606]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-16T00:56:20.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:20 smithi152 ceph-mon[63606]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T00:56:20.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:20 smithi152 podman[74209]: 2024-09-16 00:56:20.079198356 +0000 UTC m=+1.042925651 container cleanup 581cfabddcb63f0d8a689cbeed7c838c6e9933b426a75e426b3abc59286ca073 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_CLEAN=True) 2024-09-16T00:56:20.448 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:20 smithi152 bash[74209]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5 2024-09-16T00:56:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 -- 172.21.15.53:0/1389559464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c103350 msgr2=0x7f921c105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 --2- 172.21.15.53:0/1389559464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c103350 0x7f921c105790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f920c009910 tx=0x7f920c009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 -- 172.21.15.53:0/1389559464 shutdown_connections 2024-09-16T00:56:20.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 --2- 172.21.15.53:0/1389559464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c103350 0x7f921c105790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 --2- 172.21.15.53:0/1389559464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c069230 0x7f921c102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 -- 172.21.15.53:0/1389559464 >> 172.21.15.53:0/1389559464 conn(0x7f921c0fa780 msgr2=0x7f921c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 -- 172.21.15.53:0/1389559464 shutdown_connections 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.479+0000 7f9223576700 1 -- 172.21.15.53:0/1389559464 wait complete. 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 Processor -- start 2024-09-16T00:56:20.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 -- start start 2024-09-16T00:56:20.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c103350 0x7f921c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c196630 con 0x7f921c069230 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9223576700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c196770 con 0x7f921c103350 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54662/0 (socket says 172.21.15.53:54662) 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 -- 172.21.15.53:0/2133883700 learned_addr learned my addr 172.21.15.53:0/2133883700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9220b11700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c103350 0x7f921c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 -- 172.21.15.53:0/2133883700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c103350 msgr2=0x7f921c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c103350 0x7f921c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 -- 172.21.15.53:0/2133883700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0095f0 con 0x7f921c069230 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.480+0000 7f9221312700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f921800d8d0 tx=0x7f921800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.481+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92180041f0 con 0x7f921c069230 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.481+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9218004350 con 0x7f921c069230 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.481+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9218003cf0 con 0x7f921c069230 2024-09-16T00:56:20.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.481+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c19b220 con 0x7f921c069230 2024-09-16T00:56:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.481+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c19b770 con 0x7f921c069230 2024-09-16T00:56:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.482+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c18fbf0 con 0x7f921c069230 2024-09-16T00:56:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.482+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9218009730 con 0x7f921c069230 2024-09-16T00:56:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.483+0000 7f92127fc700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 0x7f9208070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.483+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f921808e1f0 con 0x7f921c069230 2024-09-16T00:56:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.483+0000 7f9220b11700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 0x7f9208070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.483+0000 7f9220b11700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 0x7f9208070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f920c005b40 tx=0x7f920c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.487+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f921805af70 con 0x7f921c069230 2024-09-16T00:56:20.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.730+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f921c061190 con 0x7f920806e680 2024-09-16T00:56:20.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.732+0000 7f92127fc700 1 -- 172.21.15.53:0/2133883700 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f921c061190 con 0x7f920806e680 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 msgr2=0x7f9208070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 0x7f9208070b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f920c005b40 tx=0x7f920c005a90 comp rx=0 tx=0).stop 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 msgr2=0x7f921c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f921800d8d0 tx=0x7f921800dc90 comp rx=0 tx=0).stop 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 shutdown_connections 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f920806e680 0x7f9208070b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c069230 0x7f921c195ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 --2- 172.21.15.53:0/2133883700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f921c103350 0x7f921c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 >> 172.21.15.53:0/2133883700 conn(0x7f921c0fa780 msgr2=0x7f921c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:20.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 shutdown_connections 2024-09-16T00:56:20.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.734+0000 7f9223576700 1 -- 172.21.15.53:0/2133883700 wait complete. 2024-09-16T00:56:20.815 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:20 smithi152 podman[74233]: 2024-09-16 00:56:20.455946086 +0000 UTC m=+0.728381620 container remove 581cfabddcb63f0d8a689cbeed7c838c6e9933b426a75e426b3abc59286ca073 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-09-16T00:56:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 -- 172.21.15.53:0/2220579144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 msgr2=0x7f5968100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 --2- 172.21.15.53:0/2220579144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968100860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f595c009910 tx=0x7f595c009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 -- 172.21.15.53:0/2220579144 shutdown_connections 2024-09-16T00:56:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 --2- 172.21.15.53:0/2220579144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968100860 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 --2- 172.21.15.53:0/2220579144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 0x7f59680ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 -- 172.21.15.53:0/2220579144 >> 172.21.15.53:0/2220579144 conn(0x7f59680fa7a0 msgr2=0x7f59680fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 -- 172.21.15.53:0/2220579144 shutdown_connections 2024-09-16T00:56:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.843+0000 7f596e144700 1 -- 172.21.15.53:0/2220579144 wait complete. 2024-09-16T00:56:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 Processor -- start 2024-09-16T00:56:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 -- start start 2024-09-16T00:56:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 0x7f5968195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968196920 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f596e144700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968196a60 con 0x7f59680ff150 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f5966ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f5966ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54680/0 (socket says 172.21.15.53:54680) 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f5966ffd700 1 -- 172.21.15.53:0/488791454 learned_addr learned my addr 172.21.15.53:0/488791454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.844+0000 7f59677fe700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 0x7f5968195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5966ffd700 1 -- 172.21.15.53:0/488791454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 msgr2=0x7f5968195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5966ffd700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 0x7f5968195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5966ffd700 1 -- 172.21.15.53:0/488791454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0095f0 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5966ffd700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f595c00b5c0 tx=0x7f595c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f595c01d070 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f595c022470 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596819b4b0 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f595c00f690 con 0x7f59681003f0 2024-09-16T00:56:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.845+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596819b9a0 con 0x7f59681003f0 2024-09-16T00:56:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.846+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5968068ab0 con 0x7f59681003f0 2024-09-16T00:56:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.847+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f595c0225e0 con 0x7f59681003f0 2024-09-16T00:56:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.847+0000 7f5964ff9700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 0x7f5950070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.847+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f595c08fcd0 con 0x7f59681003f0 2024-09-16T00:56:20.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.847+0000 7f59677fe700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 0x7f5950070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:20.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.847+0000 7f59677fe700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 0x7f5950070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5958005950 tx=0x7f595800a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:20.851+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f595c05ca50 con 0x7f59681003f0 2024-09-16T00:56:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.074+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f59680694e0 con 0x7f595006e680 2024-09-16T00:56:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.084+0000 7f5964ff9700 1 -- 172.21.15.53:0/488791454 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f59680694e0 con 0x7f595006e680 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (12m) 87s ago 14m 25.6M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (14m) 87s ago 14m 8518k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (13m) 24s ago 13m 7982k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (3m) 87s ago 14m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (3m) 24s ago 13m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (12m) 87s ago 13m 84.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (8m) 87s ago 8m 152M - 18.2.0 dc2bc1663786 c1fd12a0e258 2024-09-16T00:56:21.085 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (8m) 87s ago 8m 98.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (8m) 24s ago 8m 17.7M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (8m) 24s ago 8m 16.0M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (5m) 87s ago 15m 499M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (4m) 24s ago 13m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (4m) 87s ago 15m 50.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (3m) 24s ago 13m 37.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (14m) 87s ago 14m 16.5M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (13m) 24s ago 13m 16.0M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (2m) 87s ago 12m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (2m) 87s ago 11m 108M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:56:21.086 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (93s) 87s ago 11m 12.7M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:56:21.087 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (58s) 24s ago 11m 113M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:56:21.087 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (27s) 24s ago 10m 12.1M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:56:21.087 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (10m) 24s ago 10m 256M 2240M 18.2.0 dc2bc1663786 581cfabddcb6 2024-09-16T00:56:21.087 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (4m) 87s ago 13m 78.5M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 msgr2=0x7f5950070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 0x7f5950070b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5958005950 tx=0x7f595800a300 comp rx=0 tx=0).stop 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 msgr2=0x7f5968196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f595c00b5c0 tx=0x7f595c00bd70 comp rx=0 tx=0).stop 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 shutdown_connections 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f595006e680 0x7f5950070b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59680ff150 0x7f5968195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 --2- 172.21.15.53:0/488791454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59681003f0 0x7f5968196300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 >> 172.21.15.53:0/488791454 conn(0x7f59680fa7a0 msgr2=0x7f5968068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 shutdown_connections 2024-09-16T00:56:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.086+0000 7f596e144700 1 -- 172.21.15.53:0/488791454 wait complete. 2024-09-16T00:56:21.118 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:20 smithi152 podman[74328]: 2024-09-16 00:56:20.815294251 +0000 UTC m=+0.088389779 container create 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T00:56:21.118 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:20 smithi152 podman[74328]: 2024-09-16 00:56:20.74260848 +0000 UTC m=+0.015704017 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:56:21.118 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 podman[74328]: 2024-09-16 00:56:21.059843249 +0000 UTC m=+0.332938777 container init 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T00:56:21.118 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 podman[74328]: 2024-09-16 00:56:21.063266164 +0000 UTC m=+0.336361688 container start 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T00:56:21.118 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 podman[74328]: 2024-09-16 00:56:21.11795196 +0000 UTC m=+0.391047485 container attach 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 -- 172.21.15.53:0/3409398824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 msgr2=0x7f38ec101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 --2- 172.21.15.53:0/3409398824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec101890 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009910 tx=0x7f38dc009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 -- 172.21.15.53:0/3409398824 shutdown_connections 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 --2- 172.21.15.53:0/3409398824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec101890 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 --2- 172.21.15.53:0/3409398824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 0x7f38ec100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.198+0000 7f38f4730700 1 -- 172.21.15.53:0/3409398824 >> 172.21.15.53:0/3409398824 conn(0x7f38ec0fb7f0 msgr2=0x7f38ec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.199+0000 7f38f4730700 1 -- 172.21.15.53:0/3409398824 shutdown_connections 2024-09-16T00:56:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.199+0000 7f38f4730700 1 -- 172.21.15.53:0/3409398824 wait complete. 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.199+0000 7f38f4730700 1 Processor -- start 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.199+0000 7f38f4730700 1 -- start start 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f4730700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 0x7f38ec195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f4730700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f4730700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1965f0 con 0x7f38ec101440 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f4730700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec196730 con 0x7f38ec100240 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54696/0 (socket says 172.21.15.53:54696) 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 -- 172.21.15.53:0/3362546112 learned_addr learned my addr 172.21.15.53:0/3362546112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f24cc700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 0x7f38ec195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 -- 172.21.15.53:0/3362546112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 msgr2=0x7f38ec195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 0x7f38ec195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 -- 172.21.15.53:0/3362546112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0095f0 con 0x7f38ec101440 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f1ccb700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00bd70 tx=0x7f38dc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38dc01d070 con 0x7f38ec101440 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.200+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec19b180 con 0x7f38ec101440 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.201+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f38dc005dc0 con 0x7f38ec101440 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.201+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec19b670 con 0x7f38ec101440 2024-09-16T00:56:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.201+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38dc021410 con 0x7f38ec101440 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.201+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec108d90 con 0x7f38ec101440 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.202+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f38dc00f7d0 con 0x7f38ec101440 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.202+0000 7f38e37fe700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 0x7f38d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.203+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f38dc08f730 con 0x7f38ec101440 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.203+0000 7f38f24cc700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 0x7f38d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.203+0000 7f38f24cc700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 0x7f38d8070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38ec1012a0 tx=0x7f38e80091c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.207+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38dc05c560 con 0x7f38ec101440 2024-09-16T00:56:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:21 smithi152 ceph-mon[63606]: pgmap v152: 65 pgs: 13 stale+active+clean, 52 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:56:21.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:21 smithi152 ceph-mon[63606]: osdmap e76: 6 total, 5 up, 6 in 2024-09-16T00:56:21.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 podman[74328]: 2024-09-16 00:56:21.258797816 +0000 UTC m=+0.531893349 container died 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-16T00:56:21.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.512+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f38ec108f50 con 0x7f38ec101440 2024-09-16T00:56:21.513 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:21 smithi053 ceph-mon[77492]: pgmap v152: 65 pgs: 13 stale+active+clean, 52 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-16T00:56:21.513 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:21 smithi053 ceph-mon[77492]: osdmap e76: 6 total, 5 up, 6 in 2024-09-16T00:56:21.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.512+0000 7f38e37fe700 1 -- 172.21.15.53:0/3362546112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7f38dc05c0f0 con 0x7f38ec101440 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 5 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:56:21.514 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 9 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:56:21.515 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:56:21.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 msgr2=0x7f38d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 0x7f38d8070b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38ec1012a0 tx=0x7f38e80091c0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 msgr2=0x7f38ec195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00bd70 tx=0x7f38dc00bda0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 shutdown_connections 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f38d806e680 0x7f38d8070b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38ec100240 0x7f38ec195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 --2- 172.21.15.53:0/3362546112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ec101440 0x7f38ec195fd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 >> 172.21.15.53:0/3362546112 conn(0x7f38ec0fb7f0 msgr2=0x7f38ec104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.515+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 shutdown_connections 2024-09-16T00:56:21.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.516+0000 7f38f4730700 1 -- 172.21.15.53:0/3362546112 wait complete. 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 -- 172.21.15.53:0/3014703620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 msgr2=0x7f8194100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 --2- 172.21.15.53:0/3014703620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194100650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8184009910 tx=0x7f8184009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 -- 172.21.15.53:0/3014703620 shutdown_connections 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 --2- 172.21.15.53:0/3014703620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 0x7f8194101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 --2- 172.21.15.53:0/3014703620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194100650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 -- 172.21.15.53:0/3014703620 >> 172.21.15.53:0/3014703620 conn(0x7f81940fb7f0 msgr2=0x7f81940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 -- 172.21.15.53:0/3014703620 shutdown_connections 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.624+0000 7f819a25a700 1 -- 172.21.15.53:0/3014703620 wait complete. 2024-09-16T00:56:21.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 Processor -- start 2024-09-16T00:56:21.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 -- start start 2024-09-16T00:56:21.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 0x7f8194196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8194196630 con 0x7f8194100240 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.625+0000 7f819a25a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8194196770 con 0x7f8194101440 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54706/0 (socket says 172.21.15.53:54706) 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 -- 172.21.15.53:0/1195246007 learned_addr learned my addr 172.21.15.53:0/1195246007 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f8192ffd700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 0x7f8194196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 -- 172.21.15.53:0/1195246007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 msgr2=0x7f8194196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 0x7f8194196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 -- 172.21.15.53:0/1195246007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840095f0 con 0x7f8194100240 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f81937fe700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8184000c00 tx=0x7f818400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818401d070 con 0x7f8194100240 2024-09-16T00:56:21.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8184005dc0 con 0x7f8194100240 2024-09-16T00:56:21.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819419b1c0 con 0x7f8194100240 2024-09-16T00:56:21.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8184022470 con 0x7f8194100240 2024-09-16T00:56:21.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.626+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819419b6b0 con 0x7f8194100240 2024-09-16T00:56:21.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.627+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8194108db0 con 0x7f8194100240 2024-09-16T00:56:21.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.628+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8184003810 con 0x7f8194100240 2024-09-16T00:56:21.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.628+0000 7f8190ff9700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 0x7f817c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:21.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.629+0000 7f8192ffd700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 0x7f817c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:21.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.629+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f818408fad0 con 0x7f8194100240 2024-09-16T00:56:21.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.629+0000 7f8192ffd700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 0x7f817c070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8188009c60 tx=0x7f8188009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:21.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.633+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f818405c850 con 0x7f8194100240 2024-09-16T00:56:21.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.892+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8194108fa0 con 0x7f8194100240 2024-09-16T00:56:21.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.892+0000 7f8190ff9700 1 -- 172.21.15.53:0/1195246007 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f818405c3e0 con 0x7f8194100240 2024-09-16T00:56:21.893 INFO:teuthology.orchestra.run.smithi053.stdout:e16 2024-09-16T00:56:21.893 INFO:teuthology.orchestra.run.smithi053.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-16T00:56:21.893 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 16 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:47:52.208118+0000 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:56:21.894 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 0 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=14470} 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:56:21.895 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.53:6826/239552761,v1:172.21.15.53:6827/239552761] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.53:6828/3568284150,v1:172.21.15.53:6829/3568284150] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:24281} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:21.896 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:21.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 msgr2=0x7f817c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 0x7f817c070b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8188009c60 tx=0x7f8188009260 comp rx=0 tx=0).stop 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 msgr2=0x7f8194195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8184000c00 tx=0x7f818400f690 comp rx=0 tx=0).stop 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 shutdown_connections 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f817c06e680 0x7f817c070b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8194100240 0x7f8194195ad0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 --2- 172.21.15.53:0/1195246007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8194101440 0x7f8194196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 >> 172.21.15.53:0/1195246007 conn(0x7f81940fb7f0 msgr2=0x7f8194104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 shutdown_connections 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:21.895+0000 7f819a25a700 1 -- 172.21.15.53:0/1195246007 wait complete. 2024-09-16T00:56:21.898 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 -- 172.21.15.53:0/768550490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 msgr2=0x7f1dac0fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 --2- 172.21.15.53:0/768550490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac0fe2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009910 tx=0x7f1da0009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 -- 172.21.15.53:0/768550490 shutdown_connections 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 --2- 172.21.15.53:0/768550490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac0fe2e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 --2- 172.21.15.53:0/768550490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.005+0000 7f1db2352700 1 -- 172.21.15.53:0/768550490 >> 172.21.15.53:0/768550490 conn(0x7f1dac0f9e50 msgr2=0x7f1dac0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 -- 172.21.15.53:0/768550490 shutdown_connections 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 -- 172.21.15.53:0/768550490 wait complete. 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 Processor -- start 2024-09-16T00:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 -- start start 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac196640 con 0x7f1dac102200 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.006+0000 7f1db2352700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac196780 con 0x7f1dac101820 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dabfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dab7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dabfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:40290/0 (socket says 172.21.15.53:40290) 2024-09-16T00:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dabfff700 1 -- 172.21.15.53:0/3906600812 learned_addr learned my addr 172.21.15.53:0/3906600812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dab7fe700 1 -- 172.21.15.53:0/3906600812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 msgr2=0x7f1dac195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dab7fe700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dab7fe700 1 -- 172.21.15.53:0/3906600812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00095f0 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dabfff700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1dab7fe700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac196020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1da0000c00 tx=0x7f1da000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da001d070 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1da0005dc0 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac19b1d0 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.007+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da0017400 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.008+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac19b6c0 con 0x7f1dac102200 2024-09-16T00:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.008+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac108d90 con 0x7f1dac102200 2024-09-16T00:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.009+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1da0003810 con 0x7f1dac102200 2024-09-16T00:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.010+0000 7f1da97fa700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 0x7f1d94070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.010+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1da008f4e0 con 0x7f1dac102200 2024-09-16T00:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.010+0000 7f1dabfff700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 0x7f1d94070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.010+0000 7f1dabfff700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 0x7f1d94070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c005950 tx=0x7f1d9c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:22.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.014+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1da005c260 con 0x7f1dac102200 2024-09-16T00:56:22.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 podman[74351]: 2024-09-16 00:56:21.847679081 +0000 UTC m=+0.582728750 container remove 54a4f06dbb6e0097efedce721a7b18f1e7e01c69cce4a1ce756003f3c24a4f8f (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T00:56:22.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-16T00:56:22.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 systemd[1]: Stopped Ceph osd.5 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:56:22.198 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:21 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 9.123s CPU time. 2024-09-16T00:56:22.198 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 systemd[1]: Starting Ceph osd.5 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T00:56:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.251+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dac19bdc0 con 0x7f1d9406e680 2024-09-16T00:56:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.252+0000 7f1da97fa700 1 -- 172.21.15.53:0/3906600812 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1dac19bdc0 con 0x7f1d9406e680 2024-09-16T00:56:22.253 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:56:22.253 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:56:22.253 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:56:22.253 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "11/23 daemons upgraded", 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:56:22.254 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 msgr2=0x7f1d94070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 0x7f1d94070b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c005950 tx=0x7f1d9c009260 comp rx=0 tx=0).stop 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 msgr2=0x7f1dac196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac196020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1da0000c00 tx=0x7f1da000f690 comp rx=0 tx=0).stop 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 shutdown_connections 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1d9406e680 0x7f1d94070b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dac101820 0x7f1dac195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 --2- 172.21.15.53:0/3906600812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dac102200 0x7f1dac196020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 >> 172.21.15.53:0/3906600812 conn(0x7f1dac0f9e50 msgr2=0x7f1dac1047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 shutdown_connections 2024-09-16T00:56:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.255+0000 7f1db2352700 1 -- 172.21.15.53:0/3906600812 wait complete. 2024-09-16T00:56:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 -- 172.21.15.53:0/2378111809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0101440 msgr2=0x7f94b0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 --2- 172.21.15.53:0/2378111809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0101440 0x7f94b0101890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9498009910 tx=0x7f9498009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 -- 172.21.15.53:0/2378111809 shutdown_connections 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 --2- 172.21.15.53:0/2378111809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0101440 0x7f94b0101890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 --2- 172.21.15.53:0/2378111809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100240 0x7f94b0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 -- 172.21.15.53:0/2378111809 >> 172.21.15.53:0/2378111809 conn(0x7f94b00fb7f0 msgr2=0x7f94b00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.363+0000 7f94b4928700 1 -- 172.21.15.53:0/2378111809 shutdown_connections 2024-09-16T00:56:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.364+0000 7f94b4928700 1 -- 172.21.15.53:0/2378111809 wait complete. 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.364+0000 7f94b4928700 1 Processor -- start 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.364+0000 7f94b4928700 1 -- start start 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94b4928700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94b4928700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0101440 0x7f94b0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94b4928700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01965f0 con 0x7f94b0100240 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94b4928700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b0196730 con 0x7f94b0101440 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54742/0 (socket says 172.21.15.53:54742) 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 -- 172.21.15.53:0/689725556 learned_addr learned my addr 172.21.15.53:0/689725556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94a7fff700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0101440 0x7f94b0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 -- 172.21.15.53:0/689725556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0101440 msgr2=0x7f94b0195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0101440 0x7f94b0195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 -- 172.21.15.53:0/689725556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980095f0 con 0x7f94b0100240 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94ae59c700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a000d900 tx=0x7f94a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.365+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a00041f0 con 0x7f94b0100240 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.366+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b019b1e0 con 0x7f94b0100240 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.366+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f94a0004350 con 0x7f94b0100240 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.366+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a0003d20 con 0x7f94b0100240 2024-09-16T00:56:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.366+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b019b730 con 0x7f94b0100240 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.367+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b0108d90 con 0x7f94b0100240 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.367+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f94a0009730 con 0x7f94b0100240 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.368+0000 7f94a77fe700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 0x7f949c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.368+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f94a008e460 con 0x7f94b0100240 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.368+0000 7f94a7fff700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 0x7f949c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.368+0000 7f94a7fff700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 0x7f949c070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f949800b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:22.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.372+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f94a005b1e0 con 0x7f94b0100240 2024-09-16T00:56:22.568 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-mon[63606]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.568 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-mon[63606]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.569 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-mon[63606]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.569 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3362546112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:22.569 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1195246007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:56:22.569 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 podman[74452]: 2024-09-16 00:56:22.184115427 +0000 UTC m=+0.015866974 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:56:22.569 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 podman[74452]: 2024-09-16 00:56:22.324210037 +0000 UTC m=+0.155961574 container create 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-16T00:56:22.569 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 podman[74452]: 2024-09-16 00:56:22.568701965 +0000 UTC m=+0.400453511 container init 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:56:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:22 smithi053 ceph-mon[77492]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:22 smithi053 ceph-mon[77492]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:22 smithi053 ceph-mon[77492]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:22 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3362546112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:22.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:22 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1195246007' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:56:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.674+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f94b0108f80 con 0x7f94b0100240 2024-09-16T00:56:22.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.674+0000 7f94a77fe700 1 -- 172.21.15.53:0/689725556 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1179 (secure 0 0 0) 0x7f94a005ad70 con 0x7f94b0100240 2024-09-16T00:56:22.675 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded 2024-09-16T00:56:22.675 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: osd.5 (root=default,host=smithi152) is down 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-16T00:56:22.676 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-16T00:56:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-16T00:56:22.677 INFO:teuthology.orchestra.run.smithi053.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-16T00:56:22.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.676+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 msgr2=0x7f949c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.676+0000 7f94b4928700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 0x7f949c070b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f949800b560 comp rx=0 tx=0).stop 2024-09-16T00:56:22.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.676+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 msgr2=0x7f94b0195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.676+0000 7f94b4928700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a000d900 tx=0x7f94a000dc10 comp rx=0 tx=0).stop 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 shutdown_connections 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f949c06e680 0x7f949c070b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b0100240 0x7f94b0195a90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 --2- 172.21.15.53:0/689725556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0101440 0x7f94b0195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 >> 172.21.15.53:0/689725556 conn(0x7f94b00fb7f0 msgr2=0x7f94b0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 shutdown_connections 2024-09-16T00:56:22.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:22.677+0000 7f94b4928700 1 -- 172.21.15.53:0/689725556 wait complete. 2024-09-16T00:56:22.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 podman[74452]: 2024-09-16 00:56:22.572086751 +0000 UTC m=+0.403838294 container start 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T00:56:22.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 podman[74452]: 2024-09-16 00:56:22.643466763 +0000 UTC m=+0.475218315 container attach 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T00:56:22.948 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:56:22.948 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 bash[74452]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:56:22.948 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:56:22.948 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:22 smithi152 bash[74452]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T00:56:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:23 smithi053 ceph-mon[77492]: pgmap v154: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:23 smithi053 ceph-mon[77492]: Health check failed: Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:23 smithi053 ceph-mon[77492]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:23.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:23 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/689725556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:56:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-mon[63606]: pgmap v154: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-mon[63606]: Health check failed: Degraded data redundancy: 32/222 objects degraded (14.414%), 12 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-mon[63606]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/689725556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:56:23.698 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T00:56:23.698 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T00:56:23.698 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T00:56:23.698 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T00:56:24.030 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T00:56:24.030 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate[74467]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 bash[74452]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T00:56:24.031 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:23 smithi152 podman[74452]: 2024-09-16 00:56:23.74622571 +0000 UTC m=+1.577977247 container died 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e) 2024-09-16T00:56:24.576 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 podman[74613]: 2024-09-16 00:56:24.314568466 +0000 UTC m=+0.560880718 container remove 504dc54dd752584971b47871816ecf8b4d07854fabe292e3533c99f35e2a2b63 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T00:56:24.576 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 podman[74673]: 2024-09-16 00:56:24.49888623 +0000 UTC m=+0.093781713 container create b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-16T00:56:24.576 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 podman[74673]: 2024-09-16 00:56:24.420634189 +0000 UTC m=+0.015529675 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T00:56:25.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 podman[74673]: 2024-09-16 00:56:24.709787494 +0000 UTC m=+0.304682977 container init b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T00:56:25.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 podman[74673]: 2024-09-16 00:56:24.712883859 +0000 UTC m=+0.307779343 container start b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T00:56:25.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 ceph-osd[74692]: -- 172.21.15.152:0/2697005474 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e257cb41e0 con 0x55e256e61c00 2024-09-16T00:56:25.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 bash[74673]: b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 2024-09-16T00:56:25.198 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:24 smithi152 systemd[1]: Started Ceph osd.5 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T00:56:25.566 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:25 smithi152 ceph-mon[63606]: pgmap v155: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:25.566 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:25.566 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:25.566 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:25 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:25 smithi053 ceph-mon[77492]: pgmap v155: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:25 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:26.697 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:26 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T00:56:26.345+0000 7f02c70f7640 -1 Falling back to public interface 2024-09-16T00:56:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:27 smithi053 ceph-mon[77492]: pgmap v156: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-16T00:56:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:27 smithi152 ceph-mon[63606]: pgmap v156: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 32/222 objects degraded (14.414%) 2024-09-16T00:56:28.709 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.709 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.709 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.709 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.709 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:28 smithi152 ceph-mon[63606]: pgmap v157: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:28.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:28 smithi053 ceph-mon[77492]: pgmap v157: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:30.404 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:30.404 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:31.428 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-16T00:56:31.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T00:56:31.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-16T00:56:31.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T00:56:31.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-16T00:56:31.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T00:56:31.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T00:56:31.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-16T00:56:31.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T00:56:31.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:31 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-16T00:56:32.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:31 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T00:56:31.899+0000 7f02c70f7640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-16T00:56:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all osd 2024-09-16T00:56:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: Upgrade: Setting require_osd_release to 19 squid 2024-09-16T00:56:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-16T00:56:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-16T00:56:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: osdmap e77: 6 total, 5 up, 6 in 2024-09-16T00:56:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:32.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:32 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-16T00:56:32.697 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T00:56:32.384+0000 7f02c70f7640 -1 osd.5 74 log_to_monitors true 2024-09-16T00:56:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all osd 2024-09-16T00:56:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: Upgrade: Setting require_osd_release to 19 squid 2024-09-16T00:56:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-16T00:56:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-16T00:56:32.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: osdmap e77: 6 total, 5 up, 6 in 2024-09-16T00:56:32.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:32.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:32 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-16T00:56:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-16T00:56:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2 up:standby 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:33.697 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T00:56:33.249+0000 7f02bee91640 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T00:56:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-16T00:56:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 899 MiB used, 536 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 2 up:standby 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:34.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi053.cdsuag"]}]: dispatch 2024-09-16T00:56:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T00:56:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T00:56:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-16T00:56:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:34.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:34.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi053.cdsuag"]}]: dispatch 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: Upgrade: It appears safe to stop mds.cephfs.smithi053.cdsuag 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: pgmap v163: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904] boot 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: osdmap e80: 6 total, 6 up, 6 in 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6828/822250492,v1:172.21.15.53:6829/822250492] up:boot 2024-09-16T00:56:35.558 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:56:35.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:56:35.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:56:35.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:35.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:56:35.559 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: Upgrade: It appears safe to stop mds.cephfs.smithi053.cdsuag 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: pgmap v163: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 196 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 32/222 objects degraded (14.414%) 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: osd.5 [v2:172.21.15.152:6816/1882746904,v1:172.21.15.152:6817/1882746904] boot 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: osdmap e80: 6 total, 6 up, 6 in 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6828/822250492,v1:172.21.15.53:6829/822250492] up:boot 2024-09-16T00:56:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:56:35.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:56:35.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T00:56:35.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:35.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.cdsuag", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:56:35.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:36.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:36 smithi053 ceph-mon[77492]: Upgrade: Updating mds.cephfs.smithi053.cdsuag 2024-09-16T00:56:36.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:36 smithi053 ceph-mon[77492]: Deploying daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:56:36.426 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:36 smithi053 ceph-mon[77492]: osdmap e81: 6 total, 6 up, 6 in 2024-09-16T00:56:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:36 smithi152 ceph-mon[63606]: Upgrade: Updating mds.cephfs.smithi053.cdsuag 2024-09-16T00:56:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:36 smithi152 ceph-mon[63606]: Deploying daemon mds.cephfs.smithi053.cdsuag on smithi053 2024-09-16T00:56:36.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:36 smithi152 ceph-mon[63606]: osdmap e81: 6 total, 6 up, 6 in 2024-09-16T00:56:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[77488]: 2024-09-16T00:56:37.111+0000 7fafd60ee640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: pgmap v166: 65 pgs: 1 active, 14 active+undersized, 11 active+undersized+degraded, 39 active+clean; 196 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: osdmap e82: 6 total, 6 up, 6 in 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: Standby daemon mds.cephfs.smithi152.gatezw assigned to filesystem cephfs as rank 0 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:56:37.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:37 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:replay} 2 up:standby 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: pgmap v166: 65 pgs: 1 active, 14 active+undersized, 11 active+undersized+degraded, 39 active+clean; 196 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: osdmap e82: 6 total, 6 up, 6 in 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: Standby daemon mds.cephfs.smithi152.gatezw assigned to filesystem cephfs as rank 0 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:56:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:37 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:replay} 2 up:standby 2024-09-16T00:56:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:39 smithi053 ceph-mon[77492]: pgmap v168: 65 pgs: 1 active, 9 active+undersized, 4 active+undersized+degraded, 51 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 412 B/s rd, 0 op/s; 11/222 objects degraded (4.955%) 2024-09-16T00:56:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:39 smithi152 ceph-mon[63606]: pgmap v168: 65 pgs: 1 active, 9 active+undersized, 4 active+undersized+degraded, 51 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 412 B/s rd, 0 op/s; 11/222 objects degraded (4.955%) 2024-09-16T00:56:40.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:40 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:56:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:40 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:56:41.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:41 smithi152 ceph-mon[63606]: pgmap v169: 65 pgs: 1 active, 64 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 1 op/s 2024-09-16T00:56:41.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:41 smithi152 ceph-mon[63606]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/222 objects degraded (4.955%), 4 pgs degraded) 2024-09-16T00:56:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:41 smithi053 ceph-mon[77492]: pgmap v169: 65 pgs: 1 active, 64 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 1 op/s 2024-09-16T00:56:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:41 smithi053 ceph-mon[77492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/222 objects degraded (4.955%), 4 pgs degraded) 2024-09-16T00:56:43.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:43 smithi053 ceph-mon[77492]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-16T00:56:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:43 smithi152 ceph-mon[63606]: pgmap v170: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-16T00:56:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:45 smithi053 ceph-mon[77492]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-16T00:56:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:45 smithi152 ceph-mon[63606]: pgmap v171: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-16T00:56:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:47 smithi053 ceph-mon[77492]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:56:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:47 smithi053 ceph-mon[77492]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0 2024-09-16T00:56:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:47 smithi053 ceph-mon[77492]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0 2024-09-16T00:56:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:47 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:reconnect 2024-09-16T00:56:47.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:47 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:reconnect} 2 up:standby 2024-09-16T00:56:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:47 smithi152 ceph-mon[63606]: pgmap v172: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:56:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:47 smithi152 ceph-mon[63606]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0 2024-09-16T00:56:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:47 smithi152 ceph-mon[63606]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0 2024-09-16T00:56:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:47 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:reconnect 2024-09-16T00:56:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:47 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:reconnect} 2 up:standby 2024-09-16T00:56:48.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:48 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:rejoin 2024-09-16T00:56:48.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:48 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:rejoin} 2 up:standby 2024-09-16T00:56:48.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:48 smithi053 ceph-mon[77492]: daemon mds.cephfs.smithi152.gatezw is now active in filesystem cephfs as rank 0 2024-09-16T00:56:48.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:48 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:rejoin 2024-09-16T00:56:48.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:48 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.gatezw=up:rejoin} 2 up:standby 2024-09-16T00:56:48.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:48 smithi152 ceph-mon[63606]: daemon mds.cephfs.smithi152.gatezw is now active in filesystem cephfs as rank 0 2024-09-16T00:56:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:56:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:56:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:56:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:active 2024-09-16T00:56:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 2 up:standby 2024-09-16T00:56:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: pgmap v173: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] up:active 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 2 up:standby 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:50.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:50 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:boot 2024-09-16T00:56:50.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:50 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 3 up:standby 2024-09-16T00:56:50.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:56:50.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:50 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:boot 2024-09-16T00:56:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:50 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 3 up:standby 2024-09-16T00:56:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:56:50.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:51.302 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:51 smithi053 ceph-mon[77492]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T00:56:51.648 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:51 smithi152 ceph-mon[63606]: pgmap v174: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T00:56:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 -- 172.21.15.53:0/366327691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca841003f0 msgr2=0x7fca84100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/366327691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca841003f0 0x7fca84100860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fca74009910 tx=0x7fca74009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 -- 172.21.15.53:0/366327691 shutdown_connections 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/366327691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca841003f0 0x7fca84100860 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/366327691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca840ff150 0x7fca840ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.787+0000 7fca8aaa0700 1 -- 172.21.15.53:0/366327691 >> 172.21.15.53:0/366327691 conn(0x7fca840fa7a0 msgr2=0x7fca840fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 -- 172.21.15.53:0/366327691 shutdown_connections 2024-09-16T00:56:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 -- 172.21.15.53:0/366327691 wait complete. 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 Processor -- start 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 -- start start 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca841003f0 0x7fca8419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8419b160 con 0x7fca840ff150 2024-09-16T00:56:52.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.788+0000 7fca8aaa0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8419b2a0 con 0x7fca841003f0 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41416/0 (socket says 172.21.15.53:41416) 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 -- 172.21.15.53:0/4285678754 learned_addr learned my addr 172.21.15.53:0/4285678754 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca7bfff700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca841003f0 0x7fca8419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 -- 172.21.15.53:0/4285678754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca841003f0 msgr2=0x7fca8419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca841003f0 0x7fca8419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 -- 172.21.15.53:0/4285678754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740095f0 con 0x7fca840ff150 2024-09-16T00:56:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8883c700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca8000b4b0 tx=0x7fca8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca80011800 con 0x7fca840ff150 2024-09-16T00:56:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca80011e10 con 0x7fca840ff150 2024-09-16T00:56:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca8000f2e0 con 0x7fca840ff150 2024-09-16T00:56:52.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.789+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8419b580 con 0x7fca840ff150 2024-09-16T00:56:52.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.790+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8419bad0 con 0x7fca840ff150 2024-09-16T00:56:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.791+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca84068ab0 con 0x7fca840ff150 2024-09-16T00:56:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.791+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fca80010380 con 0x7fca840ff150 2024-09-16T00:56:52.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.791+0000 7fca79ffb700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 0x7fca6c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.792+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fca8008e280 con 0x7fca840ff150 2024-09-16T00:56:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.792+0000 7fca7bfff700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 0x7fca6c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.792+0000 7fca7bfff700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 0x7fca6c070b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca84069eb0 tx=0x7fca7400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:52.796+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca8005afa0 con 0x7fca840ff150 2024-09-16T00:56:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.033+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca84104de0 con 0x7fca6c06e680 2024-09-16T00:56:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.034+0000 7fca79ffb700 1 -- 172.21.15.53:0/4285678754 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fca84104de0 con 0x7fca6c06e680 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 msgr2=0x7fca6c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 0x7fca6c070b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca84069eb0 tx=0x7fca7400b540 comp rx=0 tx=0).stop 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 msgr2=0x7fca84069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca8000b4b0 tx=0x7fca8000b870 comp rx=0 tx=0).stop 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 shutdown_connections 2024-09-16T00:56:53.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fca6c06e680 0x7fca6c070b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca840ff150 0x7fca84069930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 --2- 172.21.15.53:0/4285678754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca841003f0 0x7fca8419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 >> 172.21.15.53:0/4285678754 conn(0x7fca840fa7a0 msgr2=0x7fca84103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 shutdown_connections 2024-09-16T00:56:53.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.036+0000 7fca8aaa0700 1 -- 172.21.15.53:0/4285678754 wait complete. 2024-09-16T00:56:53.049 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:56:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 -- 172.21.15.53:0/1361452681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808069230 msgr2=0x7fa808102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 --2- 172.21.15.53:0/1361452681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808069230 0x7fa808102e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009910 tx=0x7fa7f8009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:53.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 -- 172.21.15.53:0/1361452681 shutdown_connections 2024-09-16T00:56:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 --2- 172.21.15.53:0/1361452681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808103350 0x7fa808105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 --2- 172.21.15.53:0/1361452681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808069230 0x7fa808102e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 -- 172.21.15.53:0/1361452681 >> 172.21.15.53:0/1361452681 conn(0x7fa8080fa780 msgr2=0x7fa8080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 -- 172.21.15.53:0/1361452681 shutdown_connections 2024-09-16T00:56:53.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.146+0000 7fa80dabf700 1 -- 172.21.15.53:0/1361452681 wait complete. 2024-09-16T00:56:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 Processor -- start 2024-09-16T00:56:53.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 -- start start 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808069230 0x7fa808195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081965e0 con 0x7fa808103350 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.147+0000 7fa80dabf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808196720 con 0x7fa808069230 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41428/0 (socket says 172.21.15.53:41428) 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 -- 172.21.15.53:0/218661694 learned_addr learned my addr 172.21.15.53:0/218661694 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa8077fe700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808069230 0x7fa808195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 -- 172.21.15.53:0/218661694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808069230 msgr2=0x7fa808195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808069230 0x7fa808195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 -- 172.21.15.53:0/218661694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80095f0 con 0x7fa808103350 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa806ffd700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d8d0 tx=0x7fa7fc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc0098a0 con 0x7fa808103350 2024-09-16T00:56:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa7fc010460 con 0x7fa808103350 2024-09-16T00:56:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80819b1d0 con 0x7fa808103350 2024-09-16T00:56:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc00f5f0 con 0x7fa808103350 2024-09-16T00:56:53.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.148+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80819b720 con 0x7fa808103350 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.149+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808108cf0 con 0x7fa808103350 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.150+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa7fc009a00 con 0x7fa808103350 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.150+0000 7fa804ff9700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 0x7fa7f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.150+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa7fc08e4e0 con 0x7fa808103350 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.150+0000 7fa8077fe700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 0x7fa7f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.151+0000 7fa8077fe700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 0x7fa7f0070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005090 tx=0x7fa7f800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.155+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa7fc05b200 con 0x7fa808103350 2024-09-16T00:56:53.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:53 smithi053 ceph-mon[77492]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T00:56:53.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.412+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa808104010 con 0x7fa7f006e680 2024-09-16T00:56:53.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.414+0000 7fa804ff9700 1 -- 172.21.15.53:0/218661694 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa808104010 con 0x7fa7f006e680 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 msgr2=0x7fa7f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 0x7fa7f0070b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005090 tx=0x7fa7f800b540 comp rx=0 tx=0).stop 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 msgr2=0x7fa808195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d8d0 tx=0x7fa7fc00dbe0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 shutdown_connections 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa7f006e680 0x7fa7f0070b30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa808069230 0x7fa808195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 --2- 172.21.15.53:0/218661694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa808103350 0x7fa808195fc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 >> 172.21.15.53:0/218661694 conn(0x7fa8080fa780 msgr2=0x7fa8080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 shutdown_connections 2024-09-16T00:56:53.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.416+0000 7fa80dabf700 1 -- 172.21.15.53:0/218661694 wait complete. 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 -- 172.21.15.53:0/2995135726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c100d30 msgr2=0x7fa90c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 --2- 172.21.15.53:0/2995135726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c100d30 0x7fa90c103110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa900009910 tx=0x7fa900009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 -- 172.21.15.53:0/2995135726 shutdown_connections 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 --2- 172.21.15.53:0/2995135726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c103650 0x7fa90c105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 --2- 172.21.15.53:0/2995135726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c100d30 0x7fa90c103110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 -- 172.21.15.53:0/2995135726 >> 172.21.15.53:0/2995135726 conn(0x7fa90c0fa6d0 msgr2=0x7fa90c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 -- 172.21.15.53:0/2995135726 shutdown_connections 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 -- 172.21.15.53:0/2995135726 wait complete. 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.530+0000 7fa9130c3700 1 Processor -- start 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa9130c3700 1 -- start start 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa9130c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c100d30 0x7fa90c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa9130c3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa9130c3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c1965c0 con 0x7fa90c103650 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa9130c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c196700 con 0x7fa90c100d30 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41454/0 (socket says 172.21.15.53:41454) 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 -- 172.21.15.53:0/370225334 learned_addr learned my addr 172.21.15.53:0/370225334 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa910e5f700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c100d30 0x7fa90c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 -- 172.21.15.53:0/370225334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c100d30 msgr2=0x7fa90c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c100d30 0x7fa90c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 -- 172.21.15.53:0/370225334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000095f0 con 0x7fa90c103650 2024-09-16T00:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.531+0000 7fa90bfff700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800d8d0 tx=0x7fa8f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.532+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8f80098a0 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.532+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8f8010460 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.532+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c19b1b0 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.532+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8f800f5f0 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.532+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c19b700 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.533+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c18fc60 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.533+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa8f8009a00 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.534+0000 7fa909ffb700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 0x7fa8fc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.534+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa8f808e400 con 0x7fa90c103650 2024-09-16T00:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.534+0000 7fa910e5f700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 0x7fa8fc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.535+0000 7fa910e5f700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 0x7fa8fc070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa900006010 tx=0x7fa90000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.539+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8f805b1a0 con 0x7fa90c103650 2024-09-16T00:56:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:53 smithi152 ceph-mon[63606]: pgmap v175: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T00:56:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.761+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa90c061190 con 0x7fa8fc06e680 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.771+0000 7fa909ffb700 1 -- 172.21.15.53:0/370225334 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa90c061190 con 0x7fa8fc06e680 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (13m) 2m ago 14m 25.6M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (15m) 2m ago 15m 8518k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (14m) 26s ago 14m 8242k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (3m) 2m ago 14m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:56:53.773 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (3m) 26s ago 14m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (13m) 2m ago 14m 84.7M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 starting - - - - 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (9m) 2m ago 9m 98.9M - 18.2.0 dc2bc1663786 38f25bfc1e5d 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (9m) 26s ago 9m 17.9M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (9m) 26s ago 9m 16.2M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (6m) 2m ago 16m 499M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (5m) 26s ago 13m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (4m) 2m ago 16m 50.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (4m) 26s ago 13m 37.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (14m) 2m ago 14m 16.5M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (13m) 26s ago 13m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (3m) 2m ago 13m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (2m) 2m ago 12m 108M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:56:53.774 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (2m) 2m ago 12m 12.7M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (91s) 26s ago 11m 113M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (60s) 26s ago 11m 112M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (29s) 26s ago 10m 11.7M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (5m) 2m ago 14m 78.5M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.773+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 msgr2=0x7fa8fc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.773+0000 7fa9130c3700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 0x7fa8fc070b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa900006010 tx=0x7fa90000b560 comp rx=0 tx=0).stop 2024-09-16T00:56:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.773+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 msgr2=0x7fa90c195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.773+0000 7fa9130c3700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800d8d0 tx=0x7fa8f800dbe0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 shutdown_connections 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa8fc06e680 0x7fa8fc070b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa90c100d30 0x7fa90c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 --2- 172.21.15.53:0/370225334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa90c103650 0x7fa90c195fa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 >> 172.21.15.53:0/370225334 conn(0x7fa90c0fa6d0 msgr2=0x7fa90c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 shutdown_connections 2024-09-16T00:56:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.774+0000 7fa9130c3700 1 -- 172.21.15.53:0/370225334 wait complete. 2024-09-16T00:56:53.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/1261751577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28101440 msgr2=0x7f4f28101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/1261751577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28101440 0x7f4f28101890 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009910 tx=0x7f4f18009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:53.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/1261751577 shutdown_connections 2024-09-16T00:56:53.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/1261751577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28101440 0x7f4f28101890 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/1261751577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28100240 0x7f4f28100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/1261751577 >> 172.21.15.53:0/1261751577 conn(0x7f4f280fb7f0 msgr2=0x7f4f280fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:53.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/1261751577 shutdown_connections 2024-09-16T00:56:53.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.882+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/1261751577 wait complete. 2024-09-16T00:56:53.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 Processor -- start 2024-09-16T00:56:53.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 -- start start 2024-09-16T00:56:53.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 0x7f4f28195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f28196580 con 0x7f4f28100240 2024-09-16T00:56:53.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2f6fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f281966c0 con 0x7f4f28101440 2024-09-16T00:56:53.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2d499700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2d499700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41484/0 (socket says 172.21.15.53:41484) 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2d499700 1 -- 172.21.15.53:0/147593073 learned_addr learned my addr 172.21.15.53:0/147593073 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2cc98700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 0x7f4f28195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.883+0000 7f4f2d499700 1 -- 172.21.15.53:0/147593073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 msgr2=0x7f4f28195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2d499700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 0x7f4f28195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2d499700 1 -- 172.21.15.53:0/147593073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180095f0 con 0x7f4f28100240 2024-09-16T00:56:53.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2cc98700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 0x7f4f28195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:56:53.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2d499700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c910 tx=0x7f4f2400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f240041f0 con 0x7f4f28100240 2024-09-16T00:56:53.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2819b180 con 0x7f4f28100240 2024-09-16T00:56:53.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f24007db0 con 0x7f4f28100240 2024-09-16T00:56:53.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f24003d60 con 0x7f4f28100240 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.884+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2819b6a0 con 0x7f4f28100240 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.885+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f28108d90 con 0x7f4f28100240 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.886+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4f24007900 con 0x7f4f28100240 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.886+0000 7f4f1e7fc700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 0x7f4f14070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.886+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f4f2408e380 con 0x7f4f28100240 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.886+0000 7f4f2cc98700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 0x7f4f14070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:53.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.887+0000 7f4f2cc98700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 0x7f4f14070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b5c0 tx=0x7f4f18005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:53.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:53.891+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f2405b0a0 con 0x7f4f28100240 2024-09-16T00:56:54.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.211+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f2819bd40 con 0x7f4f28100240 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.212+0000 7f4f1e7fc700 1 -- 172.21.15.53:0/147593073 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f4f2405ac30 con 0x7f4f28100240 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:56:54.214 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 1 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 11 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:56:54.215 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.214+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 msgr2=0x7f4f14070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.214+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 0x7f4f14070b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800b5c0 tx=0x7f4f18005960 comp rx=0 tx=0).stop 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.214+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 msgr2=0x7f4f28195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.214+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c910 tx=0x7f4f2400ccd0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 shutdown_connections 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4f1406e680 0x7f4f14070b30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f28100240 0x7f4f28195ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 --2- 172.21.15.53:0/147593073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f28101440 0x7f4f28195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 >> 172.21.15.53:0/147593073 conn(0x7f4f280fb7f0 msgr2=0x7f4f28104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:54.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 shutdown_connections 2024-09-16T00:56:54.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.215+0000 7f4f2f6fd700 1 -- 172.21.15.53:0/147593073 wait complete. 2024-09-16T00:56:54.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 -- 172.21.15.53:0/90314039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8100240 msgr2=0x7f96f8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/90314039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8100240 0x7f96f8100650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f96e800b0a0 tx=0x7f96e800b3b0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 -- 172.21.15.53:0/90314039 shutdown_connections 2024-09-16T00:56:54.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/90314039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8101440 0x7f96f8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/90314039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8100240 0x7f96f8100650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 -- 172.21.15.53:0/90314039 >> 172.21.15.53:0/90314039 conn(0x7f96f80fb7f0 msgr2=0x7f96f80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 -- 172.21.15.53:0/90314039 shutdown_connections 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.338+0000 7f96fd9cf700 1 -- 172.21.15.53:0/90314039 wait complete. 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 Processor -- start 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 -- start start 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8100240 0x7f96f8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8073680 con 0x7f96f8101440 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96fd9cf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80737c0 con 0x7f96f8100240 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96f67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41512/0 (socket says 172.21.15.53:41512) 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.339+0000 7f96f67fc700 1 -- 172.21.15.53:0/4254759051 learned_addr learned my addr 172.21.15.53:0/4254759051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:54.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96f6ffd700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8100240 0x7f96f8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96f67fc700 1 -- 172.21.15.53:0/4254759051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8100240 msgr2=0x7f96f8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96f67fc700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8100240 0x7f96f8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96f67fc700 1 -- 172.21.15.53:0/4254759051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009d00 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96f67fc700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96e000b4b0 tx=0x7f96e000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96e0011800 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f96e0011e10 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f8073aa0 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96e000f2e0 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.340+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f819dc50 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.342+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f8108e10 con 0x7f96f8101440 2024-09-16T00:56:54.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.342+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f96e0010380 con 0x7f96f8101440 2024-09-16T00:56:54.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.343+0000 7f96fc9cd700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 0x7f96e4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.343+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f96e008e100 con 0x7f96f8101440 2024-09-16T00:56:54.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.343+0000 7f96f6ffd700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 0x7f96e4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.343+0000 7f96f6ffd700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 0x7f96e4070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009fd0 tx=0x7f96e80060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:54.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.347+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96e005aea0 con 0x7f96f8101440 2024-09-16T00:56:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:54 smithi053 ceph-mon[77492]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:54.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:54 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/147593073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.628+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f96f819e200 con 0x7f96f8101440 2024-09-16T00:56:54.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.629+0000 7f96fc9cd700 1 -- 172.21.15.53:0/4254759051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1930 (secure 0 0 0) 0x7f96f819e200 con 0x7f96f8101440 2024-09-16T00:56:54.631 INFO:teuthology.orchestra.run.smithi053.stdout:e24 2024-09-16T00:56:54.631 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:56:49:233111+0000 2024-09-16T00:56:54.631 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:56:54.631 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 23 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:56:48.227398+0000 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:56:54.632 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 82 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=24281} 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:56:54.633 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 24281 members: 24281 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{0:24281} state up:active seq 139 join_fscid=1 addr [v2:172.21.15.152:6824/3120948580,v1:172.21.15.152:6825/3120948580] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:24299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/822250492,v1:172.21.15.53:6829/822250492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:56:54.634 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:56:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 msgr2=0x7f96e4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 0x7f96e4070b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009fd0 tx=0x7f96e80060c0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 msgr2=0x7f96f8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96e000b4b0 tx=0x7f96e000b7c0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 shutdown_connections 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f96e406e680 0x7f96e4070b30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96f8100240 0x7f96f8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 --2- 172.21.15.53:0/4254759051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96f8101440 0x7f96f8073140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.631+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 >> 172.21.15.53:0/4254759051 conn(0x7f96f80fb7f0 msgr2=0x7f96f8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.632+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 shutdown_connections 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.632+0000 7f96fd9cf700 1 -- 172.21.15.53:0/4254759051 wait complete. 2024-09-16T00:56:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 24 2024-09-16T00:56:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:54 smithi152 ceph-mon[63606]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:54 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/147593073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 -- 172.21.15.53:0/831810695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 msgr2=0x7f4d04105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 --2- 172.21.15.53:0/831810695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04105a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009910 tx=0x7f4cf8009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 -- 172.21.15.53:0/831810695 shutdown_connections 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 --2- 172.21.15.53:0/831810695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04105a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 --2- 172.21.15.53:0/831810695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 0x7f4d04103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 -- 172.21.15.53:0/831810695 >> 172.21.15.53:0/831810695 conn(0x7f4d040fa780 msgr2=0x7f4d040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 -- 172.21.15.53:0/831810695 shutdown_connections 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.745+0000 7f4d093a1700 1 -- 172.21.15.53:0/831810695 wait complete. 2024-09-16T00:56:54.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 Processor -- start 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 -- start start 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 0x7f4d04195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04196640 con 0x7f4d04103680 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.746+0000 7f4d093a1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04196780 con 0x7f4d04100d60 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41534/0 (socket says 172.21.15.53:41534) 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 -- 172.21.15.53:0/955939884 learned_addr learned my addr 172.21.15.53:0/955939884 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d02ffd700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 0x7f4d04195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 -- 172.21.15.53:0/955939884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 msgr2=0x7f4d04195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 0x7f4d04195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:54.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 -- 172.21.15.53:0/955939884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80095f0 con 0x7f4d04103680 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d027fc700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8006010 tx=0x7f4cf800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x7f4d04103680 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4cf800f460 con 0x7f4d04103680 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0419b1d0 con 0x7f4d04103680 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.747+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0419b6c0 con 0x7f4d04103680 2024-09-16T00:56:54.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.748+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf8021640 con 0x7f4d04103680 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.749+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0418fbe0 con 0x7f4d04103680 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.749+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4cf800fab0 con 0x7f4d04103680 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.750+0000 7f4cebfff700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 0x7f4cec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.750+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f4cf808f8d0 con 0x7f4d04103680 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.750+0000 7f4d02ffd700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 0x7f4cec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:54.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.750+0000 7f4d02ffd700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 0x7f4cec070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005950 tx=0x7f4cf400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:54.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.754+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4cf805c5f0 con 0x7f4d04103680 2024-09-16T00:56:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.997+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d04061190 con 0x7f4cec06e680 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:54.998+0000 7f4cebfff700 1 -- 172.21.15.53:0/955939884 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4d04061190 con 0x7f4cec06e680 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "osd", 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:56:55.000 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:56:55.001 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "13/23 daemons upgraded", 2024-09-16T00:56:55.001 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T00:56:55.001 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:56:55.001 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 msgr2=0x7f4cec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 0x7f4cec070b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005950 tx=0x7f4cf400b410 comp rx=0 tx=0).stop 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 msgr2=0x7f4d04196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8006010 tx=0x7f4cf800bd70 comp rx=0 tx=0).stop 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 shutdown_connections 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4cec06e680 0x7f4cec070b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d04100d60 0x7f4d04195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 --2- 172.21.15.53:0/955939884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d04103680 0x7f4d04196020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.000+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 >> 172.21.15.53:0/955939884 conn(0x7f4d040fa780 msgr2=0x7f4d040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.001+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 shutdown_connections 2024-09-16T00:56:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.001+0000 7f4d093a1700 1 -- 172.21.15.53:0/955939884 wait complete. 2024-09-16T00:56:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 -- 172.21.15.53:0/4064220956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f40ff150 msgr2=0x7ff9f40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/4064220956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f40ff150 0x7ff9f40ff560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009910 tx=0x7ff9e4009c20 comp rx=0 tx=0).stop 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 -- 172.21.15.53:0/4064220956 shutdown_connections 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/4064220956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f4100350 0x7ff9f41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/4064220956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f40ff150 0x7ff9f40ff560 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.115+0000 7ff9f9a09700 1 -- 172.21.15.53:0/4064220956 >> 172.21.15.53:0/4064220956 conn(0x7ff9f40fa700 msgr2=0x7ff9f40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.116+0000 7ff9f9a09700 1 -- 172.21.15.53:0/4064220956 shutdown_connections 2024-09-16T00:56:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.116+0000 7ff9f9a09700 1 -- 172.21.15.53:0/4064220956 wait complete. 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.116+0000 7ff9f9a09700 1 Processor -- start 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f9a09700 1 -- start start 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f9a09700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f40ff150 0x7ff9f4069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f9a09700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f9a09700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f419adf0 con 0x7ff9f4100350 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f9a09700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f419af30 con 0x7ff9f40ff150 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41552/0 (socket says 172.21.15.53:41552) 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 -- 172.21.15.53:0/1853111090 learned_addr learned my addr 172.21.15.53:0/1853111090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f2ffd700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f40ff150 0x7ff9f4069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 -- 172.21.15.53:0/1853111090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f40ff150 msgr2=0x7ff9f4069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f40ff150 0x7ff9f4069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 -- 172.21.15.53:0/1853111090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40095f0 con 0x7ff9f4100350 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.117+0000 7ff9f27fc700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800d8d0 tx=0x7ff9e800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.118+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e80098a0 con 0x7ff9f4100350 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.118+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f419b210 con 0x7ff9f4100350 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.118+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8010460 con 0x7ff9f4100350 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.118+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800f5f0 con 0x7ff9f4100350 2024-09-16T00:56:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.118+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f419b760 con 0x7ff9f4100350 2024-09-16T00:56:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.119+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4107ca0 con 0x7ff9f4100350 2024-09-16T00:56:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.119+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff9e8009a00 con 0x7ff9f4100350 2024-09-16T00:56:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.120+0000 7ff9f8a07700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 0x7ff9dc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:56:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.120+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6242+0+0 (secure 0 0 0) 0x7ff9e808e410 con 0x7ff9f4100350 2024-09-16T00:56:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.120+0000 7ff9f2ffd700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 0x7ff9dc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:56:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.121+0000 7ff9f2ffd700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 0x7ff9dc070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006010 tx=0x7ff9e400b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.124+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9e805b1b0 con 0x7ff9f4100350 2024-09-16T00:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.446+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9f419bdf0 con 0x7ff9f4100350 2024-09-16T00:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.446+0000 7ff9f8a07700 1 -- 172.21.15.53:0/1853111090 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff9e805ad40 con 0x7ff9f4100350 2024-09-16T00:56:55.447 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:56:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 msgr2=0x7ff9dc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 0x7ff9dc070b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006010 tx=0x7ff9e400b560 comp rx=0 tx=0).stop 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 msgr2=0x7ff9f419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800d8d0 tx=0x7ff9e800dbe0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 shutdown_connections 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff9dc06e680 0x7ff9dc070b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f40ff150 0x7ff9f4069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 --2- 172.21.15.53:0/1853111090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9f4100350 0x7ff9f419a820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.448+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 >> 172.21.15.53:0/1853111090 conn(0x7ff9f40fa700 msgr2=0x7ff9f4103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.449+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 shutdown_connections 2024-09-16T00:56:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:56:55.449+0000 7ff9f9a09700 1 -- 172.21.15.53:0/1853111090 wait complete. 2024-09-16T00:56:55.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:55.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:55.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 426 B/s wr, 4 op/s 2024-09-16T00:56:55.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.551 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.552 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/4254759051' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:56:55.552 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.552 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: pgmap v176: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 426 B/s wr, 4 op/s 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/4254759051' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:56:55.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:55.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:56.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:56 smithi053 ceph-mon[77492]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:56.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:56 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1853111090' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:56:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:56 smithi152 ceph-mon[63606]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:56:56.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:56 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1853111090' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:56:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:57 smithi053 ceph-mon[77492]: pgmap v177: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 426 B/s wr, 4 op/s 2024-09-16T00:56:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:57 smithi152 ceph-mon[63606]: pgmap v177: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 426 B/s wr, 4 op/s 2024-09-16T00:56:59.523 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.524 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.525 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.525 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.525 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi053.jsdknu"]}]: dispatch 2024-09-16T00:56:59.525 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.525 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:56:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: pgmap v178: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:56:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi053.jsdknu"]}]: dispatch 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:56:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:56:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:00 smithi053 ceph-mon[77492]: Detected new or changed devices on smithi053 2024-09-16T00:57:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:00 smithi053 ceph-mon[77492]: Upgrade: It appears safe to stop mds.cephfs.smithi053.jsdknu 2024-09-16T00:57:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:00 smithi152 ceph-mon[63606]: Detected new or changed devices on smithi053 2024-09-16T00:57:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:00 smithi152 ceph-mon[63606]: Upgrade: It appears safe to stop mds.cephfs.smithi053.jsdknu 2024-09-16T00:57:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi053.jsdknu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:01 smithi053 ceph-mon[77492]: Upgrade: Updating mds.cephfs.smithi053.jsdknu 2024-09-16T00:57:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:01 smithi053 ceph-mon[77492]: Deploying daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:57:01.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:01 smithi053 ceph-mon[77492]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 355 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-16T00:57:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:01 smithi152 ceph-mon[63606]: Upgrade: Updating mds.cephfs.smithi053.jsdknu 2024-09-16T00:57:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:01 smithi152 ceph-mon[63606]: Deploying daemon mds.cephfs.smithi053.jsdknu on smithi053 2024-09-16T00:57:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:01 smithi152 ceph-mon[63606]: pgmap v179: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 355 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-16T00:57:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:03 smithi053 ceph-mon[77492]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-16T00:57:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:03 smithi053 ceph-mon[77492]: osdmap e83: 6 total, 6 up, 6 in 2024-09-16T00:57:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:03 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 2 up:standby 2024-09-16T00:57:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:03 smithi152 ceph-mon[63606]: pgmap v180: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-16T00:57:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:03 smithi152 ceph-mon[63606]: osdmap e83: 6 total, 6 up, 6 in 2024-09-16T00:57:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:03 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 2 up:standby 2024-09-16T00:57:04.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:04 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:04.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:04 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:05.560 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:05 smithi053 ceph-mon[77492]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-16T00:57:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:05 smithi152 ceph-mon[63606]: pgmap v182: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-16T00:57:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:07 smithi053 ceph-mon[77492]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-16T00:57:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:07 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:07 smithi152 ceph-mon[63606]: pgmap v183: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-09-16T00:57:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:07 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:08 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] up:boot 2024-09-16T00:57:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:08 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 3 up:standby 2024-09-16T00:57:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:08 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:08 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] up:boot 2024-09-16T00:57:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:08 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.gatezw=up:active} 3 up:standby 2024-09-16T00:57:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:08 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:09 smithi053 ceph-mon[77492]: pgmap v184: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:09 smithi152 ceph-mon[63606]: pgmap v184: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:11 smithi053 ceph-mon[77492]: pgmap v185: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:11 smithi152 ceph-mon[63606]: pgmap v185: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:13.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:12 smithi053 ceph-mon[77492]: pgmap v186: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:13.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.228 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:12 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:12 smithi152 ceph-mon[63606]: pgmap v186: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:13.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:12 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:14.399 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:15 smithi053 ceph-mon[77492]: pgmap v187: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:15 smithi152 ceph-mon[63606]: pgmap v187: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:17.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:17.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:17.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: pgmap v188: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.gatezw"]}]: dispatch 2024-09-16T00:57:17.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:17 smithi152 ceph-mon[63606]: Upgrade: It appears safe to stop mds.cephfs.smithi152.gatezw 2024-09-16T00:57:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: pgmap v188: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.gatezw"]}]: dispatch 2024-09-16T00:57:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:17 smithi053 ceph-mon[77492]: Upgrade: It appears safe to stop mds.cephfs.smithi152.gatezw 2024-09-16T00:57:18.935 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: Upgrade: Updating mds.cephfs.smithi152.gatezw 2024-09-16T00:57:18.935 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:18.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:18.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:18.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: Deploying daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:57:18.936 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:18 smithi152 ceph-mon[63606]: pgmap v189: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:19.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: Upgrade: Updating mds.cephfs.smithi152.gatezw 2024-09-16T00:57:19.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:19.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.gatezw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:19.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:19.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: Deploying daemon mds.cephfs.smithi152.gatezw on smithi152 2024-09-16T00:57:19.070 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:18 smithi053 ceph-mon[77492]: pgmap v189: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[77488]: 2024-09-16T00:57:19.507+0000 7fafd60ee640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:57:19.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:19.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: osdmap e84: 6 total, 6 up, 6 in 2024-09-16T00:57:19.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: Standby daemon mds.cephfs.smithi152.ocdywv assigned to filesystem cephfs as rank 0 2024-09-16T00:57:19.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:57:19.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:57:19.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:19 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:replay} 2 up:standby 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: osdmap e84: 6 total, 6 up, 6 in 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: Standby daemon mds.cephfs.smithi152.ocdywv assigned to filesystem cephfs as rank 0 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:57:19.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:19 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:replay} 2 up:standby 2024-09-16T00:57:20.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:20.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:20 smithi152 ceph-mon[63606]: pgmap v191: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:21.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:21.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:20 smithi053 ceph-mon[77492]: pgmap v191: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-16T00:57:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:23 smithi053 ceph-mon[77492]: pgmap v192: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 2 op/s 2024-09-16T00:57:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:23 smithi152 ceph-mon[63606]: pgmap v192: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 2 op/s 2024-09-16T00:57:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:25 smithi053 ceph-mon[77492]: pgmap v193: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- 172.21.15.53:0/956232891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 msgr2=0x7f3fbc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/956232891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc101890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009910 tx=0x7f3fac009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- 172.21.15.53:0/956232891 shutdown_connections 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/956232891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc101890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/956232891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 0x7f3fbc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- 172.21.15.53:0/956232891 >> 172.21.15.53:0/956232891 conn(0x7f3fbc0fb7f0 msgr2=0x7f3fbc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- 172.21.15.53:0/956232891 shutdown_connections 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- 172.21.15.53:0/956232891 wait complete. 2024-09-16T00:57:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 Processor -- start 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.575+0000 7f3fc3d83700 1 -- start start 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc3d83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 0x7f3fbc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc3d83700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc3d83700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc073680 con 0x7f3fbc101440 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc3d83700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0737c0 con 0x7f3fbc100240 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc1b1f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 0x7f3fbc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50862/0 (socket says 172.21.15.53:50862) 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 -- 172.21.15.53:0/3725342646 learned_addr learned my addr 172.21.15.53:0/3725342646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 -- 172.21.15.53:0/3725342646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 msgr2=0x7f3fbc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 0x7f3fbc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 -- 172.21.15.53:0/3725342646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac0095f0 con 0x7f3fbc101440 2024-09-16T00:57:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fc131e700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.576+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac01d070 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.577+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fac005dc0 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.577+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc073a40 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.577+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac0226a0 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.577+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc073f30 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.578+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc108d90 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.578+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3fac0038f0 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.579+0000 7f3fb2ffd700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 0x7f3fa8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.579+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3fac08fb50 con 0x7f3fbc101440 2024-09-16T00:57:25.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.579+0000 7f3fc1b1f700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 0x7f3fa8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.579+0000 7f3fc1b1f700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 0x7f3fa8070b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc1012a0 tx=0x7f3fb8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:25.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.583+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3fac05c820 con 0x7f3fbc101440 2024-09-16T00:57:25.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:25 smithi152 ceph-mon[63606]: pgmap v193: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 3 op/s 2024-09-16T00:57:25.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.823+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fbc19df10 con 0x7f3fa806e680 2024-09-16T00:57:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.824+0000 7f3fb2ffd700 1 -- 172.21.15.53:0/3725342646 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3fbc19df10 con 0x7f3fa806e680 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.826+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 msgr2=0x7f3fa8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.826+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 0x7f3fa8070b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc1012a0 tx=0x7f3fb8009260 comp rx=0 tx=0).stop 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.826+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 msgr2=0x7f3fbc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.826+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac00f690 comp rx=0 tx=0).stop 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 shutdown_connections 2024-09-16T00:57:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f3fa806e680 0x7f3fa8070b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fbc100240 0x7f3fbc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 --2- 172.21.15.53:0/3725342646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fbc101440 0x7f3fbc073140 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 >> 172.21.15.53:0/3725342646 conn(0x7f3fbc0fb7f0 msgr2=0x7f3fbc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:25.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 shutdown_connections 2024-09-16T00:57:25.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.827+0000 7f3fc3d83700 1 -- 172.21.15.53:0/3725342646 wait complete. 2024-09-16T00:57:25.838 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 -- 172.21.15.53:0/894038792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4102250 msgr2=0x7f73e40fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 --2- 172.21.15.53:0/894038792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4102250 0x7f73e40fe380 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009910 tx=0x7f73d4009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 -- 172.21.15.53:0/894038792 shutdown_connections 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 --2- 172.21.15.53:0/894038792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4102250 0x7f73e40fe380 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 --2- 172.21.15.53:0/894038792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4101900 0x7f73e4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.936+0000 7f73ec34e700 1 -- 172.21.15.53:0/894038792 >> 172.21.15.53:0/894038792 conn(0x7f73e40f9f10 msgr2=0x7f73e40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 -- 172.21.15.53:0/894038792 shutdown_connections 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 -- 172.21.15.53:0/894038792 wait complete. 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 Processor -- start 2024-09-16T00:57:25.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 -- start start 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 0x7f73e40ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40ffb90 con 0x7f73e4101900 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ec34e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40ffcd0 con 0x7f73e4102250 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ea0ea700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ea0ea700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50874/0 (socket says 172.21.15.53:50874) 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.937+0000 7f73ea0ea700 1 -- 172.21.15.53:0/418289111 learned_addr learned my addr 172.21.15.53:0/418289111 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73e98e9700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 0x7f73e40ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ea0ea700 1 -- 172.21.15.53:0/418289111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 msgr2=0x7f73e40ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ea0ea700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 0x7f73e40ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ea0ea700 1 -- 172.21.15.53:0/418289111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40095f0 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73e98e9700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 0x7f73e40ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ea0ea700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73e000e920 tx=0x7f73e000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e000c9d0 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e40fffb0 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73e0010430 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e0018650 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.938+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e419db60 con 0x7f73e4101900 2024-09-16T00:57:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.939+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4108d30 con 0x7f73e4101900 2024-09-16T00:57:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.940+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f73e00105a0 con 0x7f73e4101900 2024-09-16T00:57:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.940+0000 7f73db7fe700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 0x7f73d0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.940+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f73e0014070 con 0x7f73e4101900 2024-09-16T00:57:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.941+0000 7f73e98e9700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 0x7f73d0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.941+0000 7f73e98e9700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 0x7f73d0070b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73d40059d0 tx=0x7f73d4005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:25.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:25.945+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f73e00541b0 con 0x7f73e4101900 2024-09-16T00:57:26.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.181+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73e4105ff0 con 0x7f73d006e680 2024-09-16T00:57:26.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.182+0000 7f73db7fe700 1 -- 172.21.15.53:0/418289111 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f73e4105ff0 con 0x7f73d006e680 2024-09-16T00:57:26.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.184+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 msgr2=0x7f73d0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.184+0000 7f73ec34e700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 0x7f73d0070b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73d40059d0 tx=0x7f73d4005940 comp rx=0 tx=0).stop 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 msgr2=0x7f73e4101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73e000e920 tx=0x7f73e000ec30 comp rx=0 tx=0).stop 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 shutdown_connections 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f73d006e680 0x7f73d0070b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73e4101900 0x7f73e4101000 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 --2- 172.21.15.53:0/418289111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e4102250 0x7f73e40ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 >> 172.21.15.53:0/418289111 conn(0x7f73e40f9f10 msgr2=0x7f73e41048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 shutdown_connections 2024-09-16T00:57:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.185+0000 7f73ec34e700 1 -- 172.21.15.53:0/418289111 wait complete. 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3206626623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 msgr2=0x7ff3b8100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3206626623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8100790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009910 tx=0x7ff3a8009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3206626623 shutdown_connections 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3206626623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8100790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3206626623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 0x7ff3b80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3206626623 >> 172.21.15.53:0/3206626623 conn(0x7ff3b80fa6d0 msgr2=0x7ff3b80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3206626623 shutdown_connections 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.294+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3206626623 wait complete. 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 Processor -- start 2024-09-16T00:57:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 -- start start 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 0x7ff3b8195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8196600 con 0x7ff3b8100340 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bfab1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8196740 con 0x7ff3b80ff140 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50892/0 (socket says 172.21.15.53:50892) 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 -- 172.21.15.53:0/3454581916 learned_addr learned my addr 172.21.15.53:0/3454581916 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd84d700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 0x7ff3b8195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 -- 172.21.15.53:0/3454581916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 msgr2=0x7ff3b8195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 0x7ff3b8195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 -- 172.21.15.53:0/3454581916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80095f0 con 0x7ff3b8100340 2024-09-16T00:57:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.295+0000 7ff3bd04c700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8000c00 tx=0x7ff3a800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.296+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a801d070 con 0x7ff3b8100340 2024-09-16T00:57:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.296+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3a8005dc0 con 0x7ff3b8100340 2024-09-16T00:57:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.296+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b819b190 con 0x7ff3b8100340 2024-09-16T00:57:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.296+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a80226a0 con 0x7ff3b8100340 2024-09-16T00:57:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.296+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b819b680 con 0x7ff3b8100340 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.297+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b8107c90 con 0x7ff3b8100340 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.297+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff3a80038f0 con 0x7ff3b8100340 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.298+0000 7ff3aeffd700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.298+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff3a808fa90 con 0x7ff3b8100340 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.298+0000 7ff3bd84d700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.298+0000 7ff3bd84d700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 0x7ff3a4070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81001a0 tx=0x7ff3b4009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:26.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.302+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3a805c7e0 con 0x7ff3b8100340 2024-09-16T00:57:26.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.528+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3b819bdd0 con 0x7ff3a406e680 2024-09-16T00:57:26.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.538+0000 7ff3aeffd700 1 -- 172.21.15.53:0/3454581916 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7ff3b819bdd0 con 0x7ff3a406e680 2024-09-16T00:57:26.539 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:57:26.539 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (14m) 14s ago 15m 26.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:57:26.539 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (15m) 14s ago 15m 9021k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:57:26.539 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (14m) 59s ago 14m 8242k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:57:26.539 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (4m) 14s ago 15m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (4m) 59s ago 14m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (13m) 14s ago 15m 85.6M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (38s) 14s ago 9m 13.9M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (20s) 14s ago 9m 11.9M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (9m) 59s ago 9m 17.9M - 18.2.0 dc2bc1663786 d86ddebd5a9b 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (9m) 59s ago 9m 16.2M - 18.2.0 dc2bc1663786 6af0a31865ad 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (6m) 14s ago 16m 504M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (5m) 59s ago 14m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (5m) 14s ago 16m 54.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (4m) 59s ago 14m 37.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (15m) 14s ago 15m 16.7M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:57:26.540 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (14m) 59s ago 14m 15.9M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (3m) 14s ago 13m 113M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (3m) 14s ago 13m 118M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (2m) 14s ago 12m 102M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (2m) 59s ago 12m 113M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (93s) 59s ago 11m 112M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (62s) 59s ago 11m 11.7M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:57:26.541 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (5m) 14s ago 14m 78.0M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 msgr2=0x7ff3a4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 0x7ff3a4070b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81001a0 tx=0x7ff3b4009260 comp rx=0 tx=0).stop 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 msgr2=0x7ff3b8195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8000c00 tx=0x7ff3a800f690 comp rx=0 tx=0).stop 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 shutdown_connections 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff3a406e680 0x7ff3a4070b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3b80ff140 0x7ff3b8195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 --2- 172.21.15.53:0/3454581916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b8100340 0x7ff3b8195fe0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.540+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 >> 172.21.15.53:0/3454581916 conn(0x7ff3b80fa6d0 msgr2=0x7ff3b8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.541+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 shutdown_connections 2024-09-16T00:57:26.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.541+0000 7ff3bfab1700 1 -- 172.21.15.53:0/3454581916 wait complete. 2024-09-16T00:57:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 -- 172.21.15.53:0/2935770901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 msgr2=0x7fa824100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 --2- 172.21.15.53:0/2935770901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824100660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa81400b0a0 tx=0x7fa81400b3b0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 -- 172.21.15.53:0/2935770901 shutdown_connections 2024-09-16T00:57:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 --2- 172.21.15.53:0/2935770901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa8241018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 --2- 172.21.15.53:0/2935770901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824100660 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 -- 172.21.15.53:0/2935770901 >> 172.21.15.53:0/2935770901 conn(0x7fa8240fb7e0 msgr2=0x7fa8240fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 -- 172.21.15.53:0/2935770901 shutdown_connections 2024-09-16T00:57:26.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.649+0000 7fa829181700 1 -- 172.21.15.53:0/2935770901 wait complete. 2024-09-16T00:57:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 Processor -- start 2024-09-16T00:57:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 -- start start 2024-09-16T00:57:26.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa824073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824073680 con 0x7fa824100250 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa829181700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240737c0 con 0x7fa824101450 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50904/0 (socket says 172.21.15.53:50904) 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 -- 172.21.15.53:0/2591643750 learned_addr learned my addr 172.21.15.53:0/2591643750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa82259c700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa824073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 -- 172.21.15.53:0/2591643750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 msgr2=0x7fa824073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa824073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa822d9d700 1 -- 172.21.15.53:0/2591643750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009d00 con 0x7fa824100250 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.650+0000 7fa82259c700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa824073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa822d9d700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa814009fd0 tx=0x7fa814009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:26.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81400e040 con 0x7fa824100250 2024-09-16T00:57:26.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa814003de0 con 0x7fa824100250 2024-09-16T00:57:26.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824073a40 con 0x7fa824100250 2024-09-16T00:57:26.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81401d980 con 0x7fa824100250 2024-09-16T00:57:26.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.651+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824073f30 con 0x7fa824100250 2024-09-16T00:57:26.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.652+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824108da0 con 0x7fa824100250 2024-09-16T00:57:26.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.653+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa814004040 con 0x7fa824100250 2024-09-16T00:57:26.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.653+0000 7fa81bfff700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 0x7fa810070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:26.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.653+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa8140900a0 con 0x7fa824100250 2024-09-16T00:57:26.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.653+0000 7fa82259c700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 0x7fa810070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:26.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.654+0000 7fa82259c700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 0x7fa810070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:26.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.657+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa81405cd70 con 0x7fa824100250 2024-09-16T00:57:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.965+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa824108f90 con 0x7fa824100250 2024-09-16T00:57:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.965+0000 7fa81bfff700 1 -- 172.21.15.53:0/2591643750 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7fa81405c900 con 0x7fa824100250 2024-09-16T00:57:26.966 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:57:26.966 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:57:26.966 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:57:26.967 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-16T00:57:26.968 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 12 2024-09-16T00:57:26.968 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:57:26.968 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 msgr2=0x7fa810070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 0x7fa810070b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c0058e0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 msgr2=0x7fa824074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa814009fd0 tx=0x7fa814009790 comp rx=0 tx=0).stop 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 shutdown_connections 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa81006e680 0x7fa810070b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa824100250 0x7fa824074af0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 --2- 172.21.15.53:0/2591643750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa824101450 0x7fa824073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.967+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 >> 172.21.15.53:0/2591643750 conn(0x7fa8240fb7e0 msgr2=0x7fa824104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:26.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.968+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 shutdown_connections 2024-09-16T00:57:26.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:26.968+0000 7fa829181700 1 -- 172.21.15.53:0/2591643750 wait complete. 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.076+0000 7f2a7683f700 1 -- 172.21.15.53:0/3990810448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70069b00 msgr2=0x7f2a70102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.076+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3990810448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70069b00 0x7f2a70102df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009910 tx=0x7f2a60009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 -- 172.21.15.53:0/3990810448 shutdown_connections 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3990810448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70103330 0x7f2a701057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3990810448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70069b00 0x7f2a70102df0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 -- 172.21.15.53:0/3990810448 >> 172.21.15.53:0/3990810448 conn(0x7f2a700fa7a0 msgr2=0x7f2a700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 -- 172.21.15.53:0/3990810448 shutdown_connections 2024-09-16T00:57:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 -- 172.21.15.53:0/3990810448 wait complete. 2024-09-16T00:57:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 Processor -- start 2024-09-16T00:57:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.077+0000 7f2a7683f700 1 -- start start 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a7683f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a7683f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70196370 0x7f2a7019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a7683f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70196870 con 0x7f2a70103330 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a7683f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a701969e0 con 0x7f2a70196370 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50922/0 (socket says 172.21.15.53:50922) 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 -- 172.21.15.53:0/3965785901 learned_addr learned my addr 172.21.15.53:0/3965785901 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6f7fe700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70196370 0x7f2a7019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 -- 172.21.15.53:0/3965785901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70196370 msgr2=0x7f2a7019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70196370 0x7f2a7019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 -- 172.21.15.53:0/3965785901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600095f0 con 0x7f2a70103330 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6ffff700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000bda0 tx=0x7f2a6000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.078+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a6001d070 con 0x7f2a70103330 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.079+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2a6000f460 con 0x7f2a70103330 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.079+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7019b920 con 0x7f2a70103330 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.079+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a60021640 con 0x7f2a70103330 2024-09-16T00:57:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.079+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7019bde0 con 0x7f2a70103330 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.080+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7018fbf0 con 0x7f2a70103330 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.080+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2a6000f5d0 con 0x7f2a70103330 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.080+0000 7f2a6d7fa700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 0x7f2a58070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.081+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2a6008f930 con 0x7f2a70103330 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.081+0000 7f2a6f7fe700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 0x7f2a58070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.081+0000 7f2a6f7fe700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 0x7f2a58070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007be0 tx=0x7f2a640073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.085+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2a6005c600 con 0x7f2a70103330 2024-09-16T00:57:27.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.350+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a70068ab0 con 0x7f2a70103330 2024-09-16T00:57:27.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.350+0000 7f2a6d7fa700 1 -- 172.21.15.53:0/3965785901 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1742 (secure 0 0 0) 0x7f2a6005c190 con 0x7f2a70103330 2024-09-16T00:57:27.351 INFO:teuthology.orchestra.run.smithi053.stdout:e28 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:57:19:513182+0000 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 28 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:57:19.513167+0000 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:57:27.352 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 84 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=24299} 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:57:27.353 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 0 members: 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{0:24299} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] compat {c=[1],r=[1],i=[7ff]}] 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:57:27.354 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{-1:34414} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 msgr2=0x7f2a58070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 0x7f2a58070b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007be0 tx=0x7f2a640073d0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 msgr2=0x7f2a70195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000bda0 tx=0x7f2a6000bdd0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 shutdown_connections 2024-09-16T00:57:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f2a5806e680 0x7f2a58070b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a70103330 0x7f2a70195e30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 --2- 172.21.15.53:0/3965785901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a70196370 0x7f2a7019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 >> 172.21.15.53:0/3965785901 conn(0x7f2a700fa7a0 msgr2=0x7f2a700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 shutdown_connections 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.353+0000 7f2a7683f700 1 -- 172.21.15.53:0/3965785901 wait complete. 2024-09-16T00:57:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-09-16T00:57:27.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:27 smithi152 ceph-mon[63606]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:27.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:27 smithi152 ceph-mon[63606]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:27.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:27 smithi152 ceph-mon[63606]: pgmap v194: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-16T00:57:27.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:27 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2591643750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- 172.21.15.53:0/900324457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044101440 msgr2=0x7f6044101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 --2- 172.21.15.53:0/900324457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044101440 0x7f6044101890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6034009910 tx=0x7f6034009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- 172.21.15.53:0/900324457 shutdown_connections 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 --2- 172.21.15.53:0/900324457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044101440 0x7f6044101890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 --2- 172.21.15.53:0/900324457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044100240 0x7f6044100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- 172.21.15.53:0/900324457 >> 172.21.15.53:0/900324457 conn(0x7f60440fb7f0 msgr2=0x7f60440fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- 172.21.15.53:0/900324457 shutdown_connections 2024-09-16T00:57:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- 172.21.15.53:0/900324457 wait complete. 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 Processor -- start 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.463+0000 7f604b79c700 1 -- start start 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f604b79c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f604b79c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044101440 0x7f6044195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f604b79c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60441965f0 con 0x7f6044100240 2024-09-16T00:57:27.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f604b79c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044196730 con 0x7f6044101440 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50934/0 (socket says 172.21.15.53:50934) 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 -- 172.21.15.53:0/4080954863 learned_addr learned my addr 172.21.15.53:0/4080954863 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6048d37700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044101440 0x7f6044195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 -- 172.21.15.53:0/4080954863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044101440 msgr2=0x7f6044195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044101440 0x7f6044195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 -- 172.21.15.53:0/4080954863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340095f0 con 0x7f6044100240 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f6049538700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f604000d900 tx=0x7f604000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604000b920 con 0x7f6044100240 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6040010460 con 0x7f6044100240 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604419b1e0 con 0x7f6044100240 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.464+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604000f590 con 0x7f6044100240 2024-09-16T00:57:27.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.465+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604419b730 con 0x7f6044100240 2024-09-16T00:57:27.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.465+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6044108d90 con 0x7f6044100240 2024-09-16T00:57:27.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.466+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f60400105d0 con 0x7f6044100240 2024-09-16T00:57:27.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.467+0000 7f603a7fc700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 0x7f6030070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.467+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f604008e4d0 con 0x7f6044100240 2024-09-16T00:57:27.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.467+0000 7f6048d37700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 0x7f6030070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.467+0000 7f6048d37700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 0x7f6030070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6034006010 tx=0x7f603400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.471+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f604005b220 con 0x7f6044100240 2024-09-16T00:57:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:27 smithi053 ceph-mon[77492]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:27 smithi053 ceph-mon[77492]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:27 smithi053 ceph-mon[77492]: pgmap v194: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-16T00:57:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:27 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2591643750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:27.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.708+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f604419be80 con 0x7f603006e680 2024-09-16T00:57:27.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.710+0000 7f603a7fc700 1 -- 172.21.15.53:0/4080954863 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f604419be80 con 0x7f603006e680 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "osd", 2024-09-16T00:57:27.711 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "14/23 daemons upgraded", 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:57:27.712 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:57:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 msgr2=0x7f6030070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 0x7f6030070b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6034006010 tx=0x7f603400b540 comp rx=0 tx=0).stop 2024-09-16T00:57:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 msgr2=0x7f6044195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f604000d900 tx=0x7f604000dc10 comp rx=0 tx=0).stop 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 shutdown_connections 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f603006e680 0x7f6030070b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6044100240 0x7f6044195a90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 --2- 172.21.15.53:0/4080954863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6044101440 0x7f6044195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 >> 172.21.15.53:0/4080954863 conn(0x7f60440fb7f0 msgr2=0x7f6044104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 shutdown_connections 2024-09-16T00:57:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.712+0000 7f604b79c700 1 -- 172.21.15.53:0/4080954863 wait complete. 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 -- 172.21.15.53:0/3146848577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 msgr2=0x7f63200ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 --2- 172.21.15.53:0/3146848577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63200ff880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6314009910 tx=0x7f6314009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 -- 172.21.15.53:0/3146848577 shutdown_connections 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 --2- 172.21.15.53:0/3146848577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63200ff880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 --2- 172.21.15.53:0/3146848577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 0x7f63200feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.820+0000 7f63256be700 1 -- 172.21.15.53:0/3146848577 >> 172.21.15.53:0/3146848577 conn(0x7f63200fa6d0 msgr2=0x7f63200fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 -- 172.21.15.53:0/3146848577 shutdown_connections 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 -- 172.21.15.53:0/3146848577 wait complete. 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 Processor -- start 2024-09-16T00:57:27.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 -- start start 2024-09-16T00:57:27.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 0x7f6320197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63201987d0 con 0x7f63200ff410 2024-09-16T00:57:27.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.821+0000 7f63256be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320198940 con 0x7f63200feac0 2024-09-16T00:57:27.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50948/0 (socket says 172.21.15.53:50948) 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 -- 172.21.15.53:0/1418558938 learned_addr learned my addr 172.21.15.53:0/1418558938 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631effd700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 0x7f6320197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 -- 172.21.15.53:0/1418558938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 msgr2=0x7f6320197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 0x7f6320197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 -- 172.21.15.53:0/1418558938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140095f0 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f631e7fc700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6314000c00 tx=0x7f631400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631401d070 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6314005dc0 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632019d370 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63140226a0 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.822+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632019d860 con 0x7f63200ff410 2024-09-16T00:57:27.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.823+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632010af70 con 0x7f63200ff410 2024-09-16T00:57:27.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.824+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f63140038f0 con 0x7f63200ff410 2024-09-16T00:57:27.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.824+0000 7f6307fff700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 0x7f6308070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:27.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.824+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f631408fa90 con 0x7f63200ff410 2024-09-16T00:57:27.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.824+0000 7f631effd700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 0x7f6308070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:27.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.825+0000 7f631effd700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 0x7f6308070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6320198b70 tx=0x7f6310009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:27.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:27.829+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6314058cb0 con 0x7f63200ff410 2024-09-16T00:57:28.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.130+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f632010b160 con 0x7f63200ff410 2024-09-16T00:57:28.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.130+0000 7f6307fff700 1 -- 172.21.15.53:0/1418558938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f631405c370 con 0x7f63200ff410 2024-09-16T00:57:28.131 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-16T00:57:28.132 INFO:teuthology.orchestra.run.smithi053.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-16T00:57:28.132 INFO:teuthology.orchestra.run.smithi053.stdout: fs cephfs is degraded 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 msgr2=0x7f6308070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 0x7f6308070b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6320198b70 tx=0x7f6310009260 comp rx=0 tx=0).stop 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 msgr2=0x7f63201981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6314000c00 tx=0x7f631400f690 comp rx=0 tx=0).stop 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 shutdown_connections 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f630806e680 0x7f6308070b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63200feac0 0x7f6320197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 --2- 172.21.15.53:0/1418558938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63200ff410 0x7f63201981d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 >> 172.21.15.53:0/1418558938 conn(0x7f63200fa6d0 msgr2=0x7f63201070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:28.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 shutdown_connections 2024-09-16T00:57:28.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:28.133+0000 7f63256be700 1 -- 172.21.15.53:0/1418558938 wait complete. 2024-09-16T00:57:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:28 smithi053 ceph-mon[77492]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:28 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3965785901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:57:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:28 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1418558938' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:57:28.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:28 smithi152 ceph-mon[63606]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:28.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:28 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3965785901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:57:28.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:28 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1418558938' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: pgmap v195: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0.000999988 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:reconnect 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:reconnect} 2 up:standby 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: pgmap v195: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0.000999988 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:reconnect 2024-09-16T00:57:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:reconnect} 2 up:standby 2024-09-16T00:57:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:29.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:30 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:rejoin 2024-09-16T00:57:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:30 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:rejoin} 2 up:standby 2024-09-16T00:57:30.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:30 smithi053 ceph-mon[77492]: daemon mds.cephfs.smithi152.ocdywv is now active in filesystem cephfs as rank 0 2024-09-16T00:57:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:30 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:rejoin 2024-09-16T00:57:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:30 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi152.ocdywv=up:rejoin} 2 up:standby 2024-09-16T00:57:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:30 smithi152 ceph-mon[63606]: daemon mds.cephfs.smithi152.ocdywv is now active in filesystem cephfs as rank 0 2024-09-16T00:57:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:31 smithi053 ceph-mon[77492]: pgmap v196: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:31 smithi053 ceph-mon[77492]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:57:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:31 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:57:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:31 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:active 2024-09-16T00:57:31.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:31 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.ocdywv=up:active} 2 up:standby 2024-09-16T00:57:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:31 smithi152 ceph-mon[63606]: pgmap v196: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:31 smithi152 ceph-mon[63606]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:57:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:31 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:57:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:31 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6826/2059330716,v1:172.21.15.152:6827/2059330716] up:active 2024-09-16T00:57:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:31 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.ocdywv=up:active} 2 up:standby 2024-09-16T00:57:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: pgmap v197: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T00:57:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] up:boot 2024-09-16T00:57:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi152.ocdywv=up:active} 3 up:standby 2024-09-16T00:57:33.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:33.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: pgmap v197: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-16T00:57:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] up:boot 2024-09-16T00:57:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi152.ocdywv=up:active} 3 up:standby 2024-09-16T00:57:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:33.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:35.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:35 smithi152 ceph-mon[63606]: pgmap v198: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T00:57:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:35 smithi053 ceph-mon[77492]: pgmap v198: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T00:57:37.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:37 smithi152 ceph-mon[63606]: pgmap v199: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T00:57:37.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:37 smithi053 ceph-mon[77492]: pgmap v199: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T00:57:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:39 smithi053 ceph-mon[77492]: pgmap v200: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-16T00:57:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:39 smithi152 ceph-mon[63606]: pgmap v200: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: Detected new or changed devices on smithi152 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:41.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: pgmap v201: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.ocdywv"]}]: dispatch 2024-09-16T00:57:41.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:41 smithi152 ceph-mon[63606]: Upgrade: It appears safe to stop mds.cephfs.smithi152.ocdywv 2024-09-16T00:57:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: Detected new or changed devices on smithi152 2024-09-16T00:57:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: pgmap v201: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.ocdywv"]}]: dispatch 2024-09-16T00:57:41.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:41 smithi053 ceph-mon[77492]: Upgrade: It appears safe to stop mds.cephfs.smithi152.ocdywv 2024-09-16T00:57:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: Upgrade: Updating mds.cephfs.smithi152.ocdywv 2024-09-16T00:57:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: Deploying daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:57:42.779 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:42 smithi152 ceph-mon[63606]: pgmap v202: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 13 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: Upgrade: Updating mds.cephfs.smithi152.ocdywv 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ocdywv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: Deploying daemon mds.cephfs.smithi152.ocdywv on smithi152 2024-09-16T00:57:42.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:42 smithi053 ceph-mon[77492]: pgmap v202: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 13 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-09-16T00:57:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[77488]: 2024-09-16T00:57:43.331+0000 7fafd60ee640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:57:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:43.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: osdmap e85: 6 total, 6 up, 6 in 2024-09-16T00:57:43.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: Standby daemon mds.cephfs.smithi053.cdsuag assigned to filesystem cephfs as rank 0 2024-09-16T00:57:43.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:57:43.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:57:43.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:43 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:replay} 2 up:standby 2024-09-16T00:57:43.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T00:57:43.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T00:57:43.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: osdmap e85: 6 total, 6 up, 6 in 2024-09-16T00:57:43.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: Standby daemon mds.cephfs.smithi053.cdsuag assigned to filesystem cephfs as rank 0 2024-09-16T00:57:43.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T00:57:43.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T00:57:43.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:43 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:replay} 2 up:standby 2024-09-16T00:57:44.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:44 smithi053 ceph-mon[77492]: pgmap v204: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 5.1 KiB/s wr, 2 op/s 2024-09-16T00:57:44.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:44.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:44 smithi152 ceph-mon[63606]: pgmap v204: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 5.1 KiB/s wr, 2 op/s 2024-09-16T00:57:44.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:45.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:46.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:46 smithi053 ceph-mon[77492]: pgmap v205: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-09-16T00:57:46.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:46 smithi152 ceph-mon[63606]: pgmap v205: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-09-16T00:57:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:49 smithi053 ceph-mon[77492]: pgmap v206: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 3 op/s 2024-09-16T00:57:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:49 smithi152 ceph-mon[63606]: pgmap v206: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 3 op/s 2024-09-16T00:57:51.553 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:51 smithi152 ceph-mon[63606]: pgmap v207: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-16T00:57:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:51 smithi053 ceph-mon[77492]: pgmap v207: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-16T00:57:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0 2024-09-16T00:57:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0.00099998 2024-09-16T00:57:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:reconnect 2024-09-16T00:57:52.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:reconnect} 2 up:standby 2024-09-16T00:57:52.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:52.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:52.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:52 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:52.623 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: reconnect by client.24317 v1:172.21.15.53:0/4112295100 after 0 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: reconnect by client.14524 v1:172.21.15.152:0/2639839516 after 0.00099998 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:reconnect 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:reconnect} 2 up:standby 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:52.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:52 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: pgmap v208: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:rejoin 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] up:boot 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:rejoin} 3 up:standby 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:53.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:53 smithi152 ceph-mon[63606]: daemon mds.cephfs.smithi053.cdsuag is now active in filesystem cephfs as rank 0 2024-09-16T00:57:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: pgmap v208: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T00:57:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:rejoin 2024-09-16T00:57:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] up:boot 2024-09-16T00:57:53.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: fsmap cephfs:1/1 {0=cephfs.smithi053.cdsuag=up:rejoin} 3 up:standby 2024-09-16T00:57:53.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:53.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:53 smithi053 ceph-mon[77492]: daemon mds.cephfs.smithi053.cdsuag is now active in filesystem cephfs as rank 0 2024-09-16T00:57:54.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:54 smithi053 ceph-mon[77492]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:57:54.573 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:54 smithi053 ceph-mon[77492]: Cluster is now healthy 2024-09-16T00:57:54.573 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:54 smithi053 ceph-mon[77492]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:active 2024-09-16T00:57:54.573 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:54 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:57:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:54 smithi152 ceph-mon[63606]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T00:57:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:54 smithi152 ceph-mon[63606]: Cluster is now healthy 2024-09-16T00:57:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:54 smithi152 ceph-mon[63606]: mds.? [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] up:active 2024-09-16T00:57:54.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:54 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:57:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:55 smithi053 ceph-mon[77492]: pgmap v209: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:57:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:55 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.582 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:55 smithi152 ceph-mon[63606]: pgmap v209: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T00:57:55.582 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.582 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.583 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:55.583 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:55 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:57.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:57 smithi053 ceph-mon[77492]: pgmap v210: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-16T00:57:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:57 smithi152 ceph-mon[63606]: pgmap v210: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-16T00:57:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 -- 172.21.15.53:0/3361071530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc1003f0 msgr2=0x7ff2cc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3361071530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc100860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009910 tx=0x7ff2c0009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 -- 172.21.15.53:0/3361071530 shutdown_connections 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3361071530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc100860 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3361071530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 -- 172.21.15.53:0/3361071530 >> 172.21.15.53:0/3361071530 conn(0x7ff2cc0fa7a0 msgr2=0x7ff2cc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 -- 172.21.15.53:0/3361071530 shutdown_connections 2024-09-16T00:57:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.257+0000 7ff2d1024700 1 -- 172.21.15.53:0/3361071530 wait complete. 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 Processor -- start 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 -- start start 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc198aa0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.258+0000 7ff2d1024700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc198be0 con 0x7ff2cc1003f0 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2ca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2ca59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:51308/0 (socket says 172.21.15.53:51308) 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59756/0 (socket says 172.21.15.53:59756) 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2ca59c700 1 -- 172.21.15.53:0/3844318007 learned_addr learned my addr 172.21.15.53:0/3844318007 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 -- 172.21.15.53:0/3844318007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 msgr2=0x7ff2cc198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 -- 172.21.15.53:0/3844318007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c00095f0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2ca59c700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.259+0000 7ff2cad9d700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c8f0 tx=0x7ff2bc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.260+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc00e850 con 0x7ff2cc0ff150 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.260+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc19d690 con 0x7ff2cc0ff150 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.260+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2bc00ee60 con 0x7ff2cc0ff150 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.260+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2bc018630 con 0x7ff2cc0ff150 2024-09-16T00:57:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.260+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc19dbe0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.261+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc068ab0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.261+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff2bc00f8a0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.262+0000 7ff2b3fff700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 0x7ff2b4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.262+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff2bc08e520 con 0x7ff2cc0ff150 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.262+0000 7ff2ca59c700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 0x7ff2b4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.262+0000 7ff2ca59c700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 0x7ff2b4070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006010 tx=0x7ff2c0005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.267+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff2bc05b1a0 con 0x7ff2cc0ff150 2024-09-16T00:57:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.504+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2cc0694e0 con 0x7ff2b406e680 2024-09-16T00:57:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.505+0000 7ff2b3fff700 1 -- 172.21.15.53:0/3844318007 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff2cc0694e0 con 0x7ff2b406e680 2024-09-16T00:57:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 msgr2=0x7ff2b4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 0x7ff2b4070b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0006010 tx=0x7ff2c0005dc0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 msgr2=0x7ff2cc197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c8f0 tx=0x7ff2bc00cc00 comp rx=0 tx=0).stop 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 shutdown_connections 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff2b406e680 0x7ff2b4070b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2cc0ff150 0x7ff2cc197f40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.507+0000 7ff2d1024700 1 --2- 172.21.15.53:0/3844318007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2cc1003f0 0x7ff2cc198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.508+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 >> 172.21.15.53:0/3844318007 conn(0x7ff2cc0fa7a0 msgr2=0x7ff2cc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.508+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 shutdown_connections 2024-09-16T00:57:58.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.508+0000 7ff2d1024700 1 -- 172.21.15.53:0/3844318007 wait complete. 2024-09-16T00:57:58.520 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 -- 172.21.15.53:0/2935544767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 msgr2=0x7f7f440ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/2935544767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f440ff890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009910 tx=0x7f7f38009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 -- 172.21.15.53:0/2935544767 shutdown_connections 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/2935544767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f440ff890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/2935544767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 0x7f7f440feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 -- 172.21.15.53:0/2935544767 >> 172.21.15.53:0/2935544767 conn(0x7f7f440fa700 msgr2=0x7f7f440fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 -- 172.21.15.53:0/2935544767 shutdown_connections 2024-09-16T00:57:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.622+0000 7f7f49bd1700 1 -- 172.21.15.53:0/2935544767 wait complete. 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 Processor -- start 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 -- start start 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 0x7f7f44197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441987f0 con 0x7f7f440ff420 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f49bd1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44198960 con 0x7f7f440fead0 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59768/0 (socket says 172.21.15.53:59768) 2024-09-16T00:57:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f42ffd700 1 -- 172.21.15.53:0/997629539 learned_addr learned my addr 172.21.15.53:0/997629539 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.623+0000 7f7f437fe700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 0x7f7f44197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f42ffd700 1 -- 172.21.15.53:0/997629539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 msgr2=0x7f7f44197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f42ffd700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 0x7f7f44197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f42ffd700 1 -- 172.21.15.53:0/997629539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380095f0 con 0x7f7f440ff420 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f42ffd700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f38006010 tx=0x7f7f3800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3801d070 con 0x7f7f440ff420 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4419d390 con 0x7f7f440ff420 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f3800f460 con 0x7f7f440ff420 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f38021640 con 0x7f7f440ff420 2024-09-16T00:57:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.624+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4419d880 con 0x7f7f440ff420 2024-09-16T00:57:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.625+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4410af80 con 0x7f7f440ff420 2024-09-16T00:57:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.626+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f3800fab0 con 0x7f7f440ff420 2024-09-16T00:57:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.626+0000 7f7f40ff9700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 0x7f7f2c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.626+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7f3808f980 con 0x7f7f440ff420 2024-09-16T00:57:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.626+0000 7f7f437fe700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 0x7f7f2c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.627+0000 7f7f437fe700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 0x7f7f2c070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009550 tx=0x7f7f340091f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.631+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f38058ad0 con 0x7f7f440ff420 2024-09-16T00:57:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.868+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f4419df80 con 0x7f7f2c06e680 2024-09-16T00:57:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.869+0000 7f7f40ff9700 1 -- 172.21.15.53:0/997629539 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7f4419df80 con 0x7f7f2c06e680 2024-09-16T00:57:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 msgr2=0x7f7f2c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 0x7f7f2c070b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009550 tx=0x7f7f340091f0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 msgr2=0x7f7f441981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f38006010 tx=0x7f7f3800bd70 comp rx=0 tx=0).stop 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 shutdown_connections 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7f2c06e680 0x7f7f2c070b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f440fead0 0x7f7f44197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 --2- 172.21.15.53:0/997629539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f440ff420 0x7f7f441981f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.871+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 >> 172.21.15.53:0/997629539 conn(0x7f7f440fa700 msgr2=0x7f7f44107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.872+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 shutdown_connections 2024-09-16T00:57:58.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.872+0000 7f7f49bd1700 1 -- 172.21.15.53:0/997629539 wait complete. 2024-09-16T00:57:58.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 -- 172.21.15.53:0/948078300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784102240 msgr2=0x7f27840fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 --2- 172.21.15.53:0/948078300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784102240 0x7f27840fe300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f276c009910 tx=0x7f276c009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 -- 172.21.15.53:0/948078300 shutdown_connections 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 --2- 172.21.15.53:0/948078300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784102240 0x7f27840fe300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 --2- 172.21.15.53:0/948078300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784101860 0x7f2784101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.979+0000 7f278a7f5700 1 -- 172.21.15.53:0/948078300 >> 172.21.15.53:0/948078300 conn(0x7f27840f9e70 msgr2=0x7f27840fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.980+0000 7f278a7f5700 1 -- 172.21.15.53:0/948078300 shutdown_connections 2024-09-16T00:57:58.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.980+0000 7f278a7f5700 1 -- 172.21.15.53:0/948078300 wait complete. 2024-09-16T00:57:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.980+0000 7f278a7f5700 1 Processor -- start 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.980+0000 7f278a7f5700 1 -- start start 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784102240 0x7f27841960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841966c0 con 0x7f2784101860 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784196800 con 0x7f2784102240 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59786/0 (socket says 172.21.15.53:59786) 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 -- 172.21.15.53:0/3252901247 learned_addr learned my addr 172.21.15.53:0/3252901247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f277bfff700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784102240 0x7f27841960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 -- 172.21.15.53:0/3252901247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784102240 msgr2=0x7f27841960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784102240 0x7f27841960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 -- 172.21.15.53:0/3252901247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0095f0 con 0x7f2784101860 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2783fff700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f277400c8f0 tx=0x7f277400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27740078e0 con 0x7f2784101860 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f277400f450 con 0x7f2784101860 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278419b2b0 con 0x7f2784101860 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2774018610 con 0x7f2784101860 2024-09-16T00:57:58.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.981+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278419b800 con 0x7f2784101860 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.982+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784108dc0 con 0x7f2784101860 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.983+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f277400f5c0 con 0x7f2784101860 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.983+0000 7f2781ffb700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 0x7f2770070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.983+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f277408e4c0 con 0x7f2784101860 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.984+0000 7f277bfff700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 0x7f2770070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.984+0000 7f277bfff700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 0x7f2770070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f276c006010 tx=0x7f276c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:58.988+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f277405b1c0 con 0x7f2784101860 2024-09-16T00:57:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.211+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2784105f50 con 0x7f277006e680 2024-09-16T00:57:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.222+0000 7f2781ffb700 1 -- 172.21.15.53:0/3252901247 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f2784105f50 con 0x7f277006e680 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (14m) 47s ago 15m 26.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (16m) 47s ago 16m 9021k - 18.2.0 dc2bc1663786 72a4828f3b69 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (15m) 4s ago 15m 8841k - 18.2.0 dc2bc1663786 11cd3044c7ec 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (4m) 47s ago 16m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (4m) 4s ago 15m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (14m) 47s ago 15m 85.6M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (70s) 47s ago 10m 13.9M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (52s) 47s ago 10m 11.9M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (29s) 4s ago 10m 16.2M - 19.1.1-326-g8921c8ef f1455bd0219c 6295ee41ddf4 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (7s) 4s ago 10m 13.9M - 19.1.1-326-g8921c8ef f1455bd0219c 830ba4e1f636 2024-09-16T00:57:59.224 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (7m) 47s ago 17m 504M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (6m) 4s ago 14m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (5m) 47s ago 17m 54.1M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (5m) 4s ago 14m 41.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (16m) 47s ago 16m 16.7M - 1.5.0 0da6a335fe13 c4901020edfd 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (15m) 4s ago 15m 15.7M - 1.5.0 0da6a335fe13 a237425a8996 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (4m) 47s ago 14m 113M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (3m) 47s ago 13m 118M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (3m) 47s ago 13m 102M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (2m) 4s ago 12m 128M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (2m) 4s ago 12m 118M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (94s) 4s ago 11m 102M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:57:59.225 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (6m) 47s ago 15m 78.0M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 msgr2=0x7f2770070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 0x7f2770070b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f276c006010 tx=0x7f276c01a040 comp rx=0 tx=0).stop 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 msgr2=0x7f2784195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f277400c8f0 tx=0x7f277400cc00 comp rx=0 tx=0).stop 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 shutdown_connections 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f277006e680 0x7f2770070b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2784101860 0x7f2784195b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 --2- 172.21.15.53:0/3252901247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2784102240 0x7f27841960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 >> 172.21.15.53:0/3252901247 conn(0x7f27840f9e70 msgr2=0x7f2784104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 shutdown_connections 2024-09-16T00:57:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.226+0000 7f278a7f5700 1 -- 172.21.15.53:0/3252901247 wait complete. 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 -- 172.21.15.53:0/2019887805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 msgr2=0x7f9f140fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 --2- 172.21.15.53:0/2019887805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f140fe320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009910 tx=0x7f9f04009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 -- 172.21.15.53:0/2019887805 shutdown_connections 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 --2- 172.21.15.53:0/2019887805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f140fe320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 --2- 172.21.15.53:0/2019887805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 0x7f9f14101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 -- 172.21.15.53:0/2019887805 >> 172.21.15.53:0/2019887805 conn(0x7f9f140f9f10 msgr2=0x7f9f140fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 -- 172.21.15.53:0/2019887805 shutdown_connections 2024-09-16T00:57:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.338+0000 7f9f1c787700 1 -- 172.21.15.53:0/2019887805 wait complete. 2024-09-16T00:57:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 Processor -- start 2024-09-16T00:57:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 -- start start 2024-09-16T00:57:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 0x7f9f14195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14196640 con 0x7f9f141021f0 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1c787700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14196780 con 0x7f9f141018a0 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59810/0 (socket says 172.21.15.53:59810) 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 -- 172.21.15.53:0/630585047 learned_addr learned my addr 172.21.15.53:0/630585047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f1a523700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 0x7f9f14195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 -- 172.21.15.53:0/630585047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 msgr2=0x7f9f14195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 0x7f9f14195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.339+0000 7f9f19d22700 1 -- 172.21.15.53:0/630585047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040095f0 con 0x7f9f141021f0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f19d22700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400bda0 tx=0x7f9f0400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0401d070 con 0x7f9f141021f0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f04022470 con 0x7f9f141021f0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1419b1d0 con 0x7f9f141021f0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f0400f650 con 0x7f9f141021f0 2024-09-16T00:57:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.340+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1419b6c0 con 0x7f9f141021f0 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.341+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f14108d10 con 0x7f9f141021f0 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.342+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9f04004af0 con 0x7f9f141021f0 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.342+0000 7f9f0b7fe700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 0x7f9f00070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.342+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9f0408fbf0 con 0x7f9f141021f0 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.342+0000 7f9f1a523700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 0x7f9f00070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.343+0000 7f9f1a523700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 0x7f9f00070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f100060b0 tx=0x7f9f1000c040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:59.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.346+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f0405c9a0 con 0x7f9f141021f0 2024-09-16T00:57:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: pgmap v211: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-16T00:57:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.cdsuag"}]': finished 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:59.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.jsdknu"}]': finished 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.gatezw"}]': finished 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.ocdywv"}]': finished 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:57:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.686+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f1419bd50 con 0x7f9f141021f0 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.687+0000 7f9f0b7fe700 1 -- 172.21.15.53:0/630585047 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f9f04027290 con 0x7f9f141021f0 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:57:59.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:57:59.689 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T00:57:59.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:57:59.692 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:57:59.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 msgr2=0x7f9f00070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 0x7f9f00070b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f100060b0 tx=0x7f9f1000c040 comp rx=0 tx=0).stop 2024-09-16T00:57:59.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 msgr2=0x7f9f14196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400bda0 tx=0x7f9f0400bdd0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 shutdown_connections 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f0006e680 0x7f9f00070b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f141018a0 0x7f9f14195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 --2- 172.21.15.53:0/630585047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f141021f0 0x7f9f14196020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 >> 172.21.15.53:0/630585047 conn(0x7f9f140f9f10 msgr2=0x7f9f14104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 shutdown_connections 2024-09-16T00:57:59.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.691+0000 7f9f1c787700 1 -- 172.21.15.53:0/630585047 wait complete. 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: pgmap v211: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.cdsuag"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.cdsuag"}]': finished 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.jsdknu"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi053.jsdknu"}]': finished 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.gatezw"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.gatezw"}]': finished 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.ocdywv"}]: dispatch 2024-09-16T00:57:59.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.ocdywv"}]': finished 2024-09-16T00:57:59.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-16T00:57:59.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:57:59.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:57:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 -- 172.21.15.53:0/1750142597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0103310 msgr2=0x7fc7b0105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1750142597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0103310 0x7fc7b0105790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009910 tx=0x7fc7a4009c20 comp rx=0 tx=0).stop 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 -- 172.21.15.53:0/1750142597 shutdown_connections 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1750142597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0103310 0x7fc7b0105790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1750142597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0069270 0x7fc7b0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 -- 172.21.15.53:0/1750142597 >> 172.21.15.53:0/1750142597 conn(0x7fc7b00fa780 msgr2=0x7fc7b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:57:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 -- 172.21.15.53:0/1750142597 shutdown_connections 2024-09-16T00:57:59.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.832+0000 7fc7b658e700 1 -- 172.21.15.53:0/1750142597 wait complete. 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.833+0000 7fc7b658e700 1 Processor -- start 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.833+0000 7fc7b658e700 1 -- start start 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.833+0000 7fc7b658e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 0x7fc7b0195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.833+0000 7fc7b658e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7b658e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0196510 con 0x7fc7b0196010 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7b658e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b0196680 con 0x7fc7b0103310 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59820/0 (socket says 172.21.15.53:59820) 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 -- 172.21.15.53:0/1614217799 learned_addr learned my addr 172.21.15.53:0/1614217799 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7affff700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 0x7fc7b0195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 -- 172.21.15.53:0/1614217799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 msgr2=0x7fc7b0195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 0x7fc7b0195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 -- 172.21.15.53:0/1614217799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40095f0 con 0x7fc7b0196010 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7affff700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 0x7fc7b0195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:57:59.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.834+0000 7fc7af7fe700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4006010 tx=0x7fc7a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.835+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a401d070 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.835+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7a400f460 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.835+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b019b5c0 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.835+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a4017630 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.835+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00fed80 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.836+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b018fbf0 con 0x7fc7b0196010 2024-09-16T00:57:59.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.837+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc7a400f5d0 con 0x7fc7b0196010 2024-09-16T00:57:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.837+0000 7fc7ad7fa700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 0x7fc798074f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:57:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.837+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc7a408fb40 con 0x7fc7b0196010 2024-09-16T00:57:59.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.837+0000 7fc7affff700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 0x7fc798074f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:57:59.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.838+0000 7fc7affff700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 0x7fc798074f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0005950 tx=0x7fc7a00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:57:59.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:57:59.845+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc7a405c840 con 0x7fc7b0196010 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.118+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7b0069480 con 0x7fc7b0196010 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.119+0000 7fc7ad7fa700 1 -- 172.21.15.53:0/1614217799 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+2001 (secure 0 0 0) 0x7fc7a405c3d0 con 0x7fc7b0196010 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stdout:e39 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:57:59:582615+0000 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:58:00.120 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 39 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:57:59.582608+0000 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:58:00.121 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 85 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=34382} 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:58:00.122 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 34382 members: 34382 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:34382} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:34414} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:00.123 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.121+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 msgr2=0x7fc798074f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.121+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 0x7fc798074f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0005950 tx=0x7fc7a00058e0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.121+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 msgr2=0x7fc7b019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.121+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4006010 tx=0x7fc7a400be20 comp rx=0 tx=0).stop 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 shutdown_connections 2024-09-16T00:58:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc798072a90 0x7fc798074f40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b0103310 0x7fc7b0195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 --2- 172.21.15.53:0/1614217799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b0196010 0x7fc7b019b080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 >> 172.21.15.53:0/1614217799 conn(0x7fc7b00fa780 msgr2=0x7fc7b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 shutdown_connections 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.122+0000 7fc7b658e700 1 -- 172.21.15.53:0/1614217799 wait complete. 2024-09-16T00:58:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-16T00:58:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2443793190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 msgr2=0x7fc9d0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 --2- 172.21.15.53:0/2443793190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0100650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009910 tx=0x7fc9c0009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2443793190 shutdown_connections 2024-09-16T00:58:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 --2- 172.21.15.53:0/2443793190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 0x7fc9d0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 --2- 172.21.15.53:0/2443793190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0100650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2443793190 >> 172.21.15.53:0/2443793190 conn(0x7fc9d00fb890 msgr2=0x7fc9d00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2443793190 shutdown_connections 2024-09-16T00:58:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.252+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2443793190 wait complete. 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.253+0000 7fc9d50b3700 1 Processor -- start 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.253+0000 7fc9d50b3700 1 -- start start 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9d50b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9d50b3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 0x7fc9d0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9d50b3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01965f0 con 0x7fc9d0100240 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59850/0 (socket says 172.21.15.53:59850) 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 -- 172.21.15.53:0/2950423961 learned_addr learned my addr 172.21.15.53:0/2950423961 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9d50b3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0196730 con 0x7fc9d01014e0 2024-09-16T00:58:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ce59c700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 0x7fc9d0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 -- 172.21.15.53:0/2950423961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 msgr2=0x7fc9d0195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 0x7fc9d0195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.254+0000 7fc9ced9d700 1 -- 172.21.15.53:0/2950423961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00095f0 con 0x7fc9d0100240 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.255+0000 7fc9ced9d700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b5c0 tx=0x7fc9c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.255+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c001d070 con 0x7fc9d0100240 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.255+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9c0022470 con 0x7fc9d0100240 2024-09-16T00:58:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.255+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2950423961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d019b180 con 0x7fc9d0100240 2024-09-16T00:58:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.255+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c000f690 con 0x7fc9d0100240 2024-09-16T00:58:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.256+0000 7fc9d50b3700 1 -- 172.21.15.53:0/2950423961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d019b620 con 0x7fc9d0100240 2024-09-16T00:58:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.257+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b00052f0 con 0x7fc9d0100240 2024-09-16T00:58:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.259+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc9c00225e0 con 0x7fc9d0100240 2024-09-16T00:58:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.259+0000 7fc9b7fff700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 0x7fc9b8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.260+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc9c00901d0 con 0x7fc9d0100240 2024-09-16T00:58:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.260+0000 7fc9ce59c700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 0x7fc9b8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.260+0000 7fc9ce59c700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 0x7fc9b8070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005950 tx=0x7fc9c400a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:00.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.263+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc9c005ced0 con 0x7fc9d0100240 2024-09-16T00:58:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.525+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9b0000bc0 con 0x7fc9b806e680 2024-09-16T00:58:00.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.526+0000 7fc9b7fff700 1 -- 172.21.15.53:0/2950423961 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc9b0000bc0 con 0x7fc9b806e680 2024-09-16T00:58:00.527 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:58:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:58:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "mds", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "osd", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "16/23 daemons upgraded", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:58:00.528 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:58:00.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 msgr2=0x7fc9b8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 0x7fc9b8070b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005950 tx=0x7fc9c400a300 comp rx=0 tx=0).stop 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 msgr2=0x7fc9d0195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b5c0 tx=0x7fc9c000bd70 comp rx=0 tx=0).stop 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 shutdown_connections 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc9b806e680 0x7fc9b8070b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d0100240 0x7fc9d0195a90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 --2- 172.21.15.53:0/2950423961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d01014e0 0x7fc9d0195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 >> 172.21.15.53:0/2950423961 conn(0x7fc9d00fb890 msgr2=0x7fc9d0104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 shutdown_connections 2024-09-16T00:58:00.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.529+0000 7fc9b5ffb700 1 -- 172.21.15.53:0/2950423961 wait complete. 2024-09-16T00:58:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all mds 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/630585047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:00 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1614217799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/4014041790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 msgr2=0x7fe9a41051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/4014041790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a41051f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009910 tx=0x7fe9a0009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/4014041790 shutdown_connections 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/4014041790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a4105730 0x7fe9a4107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/4014041790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a41051f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.641+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/4014041790 >> 172.21.15.53:0/4014041790 conn(0x7fe9a40fa780 msgr2=0x7fe9a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.642+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/4014041790 shutdown_connections 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.642+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/4014041790 wait complete. 2024-09-16T00:58:00.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.642+0000 7fe9ab5aa700 1 Processor -- start 2024-09-16T00:58:00.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.642+0000 7fe9ab5aa700 1 -- start start 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.642+0000 7fe9ab5aa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9ab5aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a4105730 0x7fe9a4198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9ab5aa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a4198880 con 0x7fe9a4069250 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9ab5aa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419d290 con 0x7fe9a4105730 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59880/0 (socket says 172.21.15.53:59880) 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 -- 172.21.15.53:0/1510106362 learned_addr learned my addr 172.21.15.53:0/1510106362 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 -- 172.21.15.53:0/1510106362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a4105730 msgr2=0x7fe9a4198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a4105730 0x7fe9a4198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 -- 172.21.15.53:0/1510106362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a00095f0 con 0x7fe9a4069250 2024-09-16T00:58:00.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9a9346700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005b40 tx=0x7fe9a000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a001d070 con 0x7fe9a4069250 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9a0005dc0 con 0x7fe9a4069250 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.643+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a419d430 con 0x7fe9a4069250 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.644+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a419d8f0 con 0x7fe9a4069250 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.644+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a00226a0 con 0x7fe9a4069250 2024-09-16T00:58:00.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.645+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe988005320 con 0x7fe9a4069250 2024-09-16T00:58:00.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.645+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe9a0003680 con 0x7fe9a4069250 2024-09-16T00:58:00.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.646+0000 7fe99a7fc700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 0x7fe990070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:00.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.646+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe9a008fb80 con 0x7fe9a4069250 2024-09-16T00:58:00.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.646+0000 7fe9a8b45700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 0x7fe990070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.647+0000 7fe9a8b45700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 0x7fe990070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe994005950 tx=0x7fe9940058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:00.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.650+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe9a0058d50 con 0x7fe9a4069250 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all mds 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 3 up:standby 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: fsmap cephfs:1 {0=cephfs.smithi053.cdsuag=up:active} 1 up:standby-replay 2 up:standby 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/630585047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:00.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:00 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1614217799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:58:00.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.961+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe988005190 con 0x7fe9a4069250 2024-09-16T00:58:00.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.962+0000 7fe99a7fc700 1 -- 172.21.15.53:0/1510106362 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe9a0003930 con 0x7fe9a4069250 2024-09-16T00:58:00.963 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:58:00.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 msgr2=0x7fe990070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 0x7fe990070b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe994005950 tx=0x7fe9940058e0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 msgr2=0x7fe9a4197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005b40 tx=0x7fe9a000fab0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 shutdown_connections 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe99006e680 0x7fe990070b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a4069250 0x7fe9a4197d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 --2- 172.21.15.53:0/1510106362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a4105730 0x7fe9a4198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 >> 172.21.15.53:0/1510106362 conn(0x7fe9a40fa780 msgr2=0x7fe9a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 shutdown_connections 2024-09-16T00:58:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:00.964+0000 7fe9ab5aa700 1 -- 172.21.15.53:0/1510106362 wait complete. 2024-09-16T00:58:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:01 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all rgw 2024-09-16T00:58:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:01 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T00:58:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:01 smithi053 ceph-mon[77492]: pgmap v212: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:01 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1510106362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:58:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:01 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all rgw 2024-09-16T00:58:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:01 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T00:58:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:01 smithi152 ceph-mon[63606]: pgmap v212: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:01 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1510106362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:58:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:02 smithi152 ceph-mon[63606]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:02 smithi152 ceph-mon[63606]: Upgrade: Updating ceph-exporter.smithi053 (1/2) 2024-09-16T00:58:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:58:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:02 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:02.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:02 smithi053 ceph-mon[77492]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:02.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:02 smithi053 ceph-mon[77492]: Upgrade: Updating ceph-exporter.smithi053 (1/2) 2024-09-16T00:58:02.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:02.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi053", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:58:02.788 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:02 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:03 smithi053 ceph-mon[77492]: Deploying daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:58:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:03 smithi053 ceph-mon[77492]: pgmap v213: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-16T00:58:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:03 smithi152 ceph-mon[63606]: Deploying daemon ceph-exporter.smithi053 on smithi053 2024-09-16T00:58:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:03 smithi152 ceph-mon[63606]: pgmap v213: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-16T00:58:04.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:04 smithi053 ceph-mon[77492]: pgmap v214: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:04.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:04 smithi152 ceph-mon[63606]: pgmap v214: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:07.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:07.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:07.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:06 smithi053 ceph-mon[77492]: pgmap v215: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-16T00:58:07.326 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:07.326 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:07.326 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:06 smithi152 ceph-mon[63606]: pgmap v215: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: Upgrade: Updating ceph-exporter.smithi152 (2/2) 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: Deploying daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:58:08.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:08 smithi152 ceph-mon[63606]: pgmap v216: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: Upgrade: Updating ceph-exporter.smithi152 (2/2) 2024-09-16T00:58:08.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:08.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi152", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T00:58:08.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:08.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: Deploying daemon ceph-exporter.smithi152 on smithi152 2024-09-16T00:58:08.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:08 smithi053 ceph-mon[77492]: pgmap v216: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-16T00:58:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:11 smithi053 ceph-mon[77492]: pgmap v217: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-09-16T00:58:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:11 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:11 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:11.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:11 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:11.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:11 smithi152 ceph-mon[63606]: pgmap v217: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4 op/s 2024-09-16T00:58:11.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:11 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:11.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:11 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:11.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:11 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:13 smithi053 ceph-mon[77492]: pgmap v218: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T00:58:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:13.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:13 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:13 smithi152 ceph-mon[63606]: pgmap v218: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T00:58:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:13 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:14 smithi152 ceph-mon[63606]: pgmap v219: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-16T00:58:14.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:14.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:14.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:14.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:14 smithi053 ceph-mon[77492]: pgmap v219: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-16T00:58:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:16 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:16.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:16 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:17.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:17 smithi053 ceph-mon[77492]: pgmap v220: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 2 op/s 2024-09-16T00:58:17.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:17.512 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:17 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:17 smithi152 ceph-mon[63606]: pgmap v220: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 2 op/s 2024-09-16T00:58:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:17 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:19 smithi053 ceph-mon[77492]: pgmap v221: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 3 op/s 2024-09-16T00:58:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:19 smithi152 ceph-mon[63606]: pgmap v221: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 3 op/s 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi053"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi053"}]': finished 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi152"}]: dispatch 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi152"}]': finished 2024-09-16T00:58:20.571 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all iscsi 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all nfs 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: Upgrade: Setting container_image for all nvmeof 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.572 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:20 smithi053 ceph-mon[77492]: pgmap v222: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 1 op/s 2024-09-16T00:58:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi053"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi053"}]': finished 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi152"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi152"}]': finished 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all iscsi 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all nfs 2024-09-16T00:58:20.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.700 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:20.700 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: Upgrade: Setting container_image for all nvmeof 2024-09-16T00:58:20.700 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:20.700 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:20 smithi152 ceph-mon[63606]: pgmap v222: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 1 op/s 2024-09-16T00:58:21.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:21 smithi053 ceph-mon[77492]: Upgrade: Updating node-exporter.smithi053 (1/2) 2024-09-16T00:58:21.820 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:21 smithi053 ceph-mon[77492]: Deploying daemon node-exporter.smithi053 on smithi053 2024-09-16T00:58:21.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:21 smithi152 ceph-mon[63606]: Upgrade: Updating node-exporter.smithi053 (1/2) 2024-09-16T00:58:21.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:21 smithi152 ceph-mon[63606]: Deploying daemon node-exporter.smithi053 on smithi053 2024-09-16T00:58:22.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:22 smithi053 ceph-mon[77492]: pgmap v223: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:22.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:22 smithi152 ceph-mon[63606]: pgmap v223: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:24 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:24 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:25.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:24 smithi053 ceph-mon[77492]: pgmap v224: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:25.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:24 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:25.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:24 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:25.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:24 smithi152 ceph-mon[63606]: pgmap v224: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:26.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:25 smithi152 ceph-mon[63606]: Upgrade: Updating node-exporter.smithi152 (2/2) 2024-09-16T00:58:26.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:25 smithi152 ceph-mon[63606]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-16T00:58:26.269 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:25 smithi053 ceph-mon[77492]: Upgrade: Updating node-exporter.smithi152 (2/2) 2024-09-16T00:58:26.269 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:25 smithi053 ceph-mon[77492]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-16T00:58:27.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:26 smithi152 ceph-mon[63606]: pgmap v225: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:27.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:26 smithi053 ceph-mon[77492]: pgmap v225: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:28 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:28.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:28 smithi053 ceph-mon[77492]: pgmap v226: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:29.069 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:29.069 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:29.069 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:28 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:29.069 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:28 smithi152 ceph-mon[63606]: pgmap v226: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:29.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:29.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:29.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:30.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:30.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:30.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:31.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:30 smithi053 ceph-mon[77492]: pgmap v227: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:31.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:31.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:31.082 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:30 smithi152 ceph-mon[63606]: pgmap v227: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:31.083 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:31.083 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 -- 172.21.15.53:0/580141683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc100240 msgr2=0x7fa4fc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 --2- 172.21.15.53:0/580141683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc100240 0x7fa4fc100650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009910 tx=0x7fa4f8009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 -- 172.21.15.53:0/580141683 shutdown_connections 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 --2- 172.21.15.53:0/580141683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc101440 0x7fa4fc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 --2- 172.21.15.53:0/580141683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc100240 0x7fa4fc100650 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 -- 172.21.15.53:0/580141683 >> 172.21.15.53:0/580141683 conn(0x7fa4fc0fb7f0 msgr2=0x7fa4fc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:31.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 -- 172.21.15.53:0/580141683 shutdown_connections 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.082+0000 7fa5034d4700 1 -- 172.21.15.53:0/580141683 wait complete. 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 Processor -- start 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 -- start start 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc100240 0x7fa4fc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc073680 con 0x7fa4fc101440 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa5034d4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0737c0 con 0x7fa4fc100240 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43202/0 (socket says 172.21.15.53:43202) 2024-09-16T00:58:31.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 -- 172.21.15.53:0/3701208084 learned_addr learned my addr 172.21.15.53:0/3701208084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:31.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa501270700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc100240 0x7fa4fc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 -- 172.21.15.53:0/3701208084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc100240 msgr2=0x7fa4fc074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc100240 0x7fa4fc074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 -- 172.21.15.53:0/3701208084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80095f0 con 0x7fa4fc101440 2024-09-16T00:58:31.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.083+0000 7fa500a6f700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e920 tx=0x7fa4f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.084+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f000c9d0 con 0x7fa4fc101440 2024-09-16T00:58:31.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.084+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc073aa0 con 0x7fa4fc101440 2024-09-16T00:58:31.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.084+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4f0010430 con 0x7fa4fc101440 2024-09-16T00:58:31.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.084+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4f0018650 con 0x7fa4fc101440 2024-09-16T00:58:31.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.084+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc19db30 con 0x7fa4fc101440 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.085+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc108d90 con 0x7fa4fc101440 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.085+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4f00105a0 con 0x7fa4fc101440 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.086+0000 7fa4ee7fc700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 0x7fa4e8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.086+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa4f0014070 con 0x7fa4fc101440 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.086+0000 7fa501270700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 0x7fa4e8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.086+0000 7fa501270700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 0x7fa4e8070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800b6f0 tx=0x7fa4f8005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.091+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4f00541b0 con 0x7fa4fc101440 2024-09-16T00:58:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.325+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4fc105d90 con 0x7fa4e806e680 2024-09-16T00:58:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.326+0000 7fa4ee7fc700 1 -- 172.21.15.53:0/3701208084 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fa4fc105d90 con 0x7fa4e806e680 2024-09-16T00:58:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 msgr2=0x7fa4e8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 0x7fa4e8070b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800b6f0 tx=0x7fa4f8005940 comp rx=0 tx=0).stop 2024-09-16T00:58:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 msgr2=0x7fa4fc073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000e920 tx=0x7fa4f000ec30 comp rx=0 tx=0).stop 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 shutdown_connections 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fa4e806e680 0x7fa4e8070b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa4fc100240 0x7fa4fc074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 --2- 172.21.15.53:0/3701208084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4fc101440 0x7fa4fc073140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.328+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 >> 172.21.15.53:0/3701208084 conn(0x7fa4fc0fb7f0 msgr2=0x7fa4fc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.329+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 shutdown_connections 2024-09-16T00:58:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.329+0000 7fa5034d4700 1 -- 172.21.15.53:0/3701208084 wait complete. 2024-09-16T00:58:31.341 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 -- 172.21.15.53:0/1161594266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 msgr2=0x7f4ffc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 --2- 172.21.15.53:0/1161594266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc100860 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009910 tx=0x7f4fe4009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 -- 172.21.15.53:0/1161594266 shutdown_connections 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 --2- 172.21.15.53:0/1161594266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc100860 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 --2- 172.21.15.53:0/1161594266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 0x7f4ffc0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 -- 172.21.15.53:0/1161594266 >> 172.21.15.53:0/1161594266 conn(0x7f4ffc0fa7a0 msgr2=0x7f4ffc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 -- 172.21.15.53:0/1161594266 shutdown_connections 2024-09-16T00:58:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.441+0000 7f5001f1a700 1 -- 172.21.15.53:0/1161594266 wait complete. 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 Processor -- start 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 -- start start 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 0x7f4ffc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc196920 con 0x7f4ffc1003f0 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f5001f1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc196a60 con 0x7f4ffc0ff150 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f4ff2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43220/0 (socket says 172.21.15.53:43220) 2024-09-16T00:58:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f4ff2ffd700 1 -- 172.21.15.53:0/3861098178 learned_addr learned my addr 172.21.15.53:0/3861098178 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.442+0000 7f4ffb7fe700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 0x7f4ffc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff2ffd700 1 -- 172.21.15.53:0/3861098178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 msgr2=0x7f4ffc195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff2ffd700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 0x7f4ffc195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff2ffd700 1 -- 172.21.15.53:0/3861098178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40095f0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff2ffd700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4006010 tx=0x7f4fe400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe401d070 con 0x7f4ffc1003f0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fe400f460 con 0x7f4ffc1003f0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fe4021640 con 0x7f4ffc1003f0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc19b4b0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.443+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc19b9a0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.444+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc068ab0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.445+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4fe400fab0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.446+0000 7f4ff97fa700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 0x7f4fe8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.446+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4fe408fd00 con 0x7f4ffc1003f0 2024-09-16T00:58:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.446+0000 7f4ffb7fe700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 0x7f4fe8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.446+0000 7f4ffb7fe700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 0x7f4fe8070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005950 tx=0x7f4fec00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.449+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4fe405c9e0 con 0x7f4ffc1003f0 2024-09-16T00:58:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.712+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ffc0694e0 con 0x7f4fe806e680 2024-09-16T00:58:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.713+0000 7f4ff97fa700 1 -- 172.21.15.53:0/3861098178 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f4ffc0694e0 con 0x7f4fe806e680 2024-09-16T00:58:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.715+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 msgr2=0x7f4fe8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.715+0000 7f5001f1a700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 0x7f4fe8070b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005950 tx=0x7f4fec00b410 comp rx=0 tx=0).stop 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.715+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 msgr2=0x7f4ffc196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.715+0000 7f5001f1a700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4006010 tx=0x7f4fe400bd70 comp rx=0 tx=0).stop 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 shutdown_connections 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f4fe806e680 0x7f4fe8070b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ffc0ff150 0x7f4ffc195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 --2- 172.21.15.53:0/3861098178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ffc1003f0 0x7f4ffc196300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 >> 172.21.15.53:0/3861098178 conn(0x7f4ffc0fa7a0 msgr2=0x7f4ffc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 shutdown_connections 2024-09-16T00:58:31.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.716+0000 7f5001f1a700 1 -- 172.21.15.53:0/3861098178 wait complete. 2024-09-16T00:58:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 -- 172.21.15.53:0/886070627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 msgr2=0x7f74e0102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 --2- 172.21.15.53:0/886070627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0102e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009910 tx=0x7f74dc009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 -- 172.21.15.53:0/886070627 shutdown_connections 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 --2- 172.21.15.53:0/886070627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 0x7f74e01057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 --2- 172.21.15.53:0/886070627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0102e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 -- 172.21.15.53:0/886070627 >> 172.21.15.53:0/886070627 conn(0x7f74e00fa7a0 msgr2=0x7f74e00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 -- 172.21.15.53:0/886070627 shutdown_connections 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.825+0000 7f74e8009700 1 -- 172.21.15.53:0/886070627 wait complete. 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 Processor -- start 2024-09-16T00:58:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 -- start start 2024-09-16T00:58:31.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 0x7f74e0196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01969a0 con 0x7f74e0069ae0 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e8009700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0196ae0 con 0x7f74e0103350 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43238/0 (socket says 172.21.15.53:43238) 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 -- 172.21.15.53:0/146583329 learned_addr learned my addr 172.21.15.53:0/146583329 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e55a4700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 0x7f74e0196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 -- 172.21.15.53:0/146583329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 msgr2=0x7f74e0196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 0x7f74e0196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.826+0000 7f74e5da5700 1 -- 172.21.15.53:0/146583329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0095f0 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74e5da5700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bd70 tx=0x7f74dc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc01d070 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74dc005dc0 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e019b530 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc021410 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.827+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e019ba20 con 0x7f74e0069ae0 2024-09-16T00:58:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.828+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e018fbf0 con 0x7f74e0069ae0 2024-09-16T00:58:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.829+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f74dc00f810 con 0x7f74e0069ae0 2024-09-16T00:58:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.829+0000 7f74d6ffd700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 0x7f74cc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.829+0000 7f74e55a4700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 0x7f74cc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.829+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f74dc08f8a0 con 0x7f74e0069ae0 2024-09-16T00:58:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.830+0000 7f74e55a4700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 0x7f74cc070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005950 tx=0x7f74d000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:31.834+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74dc05c520 con 0x7f74e0069ae0 2024-09-16T00:58:31.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:31 smithi152 ceph-mon[63606]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:31.998 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:31 smithi053 ceph-mon[77492]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:32.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.083+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74e0061190 con 0x7f74cc06e680 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.092+0000 7f74d6ffd700 1 -- 172.21.15.53:0/146583329 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f74e0061190 con 0x7f74cc06e680 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (15m) 16s ago 16m 26.9M - 0.25.0 c8568f914cd2 691150dfc1ba 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (26s) 16s ago 16m 7763k - 19.1.1-326-g8921c8ef f1455bd0219c 27ec8d819f1b 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (21s) 2s ago 15m 7926k - 19.1.1-326-g8921c8ef f1455bd0219c 45e31ae13fa5 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (5m) 16s ago 16m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:58:32.094 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (5m) 2s ago 15m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (14m) 16s ago 16m 85.8M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (103s) 16s ago 10m 84.9M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (85s) 16s ago 10m 82.4M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (62s) 2s ago 10m 16.5M - 19.1.1-326-g8921c8ef f1455bd0219c 6295ee41ddf4 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (40s) 2s ago 10m 16.3M - 19.1.1-326-g8921c8ef f1455bd0219c 830ba4e1f636 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (7m) 16s ago 17m 505M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (6m) 2s ago 15m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (6m) 16s ago 18m 57.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (6m) 2s ago 15m 43.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 starting - - - - 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (4s) 2s ago 15m 3380k - 1.5.0 0da6a335fe13 4d2a6f52f049 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (4m) 16s ago 14m 116M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (4m) 16s ago 14m 124M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:58:32.095 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (3m) 16s ago 13m 106M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:58:32.096 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (3m) 2s ago 13m 129M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:58:32.096 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (2m) 2s ago 12m 118M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:58:32.096 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (2m) 2s ago 12m 103M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:58:32.096 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (6m) 16s ago 15m 79.1M - 2.43.0 a07b618ecd1d 008880b3d7ce 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 msgr2=0x7f74cc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 0x7f74cc070b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005950 tx=0x7f74d000b410 comp rx=0 tx=0).stop 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 msgr2=0x7f74e0195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bd70 tx=0x7f74dc00bda0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 shutdown_connections 2024-09-16T00:58:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f74cc06e680 0x7f74cc070b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74e0069ae0 0x7f74e0195e40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 --2- 172.21.15.53:0/146583329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74e0103350 0x7f74e0196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 >> 172.21.15.53:0/146583329 conn(0x7f74e00fa7a0 msgr2=0x7f74e00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 shutdown_connections 2024-09-16T00:58:32.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.095+0000 7f74e8009700 1 -- 172.21.15.53:0/146583329 wait complete. 2024-09-16T00:58:32.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 -- 172.21.15.53:0/2341287332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd601003d0 msgr2=0x7fcd60100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 --2- 172.21.15.53:0/2341287332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd601003d0 0x7fcd60100840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009910 tx=0x7fcd50009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:32.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 -- 172.21.15.53:0/2341287332 shutdown_connections 2024-09-16T00:58:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 --2- 172.21.15.53:0/2341287332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd601003d0 0x7fcd60100840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 --2- 172.21.15.53:0/2341287332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd600ff130 0x7fcd600ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 -- 172.21.15.53:0/2341287332 >> 172.21.15.53:0/2341287332 conn(0x7fcd600fa780 msgr2=0x7fcd600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 -- 172.21.15.53:0/2341287332 shutdown_connections 2024-09-16T00:58:32.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.203+0000 7fcd682dd700 1 -- 172.21.15.53:0/2341287332 wait complete. 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 Processor -- start 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 -- start start 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd601003d0 0x7fcd601017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60101cf0 con 0x7fcd600ff130 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd682dd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60101e30 con 0x7fcd601003d0 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd66079700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd66079700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43264/0 (socket says 172.21.15.53:43264) 2024-09-16T00:58:32.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd66079700 1 -- 172.21.15.53:0/3297141574 learned_addr learned my addr 172.21.15.53:0/3297141574 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.204+0000 7fcd65878700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd601003d0 0x7fcd601017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd66079700 1 -- 172.21.15.53:0/3297141574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd601003d0 msgr2=0x7fcd601017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd66079700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd601003d0 0x7fcd601017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd66079700 1 -- 172.21.15.53:0/3297141574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500095f0 con 0x7fcd600ff130 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd66079700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00e920 tx=0x7fcd5c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd5c00c9d0 con 0x7fcd600ff130 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd5c010430 con 0x7fcd600ff130 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd60102110 con 0x7fcd600ff130 2024-09-16T00:58:32.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd5c018650 con 0x7fcd600ff130 2024-09-16T00:58:32.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.205+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6019dac0 con 0x7fcd600ff130 2024-09-16T00:58:32.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.206+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60107c10 con 0x7fcd600ff130 2024-09-16T00:58:32.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.207+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcd5c0105a0 con 0x7fcd600ff130 2024-09-16T00:58:32.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.207+0000 7fcd577fe700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 0x7fcd4c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.207+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcd5c014070 con 0x7fcd600ff130 2024-09-16T00:58:32.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.207+0000 7fcd65878700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 0x7fcd4c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.208+0000 7fcd65878700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 0x7fcd4c070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009fd0 tx=0x7fcd50005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.211+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcd5c0541b0 con 0x7fcd600ff130 2024-09-16T00:58:32.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.527+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd6019e280 con 0x7fcd600ff130 2024-09-16T00:58:32.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.527+0000 7fcd577fe700 1 -- 172.21.15.53:0/3297141574 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fcd5c05b640 con 0x7fcd600ff130 2024-09-16T00:58:32.529 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:58:32.529 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:58:32.530 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:58:32.531 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 msgr2=0x7fcd4c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 0x7fcd4c070b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009fd0 tx=0x7fcd50005940 comp rx=0 tx=0).stop 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 msgr2=0x7fcd60103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00e920 tx=0x7fcd5c00ec30 comp rx=0 tx=0).stop 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 shutdown_connections 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fcd4c06e680 0x7fcd4c070b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600ff130 0x7fcd60103160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 --2- 172.21.15.53:0/3297141574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd601003d0 0x7fcd601017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.529+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 >> 172.21.15.53:0/3297141574 conn(0x7fcd600fa780 msgr2=0x7fcd60068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.530+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 shutdown_connections 2024-09-16T00:58:32.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.530+0000 7fcd682dd700 1 -- 172.21.15.53:0/3297141574 wait complete. 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 -- 172.21.15.53:0/3336610402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc481036c0 msgr2=0x7fdc48105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 --2- 172.21.15.53:0/3336610402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc481036c0 0x7fdc48105aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009910 tx=0x7fdc3c009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 -- 172.21.15.53:0/3336610402 shutdown_connections 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 --2- 172.21.15.53:0/3336610402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc481036c0 0x7fdc48105aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 --2- 172.21.15.53:0/3336610402 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc48100da0 0x7fdc48103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 -- 172.21.15.53:0/3336610402 >> 172.21.15.53:0/3336610402 conn(0x7fdc480fa700 msgr2=0x7fdc480fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 -- 172.21.15.53:0/3336610402 shutdown_connections 2024-09-16T00:58:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 -- 172.21.15.53:0/3336610402 wait complete. 2024-09-16T00:58:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.648+0000 7fdc4d669700 1 Processor -- start 2024-09-16T00:58:32.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc4d669700 1 -- start start 2024-09-16T00:58:32.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc4d669700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc4d669700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 0x7fdc480fed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc4d669700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480ff290 con 0x7fdc48100da0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc4d669700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480ff3d0 con 0x7fdc481036c0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42072/0 (socket says 172.21.15.53:42072) 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 -- 172.21.15.53:0/663309187 learned_addr learned my addr 172.21.15.53:0/663309187 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc467fc700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 0x7fdc480fed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 -- 172.21.15.53:0/663309187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 msgr2=0x7fdc480fed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 0x7fdc480fed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc46ffd700 1 -- 172.21.15.53:0/663309187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0095f0 con 0x7fdc48100da0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.649+0000 7fdc467fc700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 0x7fdc480fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc46ffd700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e920 tx=0x7fdc3800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc3800c9d0 con 0x7fdc48100da0 2024-09-16T00:58:32.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc38010430 con 0x7fdc48100da0 2024-09-16T00:58:32.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc480ff6b0 con 0x7fdc48100da0 2024-09-16T00:58:32.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc38018650 con 0x7fdc48100da0 2024-09-16T00:58:32.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.650+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4819db40 con 0x7fdc48100da0 2024-09-16T00:58:32.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.651+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4818fc70 con 0x7fdc48100da0 2024-09-16T00:58:32.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.652+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdc380105a0 con 0x7fdc48100da0 2024-09-16T00:58:32.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.652+0000 7fdc2ffff700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 0x7fdc30070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:32.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.652+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdc38014070 con 0x7fdc48100da0 2024-09-16T00:58:32.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.652+0000 7fdc467fc700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 0x7fdc30070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:32.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.653+0000 7fdc467fc700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 0x7fdc30070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009fd0 tx=0x7fdc3c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:32.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.657+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdc380541b0 con 0x7fdc48100da0 2024-09-16T00:58:32.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.921+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc480ff840 con 0x7fdc48100da0 2024-09-16T00:58:32.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.921+0000 7fdc2ffff700 1 -- 172.21.15.53:0/663309187 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+2001 (secure 0 0 0) 0x7fdc480ff840 con 0x7fdc48100da0 2024-09-16T00:58:32.923 INFO:teuthology.orchestra.run.smithi053.stdout:e39 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:57:59:582615+0000 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 39 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:57:59.582608+0000 2024-09-16T00:58:32.924 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 85 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=34382} 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:58:32.925 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 34382 members: 34382 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:34382} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:34414} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:58:32.926 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:32.927 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:58:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 msgr2=0x7fdc30070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 0x7fdc30070b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009fd0 tx=0x7fdc3c005940 comp rx=0 tx=0).stop 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 msgr2=0x7fdc48100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800e920 tx=0x7fdc3800ec30 comp rx=0 tx=0).stop 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 shutdown_connections 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdc3006e680 0x7fdc30070b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc48100da0 0x7fdc48100700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 --2- 172.21.15.53:0/663309187 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc481036c0 0x7fdc480fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 >> 172.21.15.53:0/663309187 conn(0x7fdc480fa700 msgr2=0x7fdc480fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 shutdown_connections 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:32.924+0000 7fdc4d669700 1 -- 172.21.15.53:0/663309187 wait complete. 2024-09-16T00:58:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: pgmap v228: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3297141574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:32.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:32 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 -- 172.21.15.53:0/3593803088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 msgr2=0x7fdb04105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3593803088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04105a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009910 tx=0x7fdaf8009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 -- 172.21.15.53:0/3593803088 shutdown_connections 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3593803088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04105a60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3593803088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.038+0000 7fdb0a386700 1 -- 172.21.15.53:0/3593803088 >> 172.21.15.53:0/3593803088 conn(0x7fdb040fa780 msgr2=0x7fdb040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.039+0000 7fdb0a386700 1 -- 172.21.15.53:0/3593803088 shutdown_connections 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.039+0000 7fdb0a386700 1 -- 172.21.15.53:0/3593803088 wait complete. 2024-09-16T00:58:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.039+0000 7fdb0a386700 1 Processor -- start 2024-09-16T00:58:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.039+0000 7fdb0a386700 1 -- start start 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb0a386700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb0a386700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb0a386700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04198850 con 0x7fdb04103680 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb0a386700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0419d260 con 0x7fdb04100d60 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.53:35218/0 (socket says 172.21.15.53:35218) 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 -- 172.21.15.53:0/3656165443 learned_addr learned my addr 172.21.15.53:0/3656165443 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 -- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 msgr2=0x7fdb04198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 -- 172.21.15.53:0/3656165443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80095f0 con 0x7fdb04100d60 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb037fe700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb03fff700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d900 tx=0x7fdaf400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.040+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf4009900 con 0x7fdb04100d60 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.041+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdaf4010460 con 0x7fdb04100d60 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.041+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0419d460 con 0x7fdb04100d60 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.041+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf400f5f0 con 0x7fdb04100d60 2024-09-16T00:58:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.041+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0419d980 con 0x7fdb04100d60 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.042+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb040fc340 con 0x7fdb04100d60 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.042+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdaf40105d0 con 0x7fdb04100d60 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.043+0000 7fdb017fa700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 0x7fdaec070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.043+0000 7fdb037fe700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 0x7fdaec070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.043+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdaf408e230 con 0x7fdb04100d60 2024-09-16T00:58:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.043+0000 7fdb037fe700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 0x7fdaec070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8006010 tx=0x7fdaf800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.048+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdaf4057360 con 0x7fdb04100d60 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: pgmap v228: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3297141574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:33.050 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:32 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:33.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.288+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb04061190 con 0x7fdaec06e680 2024-09-16T00:58:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.290+0000 7fdb017fa700 1 -- 172.21.15.53:0/3656165443 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fdb04061190 con 0x7fdaec06e680 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "mds", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "osd", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph-exporter", 2024-09-16T00:58:33.292 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:58:33.293 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:58:33.293 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "18/23 daemons upgraded", 2024-09-16T00:58:33.293 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-16T00:58:33.293 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:58:33.293 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 msgr2=0x7fdaec070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 0x7fdaec070b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8006010 tx=0x7fdaf800b540 comp rx=0 tx=0).stop 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 msgr2=0x7fdb04197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d900 tx=0x7fdaf400dc10 comp rx=0 tx=0).stop 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 shutdown_connections 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdaec06e680 0x7fdaec070b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb04100d60 0x7fdb04197cf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 --2- 172.21.15.53:0/3656165443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb04103680 0x7fdb04198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 >> 172.21.15.53:0/3656165443 conn(0x7fdb040fa780 msgr2=0x7fdb040ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 shutdown_connections 2024-09-16T00:58:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.293+0000 7fdb0a386700 1 -- 172.21.15.53:0/3656165443 wait complete. 2024-09-16T00:58:33.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 -- 172.21.15.53:0/656129902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 msgr2=0x7fabb0102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 --2- 172.21.15.53:0/656129902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0102e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fabac009910 tx=0x7fabac009c20 comp rx=0 tx=0).stop 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 -- 172.21.15.53:0/656129902 shutdown_connections 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 --2- 172.21.15.53:0/656129902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 --2- 172.21.15.53:0/656129902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0102e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 -- 172.21.15.53:0/656129902 >> 172.21.15.53:0/656129902 conn(0x7fabb00fa780 msgr2=0x7fabb00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 -- 172.21.15.53:0/656129902 shutdown_connections 2024-09-16T00:58:33.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.410+0000 7fabb7317700 1 -- 172.21.15.53:0/656129902 wait complete. 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 Processor -- start 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 -- start start 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01965e0 con 0x7fabb0069230 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb7317700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0196720 con 0x7fabb0103350 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb50b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb50b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42112/0 (socket says 172.21.15.53:42112) 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.411+0000 7fabb50b3700 1 -- 172.21.15.53:0/3727365060 learned_addr learned my addr 172.21.15.53:0/3727365060 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:58:33.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb48b2700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb50b3700 1 -- 172.21.15.53:0/3727365060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 msgr2=0x7fabb0195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb50b3700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb50b3700 1 -- 172.21.15.53:0/3727365060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0095f0 con 0x7fabb0069230 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb48b2700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb50b3700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabac005b40 tx=0x7fabac00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac01d070 con 0x7fabb0069230 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabac005dc0 con 0x7fabb0069230 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb019b170 con 0x7fabb0069230 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.412+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac022470 con 0x7fabb0069230 2024-09-16T00:58:33.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.413+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb019b660 con 0x7fabb0069230 2024-09-16T00:58:33.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.414+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb0108cf0 con 0x7fabb0069230 2024-09-16T00:58:33.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.415+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fabac0050d0 con 0x7fabb0069230 2024-09-16T00:58:33.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.415+0000 7faba67fc700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 0x7fab9c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:58:33.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.415+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fabac08fc00 con 0x7fabb0069230 2024-09-16T00:58:33.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.415+0000 7fabb48b2700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 0x7fab9c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:58:33.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.416+0000 7fabb48b2700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 0x7fab9c070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faba0011490 tx=0x7faba0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:58:33.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.424+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fabac095020 con 0x7fabb0069230 2024-09-16T00:58:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.754+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fabb0108ee0 con 0x7fabb0069230 2024-09-16T00:58:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.755+0000 7faba67fc700 1 -- 172.21.15.53:0/3727365060 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fabac05c880 con 0x7fabb0069230 2024-09-16T00:58:33.757 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 msgr2=0x7fab9c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 0x7fab9c070b30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faba0011490 tx=0x7faba0009260 comp rx=0 tx=0).stop 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 msgr2=0x7fabb0195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fabac005b40 tx=0x7fabac00fa00 comp rx=0 tx=0).stop 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 shutdown_connections 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fab9c06e680 0x7fab9c070b30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb0069230 0x7fabb0195a80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 --2- 172.21.15.53:0/3727365060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb0103350 0x7fabb0195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 >> 172.21.15.53:0/3727365060 conn(0x7fabb00fa780 msgr2=0x7fabb00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:58:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 shutdown_connections 2024-09-16T00:58:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:58:33.757+0000 7fabb7317700 1 -- 172.21.15.53:0/3727365060 wait complete. 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/663309187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='client.44391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.013 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:33 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3727365060' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/663309187' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='client.44391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:34.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:33 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3727365060' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:58:35.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:34 smithi053 ceph-mon[77492]: pgmap v229: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:35.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:34 smithi152 ceph-mon[63606]: pgmap v229: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:37.544 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: pgmap v230: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:37.544 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.544 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.544 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:37.544 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.545 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.546 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.546 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.546 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:37 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: pgmap v230: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:37.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:37 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:39.496 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:39 smithi053 ceph-mon[77492]: pgmap v231: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:39 smithi152 ceph-mon[63606]: pgmap v231: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:40.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:40 smithi053 ceph-mon[77492]: Upgrade: Updating prometheus.smithi053 2024-09-16T00:58:40.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:40 smithi053 ceph-mon[77492]: Deploying daemon prometheus.smithi053 on smithi053 2024-09-16T00:58:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:40 smithi152 ceph-mon[63606]: Upgrade: Updating prometheus.smithi053 2024-09-16T00:58:40.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:40 smithi152 ceph-mon[63606]: Deploying daemon prometheus.smithi053 on smithi053 2024-09-16T00:58:41.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:41 smithi152 ceph-mon[63606]: pgmap v232: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:41.557 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:41 smithi053 ceph-mon[77492]: pgmap v232: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:43.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:43 smithi053 ceph-mon[77492]: pgmap v233: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:43 smithi152 ceph-mon[63606]: pgmap v233: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:44.325 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:45 smithi053 ceph-mon[77492]: pgmap v234: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:45.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:45 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:45 smithi152 ceph-mon[63606]: pgmap v234: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:45 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:47 smithi053 ceph-mon[77492]: pgmap v235: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:47 smithi152 ceph-mon[63606]: pgmap v235: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:49 smithi053 ceph-mon[77492]: pgmap v236: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:49.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:49 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:49 smithi152 ceph-mon[63606]: pgmap v236: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:49 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:50.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:50.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:50 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:50.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:50 smithi152 ceph-mon[63606]: pgmap v237: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:51.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:51.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:50 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:51.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:50 smithi053 ceph-mon[77492]: pgmap v237: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:52.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:52 smithi152 ceph-mon[63606]: pgmap v238: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:52.980 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:52 smithi053 ceph-mon[77492]: pgmap v238: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:54.279 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.280 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.281 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:54 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:54.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:54 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:58:55.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:55 smithi053 ceph-mon[77492]: pgmap v239: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:55.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:55 smithi152 ceph-mon[63606]: pgmap v239: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:56 smithi053 ceph-mon[77492]: Upgrade: Updating alertmanager.smithi053 2024-09-16T00:58:56.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:56 smithi053 ceph-mon[77492]: Deploying daemon alertmanager.smithi053 on smithi053 2024-09-16T00:58:56.421 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:56 smithi152 ceph-mon[63606]: Upgrade: Updating alertmanager.smithi053 2024-09-16T00:58:56.421 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:56 smithi152 ceph-mon[63606]: Deploying daemon alertmanager.smithi053 on smithi053 2024-09-16T00:58:57.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:57 smithi053 ceph-mon[77492]: pgmap v240: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:57.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:57 smithi152 ceph-mon[63606]: pgmap v240: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:58:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:59 smithi053 ceph-mon[77492]: pgmap v241: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:58:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:58:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:59 smithi152 ceph-mon[63606]: pgmap v241: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:58:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:58:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:01.548 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:01 smithi053 ceph-mon[77492]: pgmap v242: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:01.548 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:01.548 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:01.548 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:01 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:01 smithi152 ceph-mon[63606]: pgmap v242: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:01 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:03 smithi053 ceph-mon[77492]: pgmap v243: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:03 smithi152 ceph-mon[63606]: pgmap v243: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 -- 172.21.15.53:0/3378248354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338100d60 msgr2=0x7fc338103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/3378248354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338100d60 0x7fc338103140 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc328009910 tx=0x7fc328009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 -- 172.21.15.53:0/3378248354 shutdown_connections 2024-09-16T00:59:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/3378248354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338103680 0x7fc338105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/3378248354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338100d60 0x7fc338103140 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 -- 172.21.15.53:0/3378248354 >> 172.21.15.53:0/3378248354 conn(0x7fc3380fa780 msgr2=0x7fc3380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 -- 172.21.15.53:0/3378248354 shutdown_connections 2024-09-16T00:59:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.879+0000 7fc33d2e4700 1 -- 172.21.15.53:0/3378248354 wait complete. 2024-09-16T00:59:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 Processor -- start 2024-09-16T00:59:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 -- start start 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338100d60 0x7fc338195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338196610 con 0x7fc338103680 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc33d2e4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc338196750 con 0x7fc338100d60 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.880+0000 7fc3367fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59330/0 (socket says 172.21.15.53:59330) 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 -- 172.21.15.53:0/1433127780 learned_addr learned my addr 172.21.15.53:0/1433127780 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc336ffd700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338100d60 0x7fc338195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 -- 172.21.15.53:0/1433127780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338100d60 msgr2=0x7fc338195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338100d60 0x7fc338195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 -- 172.21.15.53:0/1433127780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280095f0 con 0x7fc338103680 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc3367fc700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c8a0 tx=0x7fc32c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c00cea0 con 0x7fc338103680 2024-09-16T00:59:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc32c004830 con 0x7fc338103680 2024-09-16T00:59:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33819b200 con 0x7fc338103680 2024-09-16T00:59:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32c0055b0 con 0x7fc338103680 2024-09-16T00:59:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.881+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33819b750 con 0x7fc338103680 2024-09-16T00:59:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.883+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33818fbc0 con 0x7fc338103680 2024-09-16T00:59:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.883+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc32c007ad0 con 0x7fc338103680 2024-09-16T00:59:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.883+0000 7fc31ffff700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 0x7fc320070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.884+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc32c08e370 con 0x7fc338103680 2024-09-16T00:59:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.884+0000 7fc336ffd700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 0x7fc320070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.884+0000 7fc336ffd700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 0x7fc320070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc328006010 tx=0x7fc32800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:03.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:03.892+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc32c05b070 con 0x7fc338103680 2024-09-16T00:59:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.137+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc338061190 con 0x7fc32006e680 2024-09-16T00:59:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.138+0000 7fc31ffff700 1 -- 172.21.15.53:0/1433127780 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fc338061190 con 0x7fc32006e680 2024-09-16T00:59:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 msgr2=0x7fc320070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 0x7fc320070b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc328006010 tx=0x7fc32800b540 comp rx=0 tx=0).stop 2024-09-16T00:59:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 msgr2=0x7fc338195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c8a0 tx=0x7fc32c00cc60 comp rx=0 tx=0).stop 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 shutdown_connections 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc32006e680 0x7fc320070b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc338100d60 0x7fc338195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 --2- 172.21.15.53:0/1433127780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc338103680 0x7fc338195ff0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.140+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 >> 172.21.15.53:0/1433127780 conn(0x7fc3380fa780 msgr2=0x7fc3380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.141+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 shutdown_connections 2024-09-16T00:59:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.141+0000 7fc33d2e4700 1 -- 172.21.15.53:0/1433127780 wait complete. 2024-09-16T00:59:04.152 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.256+0000 7fe328b18700 1 -- 172.21.15.53:0/3853171990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324103680 msgr2=0x7fe324105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.256+0000 7fe328b18700 1 --2- 172.21.15.53:0/3853171990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324103680 0x7fe324105a60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe318009910 tx=0x7fe318009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 -- 172.21.15.53:0/3853171990 shutdown_connections 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 --2- 172.21.15.53:0/3853171990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324103680 0x7fe324105a60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 --2- 172.21.15.53:0/3853171990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324100d60 0x7fe324103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 -- 172.21.15.53:0/3853171990 >> 172.21.15.53:0/3853171990 conn(0x7fe3240fa780 msgr2=0x7fe3240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 -- 172.21.15.53:0/3853171990 shutdown_connections 2024-09-16T00:59:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.257+0000 7fe328b18700 1 -- 172.21.15.53:0/3853171990 wait complete. 2024-09-16T00:59:04.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 Processor -- start 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 -- start start 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 0x7fe324196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324196640 con 0x7fe324100d60 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.258+0000 7fe328b18700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324196780 con 0x7fe324103680 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59338/0 (socket says 172.21.15.53:59338) 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 -- 172.21.15.53:0/1953272713 learned_addr learned my addr 172.21.15.53:0/1953272713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe321d9b700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 0x7fe324196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 -- 172.21.15.53:0/1953272713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 msgr2=0x7fe324196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 0x7fe324196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 -- 172.21.15.53:0/1953272713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180095f0 con 0x7fe324100d60 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe321d9b700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 0x7fe324196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe32259c700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c8f0 tx=0x7fe31400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe314007a50 con 0x7fe324100d60 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe314007bb0 con 0x7fe324100d60 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.259+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32419b230 con 0x7fe324100d60 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.260+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe314018630 con 0x7fe324100d60 2024-09-16T00:59:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.260+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32419b780 con 0x7fe324100d60 2024-09-16T00:59:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.261+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32418fbe0 con 0x7fe324100d60 2024-09-16T00:59:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.262+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe314007d20 con 0x7fe324100d60 2024-09-16T00:59:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.262+0000 7fe3137fe700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 0x7fe30c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.263+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe31408e5e0 con 0x7fe324100d60 2024-09-16T00:59:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.263+0000 7fe321d9b700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 0x7fe30c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.263+0000 7fe321d9b700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 0x7fe30c070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe318005b40 tx=0x7fe318005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.268+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe31405b2e0 con 0x7fe324100d60 2024-09-16T00:59:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.511+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe324061190 con 0x7fe30c06e680 2024-09-16T00:59:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.512+0000 7fe3137fe700 1 -- 172.21.15.53:0/1953272713 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fe324061190 con 0x7fe30c06e680 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 msgr2=0x7fe30c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 0x7fe30c070b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe318005b40 tx=0x7fe318005ab0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 msgr2=0x7fe324195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31400c8f0 tx=0x7fe31400ccb0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 shutdown_connections 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe30c06e680 0x7fe30c070b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe324100d60 0x7fe324195ae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 --2- 172.21.15.53:0/1953272713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe324103680 0x7fe324196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 >> 172.21.15.53:0/1953272713 conn(0x7fe3240fa780 msgr2=0x7fe3240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 shutdown_connections 2024-09-16T00:59:04.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.515+0000 7fe328b18700 1 -- 172.21.15.53:0/1953272713 wait complete. 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 -- 172.21.15.53:0/3216829431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 msgr2=0x7fc27c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 --2- 172.21.15.53:0/3216829431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0ff540 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc278009910 tx=0x7fc278009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 -- 172.21.15.53:0/3216829431 shutdown_connections 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 --2- 172.21.15.53:0/3216829431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 0x7fc27c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 --2- 172.21.15.53:0/3216829431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0ff540 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 -- 172.21.15.53:0/3216829431 >> 172.21.15.53:0/3216829431 conn(0x7fc27c0fa780 msgr2=0x7fc27c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 -- 172.21.15.53:0/3216829431 shutdown_connections 2024-09-16T00:59:04.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.641+0000 7fc2832c2700 1 -- 172.21.15.53:0/3216829431 wait complete. 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 Processor -- start 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 -- start start 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 0x7fc27c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c1965f0 con 0x7fc27c0ff130 2024-09-16T00:59:04.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc2832c2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c19d150 con 0x7fc27c1003d0 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc28105e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc28105e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59346/0 (socket says 172.21.15.53:59346) 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.642+0000 7fc28105e700 1 -- 172.21.15.53:0/1363220737 learned_addr learned my addr 172.21.15.53:0/1363220737 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc28085d700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 0x7fc27c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc28105e700 1 -- 172.21.15.53:0/1363220737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 msgr2=0x7fc27c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc28105e700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 0x7fc27c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc28105e700 1 -- 172.21.15.53:0/1363220737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780095f0 con 0x7fc27c0ff130 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc28105e700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc278005090 tx=0x7fc27800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27801d070 con 0x7fc27c0ff130 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc27800f460 con 0x7fc27c0ff130 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c19d350 con 0x7fc27c0ff130 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc278017630 con 0x7fc27c0ff130 2024-09-16T00:59:04.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.643+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c19d810 con 0x7fc27c0ff130 2024-09-16T00:59:04.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.644+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c107c10 con 0x7fc27c0ff130 2024-09-16T00:59:04.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.645+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc278017860 con 0x7fc27c0ff130 2024-09-16T00:59:04.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.646+0000 7fc2727fc700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 0x7fc268070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:04.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.646+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc27808fd00 con 0x7fc27c0ff130 2024-09-16T00:59:04.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.646+0000 7fc28085d700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 0x7fc268070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:04.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.646+0000 7fc28085d700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 0x7fc268070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005ea0 tx=0x7fc26c005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:04.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.650+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc278093030 con 0x7fc27c0ff130 2024-09-16T00:59:04.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.876+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc27c19df60 con 0x7fc26806e680 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.886+0000 7fc2727fc700 1 -- 172.21.15.53:0/1363220737 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc27c19df60 con 0x7fc26806e680 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 starting - - - - 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (59s) 15s ago 17m 8434k - 19.1.1-326-g8921c8ef f1455bd0219c 27ec8d819f1b 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (54s) 35s ago 16m 7926k - 19.1.1-326-g8921c8ef f1455bd0219c 45e31ae13fa5 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (5m) 15s ago 17m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (5m) 35s ago 16m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (15m) 15s ago 16m 86.0M - 9.4.7 954c08fa6188 9a92be139403 2024-09-16T00:59:04.887 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (2m) 15s ago 11m 84.9M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (118s) 15s ago 11m 82.1M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (95s) 35s ago 11m 16.5M - 19.1.1-326-g8921c8ef f1455bd0219c 6295ee41ddf4 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (73s) 35s ago 11m 16.3M - 19.1.1-326-g8921c8ef f1455bd0219c 830ba4e1f636 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (8m) 15s ago 18m 508M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (7m) 35s ago 16m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (6m) 15s ago 18m 59.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (6m) 35s ago 15m 43.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (41s) 15s ago 17m 8518k - 1.5.0 0da6a335fe13 1bb5870b7a15 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (37s) 35s ago 16m 3380k - 1.5.0 0da6a335fe13 4d2a6f52f049 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (5m) 15s ago 15m 115M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (4m) 15s ago 14m 122M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (4m) 15s ago 14m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (3m) 35s ago 13m 129M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:59:04.888 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (3m) 35s ago 13m 118M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:59:04.889 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (2m) 35s ago 12m 103M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:59:04.889 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (21s) 15s ago 16m 53.1M - 2.43.0 a07b618ecd1d f82c97fc52c3 2024-09-16T00:59:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.888+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 msgr2=0x7fc268070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.888+0000 7fc2832c2700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 0x7fc268070b30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005ea0 tx=0x7fc26c005e30 comp rx=0 tx=0).stop 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.888+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 msgr2=0x7fc27c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.888+0000 7fc2832c2700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc278005090 tx=0x7fc27800be20 comp rx=0 tx=0).stop 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 shutdown_connections 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fc26806e680 0x7fc268070b30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c0ff130 0x7fc27c0690a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 --2- 172.21.15.53:0/1363220737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc27c1003d0 0x7fc27c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 >> 172.21.15.53:0/1363220737 conn(0x7fc27c0fa780 msgr2=0x7fc27c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 shutdown_connections 2024-09-16T00:59:04.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.889+0000 7fc2832c2700 1 -- 172.21.15.53:0/1363220737 wait complete. 2024-09-16T00:59:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 -- 172.21.15.53:0/1576126574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4634100d80 msgr2=0x7f4634103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 --2- 172.21.15.53:0/1576126574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4634100d80 0x7f4634103160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4624009910 tx=0x7f4624009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 -- 172.21.15.53:0/1576126574 shutdown_connections 2024-09-16T00:59:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 --2- 172.21.15.53:0/1576126574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46341036a0 0x7f4634105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 --2- 172.21.15.53:0/1576126574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4634100d80 0x7f4634103160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 -- 172.21.15.53:0/1576126574 >> 172.21.15.53:0/1576126574 conn(0x7f46340fa700 msgr2=0x7f46340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 -- 172.21.15.53:0/1576126574 shutdown_connections 2024-09-16T00:59:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.998+0000 7f4639ad9700 1 -- 172.21.15.53:0/1576126574 wait complete. 2024-09-16T00:59:05.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.999+0000 7f4639ad9700 1 Processor -- start 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:04.999+0000 7f4639ad9700 1 -- start start 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4639ad9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 0x7f46341006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4639ad9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4639ad9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340ff270 con 0x7f46341036a0 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4639ad9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340ff3b0 con 0x7f4634100d80 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59368/0 (socket says 172.21.15.53:59368) 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 -- 172.21.15.53:0/502064398 learned_addr learned my addr 172.21.15.53:0/502064398 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f46337fe700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 0x7f46341006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 -- 172.21.15.53:0/502064398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 msgr2=0x7f46341006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 0x7f46341006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 -- 172.21.15.53:0/502064398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240095f0 con 0x7f46341036a0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f46337fe700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 0x7f46341006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4632ffd700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f462800c930 tx=0x7f462800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.000+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4628007ad0 con 0x7f46341036a0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.001+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46340ff690 con 0x7f46341036a0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.001+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4628007c30 con 0x7f46341036a0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.001+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463419daf0 con 0x7f46341036a0 2024-09-16T00:59:05.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.001+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4628018630 con 0x7f46341036a0 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.002+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463418fc80 con 0x7f46341036a0 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.002+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f462800f450 con 0x7f46341036a0 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.003+0000 7f4630ff9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 0x7f461c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.003+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f462808e7e0 con 0x7f46341036a0 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.003+0000 7f46337fe700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 0x7f461c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.003+0000 7f46337fe700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 0x7f461c070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f462400b5c0 tx=0x7f4624005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.007+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f462805b4e0 con 0x7f46341036a0 2024-09-16T00:59:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.373+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4634061960 con 0x7f46341036a0 2024-09-16T00:59:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.374+0000 7f4630ff9700 1 -- 172.21.15.53:0/502064398 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f462805b070 con 0x7f46341036a0 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:05.375 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:59:05.376 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 msgr2=0x7f461c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 0x7f461c070b30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f462400b5c0 tx=0x7f4624005960 comp rx=0 tx=0).stop 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 msgr2=0x7f46340fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f462800c930 tx=0x7f462800ccf0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 shutdown_connections 2024-09-16T00:59:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f461c06e680 0x7f461c070b30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4634100d80 0x7f46341006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 --2- 172.21.15.53:0/502064398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46341036a0 0x7f46340fed30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 >> 172.21.15.53:0/502064398 conn(0x7f46340fa700 msgr2=0x7f46340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 shutdown_connections 2024-09-16T00:59:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.376+0000 7f4639ad9700 1 -- 172.21.15.53:0/502064398 wait complete. 2024-09-16T00:59:05.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 -- 172.21.15.53:0/910910103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 msgr2=0x7f40d01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 --2- 172.21.15.53:0/910910103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d01059e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009910 tx=0x7f40b8009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:05.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 -- 172.21.15.53:0/910910103 shutdown_connections 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 --2- 172.21.15.53:0/910910103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d01059e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 --2- 172.21.15.53:0/910910103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d01030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 -- 172.21.15.53:0/910910103 >> 172.21.15.53:0/910910103 conn(0x7f40d00fa700 msgr2=0x7f40d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 -- 172.21.15.53:0/910910103 shutdown_connections 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.496+0000 7f40d659b700 1 -- 172.21.15.53:0/910910103 wait complete. 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 Processor -- start 2024-09-16T00:59:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 -- start start 2024-09-16T00:59:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d0195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0196690 con 0x7f40d0103600 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40d659b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01967d0 con 0x7f40d0100ce0 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59388/0 (socket says 172.21.15.53:59388) 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40cf7fe700 1 -- 172.21.15.53:0/2865589237 learned_addr learned my addr 172.21.15.53:0/2865589237 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.497+0000 7f40cffff700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d0195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cf7fe700 1 -- 172.21.15.53:0/2865589237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 msgr2=0x7f40d0195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cf7fe700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d0195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cf7fe700 1 -- 172.21.15.53:0/2865589237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80095f0 con 0x7f40d0103600 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cffff700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d0195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cf7fe700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40b8006010 tx=0x7f40b800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b801d070 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d019b220 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f40b800f460 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d019b710 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.498+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b8021640 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.499+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d018fcf0 con 0x7f40d0103600 2024-09-16T00:59:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.500+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f40b802b440 con 0x7f40d0103600 2024-09-16T00:59:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.500+0000 7f40cd7fa700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 0x7f40bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.500+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f40b808fb50 con 0x7f40d0103600 2024-09-16T00:59:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.500+0000 7f40cffff700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 0x7f40bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.501+0000 7f40cffff700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 0x7f40bc070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099d0 tx=0x7f40c0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.505+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40b805c850 con 0x7f40d0103600 2024-09-16T00:59:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:05 smithi053 ceph-mon[77492]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:05.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:05 smithi053 ceph-mon[77492]: pgmap v244: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:05 smithi152 ceph-mon[63606]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:05 smithi152 ceph-mon[63606]: pgmap v244: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:05.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.803+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f40d0061960 con 0x7f40d0103600 2024-09-16T00:59:05.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.803+0000 7f40cd7fa700 1 -- 172.21.15.53:0/2865589237 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+2001 (secure 0 0 0) 0x7f40b80267f0 con 0x7f40d0103600 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:e39 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:57:59:582615+0000 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 39 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T00:59:05.805 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:57:59.582608+0000 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T00:59:05.806 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 85 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=34382} 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T00:59:05.807 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 34382 members: 34382 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:34382} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:34414} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:59:05.808 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 msgr2=0x7f40bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 0x7f40bc070b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40c00099d0 tx=0x7f40c0008040 comp rx=0 tx=0).stop 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 msgr2=0x7f40d0196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f40b8006010 tx=0x7f40b800be20 comp rx=0 tx=0).stop 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 shutdown_connections 2024-09-16T00:59:05.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f40bc06e680 0x7f40bc070b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40d0100ce0 0x7f40d0195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 --2- 172.21.15.53:0/2865589237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40d0103600 0x7f40d0196070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 >> 172.21.15.53:0/2865589237 conn(0x7f40d00fa700 msgr2=0x7f40d00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 shutdown_connections 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.806+0000 7f40d659b700 1 -- 172.21.15.53:0/2865589237 wait complete. 2024-09-16T00:59:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-16T00:59:05.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 -- 172.21.15.53:0/3219950844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 msgr2=0x7f90ac100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 --2- 172.21.15.53:0/3219950844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac100660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009910 tx=0x7f90a0009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:05.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 -- 172.21.15.53:0/3219950844 shutdown_connections 2024-09-16T00:59:05.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 --2- 172.21.15.53:0/3219950844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 --2- 172.21.15.53:0/3219950844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac100660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 -- 172.21.15.53:0/3219950844 >> 172.21.15.53:0/3219950844 conn(0x7f90ac0fb7e0 msgr2=0x7f90ac0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:05.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 -- 172.21.15.53:0/3219950844 shutdown_connections 2024-09-16T00:59:05.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.920+0000 7f90b3759700 1 -- 172.21.15.53:0/3219950844 wait complete. 2024-09-16T00:59:05.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 Processor -- start 2024-09-16T00:59:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 -- start start 2024-09-16T00:59:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac196640 con 0x7f90ac100250 2024-09-16T00:59:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.921+0000 7f90b3759700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac196780 con 0x7f90ac101450 2024-09-16T00:59:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59416/0 (socket says 172.21.15.53:59416) 2024-09-16T00:59:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 -- 172.21.15.53:0/4054334446 learned_addr learned my addr 172.21.15.53:0/4054334446 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b0cf4700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 -- 172.21.15.53:0/4054334446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 msgr2=0x7f90ac196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 -- 172.21.15.53:0/4054334446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00095f0 con 0x7f90ac100250 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b0cf4700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:05.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b14f5700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90a000bda0 tx=0x7f90a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a001d070 con 0x7f90ac100250 2024-09-16T00:59:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90a000f460 con 0x7f90ac100250 2024-09-16T00:59:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.922+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac19b1d0 con 0x7f90ac100250 2024-09-16T00:59:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.923+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a0021640 con 0x7f90ac100250 2024-09-16T00:59:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.923+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac19b6c0 con 0x7f90ac100250 2024-09-16T00:59:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.924+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f90a0017400 con 0x7f90ac100250 2024-09-16T00:59:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.925+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac108da0 con 0x7f90ac100250 2024-09-16T00:59:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.925+0000 7f909e7fc700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 0x7f9098070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.925+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f90a008f7d0 con 0x7f90ac100250 2024-09-16T00:59:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.925+0000 7f90b0cf4700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 0x7f9098070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.926+0000 7f90b0cf4700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 0x7f9098070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90a800bc10 tx=0x7f90a800b5f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:05.930+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90a005c3c0 con 0x7f90ac100250 2024-09-16T00:59:06.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.175+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90ac105da0 con 0x7f909806e680 2024-09-16T00:59:06.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.176+0000 7f909e7fc700 1 -- 172.21.15.53:0/4054334446 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f90ac105da0 con 0x7f909806e680 2024-09-16T00:59:06.177 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:59:06.177 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80", 2024-09-16T00:59:06.177 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": true, 2024-09-16T00:59:06.177 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [ 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mds", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mon", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "osd", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph-exporter", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "crash" 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": "18/23 daemons upgraded", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:59:06.178 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:59:06.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 msgr2=0x7f9098070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 0x7f9098070b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90a800bc10 tx=0x7f90a800b5f0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 msgr2=0x7f90ac195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90a000bda0 tx=0x7f90a000be80 comp rx=0 tx=0).stop 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 shutdown_connections 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f909806e680 0x7f9098070b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ac100250 0x7f90ac195ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 --2- 172.21.15.53:0/4054334446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90ac101450 0x7f90ac196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 >> 172.21.15.53:0/4054334446 conn(0x7f90ac0fb7e0 msgr2=0x7f90ac104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 shutdown_connections 2024-09-16T00:59:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.179+0000 7f90b3759700 1 -- 172.21.15.53:0/4054334446 wait complete. 2024-09-16T00:59:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- 172.21.15.53:0/766263295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808103680 msgr2=0x7fe808105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/766263295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808103680 0x7fe808105a60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009910 tx=0x7fe7f8009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- 172.21.15.53:0/766263295 shutdown_connections 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/766263295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808103680 0x7fe808105a60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/766263295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808100d60 0x7fe808103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- 172.21.15.53:0/766263295 >> 172.21.15.53:0/766263295 conn(0x7fe8080fa780 msgr2=0x7fe8080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- 172.21.15.53:0/766263295 shutdown_connections 2024-09-16T00:59:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- 172.21.15.53:0/766263295 wait complete. 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 Processor -- start 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.290+0000 7fe80f6f7700 1 -- start start 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80f6f7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 0x7fe8081006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80f6f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 0x7fe8080fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80f6f7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080ff250 con 0x7fe808100d60 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80f6f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080ff390 con 0x7fe808103680 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80d493700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 0x7fe8081006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80d493700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 0x7fe8081006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59434/0 (socket says 172.21.15.53:59434) 2024-09-16T00:59:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80d493700 1 -- 172.21.15.53:0/2896202914 learned_addr learned my addr 172.21.15.53:0/2896202914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80cc92700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 0x7fe8080fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80cc92700 1 -- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 msgr2=0x7fe8081006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80cc92700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 0x7fe8081006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.291+0000 7fe80cc92700 1 -- 172.21.15.53:0/2896202914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80095f0 con 0x7fe808103680 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe80cc92700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 0x7fe8080fed10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005b40 tx=0x7fe7f800fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f801d070 con 0x7fe808103680 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe7f8005dc0 con 0x7fe808103680 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f8022470 con 0x7fe808103680 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8080ff610 con 0x7fe808103680 2024-09-16T00:59:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.292+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8080ffab0 con 0x7fe808103680 2024-09-16T00:59:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.293+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80818fbe0 con 0x7fe808103680 2024-09-16T00:59:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.294+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe7f8003680 con 0x7fe808103680 2024-09-16T00:59:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.294+0000 7fe7fe7fc700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 0x7fe7f4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.295+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe7f808fc00 con 0x7fe808103680 2024-09-16T00:59:06.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.295+0000 7fe80d493700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 0x7fe7f4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.295+0000 7fe80d493700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 0x7fe7f4070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe804005950 tx=0x7fe804009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:06.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.300+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe7f8095020 con 0x7fe808103680 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/502064398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2865589237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.490 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:06 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.625+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe80802cc30 con 0x7fe808103680 2024-09-16T00:59:06.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.625+0000 7fe7fe7fc700 1 -- 172.21.15.53:0/2896202914 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe7f805c880 con 0x7fe808103680 2024-09-16T00:59:06.626 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:59:06.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 msgr2=0x7fe7f4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 0x7fe7f4070b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe804005950 tx=0x7fe804009260 comp rx=0 tx=0).stop 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 msgr2=0x7fe8080fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 0x7fe8080fed10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005b40 tx=0x7fe7f800fab0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 shutdown_connections 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe7f406e680 0x7fe7f4070b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe808100d60 0x7fe8081006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 --2- 172.21.15.53:0/2896202914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe808103680 0x7fe8080fed10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 >> 172.21.15.53:0/2896202914 conn(0x7fe8080fa780 msgr2=0x7fe8080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 shutdown_connections 2024-09-16T00:59:06.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:06.628+0000 7fe80f6f7700 1 -- 172.21.15.53:0/2896202914 wait complete. 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/502064398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2865589237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:06 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:07.650 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:07 smithi053 ceph-mon[77492]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:07.650 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:07 smithi053 ceph-mon[77492]: pgmap v245: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:07.650 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:07 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2896202914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:59:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:07 smithi152 ceph-mon[63606]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:07 smithi152 ceph-mon[63606]: pgmap v245: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:07 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2896202914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:59:09.492 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:09 smithi053 ceph-mon[77492]: pgmap v246: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:09 smithi152 ceph-mon[63606]: pgmap v246: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.761 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.762 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:10 smithi053 ceph-mon[77492]: pgmap v247: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:10.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:10.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:10 smithi152 ceph-mon[63606]: pgmap v247: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:11.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:11 smithi053 ceph-mon[77492]: Upgrade: Updating grafana.smithi053 2024-09-16T00:59:11.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:11 smithi053 ceph-mon[77492]: Deploying daemon grafana.smithi053 on smithi053 2024-09-16T00:59:11.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:11 smithi152 ceph-mon[63606]: Upgrade: Updating grafana.smithi053 2024-09-16T00:59:11.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:11 smithi152 ceph-mon[63606]: Deploying daemon grafana.smithi053 on smithi053 2024-09-16T00:59:12.949 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:12 smithi152 ceph-mon[63606]: pgmap v248: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:13.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:12 smithi053 ceph-mon[77492]: pgmap v248: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:14.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:14.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:15.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:15 smithi053 ceph-mon[77492]: pgmap v249: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:15 smithi152 ceph-mon[63606]: pgmap v249: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:17.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:17 smithi053 ceph-mon[77492]: pgmap v250: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:17 smithi152 ceph-mon[63606]: pgmap v250: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:19 smithi053 ceph-mon[77492]: pgmap v251: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:19 smithi152 ceph-mon[63606]: pgmap v251: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:21 smithi053 ceph-mon[77492]: pgmap v252: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:21 smithi152 ceph-mon[63606]: pgmap v252: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:23 smithi053 ceph-mon[77492]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:23 smithi152 ceph-mon[63606]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:24 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:24 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:24 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:24.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:24 smithi053 ceph-mon[77492]: pgmap v254: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:24.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:24 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:24.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:24 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:24.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:24 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:24.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:24 smithi152 ceph-mon[63606]: pgmap v254: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:27.567 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:27 smithi053 ceph-mon[77492]: pgmap v255: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:27 smithi152 ceph-mon[63606]: pgmap v255: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:29 smithi152 ceph-mon[63606]: pgmap v256: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:29.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:29 smithi053 ceph-mon[77492]: pgmap v256: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:29.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:29.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:30.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:30 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:30.452 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:30 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:31.385 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:31 smithi053 ceph-mon[77492]: pgmap v257: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:31.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:31 smithi152 ceph-mon[63606]: pgmap v257: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:33.320 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.321 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.322 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.322 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:59:33.322 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:59:33.322 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.322 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.323 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.323 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.323 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.323 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.323 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.324 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.324 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.324 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.324 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.324 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.325 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.325 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.325 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: Upgrade: Finalizing container_image settings 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.326 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T00:59:33.327 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T00:59:33.328 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T00:59:33.329 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T00:59:33.329 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T00:59:33.330 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T00:59:33.331 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T00:59:33.331 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T00:59:33.331 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T00:59:33.331 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T00:59:33.331 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: pgmap v258: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.332 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.333 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.333 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: Upgrade: Complete! 2024-09-16T00:59:33.333 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T00:59:33.333 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T00:59:33.333 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.334 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.334 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.334 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.334 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.334 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.335 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.335 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.448 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.449 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: Upgrade: Finalizing container_image settings 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T00:59:33.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: pgmap v258: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T00:59:33.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: Upgrade: Complete! 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T00:59:33.452 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T00:59:33.453 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:35 smithi053 ceph-mon[77492]: pgmap v259: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:35.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:35 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:35 smithi152 ceph-mon[63606]: pgmap v259: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:35 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T00:59:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 -- 172.21.15.53:0/591573204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf300ff140 msgr2=0x7faf300ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 --2- 172.21.15.53:0/591573204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf300ff140 0x7faf300ff550 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009910 tx=0x7faf2c009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 -- 172.21.15.53:0/591573204 shutdown_connections 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 --2- 172.21.15.53:0/591573204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf30100340 0x7faf30100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 --2- 172.21.15.53:0/591573204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf300ff140 0x7faf300ff550 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.752+0000 7faf38650700 1 -- 172.21.15.53:0/591573204 >> 172.21.15.53:0/591573204 conn(0x7faf300fa6d0 msgr2=0x7faf300fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 -- 172.21.15.53:0/591573204 shutdown_connections 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 -- 172.21.15.53:0/591573204 wait complete. 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 Processor -- start 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 -- start start 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 0x7faf30197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf30198850 con 0x7faf30100340 2024-09-16T00:59:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.753+0000 7faf38650700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3019d260 con 0x7faf300ff140 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40194/0 (socket says 172.21.15.53:40194) 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 -- 172.21.15.53:0/1834627281 learned_addr learned my addr 172.21.15.53:0/1834627281 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf363ec700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 0x7faf30197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 -- 172.21.15.53:0/1834627281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 msgr2=0x7faf30197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 0x7faf30197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 -- 172.21.15.53:0/1834627281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0095f0 con 0x7faf30100340 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf363ec700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 0x7faf30197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf35beb700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d8d0 tx=0x7faf2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf20009940 con 0x7faf30100340 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf20010460 con 0x7faf30100340 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3019d460 con 0x7faf30100340 2024-09-16T00:59:36.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf2000f5f0 con 0x7faf30100340 2024-09-16T00:59:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.754+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3019d980 con 0x7faf30100340 2024-09-16T00:59:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.755+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf30107c90 con 0x7faf30100340 2024-09-16T00:59:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.756+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faf200105d0 con 0x7faf30100340 2024-09-16T00:59:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.756+0000 7faf277fe700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 0x7faf1c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:36.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.757+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faf2008e6a0 con 0x7faf30100340 2024-09-16T00:59:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.757+0000 7faf363ec700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 0x7faf1c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:36.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.757+0000 7faf363ec700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 0x7faf1c070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005090 tx=0x7faf2c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:36.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.761+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faf200577f0 con 0x7faf30100340 2024-09-16T00:59:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:36.999+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf30069500 con 0x7faf1c06e680 2024-09-16T00:59:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.000+0000 7faf277fe700 1 -- 172.21.15.53:0/1834627281 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7faf30069500 con 0x7faf1c06e680 2024-09-16T00:59:37.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.002+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 msgr2=0x7faf1c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 0x7faf1c070b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005090 tx=0x7faf2c005a90 comp rx=0 tx=0).stop 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 msgr2=0x7faf30198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d8d0 tx=0x7faf2000dc90 comp rx=0 tx=0).stop 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 shutdown_connections 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faf1c06e680 0x7faf1c070b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf300ff140 0x7faf30197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 --2- 172.21.15.53:0/1834627281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf30100340 0x7faf30198230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 >> 172.21.15.53:0/1834627281 conn(0x7faf300fa6d0 msgr2=0x7faf30068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 shutdown_connections 2024-09-16T00:59:37.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:37.003+0000 7faf38650700 1 -- 172.21.15.53:0/1834627281 wait complete. 2024-09-16T00:59:37.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:37 smithi053 ceph-mon[77492]: pgmap v260: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:37 smithi152 ceph-mon[63606]: pgmap v260: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:37.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch ps' 2024-09-16T00:59:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:38.502 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:38 smithi053 ceph-mon[77492]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:38.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:38 smithi152 ceph-mon[63606]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:39 smithi053 ceph-mon[77492]: pgmap v261: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:39 smithi152 ceph-mon[63606]: pgmap v261: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:39.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3158045117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea41004e0 msgr2=0x7fcea41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3158045117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea41004e0 0x7fcea41008b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b0a0 tx=0x7fce9400b3b0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3158045117 shutdown_connections 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3158045117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea4100e80 0x7fcea4104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3158045117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea41004e0 0x7fcea41008b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3158045117 >> 172.21.15.53:0/3158045117 conn(0x7fcea40fbda0 msgr2=0x7fcea40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3158045117 shutdown_connections 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.941+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3158045117 wait complete. 2024-09-16T00:59:39.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 Processor -- start 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 -- start start 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea41004e0 0x7fcea4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4196bb0 con 0x7fcea4100e80 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fceaa0e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea419a940 con 0x7fcea41004e0 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.942+0000 7fcea2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40204/0 (socket says 172.21.15.53:40204) 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 -- 172.21.15.53:0/3491863741 learned_addr learned my addr 172.21.15.53:0/3491863741 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea37fe700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea41004e0 0x7fcea4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 -- 172.21.15.53:0/3491863741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea41004e0 msgr2=0x7fcea4195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea41004e0 0x7fcea4195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 -- 172.21.15.53:0/3491863741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009d00 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea2ffd700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00b480 tx=0x7fce8c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c0118c0 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce8c010380 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea419ac20 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8c00f4f0 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.943+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea419b170 con 0x7fcea4100e80 2024-09-16T00:59:39.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.944+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea41087f0 con 0x7fcea4100e80 2024-09-16T00:59:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.945+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fce8c0104f0 con 0x7fcea4100e80 2024-09-16T00:59:39.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.945+0000 7fcea0ff9700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 0x7fce90070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.945+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fce8c08e250 con 0x7fcea4100e80 2024-09-16T00:59:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.945+0000 7fcea37fe700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 0x7fce90070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:39.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.946+0000 7fcea37fe700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 0x7fce90070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b830 tx=0x7fce94006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:39.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:39.950+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce8c057420 con 0x7fcea4100e80 2024-09-16T00:59:40.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.174+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea419b4b0 con 0x7fce9006e680 2024-09-16T00:59:40.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.184+0000 7fcea0ff9700 1 -- 172.21.15.53:0/3491863741 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcea419b4b0 con 0x7fce9006e680 2024-09-16T00:59:40.185 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T00:59:40.185 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (40s) 12s ago 17m 16.0M - 0.25.0 c8568f914cd2 aab246f97a6c 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (94s) 12s ago 17m 8493k - 19.1.1-326-g8921c8ef f1455bd0219c 27ec8d819f1b 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (89s) 70s ago 16m 7926k - 19.1.1-326-g8921c8ef f1455bd0219c 45e31ae13fa5 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (6m) 12s ago 17m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (6m) 70s ago 16m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (17s) 12s ago 17m 48.2M - 9.4.12 2bacad6d85d8 2ccf112bd515 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (2m) 12s ago 12m 84.6M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (2m) 12s ago 11m 82.4M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (2m) 70s ago 11m 16.5M - 19.1.1-326-g8921c8ef f1455bd0219c 6295ee41ddf4 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (108s) 70s ago 11m 16.3M - 19.1.1-326-g8921c8ef f1455bd0219c 830ba4e1f636 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (8m) 12s ago 19m 515M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (7m) 70s ago 16m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T00:59:40.186 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (7m) 12s ago 19m 59.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (7m) 70s ago 16m 43.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (76s) 12s ago 17m 16.7M - 1.5.0 0da6a335fe13 1bb5870b7a15 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (72s) 70s ago 16m 3380k - 1.5.0 0da6a335fe13 4d2a6f52f049 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (6m) 12s ago 15m 115M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (5m) 12s ago 15m 122M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (4m) 12s ago 14m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (4m) 70s ago 14m 129M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (3m) 70s ago 13m 118M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (3m) 70s ago 13m 103M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T00:59:40.187 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (56s) 12s ago 17m 66.9M - 2.43.0 a07b618ecd1d f82c97fc52c3 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 msgr2=0x7fce90070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 0x7fce90070b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b830 tx=0x7fce94006000 comp rx=0 tx=0).stop 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 msgr2=0x7fcea41964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00b480 tx=0x7fce8c00b840 comp rx=0 tx=0).stop 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 shutdown_connections 2024-09-16T00:59:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fce9006e680 0x7fce90070b30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea41004e0 0x7fcea4195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 --2- 172.21.15.53:0/3491863741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4100e80 0x7fcea41964d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 >> 172.21.15.53:0/3491863741 conn(0x7fcea40fbda0 msgr2=0x7fcea40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 shutdown_connections 2024-09-16T00:59:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:40.187+0000 7fceaa0e7700 1 -- 172.21.15.53:0/3491863741 wait complete. 2024-09-16T00:59:41.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch upgrade status' 2024-09-16T00:59:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:41.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:41 smithi053 ceph-mon[77492]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:41.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:41 smithi053 ceph-mon[77492]: pgmap v262: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:41 smithi152 ceph-mon[63606]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:41 smithi152 ceph-mon[63606]: pgmap v262: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:43.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 -- 172.21.15.53:0/1406186299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101420 msgr2=0x7fe0381017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/1406186299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101420 0x7fe0381017f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe028009910 tx=0x7fe028009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:43.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 -- 172.21.15.53:0/1406186299 shutdown_connections 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/1406186299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101d30 0x7fe03810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/1406186299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101420 0x7fe0381017f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 -- 172.21.15.53:0/1406186299 >> 172.21.15.53:0/1406186299 conn(0x7fe0380fac80 msgr2=0x7fe0380fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 -- 172.21.15.53:0/1406186299 shutdown_connections 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.119+0000 7fe03d9ba700 1 -- 172.21.15.53:0/1406186299 wait complete. 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 Processor -- start 2024-09-16T00:59:43.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 -- start start 2024-09-16T00:59:43.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101420 0x7fe038195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038196a90 con 0x7fe038101d30 2024-09-16T00:59:43.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe03d9ba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03819a820 con 0x7fe038101420 2024-09-16T00:59:43.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe02e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe02e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54102/0 (socket says 172.21.15.53:54102) 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe02e7fc700 1 -- 172.21.15.53:0/23462740 learned_addr learned my addr 172.21.15.53:0/23462740 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.120+0000 7fe036ffd700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101420 0x7fe038195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe02e7fc700 1 -- 172.21.15.53:0/23462740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101420 msgr2=0x7fe038195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe02e7fc700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101420 0x7fe038195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe02e7fc700 1 -- 172.21.15.53:0/23462740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280095f0 con 0x7fe038101d30 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe02e7fc700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d900 tx=0x7fe02000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe020004a00 con 0x7fe038101d30 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0200054e0 con 0x7fe038101d30 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03819ab00 con 0x7fe038101d30 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe020009d00 con 0x7fe038101d30 2024-09-16T00:59:43.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.121+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03819b050 con 0x7fe038101d30 2024-09-16T00:59:43.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.122+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0381078d0 con 0x7fe038101d30 2024-09-16T00:59:43.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.124+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe020005000 con 0x7fe038101d30 2024-09-16T00:59:43.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.124+0000 7fe03c9b8700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 0x7fe024070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:43.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.124+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe02008ea80 con 0x7fe038101d30 2024-09-16T00:59:43.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.124+0000 7fe036ffd700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 0x7fe024070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:43.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.125+0000 7fe036ffd700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 0x7fe024070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe028006010 tx=0x7fe02801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:43.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.128+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe020057c30 con 0x7fe038101d30 2024-09-16T00:59:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.364+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe03819b330 con 0x7fe02406e680 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.365+0000 7fe03c9b8700 1 -- 172.21.15.53:0/23462740 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe03819b330 con 0x7fe02406e680 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stdout: "target_image": null, 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stdout: "in_progress": false, 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stdout: "which": "", 2024-09-16T00:59:43.366 INFO:teuthology.orchestra.run.smithi053.stdout: "services_complete": [], 2024-09-16T00:59:43.367 INFO:teuthology.orchestra.run.smithi053.stdout: "progress": null, 2024-09-16T00:59:43.367 INFO:teuthology.orchestra.run.smithi053.stdout: "message": "", 2024-09-16T00:59:43.367 INFO:teuthology.orchestra.run.smithi053.stdout: "is_paused": false 2024-09-16T00:59:43.367 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 msgr2=0x7fe024070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 0x7fe024070b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe028006010 tx=0x7fe02801a040 comp rx=0 tx=0).stop 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 msgr2=0x7fe0381963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d900 tx=0x7fe02000dc10 comp rx=0 tx=0).stop 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 shutdown_connections 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe02406e680 0x7fe024070b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe038101420 0x7fe038195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 --2- 172.21.15.53:0/23462740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe038101d30 0x7fe0381963b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 >> 172.21.15.53:0/23462740 conn(0x7fe0380fac80 msgr2=0x7fe038104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 shutdown_connections 2024-09-16T00:59:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:43.368+0000 7fe03d9ba700 1 -- 172.21.15.53:0/23462740 wait complete. 2024-09-16T00:59:43.380 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:43 smithi053 ceph-mon[77492]: pgmap v263: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:43 smithi152 ceph-mon[63606]: pgmap v263: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:44.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph health detail' 2024-09-16T00:59:44.308 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:44.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:45 smithi053 ceph-mon[77492]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:45.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:45 smithi053 ceph-mon[77492]: pgmap v264: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:45 smithi152 ceph-mon[63606]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T00:59:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:45 smithi152 ceph-mon[63606]: pgmap v264: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:47.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:47 smithi152 ceph-mon[63606]: pgmap v265: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:47.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:47 smithi053 ceph-mon[77492]: pgmap v265: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:48.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 -- 172.21.15.53:0/460392195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 msgr2=0x7f234c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 --2- 172.21.15.53:0/460392195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f233c009910 tx=0x7f233c009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:48.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 -- 172.21.15.53:0/460392195 shutdown_connections 2024-09-16T00:59:48.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 --2- 172.21.15.53:0/460392195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 --2- 172.21.15.53:0/460392195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 0x7f234c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 -- 172.21.15.53:0/460392195 >> 172.21.15.53:0/460392195 conn(0x7f234c075130 msgr2=0x7f234c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 -- 172.21.15.53:0/460392195 shutdown_connections 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.804+0000 7f2354650700 1 -- 172.21.15.53:0/460392195 wait complete. 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 Processor -- start 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 -- start start 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 0x7f234c101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1018b0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.805+0000 7f2354650700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1019f0 con 0x7f234c104130 2024-09-16T00:59:48.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54112/0 (socket says 172.21.15.53:54112) 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 -- 172.21.15.53:0/559589261 learned_addr learned my addr 172.21.15.53:0/559589261 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f2351beb700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 0x7f234c101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 -- 172.21.15.53:0/559589261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 msgr2=0x7f234c101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 0x7f234c101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 -- 172.21.15.53:0/559589261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0095f0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23523ec700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f234800c8a0 tx=0x7f234800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234800cea0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2348004830 con 0x7f234c0ffbd0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c1a1ff0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23480055b0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.806+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c1a2400 con 0x7f234c0ffbd0 2024-09-16T00:59:48.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.807+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c1086a0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.808+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f23480049a0 con 0x7f234c0ffbd0 2024-09-16T00:59:48.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.808+0000 7f23437fe700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 0x7f2338070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:48.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.809+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f234808e270 con 0x7f234c0ffbd0 2024-09-16T00:59:48.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.809+0000 7f2351beb700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 0x7f2338070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:48.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.809+0000 7f2351beb700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 0x7f2338070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f233c000c00 tx=0x7f233c005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:48.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:48.813+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2348057440 con 0x7f234c0ffbd0 2024-09-16T00:59:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.117+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f234c108080 con 0x7f234c0ffbd0 2024-09-16T00:59:49.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.117+0000 7f23437fe700 1 -- 172.21.15.53:0/559589261 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f234801d020 con 0x7f234c0ffbd0 2024-09-16T00:59:49.118 INFO:teuthology.orchestra.run.smithi053.stdout:HEALTH_OK 2024-09-16T00:59:49.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.119+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 msgr2=0x7f2338070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.119+0000 7f2354650700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 0x7f2338070b30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f233c000c00 tx=0x7f233c005fb0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 msgr2=0x7f234c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f234800c8a0 tx=0x7f234800cc60 comp rx=0 tx=0).stop 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 shutdown_connections 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f233806e680 0x7f2338070b30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f234c0ffbd0 0x7f234c100e30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 --2- 172.21.15.53:0/559589261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f234c104130 0x7f234c101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 >> 172.21.15.53:0/559589261 conn(0x7f234c075130 msgr2=0x7f234c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 shutdown_connections 2024-09-16T00:59:49.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:49.120+0000 7f2354650700 1 -- 172.21.15.53:0/559589261 wait complete. 2024-09-16T00:59:49.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:49 smithi053 ceph-mon[77492]: pgmap v266: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:49.463 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:49 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/559589261' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:59:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:49 smithi152 ceph-mon[63606]: pgmap v266: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:49 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/559589261' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T00:59:49.910 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions' 2024-09-16T00:59:50.132 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:51.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:51 smithi053 ceph-mon[77492]: pgmap v267: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:51 smithi152 ceph-mon[63606]: pgmap v267: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 -- 172.21.15.53:0/723299272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 msgr2=0x7f9f78104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/723299272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78104e50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009910 tx=0x7f9f60009c20 comp rx=0 tx=0).stop 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 -- 172.21.15.53:0/723299272 shutdown_connections 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/723299272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78104e50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/723299272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 0x7f9f781008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 -- 172.21.15.53:0/723299272 >> 172.21.15.53:0/723299272 conn(0x7f9f780fbda0 msgr2=0x7f9f780fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 -- 172.21.15.53:0/723299272 shutdown_connections 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.866+0000 7f9f7ec45700 1 -- 172.21.15.53:0/723299272 wait complete. 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 Processor -- start 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 -- start start 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 0x7f9f78195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78196b30 con 0x7f9f78100e80 2024-09-16T00:59:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f7ec45700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7819a8c0 con 0x7f9f781004e0 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f77fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f77fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54136/0 (socket says 172.21.15.53:54136) 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.867+0000 7f9f77fff700 1 -- 172.21.15.53:0/3618437717 learned_addr learned my addr 172.21.15.53:0/3618437717 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f7c9e1700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 0x7f9f78195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f77fff700 1 -- 172.21.15.53:0/3618437717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 msgr2=0x7f9f78195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f77fff700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 0x7f9f78195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f77fff700 1 -- 172.21.15.53:0/3618437717 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600095f0 con 0x7f9f78100e80 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f77fff700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000bda0 tx=0x7f9f6000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6001d070 con 0x7f9f78100e80 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f60004fb0 con 0x7f9f78100e80 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7819ab40 con 0x7f9f78100e80 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6000f480 con 0x7f9f78100e80 2024-09-16T00:59:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.868+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7819b030 con 0x7f9f78100e80 2024-09-16T00:59:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.869+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f78108850 con 0x7f9f78100e80 2024-09-16T00:59:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.870+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9f60022870 con 0x7f9f78100e80 2024-09-16T00:59:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.870+0000 7f9f75ffb700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 0x7f9f64070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T00:59:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.870+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9f6008fb30 con 0x7f9f78100e80 2024-09-16T00:59:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.870+0000 7f9f7c9e1700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 0x7f9f64070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T00:59:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.871+0000 7f9f7c9e1700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 0x7f9f64070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005fd0 tx=0x7f9f6800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T00:59:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:51.875+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f60058db0 con 0x7f9f78100e80 2024-09-16T00:59:52.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.178+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f78197270 con 0x7f9f78100e80 2024-09-16T00:59:52.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.179+0000 7f9f75ffb700 1 -- 172.21.15.53:0/3618437717 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f9f6005c470 con 0x7f9f78100e80 2024-09-16T00:59:52.181 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T00:59:52.181 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T00:59:52.181 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:59:52.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:52.182 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T00:59:52.182 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T00:59:52.182 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T00:59:52.183 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T00:59:52.184 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T00:59:52.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.181+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 msgr2=0x7f9f64070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.181+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 0x7f9f64070b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005fd0 tx=0x7f9f6800a560 comp rx=0 tx=0).stop 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.181+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 msgr2=0x7f9f78196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.181+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000bda0 tx=0x7f9f6000be80 comp rx=0 tx=0).stop 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 shutdown_connections 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9f6406e680 0x7f9f64070b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f781004e0 0x7f9f78195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 --2- 172.21.15.53:0/3618437717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f78100e80 0x7f9f78196450 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 >> 172.21.15.53:0/3618437717 conn(0x7f9f780fbda0 msgr2=0x7f9f780fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 shutdown_connections 2024-09-16T00:59:52.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T00:59:52.182+0000 7f9f7ec45700 1 -- 172.21.15.53:0/3618437717 wait complete. 2024-09-16T00:59:52.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:52 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3618437717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:52.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:52 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3618437717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T00:59:52.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-16T00:59:53.121 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:53.509 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:53 smithi053 ceph-mon[77492]: pgmap v268: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:53 smithi152 ceph-mon[63606]: pgmap v268: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:54.850 INFO:teuthology.orchestra.run.smithi053.stdout:wait for servicemap items w/ changing names to refresh 2024-09-16T00:59:55.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:55 smithi053 ceph-mon[77492]: pgmap v269: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:55.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'sleep 60' 2024-09-16T00:59:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:55 smithi152 ceph-mon[63606]: pgmap v269: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:55.852 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T00:59:57.610 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:57 smithi053 ceph-mon[77492]: pgmap v270: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:57 smithi152 ceph-mon[63606]: pgmap v270: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T00:59:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:59 smithi152 ceph-mon[63606]: pgmap v271: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 00:59:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T00:59:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:59 smithi053 ceph-mon[77492]: pgmap v271: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T00:59:59.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 00:59:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:00 smithi152 ceph-mon[63606]: overall HEALTH_OK 2024-09-16T01:00:00.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:00 smithi053 ceph-mon[77492]: overall HEALTH_OK 2024-09-16T01:00:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:01 smithi152 ceph-mon[63606]: pgmap v272: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:01.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:01 smithi053 ceph-mon[77492]: pgmap v272: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:03.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:03 smithi053 ceph-mon[77492]: pgmap v273: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:03 smithi152 ceph-mon[63606]: pgmap v273: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:05 smithi152 ceph-mon[63606]: pgmap v274: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:05.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:05 smithi053 ceph-mon[77492]: pgmap v274: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:07 smithi152 ceph-mon[63606]: pgmap v275: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:07.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:07 smithi053 ceph-mon[77492]: pgmap v275: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:09 smithi152 ceph-mon[63606]: pgmap v276: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:09.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:09 smithi053 ceph-mon[77492]: pgmap v276: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:11 smithi152 ceph-mon[63606]: pgmap v277: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:11.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:11 smithi053 ceph-mon[77492]: pgmap v277: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:13.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:13 smithi053 ceph-mon[77492]: pgmap v278: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:13 smithi152 ceph-mon[63606]: pgmap v278: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:14.712 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:15 smithi152 ceph-mon[63606]: pgmap v279: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:15.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:15 smithi053 ceph-mon[77492]: pgmap v279: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:16.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:16 smithi152 ceph-mon[63606]: pgmap v280: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:16.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:16 smithi053 ceph-mon[77492]: pgmap v280: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:19.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:19 smithi053 ceph-mon[77492]: pgmap v281: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:19 smithi152 ceph-mon[63606]: pgmap v281: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:21 smithi053 ceph-mon[77492]: pgmap v282: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:21 smithi152 ceph-mon[63606]: pgmap v282: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:23 smithi053 ceph-mon[77492]: pgmap v283: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:23 smithi152 ceph-mon[63606]: pgmap v283: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:25 smithi053 ceph-mon[77492]: pgmap v284: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:25 smithi152 ceph-mon[63606]: pgmap v284: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:27.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:27 smithi053 ceph-mon[77492]: pgmap v285: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:27 smithi152 ceph-mon[63606]: pgmap v285: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:29 smithi053 ceph-mon[77492]: pgmap v286: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:29.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:29 smithi152 ceph-mon[63606]: pgmap v286: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:31 smithi152 ceph-mon[63606]: pgmap v287: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:31.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:31 smithi053 ceph-mon[77492]: pgmap v287: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:33.622 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:33 smithi053 ceph-mon[77492]: pgmap v288: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:33.622 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:33.622 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:33.623 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:33.623 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T01:00:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:33 smithi152 ceph-mon[63606]: pgmap v288: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:00:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:00:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:00:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T01:00:35.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:35 smithi152 ceph-mon[63606]: pgmap v289: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:35.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:35 smithi053 ceph-mon[77492]: pgmap v289: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:37 smithi152 ceph-mon[63606]: pgmap v290: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:37.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:37 smithi053 ceph-mon[77492]: pgmap v290: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:39 smithi152 ceph-mon[63606]: pgmap v291: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:39.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:39 smithi053 ceph-mon[77492]: pgmap v291: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:41 smithi152 ceph-mon[63606]: pgmap v292: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:41.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:41 smithi053 ceph-mon[77492]: pgmap v292: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:43 smithi152 ceph-mon[63606]: pgmap v293: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:43.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:43 smithi053 ceph-mon[77492]: pgmap v293: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:44.710 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:45 smithi152 ceph-mon[63606]: pgmap v294: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:45.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:45 smithi053 ceph-mon[77492]: pgmap v294: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:47 smithi152 ceph-mon[63606]: pgmap v295: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:47.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:47 smithi053 ceph-mon[77492]: pgmap v295: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:49 smithi152 ceph-mon[63606]: pgmap v296: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:49.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:49 smithi053 ceph-mon[77492]: pgmap v296: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:51 smithi152 ceph-mon[63606]: pgmap v297: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:51.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:51 smithi053 ceph-mon[77492]: pgmap v297: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:53 smithi152 ceph-mon[63606]: pgmap v298: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:53.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:53 smithi053 ceph-mon[77492]: pgmap v298: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:55 smithi152 ceph-mon[63606]: pgmap v299: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:55 smithi053 ceph-mon[77492]: pgmap v299: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:57 smithi152 ceph-mon[63606]: pgmap v300: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:57.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:57 smithi053 ceph-mon[77492]: pgmap v300: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:00:58.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph orch ps' 2024-09-16T01:00:58.456 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:00:59.453 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:59 smithi053 ceph-mon[77492]: pgmap v301: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:59.453 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:00:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:00:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:59 smithi152 ceph-mon[63606]: pgmap v301: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:00:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:00:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:00.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 -- 172.21.15.53:0/66506055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100ed0 msgr2=0x7f1f90104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/66506055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100ed0 0x7f1f90104ea0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009910 tx=0x7f1f84009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:00.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 -- 172.21.15.53:0/66506055 shutdown_connections 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/66506055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100ed0 0x7f1f90104ea0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/66506055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100530 0x7f1f90100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 -- 172.21.15.53:0/66506055 >> 172.21.15.53:0/66506055 conn(0x7f1f900fbe10 msgr2=0x7f1f900fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 -- 172.21.15.53:0/66506055 shutdown_connections 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.508+0000 7f1f94cf8700 1 -- 172.21.15.53:0/66506055 wait complete. 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 Processor -- start 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 -- start start 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100ed0 0x7f1f90196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90196b10 con 0x7f1f90100530 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f94cf8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9019a8a0 con 0x7f1f90100ed0 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55076/0 (socket says 172.21.15.53:55076) 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8e59c700 1 -- 172.21.15.53:0/1202896605 learned_addr learned my addr 172.21.15.53:0/1202896605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8dd9b700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100ed0 0x7f1f90196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8e59c700 1 -- 172.21.15.53:0/1202896605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100ed0 msgr2=0x7f1f90196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.509+0000 7f1f8e59c700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100ed0 0x7f1f90196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f8e59c700 1 -- 172.21.15.53:0/1202896605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840095f0 con 0x7f1f90100530 2024-09-16T01:01:00.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f8e59c700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d8d0 tx=0x7f1f8000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:00.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f80009940 con 0x7f1f90100530 2024-09-16T01:01:00.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f80010460 con 0x7f1f90100530 2024-09-16T01:01:00.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9019ab80 con 0x7f1f90100530 2024-09-16T01:01:00.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8000f5f0 con 0x7f1f90100530 2024-09-16T01:01:00.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.510+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9019b0d0 con 0x7f1f90100530 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.511+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f901088a0 con 0x7f1f90100530 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.512+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1f800105d0 con 0x7f1f90100530 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.512+0000 7f1f7f7fe700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 0x7f1f78070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.512+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1f8008e6d0 con 0x7f1f90100530 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.513+0000 7f1f8dd9b700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 0x7f1f78070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:00.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.513+0000 7f1f8dd9b700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 0x7f1f78070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f90197510 tx=0x7f1f8401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:00.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.517+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1f80057820 con 0x7f1f90100530 2024-09-16T01:01:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.745+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 --> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f9019b2f0 con 0x7f1f7806e680 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.754+0000 7f1f7f7fe700 1 -- 172.21.15.53:0/1202896605 <== mgr.34104 v2:172.21.15.53:6800/1189751573 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f1f9019b2f0 con 0x7f1f7806e680 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.smithi053 smithi053 *:9093,9094 running (2m) 92s ago 18m 16.0M - 0.25.0 c8568f914cd2 aab246f97a6c 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi053 smithi053 running (2m) 92s ago 19m 8493k - 19.1.1-326-g8921c8ef f1455bd0219c 27ec8d819f1b 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-exporter.smithi152 smithi152 running (2m) 2m ago 18m 7926k - 19.1.1-326-g8921c8ef f1455bd0219c 45e31ae13fa5 2024-09-16T01:01:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi053 smithi053 running (7m) 92s ago 19m 6895k - 19.1.1-326-g8921c8ef f1455bd0219c 4bd2b98987d6 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:crash.smithi152 smithi152 running (7m) 2m ago 18m 6899k - 19.1.1-326-g8921c8ef f1455bd0219c e4de95890431 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.smithi053 smithi053 *:3000 running (97s) 92s ago 18m 48.2M - 9.4.12 2bacad6d85d8 2ccf112bd515 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.cdsuag smithi053 running (4m) 92s ago 13m 84.6M - 19.1.1-326-g8921c8ef f1455bd0219c 92918faa0094 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi053.jsdknu smithi053 running (3m) 92s ago 13m 82.4M - 19.1.1-326-g8921c8ef f1455bd0219c 31d9d574d25c 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.gatezw smithi152 running (3m) 2m ago 13m 16.5M - 19.1.1-326-g8921c8ef f1455bd0219c 6295ee41ddf4 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mds.cephfs.smithi152.ocdywv smithi152 running (3m) 2m ago 13m 16.3M - 19.1.1-326-g8921c8ef f1455bd0219c 830ba4e1f636 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi053.cjiiek smithi053 *:8443,9283,8765 running (10m) 92s ago 20m 515M - 19.1.1-326-g8921c8ef f1455bd0219c 485f20a8ceda 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.smithi152.nlmwrx smithi152 *:8443,9283,8765 running (9m) 2m ago 17m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 16c468143cc4 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi053 smithi053 running (8m) 92s ago 20m 59.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e4bf16c85251 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:mon.smithi152 smithi152 running (8m) 2m ago 17m 43.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2521499d6cab 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi053 smithi053 *:9100 running (2m) 92s ago 19m 16.7M - 1.5.0 0da6a335fe13 1bb5870b7a15 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 2m ago 18m 3380k - 1.5.0 0da6a335fe13 4d2a6f52f049 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (7m) 92s ago 17m 115M 1217M 19.1.1-326-g8921c8ef f1455bd0219c b2f531c703f7 2024-09-16T01:01:00.756 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (6m) 92s ago 16m 122M 1217M 19.1.1-326-g8921c8ef f1455bd0219c 4bfbceabcb0c 2024-09-16T01:01:00.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (6m) 92s ago 16m 105M 1217M 19.1.1-326-g8921c8ef f1455bd0219c d1d60bda6021 2024-09-16T01:01:00.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi152 running (5m) 2m ago 15m 129M 2240M 19.1.1-326-g8921c8ef f1455bd0219c f67a3bbb671d 2024-09-16T01:01:00.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi152 running (5m) 2m ago 15m 118M 2240M 19.1.1-326-g8921c8ef f1455bd0219c 872bbbf946b9 2024-09-16T01:01:00.757 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi152 running (4m) 2m ago 14m 103M 2240M 19.1.1-326-g8921c8ef f1455bd0219c b153302d1456 2024-09-16T01:01:00.757 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.smithi053 smithi053 *:9095 running (2m) 92s ago 18m 66.9M - 2.43.0 a07b618ecd1d f82c97fc52c3 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 msgr2=0x7f1f78070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 0x7f1f78070b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f90197510 tx=0x7f1f8401a040 comp rx=0 tx=0).stop 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 msgr2=0x7f1f90195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d8d0 tx=0x7f1f8000dc90 comp rx=0 tx=0).stop 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 shutdown_connections 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f1f7806e680 0x7f1f78070b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f90100530 0x7f1f90195ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 --2- 172.21.15.53:0/1202896605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f90100ed0 0x7f1f90196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.756+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 >> 172.21.15.53:0/1202896605 conn(0x7f1f900fbe10 msgr2=0x7f1f900fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.757+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 shutdown_connections 2024-09-16T01:01:00.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:00.757+0000 7f1f94cf8700 1 -- 172.21.15.53:0/1202896605 wait complete. 2024-09-16T01:01:01.410 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:01 smithi053 ceph-mon[77492]: pgmap v302: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:01.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions' 2024-09-16T01:01:01.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:01 smithi152 ceph-mon[63606]: pgmap v302: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:01.646 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:02 smithi053 ceph-mon[77492]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:02.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:02 smithi053 ceph-mon[77492]: pgmap v303: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:02 smithi152 ceph-mon[63606]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:01:02.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:02 smithi152 ceph-mon[63606]: pgmap v303: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 -- 172.21.15.53:0/1414074668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 msgr2=0x7f179c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1414074668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c100890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b0a0 tx=0x7f178c00b3b0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 -- 172.21.15.53:0/1414074668 shutdown_connections 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1414074668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 0x7f179c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1414074668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c100890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 -- 172.21.15.53:0/1414074668 >> 172.21.15.53:0/1414074668 conn(0x7f179c0fbd80 msgr2=0x7f179c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:03.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 -- 172.21.15.53:0/1414074668 shutdown_connections 2024-09-16T01:01:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.694+0000 7f17a19b9700 1 -- 172.21.15.53:0/1414074668 wait complete. 2024-09-16T01:01:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 Processor -- start 2024-09-16T01:01:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 -- start start 2024-09-16T01:01:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 0x7f179c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c073ad0 con 0x7f179c1004c0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f17a19b9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c073c10 con 0x7f179c100e60 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f179affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f179affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48124/0 (socket says 172.21.15.53:48124) 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f179affd700 1 -- 172.21.15.53:0/1167157653 learned_addr learned my addr 172.21.15.53:0/1167157653 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.695+0000 7f179a7fc700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 0x7f179c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f179affd700 1 -- 172.21.15.53:0/1167157653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 msgr2=0x7f179c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f179affd700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 0x7f179c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f179affd700 1 -- 172.21.15.53:0/1167157653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009d00 con 0x7f179c1004c0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f179affd700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f80 tx=0x7f178c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c00e040 con 0x7f179c1004c0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c073e90 con 0x7f179c1004c0 2024-09-16T01:01:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f178c003de0 con 0x7f179c1004c0 2024-09-16T01:01:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c01d7d0 con 0x7f179c1004c0 2024-09-16T01:01:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.696+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c1a2490 con 0x7f179c1004c0 2024-09-16T01:01:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.697+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c1087d0 con 0x7f179c1004c0 2024-09-16T01:01:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.698+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f178c004040 con 0x7f179c1004c0 2024-09-16T01:01:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.698+0000 7f17a09b7700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 0x7f1784070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.698+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f178c08ffd0 con 0x7f179c1004c0 2024-09-16T01:01:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.698+0000 7f179a7fc700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 0x7f1784070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.699+0000 7f179a7fc700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 0x7f1784070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f179c074840 tx=0x7f1790009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:03.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:03.703+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f178c059120 con 0x7f179c1004c0 2024-09-16T01:01:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.007+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f179c04f2a0 con 0x7f179c1004c0 2024-09-16T01:01:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.008+0000 7f17a09b7700 1 -- 172.21.15.53:0/1167157653 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f178c05c7e0 con 0x7f179c1004c0 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": { 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": { 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 2 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": { 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 6 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 4 2024-09-16T01:01:04.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-16T01:01:04.010 INFO:teuthology.orchestra.run.smithi053.stdout: "overall": { 2024-09-16T01:01:04.010 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)": 14 2024-09-16T01:01:04.010 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-16T01:01:04.010 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 msgr2=0x7f1784070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 0x7f1784070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f179c074840 tx=0x7f1790009190 comp rx=0 tx=0).stop 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 msgr2=0x7f179c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f80 tx=0x7f178c00cd20 comp rx=0 tx=0).stop 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 shutdown_connections 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f178406e680 0x7f1784070b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f179c1004c0 0x7f179c073050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 --2- 172.21.15.53:0/1167157653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f179c100e60 0x7f179c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 >> 172.21.15.53:0/1167157653 conn(0x7f179c0fbd80 msgr2=0x7f179c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 shutdown_connections 2024-09-16T01:01:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:04.010+0000 7f17a19b9700 1 -- 172.21.15.53:0/1167157653 wait complete. 2024-09-16T01:01:04.258 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:04 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1167157653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:04.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:04 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1167157653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:04.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-16T01:01:04.928 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:05.301 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:05 smithi053 ceph-mon[77492]: pgmap v304: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:05.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:05 smithi152 ceph-mon[63606]: pgmap v304: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2026539761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 msgr2=0x7fd2c41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2026539761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41094d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009910 tx=0x7fd2b8009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2026539761 shutdown_connections 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2026539761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41094d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2026539761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 0x7fd2c4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2026539761 >> 172.21.15.53:0/2026539761 conn(0x7fd2c40748b0 msgr2=0x7fd2c4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2026539761 shutdown_connections 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.692+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2026539761 wait complete. 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 Processor -- start 2024-09-16T01:01:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 -- start start 2024-09-16T01:01:06.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 0x7fd2c4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4196a80 con 0x7fd2c4100d70 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2ca5cc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c419a810 con 0x7fd2c4100460 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48142/0 (socket says 172.21.15.53:48142) 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2c37fe700 1 -- 172.21.15.53:0/2109643079 learned_addr learned my addr 172.21.15.53:0/2109643079 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.693+0000 7fd2c3fff700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 0x7fd2c4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c37fe700 1 -- 172.21.15.53:0/2109643079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 msgr2=0x7fd2c4195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c37fe700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 0x7fd2c4195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c37fe700 1 -- 172.21.15.53:0/2109643079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80095f0 con 0x7fd2c4100d70 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c37fe700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80092e0 tx=0x7fd2b800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b801d070 con 0x7fd2c4100d70 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c419aaf0 con 0x7fd2c4100d70 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2b8005e00 con 0x7fd2c4100d70 2024-09-16T01:01:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b8017400 con 0x7fd2c4100d70 2024-09-16T01:01:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.694+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c419b040 con 0x7fd2c4100d70 2024-09-16T01:01:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.695+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c4107e40 con 0x7fd2c4100d70 2024-09-16T01:01:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.696+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd2b800f6f0 con 0x7fd2c4100d70 2024-09-16T01:01:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.696+0000 7fd2c17fa700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 0x7fd2ac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.696+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd2b808fb30 con 0x7fd2c4100d70 2024-09-16T01:01:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.696+0000 7fd2c3fff700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 0x7fd2ac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.697+0000 7fd2c3fff700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 0x7fd2ac070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4005950 tx=0x7fd2b400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:06.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:06.703+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd2b8058c80 con 0x7fd2c4100d70 2024-09-16T01:01:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.003+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2c4197260 con 0x7fd2c4100d70 2024-09-16T01:01:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.004+0000 7fd2c17fa700 1 -- 172.21.15.53:0/2109643079 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd2b805c340 con 0x7fd2c4100d70 2024-09-16T01:01:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 msgr2=0x7fd2ac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 0x7fd2ac070b30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4005950 tx=0x7fd2b400b410 comp rx=0 tx=0).stop 2024-09-16T01:01:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 msgr2=0x7fd2c41963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80092e0 tx=0x7fd2b800bd70 comp rx=0 tx=0).stop 2024-09-16T01:01:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 shutdown_connections 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fd2ac06e680 0x7fd2ac070b30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2c4100460 0x7fd2c4195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 --2- 172.21.15.53:0/2109643079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2c4100d70 0x7fd2c41963a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 >> 172.21.15.53:0/2109643079 conn(0x7fd2c40748b0 msgr2=0x7fd2c40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 shutdown_connections 2024-09-16T01:01:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:07.006+0000 7fd2ca5cc700 1 -- 172.21.15.53:0/2109643079 wait complete. 2024-09-16T01:01:07.017 INFO:teuthology.orchestra.run.smithi053.stdout:true 2024-09-16T01:01:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:07 smithi053 ceph-mon[77492]: pgmap v305: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:07.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:07 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2109643079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:07 smithi152 ceph-mon[63606]: pgmap v305: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:07 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2109643079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:07.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -e sha1=8921c8ef947807b717db041d85f0761b7914d5fc -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-16T01:01:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:09.541 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:09 smithi053 ceph-mon[77492]: pgmap v306: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:09 smithi152 ceph-mon[63606]: pgmap v306: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 -- 172.21.15.53:0/2703104525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101c10 msgr2=0x7faa1c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 --2- 172.21.15.53:0/2703104525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101c10 0x7faa1c10a2e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa10009910 tx=0x7faa10009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 -- 172.21.15.53:0/2703104525 shutdown_connections 2024-09-16T01:01:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 --2- 172.21.15.53:0/2703104525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101c10 0x7faa1c10a2e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 --2- 172.21.15.53:0/2703104525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101300 0x7faa1c1016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 -- 172.21.15.53:0/2703104525 >> 172.21.15.53:0/2703104525 conn(0x7faa1c0fac90 msgr2=0x7faa1c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 -- 172.21.15.53:0/2703104525 shutdown_connections 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 -- 172.21.15.53:0/2703104525 wait complete. 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.795+0000 7faa21d74700 1 Processor -- start 2024-09-16T01:01:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa21d74700 1 -- start start 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa21d74700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa21d74700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101c10 0x7faa1c196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa21d74700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c196af0 con 0x7faa1c101300 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa21d74700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c19a880 con 0x7faa1c101c10 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48162/0 (socket says 172.21.15.53:48162) 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa1b7fe700 1 -- 172.21.15.53:0/537386304 learned_addr learned my addr 172.21.15.53:0/537386304 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.796+0000 7faa1affd700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101c10 0x7faa1c196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa1b7fe700 1 -- 172.21.15.53:0/537386304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101c10 msgr2=0x7faa1c196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa1b7fe700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101c10 0x7faa1c196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa1b7fe700 1 -- 172.21.15.53:0/537386304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100095f0 con 0x7faa1c101300 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa1b7fe700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c8a0 tx=0x7faa0c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0c0078e0 con 0x7faa1c101300 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c19ab60 con 0x7faa1c101300 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa0c00f450 con 0x7faa1c101300 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0c00e5e0 con 0x7faa1c101300 2024-09-16T01:01:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.797+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c19b0b0 con 0x7faa1c101300 2024-09-16T01:01:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.798+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c1079e0 con 0x7faa1c101300 2024-09-16T01:01:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.799+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faa0c00f5c0 con 0x7faa1c101300 2024-09-16T01:01:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.799+0000 7faa18ff9700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 0x7faa04070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.799+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faa0c08e6e0 con 0x7faa1c101300 2024-09-16T01:01:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.799+0000 7faa1affd700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 0x7faa04070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:09.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.800+0000 7faa1affd700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 0x7faa04070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa1c1974f0 tx=0x7faa1000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:09.803+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faa0c057830 con 0x7faa1c101300 2024-09-16T01:01:10.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.105+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa1c19b2d0 con 0x7faa1c101300 2024-09-16T01:01:10.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.106+0000 7faa18ff9700 1 -- 172.21.15.53:0/537386304 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7faa0c05aef0 con 0x7faa1c101300 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 msgr2=0x7faa04070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 0x7faa04070b30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa1c1974f0 tx=0x7faa1000b540 comp rx=0 tx=0).stop 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 msgr2=0x7faa1c195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c8a0 tx=0x7faa0c00cbb0 comp rx=0 tx=0).stop 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 shutdown_connections 2024-09-16T01:01:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7faa0406e680 0x7faa04070b30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa1c101300 0x7faa1c195ed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 --2- 172.21.15.53:0/537386304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa1c101c10 0x7faa1c196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 >> 172.21.15.53:0/537386304 conn(0x7faa1c0fac90 msgr2=0x7faa1c104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 shutdown_connections 2024-09-16T01:01:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:10.108+0000 7faa21d74700 1 -- 172.21.15.53:0/537386304 wait complete. 2024-09-16T01:01:10.120 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)" 2024-09-16T01:01:10.420 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:10 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/537386304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:10 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/537386304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T01:01:10.735 DEBUG:teuthology.parallel:result is None 2024-09-16T01:01:10.735 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:01:10.750 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T01:01:10.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T01:01:10.960 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:11.364 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:11 smithi053 ceph-mon[77492]: pgmap v307: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:11.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:11 smithi152 ceph-mon[63606]: pgmap v307: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:12.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 -- 172.21.15.53:0/1820201831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 msgr2=0x7fea1810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1820201831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea1810a2d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009910 tx=0x7fea0c009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 -- 172.21.15.53:0/1820201831 shutdown_connections 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1820201831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea1810a2d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1820201831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 0x7fea181016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 -- 172.21.15.53:0/1820201831 >> 172.21.15.53:0/1820201831 conn(0x7fea180fac80 msgr2=0x7fea180fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 -- 172.21.15.53:0/1820201831 shutdown_connections 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.674+0000 7fea1cf42700 1 -- 172.21.15.53:0/1820201831 wait complete. 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 Processor -- start 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 -- start start 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 0x7fea18195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18196aa0 con 0x7fea18101c90 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea1cf42700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1819a830 con 0x7fea181012f0 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea15d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea15d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57512/0 (socket says 172.21.15.53:57512) 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.675+0000 7fea15d9b700 1 -- 172.21.15.53:0/1419671120 learned_addr learned my addr 172.21.15.53:0/1419671120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea1659c700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 0x7fea18195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea15d9b700 1 -- 172.21.15.53:0/1419671120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 msgr2=0x7fea18195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea15d9b700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 0x7fea18195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea15d9b700 1 -- 172.21.15.53:0/1419671120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0095f0 con 0x7fea18101c90 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea15d9b700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c010 tx=0x7fea0c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c01d070 con 0x7fea18101c90 2024-09-16T01:01:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea0c0052a0 con 0x7fea18101c90 2024-09-16T01:01:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0c022470 con 0x7fea18101c90 2024-09-16T01:01:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1819aab0 con 0x7fea18101c90 2024-09-16T01:01:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.676+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1819ae90 con 0x7fea18101c90 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.677+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea181079d0 con 0x7fea18101c90 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.678+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fea0c00f820 con 0x7fea18101c90 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.678+0000 7fea077fe700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 0x7fea00070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.678+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fea0c08fbc0 con 0x7fea18101c90 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.678+0000 7fea1659c700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 0x7fea00070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.679+0000 7fea1659c700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 0x7fea00070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea08009bf0 tx=0x7fea08009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:12.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.683+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea0c058d10 con 0x7fea18101c90 2024-09-16T01:01:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.946+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fea1802cc30 con 0x7fea18101c90 2024-09-16T01:01:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.947+0000 7fea077fe700 1 -- 172.21.15.53:0/1419671120 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+2001 (secure 0 0 0) 0x7fea0c05c3d0 con 0x7fea18101c90 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:e39 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:btime 2024-09-16T00:57:59:582615+0000 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:legacy client fscid: 1 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:Filesystem 'cephfs' (1) 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:fs_name cephfs 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 39 2024-09-16T01:01:12.948 INFO:teuthology.orchestra.run.smithi053.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-16T00:47:35.714216+0000 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:modified 2024-09-16T00:57:59.582608+0000 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:tableserver 0 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:root 0 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:session_timeout 60 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:session_autoclose 300 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:max_file_size 1099511627776 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:max_xattr_size 65536 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:required_client_features {} 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure 0 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:last_failure_osd_epoch 85 2024-09-16T01:01:12.949 INFO:teuthology.orchestra.run.smithi053.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:max_mds 1 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:in 0 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:up {0=34382} 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:failed 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:damaged 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:stopped 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:data_pools [3] 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:metadata_pool 2 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:inline_data disabled 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:balancer 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:bal_rank_mask -1 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:standby_count_wanted 1 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:qdb_cluster leader: 34382 members: 34382 2024-09-16T01:01:12.950 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.cdsuag{0:34382} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.53:6826/1815483431,v1:172.21.15.53:6827/1815483431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi053.jsdknu{0:34414} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.53:6828/953088818,v1:172.21.15.53:6829/953088818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout:Standby daemons: 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.gatezw{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1770820177,v1:172.21.15.152:6825/1770820177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:01:12.951 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.cephfs.smithi152.ocdywv{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/219767319,v1:172.21.15.152:6827/219767319] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 msgr2=0x7fea00070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 0x7fea00070b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea08009bf0 tx=0x7fea08009260 comp rx=0 tx=0).stop 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 msgr2=0x7fea181963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c010 tx=0x7fea0c00b660 comp rx=0 tx=0).stop 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 shutdown_connections 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fea0006e680 0x7fea00070b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea181012f0 0x7fea18195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 --2- 172.21.15.53:0/1419671120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea18101c90 0x7fea181963c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 >> 172.21.15.53:0/1419671120 conn(0x7fea180fac80 msgr2=0x7fea18104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 shutdown_connections 2024-09-16T01:01:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:12.949+0000 7fea1cf42700 1 -- 172.21.15.53:0/1419671120 wait complete. 2024-09-16T01:01:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-16T01:01:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:13 smithi152 ceph-mon[63606]: pgmap v308: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:13.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:13 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1419671120' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:01:13.708 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:13 smithi053 ceph-mon[77492]: pgmap v308: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:13.708 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:13 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1419671120' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:01:13.736 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-16T01:01:13.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:01:13.968 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:14.711 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:15.424 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:15 smithi053 ceph-mon[77492]: pgmap v309: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 -- 172.21.15.53:0/1774435008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 msgr2=0x7f2980104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 --2- 172.21.15.53:0/1774435008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980104e50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2974009910 tx=0x7f2974009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 -- 172.21.15.53:0/1774435008 shutdown_connections 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 --2- 172.21.15.53:0/1774435008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980104e50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 --2- 172.21.15.53:0/1774435008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 0x7f29801008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 -- 172.21.15.53:0/1774435008 >> 172.21.15.53:0/1774435008 conn(0x7f29800fbda0 msgr2=0x7f29800fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 -- 172.21.15.53:0/1774435008 shutdown_connections 2024-09-16T01:01:15.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.682+0000 7f2987c12700 1 -- 172.21.15.53:0/1774435008 wait complete. 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 Processor -- start 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 -- start start 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 0x7f2980195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2980196b30 con 0x7f2980100e80 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f2987c12700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298019a8c0 con 0x7f29801004e0 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29851ad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29851ad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57532/0 (socket says 172.21.15.53:57532) 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29851ad700 1 -- 172.21.15.53:0/1384588165 learned_addr learned my addr 172.21.15.53:0/1384588165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29859ae700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 0x7f2980195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29851ad700 1 -- 172.21.15.53:0/1384588165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 msgr2=0x7f2980195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.683+0000 7f29851ad700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 0x7f2980195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f29851ad700 1 -- 172.21.15.53:0/1384588165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740095f0 con 0x7f2980100e80 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f29851ad700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2974005f50 tx=0x7f297400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297401d070 con 0x7f2980100e80 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298019ab40 con 0x7f2980100e80 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f297400f460 con 0x7f2980100e80 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2974017630 con 0x7f2980100e80 2024-09-16T01:01:15.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.684+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298019b030 con 0x7f2980100e80 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.685+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980108850 con 0x7f2980100e80 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.686+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f297400f5d0 con 0x7f2980100e80 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.686+0000 7f297effd700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 0x7f2968070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.686+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f297408fcd0 con 0x7f2980100e80 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.686+0000 7f29859ae700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 0x7f2968070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.687+0000 7f29859ae700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 0x7f2968070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29700060b0 tx=0x7f2970007b80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.691+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2974058e20 con 0x7f2980100e80 2024-09-16T01:01:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:15 smithi152 ceph-mon[63606]: pgmap v309: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:15.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.949+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2980108230 con 0x7f2980100e80 2024-09-16T01:01:15.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.949+0000 7f297effd700 1 -- 172.21.15.53:0/1384588165 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+5257 (secure 0 0 0) 0x7f297405c4e0 con 0x7f2980100e80 2024-09-16T01:01:15.950 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:15.950 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"btime":"2024-09-16T00:57:59:582615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44345,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/219767319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":219767319},{"type":"v1","addr":"172.21.15.152:6827","nonce":219767319}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:59.582608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:active","state_seq":19,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34414":{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34382,"qdb_cluster":[34382]},"id":1}]} 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 msgr2=0x7f2968070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 0x7f2968070b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29700060b0 tx=0x7f2970007b80 comp rx=0 tx=0).stop 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 msgr2=0x7f2980196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2974005f50 tx=0x7f297400be20 comp rx=0 tx=0).stop 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 shutdown_connections 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f296806e680 0x7f2968070b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29801004e0 0x7f2980195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 --2- 172.21.15.53:0/1384588165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2980100e80 0x7f2980196450 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 >> 172.21.15.53:0/1384588165 conn(0x7f29800fbda0 msgr2=0x7f29800fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 shutdown_connections 2024-09-16T01:01:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:15.952+0000 7f2987c12700 1 -- 172.21.15.53:0/1384588165 wait complete. 2024-09-16T01:01:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-16T01:01:16.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:16 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1384588165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:16.612 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-16T01:01:16.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-16T01:01:16.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:16 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1384588165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:01:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:17.570 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:17 smithi053 ceph-mon[77492]: pgmap v310: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:17 smithi152 ceph-mon[63606]: pgmap v310: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:18.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 -- 172.21.15.53:0/3135414182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101d20 msgr2=0x7fdef410a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 --2- 172.21.15.53:0/3135414182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101d20 0x7fdef410a220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009910 tx=0x7fdee8009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 -- 172.21.15.53:0/3135414182 shutdown_connections 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 --2- 172.21.15.53:0/3135414182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101d20 0x7fdef410a220 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 --2- 172.21.15.53:0/3135414182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101410 0x7fdef41017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 -- 172.21.15.53:0/3135414182 >> 172.21.15.53:0/3135414182 conn(0x7fdef40fac90 msgr2=0x7fdef40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 -- 172.21.15.53:0/3135414182 shutdown_connections 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.586+0000 7fdef9532700 1 -- 172.21.15.53:0/3135414182 wait complete. 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 Processor -- start 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 -- start start 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101d20 0x7fdef4196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4196c00 con 0x7fdef4101410 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef9532700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef419a990 con 0x7fdef4101d20 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57548/0 (socket says 172.21.15.53:57548) 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.587+0000 7fdef2ffd700 1 -- 172.21.15.53:0/57201982 learned_addr learned my addr 172.21.15.53:0/57201982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef27fc700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101d20 0x7fdef4196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef2ffd700 1 -- 172.21.15.53:0/57201982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101d20 msgr2=0x7fdef4196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef2ffd700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101d20 0x7fdef4196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef2ffd700 1 -- 172.21.15.53:0/57201982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80095f0 con 0x7fdef4101410 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef2ffd700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b4b0 tx=0x7fdee400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee4011800 con 0x7fdef4101410 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdee4011e20 con 0x7fdef4101410 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee400f2e0 con 0x7fdef4101410 2024-09-16T01:01:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef419ac70 con 0x7fdef4101410 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.588+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef419b1c0 con 0x7fdef4101410 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.589+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4107890 con 0x7fdef4101410 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.589+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdee4010380 con 0x7fdef4101410 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.590+0000 7fdedbfff700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 0x7fdedc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.590+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdee408e280 con 0x7fdef4101410 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.590+0000 7fdef27fc700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 0x7fdedc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.590+0000 7fdef27fc700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 0x7fdedc070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdee80059d0 tx=0x7fdee801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:18.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.594+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdee40573d0 con 0x7fdef4101410 2024-09-16T01:01:18.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.857+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fdef404f2a0 con 0x7fdef4101410 2024-09-16T01:01:18.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.858+0000 7fdedbfff700 1 -- 172.21.15.53:0/57201982 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v39) v1 ==== 107+0+4132 (secure 0 0 0) 0x7fdee405aa90 con 0x7fdef4101410 2024-09-16T01:01:18.860 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:18.860 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":17,"btime":"2024-09-16T00:56:33:198664+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:33.198658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6827/239552761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":239552761},{"type":"v1","addr":"172.21.15.53:6827","nonce":239552761}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-16T01:01:18.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 msgr2=0x7fdedc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 0x7fdedc070b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdee80059d0 tx=0x7fdee801a040 comp rx=0 tx=0).stop 2024-09-16T01:01:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 msgr2=0x7fdef4195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b4b0 tx=0x7fdee400b870 comp rx=0 tx=0).stop 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 shutdown_connections 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdedc06e680 0x7fdedc070b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef4101410 0x7fdef4195fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 --2- 172.21.15.53:0/57201982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdef4101d20 0x7fdef4196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 >> 172.21.15.53:0/57201982 conn(0x7fdef40fac90 msgr2=0x7fdef41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 shutdown_connections 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:18.861+0000 7fdef9532700 1 -- 172.21.15.53:0/57201982 wait complete. 2024-09-16T01:01:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 17 2024-09-16T01:01:19.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:19 smithi053 ceph-mon[77492]: pgmap v311: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:19.520 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:19 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/57201982' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-16T01:01:19.552 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-16T01:01:19.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-16T01:01:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:19 smithi152 ceph-mon[63606]: pgmap v311: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:19.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:19 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/57201982' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-16T01:01:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.469+0000 7f6cd4356700 1 -- 172.21.15.53:0/2614807077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc104130 msgr2=0x7f6ccc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.469+0000 7f6cd4356700 1 --2- 172.21.15.53:0/2614807077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc104130 0x7f6ccc104500 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009910 tx=0x7f6cc8009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 -- 172.21.15.53:0/2614807077 shutdown_connections 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 --2- 172.21.15.53:0/2614807077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 --2- 172.21.15.53:0/2614807077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc104130 0x7f6ccc104500 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 -- 172.21.15.53:0/2614807077 >> 172.21.15.53:0/2614807077 conn(0x7f6ccc075130 msgr2=0x7f6ccc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 -- 172.21.15.53:0/2614807077 shutdown_connections 2024-09-16T01:01:21.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.470+0000 7f6cd4356700 1 -- 172.21.15.53:0/2614807077 wait complete. 2024-09-16T01:01:21.472 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:21 smithi053 ceph-mon[77492]: pgmap v312: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 Processor -- start 2024-09-16T01:01:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 -- start start 2024-09-16T01:01:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 0x7f6ccc106550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc106a90 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd4356700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc106bd0 con 0x7f6ccc104130 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd20f2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd20f2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57568/0 (socket says 172.21.15.53:57568) 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd20f2700 1 -- 172.21.15.53:0/1251509479 learned_addr learned my addr 172.21.15.53:0/1251509479 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd18f1700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 0x7f6ccc106550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd20f2700 1 -- 172.21.15.53:0/1251509479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 msgr2=0x7f6ccc106550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.471+0000 7f6cd20f2700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 0x7f6ccc106550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cd20f2700 1 -- 172.21.15.53:0/1251509479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80095f0 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cd18f1700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 0x7f6ccc106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cd20f2700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc801d070 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cc800f460 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc106e50 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc8017630 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.472+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc1a2320 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.473+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc102500 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.474+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6cc800f5d0 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.474+0000 7f6cc37fe700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 0x7f6cb8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.475+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6cc808fb70 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.475+0000 7f6cd18f1700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 0x7f6cb8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.475+0000 7f6cd18f1700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 0x7f6cb8070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc005950 tx=0x7f6cbc0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:21.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.479+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6cc8058d80 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:21 smithi152 ceph-mon[63606]: pgmap v312: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:21.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.741+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f6ccc107640 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.742+0000 7f6cc37fe700 1 -- 172.21.15.53:0/1251509479 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v39) v1 ==== 107+0+4908 (secure 0 0 0) 0x7f6cc805c440 con 0x7f6ccc0ffbd0 2024-09-16T01:01:21.742 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:21.743 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"btime":"2024-09-16T00:56:34:229318+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:33.198658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6827/239552761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":239552761},{"type":"v1","addr":"172.21.15.53:6827","nonce":239552761}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 msgr2=0x7f6cb8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 0x7f6cb8070b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc005950 tx=0x7f6cbc0058e0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 msgr2=0x7f6ccc106010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8006010 tx=0x7f6cc800be20 comp rx=0 tx=0).stop 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 shutdown_connections 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6cb806e680 0x7f6cb8070b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ccc0ffbd0 0x7f6ccc106010 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 --2- 172.21.15.53:0/1251509479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ccc104130 0x7f6ccc106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 >> 172.21.15.53:0/1251509479 conn(0x7f6ccc075130 msgr2=0x7f6ccc108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 shutdown_connections 2024-09-16T01:01:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:21.744+0000 7f6cd4356700 1 -- 172.21.15.53:0/1251509479 wait complete. 2024-09-16T01:01:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 18 2024-09-16T01:01:22.409 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:22 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1251509479' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-16T01:01:22.435 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-16T01:01:22.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-16T01:01:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:22.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:22 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1251509479' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-16T01:01:23.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:23 smithi053 ceph-mon[77492]: pgmap v313: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:23.674 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:23 smithi152 ceph-mon[63606]: pgmap v313: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:24.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 -- 172.21.15.53:0/1885957915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c00ff350 msgr2=0x7f29c00ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:24.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/1885957915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c00ff350 0x7f29c00ff7c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f29b400aa20 tx=0x7f29b400ad30 comp rx=0 tx=0).stop 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 -- 172.21.15.53:0/1885957915 shutdown_connections 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/1885957915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c00ff350 0x7f29c00ff7c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/1885957915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c01038b0 0x7f29c0103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 -- 172.21.15.53:0/1885957915 >> 172.21.15.53:0/1885957915 conn(0x7f29c00748b0 msgr2=0x7f29c0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 -- 172.21.15.53:0/1885957915 shutdown_connections 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.568+0000 7f29c6a7e700 1 -- 172.21.15.53:0/1885957915 wait complete. 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 Processor -- start 2024-09-16T01:01:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 -- start start 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 0x7f29c0195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0196a80 con 0x7f29c01038b0 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c6a7e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c019a810 con 0x7f29c00ff350 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29bffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29bffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54654/0 (socket says 172.21.15.53:54654) 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29bffff700 1 -- 172.21.15.53:0/3694983639 learned_addr learned my addr 172.21.15.53:0/3694983639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.569+0000 7f29c481a700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 0x7f29c0195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bffff700 1 -- 172.21.15.53:0/3694983639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 msgr2=0x7f29c0195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bffff700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 0x7f29c0195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bffff700 1 -- 172.21.15.53:0/3694983639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b400a700 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29c481a700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 0x7f29c0195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bffff700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006010 tx=0x7f29b4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b4004bf0 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c019aa90 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29b4004d50 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b40168c0 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.570+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c019af80 con 0x7f29c01038b0 2024-09-16T01:01:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.571+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0108e30 con 0x7f29c01038b0 2024-09-16T01:01:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.572+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f29b4016b00 con 0x7f29c01038b0 2024-09-16T01:01:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.572+0000 7f29bdffb700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 0x7f29a8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.572+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f29b4012070 con 0x7f29c01038b0 2024-09-16T01:01:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.572+0000 7f29c481a700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 0x7f29a8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:24.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.573+0000 7f29c481a700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 0x7f29a8070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005fd0 tx=0x7f29b0005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:24.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.577+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f29b40598a0 con 0x7f29c01038b0 2024-09-16T01:01:24.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.838+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f29c0197260 con 0x7f29c01038b0 2024-09-16T01:01:24.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.839+0000 7f29bdffb700 1 -- 172.21.15.53:0/3694983639 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v39) v1 ==== 107+0+4114 (secure 0 0 0) 0x7f29b4059020 con 0x7f29c01038b0 2024-09-16T01:01:24.840 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:24.840 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"btime":"2024-09-16T00:56:37:112747+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:37.112745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:24.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 msgr2=0x7f29a8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:24.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 0x7f29a8070b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29b0005fd0 tx=0x7f29b0005ee0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 msgr2=0x7f29c01963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006010 tx=0x7f29b4005720 comp rx=0 tx=0).stop 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 shutdown_connections 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f29a806e680 0x7f29a8070b30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29c00ff350 0x7f29c0195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 --2- 172.21.15.53:0/3694983639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c01038b0 0x7f29c01963a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.841+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 >> 172.21.15.53:0/3694983639 conn(0x7f29c00748b0 msgr2=0x7f29c0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.842+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 shutdown_connections 2024-09-16T01:01:24.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:24.842+0000 7f29c6a7e700 1 -- 172.21.15.53:0/3694983639 wait complete. 2024-09-16T01:01:24.844 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 19 2024-09-16T01:01:25.481 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:25 smithi053 ceph-mon[77492]: pgmap v314: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:25.481 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:25 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3694983639' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-16T01:01:25.505 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-16T01:01:25.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-16T01:01:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:25 smithi152 ceph-mon[63606]: pgmap v314: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:25 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3694983639' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-16T01:01:25.716 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:27.451 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:27 smithi053 ceph-mon[77492]: pgmap v315: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- 172.21.15.53:0/13222168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01101004e0 msgr2=0x7f01101008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 --2- 172.21.15.53:0/13222168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01101004e0 0x7f01101008b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0104009910 tx=0x7f0104009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- 172.21.15.53:0/13222168 shutdown_connections 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 --2- 172.21.15.53:0/13222168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0110100e80 0x7f0110104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 --2- 172.21.15.53:0/13222168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01101004e0 0x7f01101008b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- 172.21.15.53:0/13222168 >> 172.21.15.53:0/13222168 conn(0x7f01100fbda0 msgr2=0x7f01100fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- 172.21.15.53:0/13222168 shutdown_connections 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- 172.21.15.53:0/13222168 wait complete. 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 Processor -- start 2024-09-16T01:01:27.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.450+0000 7f0117237700 1 -- start start 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f0117237700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01101004e0 0x7f01101980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f0117237700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f0117237700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110198d10 con 0x7f0110100e80 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f0117237700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011019caa0 con 0x7f01101004e0 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54670/0 (socket says 172.21.15.53:54670) 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 -- 172.21.15.53:0/3723157361 learned_addr learned my addr 172.21.15.53:0/3723157361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f0114fd3700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01101004e0 0x7f01101980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 -- 172.21.15.53:0/3723157361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01101004e0 msgr2=0x7f01101980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01101004e0 0x7f01101980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 -- 172.21.15.53:0/3723157361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040095f0 con 0x7f0110100e80 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010ffff700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c8f0 tx=0x7f00fc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00fc0078a0 con 0x7f0110100e80 2024-09-16T01:01:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00fc00f450 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.451+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00fc018610 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.452+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011019cd80 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.452+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011019d2d0 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.453+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01101045d0 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.453+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f00fc00f5c0 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.454+0000 7f010dffb700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 0x7f0100070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.454+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f00fc08e590 con 0x7f0110100e80 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.454+0000 7f0114fd3700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 0x7f0100070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.454+0000 7f0114fd3700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 0x7f0100070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0104006010 tx=0x7f010401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.458+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f00fc057760 con 0x7f0110100e80 2024-09-16T01:01:27.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:27 smithi152 ceph-mon[63606]: pgmap v315: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:27.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.720+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f01101994f0 con 0x7f0110100e80 2024-09-16T01:01:27.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.720+0000 7f010dffb700 1 -- 172.21.15.53:0/3723157361 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v39) v1 ==== 107+0+4125 (secure 0 0 0) 0x7f00fc05ae20 con 0x7f0110100e80 2024-09-16T01:01:27.721 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:27.721 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"btime":"2024-09-16T00:56:37:117305+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:37.117290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:replay","state_seq":3,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.722+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 msgr2=0x7f0100070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.722+0000 7f0117237700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 0x7f0100070b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0104006010 tx=0x7f010401a040 comp rx=0 tx=0).stop 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.722+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 msgr2=0x7f0110198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.722+0000 7f0117237700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c8f0 tx=0x7f00fc00cc00 comp rx=0 tx=0).stop 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 shutdown_connections 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f010006e680 0x7f0100070b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01101004e0 0x7f01101980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 --2- 172.21.15.53:0/3723157361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0110100e80 0x7f0110198630 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 >> 172.21.15.53:0/3723157361 conn(0x7f01100fbda0 msgr2=0x7f01100fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 shutdown_connections 2024-09-16T01:01:27.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:27.723+0000 7f0117237700 1 -- 172.21.15.53:0/3723157361 wait complete. 2024-09-16T01:01:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2024-09-16T01:01:28.394 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-16T01:01:28.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-16T01:01:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:28 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3723157361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-16T01:01:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:28 smithi053 ceph-mon[77492]: pgmap v316: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:28.604 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:28 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3723157361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-16T01:01:28.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:28 smithi152 ceph-mon[63606]: pgmap v316: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:29.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:29 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:29.701 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:29 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:30.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 -- 172.21.15.53:0/1827320103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 msgr2=0x7fee48103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 --2- 172.21.15.53:0/1827320103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48103d30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee30009910 tx=0x7fee30009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:30.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 -- 172.21.15.53:0/1827320103 shutdown_connections 2024-09-16T01:01:30.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 --2- 172.21.15.53:0/1827320103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48103d30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 --2- 172.21.15.53:0/1827320103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 0x7fee480ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 -- 172.21.15.53:0/1827320103 >> 172.21.15.53:0/1827320103 conn(0x7fee480fac80 msgr2=0x7fee480fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 -- 172.21.15.53:0/1827320103 shutdown_connections 2024-09-16T01:01:30.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.279+0000 7fee4d40a700 1 -- 172.21.15.53:0/1827320103 wait complete. 2024-09-16T01:01:30.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.280+0000 7fee4d40a700 1 Processor -- start 2024-09-16T01:01:30.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.280+0000 7fee4d40a700 1 -- start start 2024-09-16T01:01:30.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.280+0000 7fee4d40a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 0x7fee48196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee4d40a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee4d40a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48196c20 con 0x7fee480ffd60 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee4d40a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4819a940 con 0x7fee480ff3c0 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54702/0 (socket says 172.21.15.53:54702) 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 -- 172.21.15.53:0/3616983507 learned_addr learned my addr 172.21.15.53:0/3616983507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee46ffd700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 0x7fee48196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 -- 172.21.15.53:0/3616983507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 msgr2=0x7fee48196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 0x7fee48196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 -- 172.21.15.53:0/3616983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300095f0 con 0x7fee480ffd60 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.281+0000 7fee467fc700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee3000bda0 tx=0x7fee3000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.282+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3001d070 con 0x7fee480ffd60 2024-09-16T01:01:30.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.282+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4819abc0 con 0x7fee480ffd60 2024-09-16T01:01:30.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.282+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee3000f460 con 0x7fee480ffd60 2024-09-16T01:01:30.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.282+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee30017630 con 0x7fee480ffd60 2024-09-16T01:01:30.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.282+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4819b0b0 con 0x7fee480ffd60 2024-09-16T01:01:30.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.283+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4804f2a0 con 0x7fee480ffd60 2024-09-16T01:01:30.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.283+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fee30003a60 con 0x7fee480ffd60 2024-09-16T01:01:30.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.284+0000 7fee3ffff700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 0x7fee34070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:30.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.284+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fee3008fb60 con 0x7fee480ffd60 2024-09-16T01:01:30.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.284+0000 7fee46ffd700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 0x7fee34070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:30.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.284+0000 7fee46ffd700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 0x7fee34070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee38009a10 tx=0x7fee38009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:30.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.288+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee30058cb0 con 0x7fee480ffd60 2024-09-16T01:01:30.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.551+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fee4819b2d0 con 0x7fee480ffd60 2024-09-16T01:01:30.552 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:30 smithi053 ceph-mon[77492]: pgmap v317: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.551+0000 7fee3ffff700 1 -- 172.21.15.53:0/3616983507 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v39) v1 ==== 107+0+4130 (secure 0 0 0) 0x7fee3005c370 con 0x7fee480ffd60 2024-09-16T01:01:30.553 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:30.553 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":21,"btime":"2024-09-16T00:56:46:217408+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:45.288540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":137,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 msgr2=0x7fee34070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 0x7fee34070b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee38009a10 tx=0x7fee38009190 comp rx=0 tx=0).stop 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 msgr2=0x7fee48196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fee3000bda0 tx=0x7fee3000bdd0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 shutdown_connections 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fee3406e680 0x7fee34070b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee480ff3c0 0x7fee48196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 --2- 172.21.15.53:0/3616983507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee480ffd60 0x7fee48196540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 >> 172.21.15.53:0/3616983507 conn(0x7fee480fac80 msgr2=0x7fee481034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 shutdown_connections 2024-09-16T01:01:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:30.554+0000 7fee4d40a700 1 -- 172.21.15.53:0/3616983507 wait complete. 2024-09-16T01:01:30.556 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 21 2024-09-16T01:01:30.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:30 smithi152 ceph-mon[63606]: pgmap v317: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:31.263 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-16T01:01:31.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-16T01:01:31.481 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:31.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:31 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3616983507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-16T01:01:31.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:31 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3616983507' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-16T01:01:32.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:32 smithi053 ceph-mon[77492]: pgmap v318: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:32.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:32 smithi152 ceph-mon[63606]: pgmap v318: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:33.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.157+0000 7f437e090700 1 -- 172.21.15.53:0/3657359687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 msgr2=0x7f43780ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.157+0000 7f437e090700 1 --2- 172.21.15.53:0/3657359687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f43780ff780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4368009910 tx=0x7f4368009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:33.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 -- 172.21.15.53:0/3657359687 shutdown_connections 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 --2- 172.21.15.53:0/3657359687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 0x7f4378103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 --2- 172.21.15.53:0/3657359687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f43780ff780 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 -- 172.21.15.53:0/3657359687 >> 172.21.15.53:0/3657359687 conn(0x7f43780fac90 msgr2=0x7f43780fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 -- 172.21.15.53:0/3657359687 shutdown_connections 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 -- 172.21.15.53:0/3657359687 wait complete. 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 Processor -- start 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.158+0000 7f437e090700 1 -- start start 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f437e090700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f437e090700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 0x7f4378101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f437e090700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378101840 con 0x7f43780ff3b0 2024-09-16T01:01:33.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f437e090700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378101980 con 0x7f43780ffd50 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59892/0 (socket says 172.21.15.53:59892) 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 -- 172.21.15.53:0/3556962194 learned_addr learned my addr 172.21.15.53:0/3556962194 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f4376ffd700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 0x7f4378101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 -- 172.21.15.53:0/3556962194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 msgr2=0x7f4378101300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 0x7f4378101300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 -- 172.21.15.53:0/3556962194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680095f0 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.159+0000 7f43777fe700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4368006010 tx=0x7f436800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.160+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436801d070 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.160+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4368004fb0 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.160+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4378101c00 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.160+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4368022ea0 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.160+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43781a2350 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.161+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43781086d0 con 0x7f43780ff3b0 2024-09-16T01:01:33.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.161+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4368022470 con 0x7f43780ff3b0 2024-09-16T01:01:33.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.162+0000 7f4374ff9700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 0x7f4360070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:33.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.162+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f436808fb40 con 0x7f43780ff3b0 2024-09-16T01:01:33.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.162+0000 7f4376ffd700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 0x7f4360070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:33.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.162+0000 7f4376ffd700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 0x7f4360070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f436c005fd0 tx=0x7f436c00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:33.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.166+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4368058ee0 con 0x7f43780ff3b0 2024-09-16T01:01:33.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.430+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f4378102390 con 0x7f43780ff3b0 2024-09-16T01:01:33.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.431+0000 7f4374ff9700 1 -- 172.21.15.53:0/3556962194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v39) v1 ==== 107+0+4127 (secure 0 0 0) 0x7f4368027090 con 0x7f43780ff3b0 2024-09-16T01:01:33.433 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:33.433 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"btime":"2024-09-16T00:56:47:222342+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:46.224754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":138,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 msgr2=0x7f4360070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 0x7f4360070b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f436c005fd0 tx=0x7f436c00a560 comp rx=0 tx=0).stop 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 msgr2=0x7f4378100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4368006010 tx=0x7f436800be20 comp rx=0 tx=0).stop 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 shutdown_connections 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f436006e680 0x7f4360070b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43780ff3b0 0x7f4378100dc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 --2- 172.21.15.53:0/3556962194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43780ffd50 0x7f4378101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 >> 172.21.15.53:0/3556962194 conn(0x7f43780fac90 msgr2=0x7f4378069130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 shutdown_connections 2024-09-16T01:01:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:33.434+0000 7f437e090700 1 -- 172.21.15.53:0/3556962194 wait complete. 2024-09-16T01:01:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 22 2024-09-16T01:01:33.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:33 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:33.798 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:33 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:01:34.153 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-16T01:01:34.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-16T01:01:34.361 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:34.675 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:34 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3556962194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-16T01:01:34.675 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:34.676 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:34.676 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:34 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T01:01:34.676 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:34 smithi053 ceph-mon[77492]: pgmap v319: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:34 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3556962194' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-16T01:01:34.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:01:34.701 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:01:34.701 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:34 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' 2024-09-16T01:01:34.701 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:34 smithi152 ceph-mon[63606]: pgmap v319: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 -- 172.21.15.53:0/3302071390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4184100e80 msgr2=0x7f4184104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 --2- 172.21.15.53:0/3302071390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4184100e80 0x7f4184104e50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4178009910 tx=0x7f4178009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 -- 172.21.15.53:0/3302071390 shutdown_connections 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 --2- 172.21.15.53:0/3302071390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4184100e80 0x7f4184104e50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 --2- 172.21.15.53:0/3302071390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41841004e0 0x7f41841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 -- 172.21.15.53:0/3302071390 >> 172.21.15.53:0/3302071390 conn(0x7f41840fbda0 msgr2=0x7f41840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 -- 172.21.15.53:0/3302071390 shutdown_connections 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.131+0000 7f418afe3700 1 -- 172.21.15.53:0/3302071390 wait complete. 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 Processor -- start 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 -- start start 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4184100e80 0x7f4184073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184073ad0 con 0x7f41841004e0 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f418afe3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184073c10 con 0x7f4184100e80 2024-09-16T01:01:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59904/0 (socket says 172.21.15.53:59904) 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 -- 172.21.15.53:0/3236491175 learned_addr learned my addr 172.21.15.53:0/3236491175 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4183fff700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4184100e80 0x7f4184073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 -- 172.21.15.53:0/3236491175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4184100e80 msgr2=0x7f4184073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4184100e80 0x7f4184073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.132+0000 7f4188d7f700 1 -- 172.21.15.53:0/3236491175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780095f0 con 0x7f41841004e0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f4188d7f700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f417400b4b0 tx=0x7f417400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4174011800 con 0x7f41841004e0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4174011e20 con 0x7f41841004e0 2024-09-16T01:01:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41841a21d0 con 0x7f41841004e0 2024-09-16T01:01:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417400f2e0 con 0x7f41841004e0 2024-09-16T01:01:36.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.133+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41841a25e0 con 0x7f41841004e0 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.134+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4184108780 con 0x7f41841004e0 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.134+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4174010380 con 0x7f41841004e0 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.135+0000 7f4181ffb700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 0x7f416c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.135+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f417408e1d0 con 0x7f41841004e0 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.135+0000 7f4183fff700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 0x7f416c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.136+0000 7f4183fff700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 0x7f416c070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4184074840 tx=0x7f417801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:36.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.139+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f41740573a0 con 0x7f41841004e0 2024-09-16T01:01:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.397+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f4184108160 con 0x7f41841004e0 2024-09-16T01:01:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.397+0000 7f4181ffb700 1 -- 172.21.15.53:0/3236491175 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v39) v1 ==== 107+0+4136 (secure 0 0 0) 0x7f417405aa60 con 0x7f41841004e0 2024-09-16T01:01:36.398 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:36.398 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"btime":"2024-09-16T00:56:48:227401+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:48.227398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:active","state_seq":139,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-16T01:01:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 msgr2=0x7f416c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 0x7f416c070b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4184074840 tx=0x7f417801a040 comp rx=0 tx=0).stop 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 msgr2=0x7f4184073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f417400b4b0 tx=0x7f417400b870 comp rx=0 tx=0).stop 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 shutdown_connections 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f416c06e680 0x7f416c070b30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41841004e0 0x7f4184073050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 --2- 172.21.15.53:0/3236491175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4184100e80 0x7f4184073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 >> 172.21.15.53:0/3236491175 conn(0x7f41840fbda0 msgr2=0x7f41840fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 shutdown_connections 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:36.400+0000 7f418afe3700 1 -- 172.21.15.53:0/3236491175 wait complete. 2024-09-16T01:01:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-16T01:01:37.070 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-16T01:01:37.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-16T01:01:37.282 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:37.631 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:37 smithi053 ceph-mon[77492]: pgmap v320: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:37.631 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:37 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3236491175' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-16T01:01:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:37 smithi152 ceph-mon[63606]: pgmap v320: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:37.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:37 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3236491175' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- 172.21.15.53:0/946836647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c1004e0 msgr2=0x7f7c7c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/946836647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c1008b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009910 tx=0x7f7c6c009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- 172.21.15.53:0/946836647 shutdown_connections 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/946836647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c100e80 0x7f7c7c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/946836647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c1008b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- 172.21.15.53:0/946836647 >> 172.21.15.53:0/946836647 conn(0x7f7c7c0fbda0 msgr2=0x7f7c7c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- 172.21.15.53:0/946836647 shutdown_connections 2024-09-16T01:01:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- 172.21.15.53:0/946836647 wait complete. 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 Processor -- start 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.971+0000 7f7c82a4e700 1 -- start start 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c82a4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c82a4e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c82a4e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c196b10 con 0x7f7c7c100e80 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c82a4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c19a8a0 con 0x7f7c7c1004e0 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59922/0 (socket says 172.21.15.53:59922) 2024-09-16T01:01:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 -- 172.21.15.53:0/3077908185 learned_addr learned my addr 172.21.15.53:0/3077908185 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7bfff700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 -- 172.21.15.53:0/3077908185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c1004e0 msgr2=0x7f7c7c195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.972+0000 7f7c7b7fe700 1 -- 172.21.15.53:0/3077908185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0095f0 con 0x7f7c7c100e80 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c7b7fe700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400d900 tx=0x7f7c6400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c64009900 con 0x7f7c7c100e80 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c64010460 con 0x7f7c7c100e80 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c19ab80 con 0x7f7c7c100e80 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6400f5f0 con 0x7f7c7c100e80 2024-09-16T01:01:38.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.973+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c19b0d0 con 0x7f7c7c100e80 2024-09-16T01:01:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.974+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c1087f0 con 0x7f7c7c100e80 2024-09-16T01:01:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.975+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7c640105d0 con 0x7f7c7c100e80 2024-09-16T01:01:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.975+0000 7f7c797fa700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 0x7f7c68070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.976+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7c6408e190 con 0x7f7c7c100e80 2024-09-16T01:01:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.976+0000 7f7c7bfff700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 0x7f7c68070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.976+0000 7f7c7bfff700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 0x7f7c68070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c006010 tx=0x7f7c6c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:38.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:38.981+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7c64057360 con 0x7f7c7c100e80 2024-09-16T01:01:39.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.245+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f7c7c19b340 con 0x7f7c7c100e80 2024-09-16T01:01:39.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.246+0000 7f7c797fa700 1 -- 172.21.15.53:0/3077908185 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v39) v1 ==== 107+0+4983 (secure 0 0 0) 0x7f7c6405aa20 con 0x7f7c7c100e80 2024-09-16T01:01:39.247 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:39.247 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"btime":"2024-09-16T00:56:49:233111+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/822250492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":822250492},{"type":"v1","addr":"172.21.15.53:6829","nonce":822250492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:48.227398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:active","state_seq":139,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-16T01:01:39.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.248+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 msgr2=0x7f7c68070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.248+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 0x7f7c68070b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c006010 tx=0x7f7c6c01a040 comp rx=0 tx=0).stop 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.248+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 msgr2=0x7f7c7c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.248+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400d900 tx=0x7f7c6400dc10 comp rx=0 tx=0).stop 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 shutdown_connections 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f7c6806e680 0x7f7c68070b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c7c1004e0 0x7f7c7c195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 --2- 172.21.15.53:0/3077908185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c7c100e80 0x7f7c7c196430 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 >> 172.21.15.53:0/3077908185 conn(0x7f7c7c0fbda0 msgr2=0x7f7c7c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 shutdown_connections 2024-09-16T01:01:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:39.249+0000 7f7c82a4e700 1 -- 172.21.15.53:0/3077908185 wait complete. 2024-09-16T01:01:39.251 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 24 2024-09-16T01:01:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:39 smithi053 ceph-mon[77492]: pgmap v321: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:39.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:39 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3077908185' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-16T01:01:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:39 smithi152 ceph-mon[63606]: pgmap v321: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:39.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:39 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3077908185' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-16T01:01:39.999 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-16T01:01:39.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-16T01:01:40.211 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:41.547 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:41 smithi053 ceph-mon[77492]: pgmap v322: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:41.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:41 smithi152 ceph-mon[63606]: pgmap v322: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 -- 172.21.15.53:0/1163222695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 msgr2=0x7f79400ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 --2- 172.21.15.53:0/1163222695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79400ff7c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7930009910 tx=0x7f7930009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 -- 172.21.15.53:0/1163222695 shutdown_connections 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 --2- 172.21.15.53:0/1163222695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79400ff7c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 --2- 172.21.15.53:0/1163222695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 0x7f7940103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 -- 172.21.15.53:0/1163222695 >> 172.21.15.53:0/1163222695 conn(0x7f79400748b0 msgr2=0x7f7940074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:41.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 -- 172.21.15.53:0/1163222695 shutdown_connections 2024-09-16T01:01:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.792+0000 7f7948090700 1 -- 172.21.15.53:0/1163222695 wait complete. 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 Processor -- start 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 -- start start 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 0x7f7940100af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940101030 con 0x7f79400ff350 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7948090700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940101170 con 0x7f79401038b0 2024-09-16T01:01:41.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59952/0 (socket says 172.21.15.53:59952) 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 -- 172.21.15.53:0/1420722267 learned_addr learned my addr 172.21.15.53:0/1420722267 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f794562b700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 0x7f7940100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 -- 172.21.15.53:0/1420722267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 msgr2=0x7f7940100af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 0x7f7940100af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 -- 172.21.15.53:0/1420722267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300095f0 con 0x7f79400ff350 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.793+0000 7f7945e2c700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b4b0 tx=0x7f793c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.794+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793c011800 con 0x7f79400ff350 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.794+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f793c011e20 con 0x7f79400ff350 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.794+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79401a2150 con 0x7f79400ff350 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.794+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793c00f2e0 con 0x7f79400ff350 2024-09-16T01:01:41.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.794+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79401a2560 con 0x7f79400ff350 2024-09-16T01:01:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.795+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7940108e30 con 0x7f79400ff350 2024-09-16T01:01:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.795+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f793c010380 con 0x7f79400ff350 2024-09-16T01:01:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.796+0000 7f7936ffd700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 0x7f792c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.796+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f793c08e1d0 con 0x7f79400ff350 2024-09-16T01:01:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.796+0000 7f794562b700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 0x7f792c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.796+0000 7f794562b700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 0x7f792c070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79300059d0 tx=0x7f793001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:41.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:41.800+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f793c0573a0 con 0x7f79400ff350 2024-09-16T01:01:42.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.061+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f794004f2a0 con 0x7f79400ff350 2024-09-16T01:01:42.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.062+0000 7f7936ffd700 1 -- 172.21.15.53:0/1420722267 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v39) v1 ==== 107+0+4207 (secure 0 0 0) 0x7f793c05aa60 con 0x7f79400ff350 2024-09-16T01:01:42.063 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"btime":"2024-09-16T00:57:02:302583+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:48.227398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:active","state_seq":139,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 msgr2=0x7f792c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 0x7f792c070b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f79300059d0 tx=0x7f793001a040 comp rx=0 tx=0).stop 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 msgr2=0x7f79401005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b4b0 tx=0x7f793c00b870 comp rx=0 tx=0).stop 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 shutdown_connections 2024-09-16T01:01:42.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f792c06e680 0x7f792c070b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79400ff350 0x7f79401005b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 --2- 172.21.15.53:0/1420722267 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401038b0 0x7f7940100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:42.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 >> 172.21.15.53:0/1420722267 conn(0x7f79400748b0 msgr2=0x7f7940102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:42.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 shutdown_connections 2024-09-16T01:01:42.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:42.064+0000 7f7948090700 1 -- 172.21.15.53:0/1420722267 wait complete. 2024-09-16T01:01:42.068 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 25 2024-09-16T01:01:42.689 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:42 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1420722267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-16T01:01:42.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:42 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1420722267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-16T01:01:42.713 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-16T01:01:42.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-16T01:01:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:43.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:43 smithi152 ceph-mon[63606]: pgmap v323: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:43.722 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:43 smithi053 ceph-mon[77492]: pgmap v323: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:44.632 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:44 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:44.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:44 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:44.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 -- 172.21.15.53:0/3075357323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 msgr2=0x7f9950103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 --2- 172.21.15.53:0/3075357323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950103d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9944009910 tx=0x7f9944009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 -- 172.21.15.53:0/3075357323 shutdown_connections 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 --2- 172.21.15.53:0/3075357323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950103d30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 --2- 172.21.15.53:0/3075357323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 0x7f99500ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 -- 172.21.15.53:0/3075357323 >> 172.21.15.53:0/3075357323 conn(0x7f99500fac80 msgr2=0x7f99500fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 -- 172.21.15.53:0/3075357323 shutdown_connections 2024-09-16T01:01:44.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.737+0000 7f995576d700 1 -- 172.21.15.53:0/3075357323 wait complete. 2024-09-16T01:01:44.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.738+0000 7f995576d700 1 Processor -- start 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.738+0000 7f995576d700 1 -- start start 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.738+0000 7f995576d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 0x7f9950100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.738+0000 7f995576d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f995576d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950101850 con 0x7f99500ffd60 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f995576d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950101990 con 0x7f99500ff3c0 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45790/0 (socket says 172.21.15.53:45790) 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 -- 172.21.15.53:0/2908158108 learned_addr learned my addr 172.21.15.53:0/2908158108 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994effd700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 0x7f9950100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 -- 172.21.15.53:0/2908158108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 msgr2=0x7f9950100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 0x7f9950100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 -- 172.21.15.53:0/2908158108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440095f0 con 0x7f99500ffd60 2024-09-16T01:01:44.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f994e7fc700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99440092e0 tx=0x7f994400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:44.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994401d070 con 0x7f99500ffd60 2024-09-16T01:01:44.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9950101c10 con 0x7f99500ffd60 2024-09-16T01:01:44.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9944005dc0 con 0x7f99500ffd60 2024-09-16T01:01:44.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9944017400 con 0x7f99500ffd60 2024-09-16T01:01:44.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.739+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99501a2390 con 0x7f99500ffd60 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.740+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950108740 con 0x7f99500ffd60 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.741+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f994400f6f0 con 0x7f99500ffd60 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.741+0000 7f9937fff700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 0x7f9938070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.742+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f994408faa0 con 0x7f99500ffd60 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.742+0000 7f994effd700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 0x7f9938070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:44.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.742+0000 7f994effd700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 0x7f9938070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9940005950 tx=0x7f994000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:44.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:44.746+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9944058bf0 con 0x7f99500ffd60 2024-09-16T01:01:45.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.009+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f995004f2a0 con 0x7f99500ffd60 2024-09-16T01:01:45.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.009+0000 7f9937fff700 1 -- 172.21.15.53:0/2908158108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v39) v1 ==== 107+0+5051 (secure 0 0 0) 0x7f994405c2b0 con 0x7f99500ffd60 2024-09-16T01:01:45.011 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:45.011 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"btime":"2024-09-16T00:57:07:313372+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:56:48.227398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi152.gatezw","rank":0,"incarnation":20,"state":"up:active","state_seq":139,"addr":"172.21.15.152:6825/3120948580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3120948580},{"type":"v1","addr":"172.21.15.152:6825","nonce":3120948580}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-16T01:01:45.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 msgr2=0x7f9938070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 0x7f9938070b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9940005950 tx=0x7f994000b410 comp rx=0 tx=0).stop 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 msgr2=0x7f9950101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99440092e0 tx=0x7f994400bd70 comp rx=0 tx=0).stop 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 shutdown_connections 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f993806e680 0x7f9938070b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99500ff3c0 0x7f9950100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 --2- 172.21.15.53:0/2908158108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99500ffd60 0x7f9950101310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 >> 172.21.15.53:0/2908158108 conn(0x7f99500fac80 msgr2=0x7f99500690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 shutdown_connections 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:45.012+0000 7f995576d700 1 -- 172.21.15.53:0/2908158108 wait complete. 2024-09-16T01:01:45.014 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2024-09-16T01:01:45.595 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:45 smithi053 ceph-mon[77492]: pgmap v324: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:45.595 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:45 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2908158108' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-16T01:01:45.617 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-16T01:01:45.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-16T01:01:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:45 smithi152 ceph-mon[63606]: pgmap v324: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:45.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:45 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2908158108' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-16T01:01:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:47.579 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:47 smithi053 ceph-mon[77492]: pgmap v325: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 -- 172.21.15.53:0/1755307004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 msgr2=0x7fabdc104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 --2- 172.21.15.53:0/1755307004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc104e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009910 tx=0x7fabcc009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 -- 172.21.15.53:0/1755307004 shutdown_connections 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 --2- 172.21.15.53:0/1755307004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc104e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 --2- 172.21.15.53:0/1755307004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 -- 172.21.15.53:0/1755307004 >> 172.21.15.53:0/1755307004 conn(0x7fabdc0fbd80 msgr2=0x7fabdc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 -- 172.21.15.53:0/1755307004 shutdown_connections 2024-09-16T01:01:47.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.580+0000 7fabe47cc700 1 -- 172.21.15.53:0/1755307004 wait complete. 2024-09-16T01:01:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 Processor -- start 2024-09-16T01:01:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 -- start start 2024-09-16T01:01:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc196b10 con 0x7fabdc100e60 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe47cc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc19a8a0 con 0x7fabdc1004c0 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe1d67700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe1d67700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45814/0 (socket says 172.21.15.53:45814) 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.581+0000 7fabe1d67700 1 -- 172.21.15.53:0/3763605233 learned_addr learned my addr 172.21.15.53:0/3763605233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe2568700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe1d67700 1 -- 172.21.15.53:0/3763605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 msgr2=0x7fabdc195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe1d67700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe1d67700 1 -- 172.21.15.53:0/3763605233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0095f0 con 0x7fabdc100e60 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe2568700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe1d67700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0092e0 tx=0x7fabcc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc01d070 con 0x7fabdc100e60 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabcc005dc0 con 0x7fabdc100e60 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc017400 con 0x7fabdc100e60 2024-09-16T01:01:47.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc19ab20 con 0x7fabdc100e60 2024-09-16T01:01:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.582+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc19afc0 con 0x7fabdc100e60 2024-09-16T01:01:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.583+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc108830 con 0x7fabdc100e60 2024-09-16T01:01:47.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.584+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fabcc00f460 con 0x7fabdc100e60 2024-09-16T01:01:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.584+0000 7fabd37fe700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 0x7fabc8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.584+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fabcc08fbc0 con 0x7fabdc100e60 2024-09-16T01:01:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.584+0000 7fabe2568700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 0x7fabc8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:47.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.585+0000 7fabe2568700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 0x7fabc8070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabd8005fd0 tx=0x7fabd8005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:47.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.589+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fabcc058d10 con 0x7fabdc100e60 2024-09-16T01:01:47.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:47 smithi152 ceph-mon[63606]: pgmap v325: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:47.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.850+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fabdc108210 con 0x7fabdc100e60 2024-09-16T01:01:47.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.851+0000 7fabd37fe700 1 -- 172.21.15.53:0/3763605233 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v39) v1 ==== 107+0+4247 (secure 0 0 0) 0x7fabcc05c3d0 con 0x7fabdc100e60 2024-09-16T01:01:47.853 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:47.853 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":27,"btime":"2024-09-16T00:57:19:507837+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:19.507834+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 msgr2=0x7fabc8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 0x7fabc8070b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabd8005fd0 tx=0x7fabd8005ee0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 msgr2=0x7fabdc196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0092e0 tx=0x7fabcc00be20 comp rx=0 tx=0).stop 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 shutdown_connections 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fabc806e680 0x7fabc8070b30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabdc1004c0 0x7fabdc195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 --2- 172.21.15.53:0/3763605233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabdc100e60 0x7fabdc196430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 >> 172.21.15.53:0/3763605233 conn(0x7fabdc0fbd80 msgr2=0x7fabdc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 shutdown_connections 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:47.853+0000 7fabe47cc700 1 -- 172.21.15.53:0/3763605233 wait complete. 2024-09-16T01:01:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 27 2024-09-16T01:01:48.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:48 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3763605233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-16T01:01:48.653 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-16T01:01:48.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-16T01:01:48.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:48 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3763605233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-16T01:01:48.866 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:49.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:49 smithi053 ceph-mon[77492]: pgmap v326: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:49.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:49 smithi152 ceph-mon[63606]: pgmap v326: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3916252006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c54101c30 msgr2=0x7f9c541020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3916252006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c54101c30 0x7f9c541020a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009910 tx=0x7f9c44009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3916252006 shutdown_connections 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3916252006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c54101c30 0x7f9c541020a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3916252006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c541003d0 0x7f9c541007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.593+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3916252006 >> 172.21.15.53:0/3916252006 conn(0x7f9c540fbbd0 msgr2=0x7f9c540fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.594+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3916252006 shutdown_connections 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.594+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3916252006 wait complete. 2024-09-16T01:01:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.594+0000 7f9c5a1a1700 1 Processor -- start 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.594+0000 7f9c5a1a1700 1 -- start start 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5a1a1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5a1a1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c54101c30 0x7f9c541961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5a1a1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54196870 con 0x7f9c541003d0 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5a1a1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541995a0 con 0x7f9c54101c30 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45830/0 (socket says 172.21.15.53:45830) 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 -- 172.21.15.53:0/3127799993 learned_addr learned my addr 172.21.15.53:0/3127799993 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5899e700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c54101c30 0x7f9c541961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 -- 172.21.15.53:0/3127799993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c54101c30 msgr2=0x7f9c541961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c54101c30 0x7f9c541961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 -- 172.21.15.53:0/3127799993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440095f0 con 0x7f9c541003d0 2024-09-16T01:01:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5919f700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000d8d0 tx=0x7f9c5000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c500098a0 con 0x7f9c541003d0 2024-09-16T01:01:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c50010460 con 0x7f9c541003d0 2024-09-16T01:01:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.595+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c54199880 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.596+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5000f5f0 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.596+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54199e50 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.597+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c54062380 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.597+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9c50009a00 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.598+0000 7f9c4a7fc700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 0x7f9c40070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.598+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9c5008e5a0 con 0x7f9c541003d0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.598+0000 7f9c5899e700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 0x7f9c40070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.598+0000 7f9c5899e700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 0x7f9c40070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c54197280 tx=0x7f9c4401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.602+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c500576f0 con 0x7f9c541003d0 2024-09-16T01:01:50.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.861+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9c54196fc0 con 0x7f9c541003d0 2024-09-16T01:01:50.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.862+0000 7f9c4a7fc700 1 -- 172.21.15.53:0/3127799993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v39) v1 ==== 107+0+4258 (secure 0 0 0) 0x7f9c5005adb0 con 0x7f9c541003d0 2024-09-16T01:01:50.863 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:50.863 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"btime":"2024-09-16T00:57:19:513182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:19.513167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 msgr2=0x7f9c40070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 0x7f9c40070b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c54197280 tx=0x7f9c4401a040 comp rx=0 tx=0).stop 2024-09-16T01:01:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 msgr2=0x7f9c54195ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:50.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000d8d0 tx=0x7f9c5000dbe0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 shutdown_connections 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f9c4006e680 0x7f9c40070b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c541003d0 0x7f9c54195ca0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 --2- 172.21.15.53:0/3127799993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c54101c30 0x7f9c541961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.864+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 >> 172.21.15.53:0/3127799993 conn(0x7f9c540fbbd0 msgr2=0x7f9c540fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.865+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 shutdown_connections 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:50.865+0000 7f9c5a1a1700 1 -- 172.21.15.53:0/3127799993 wait complete. 2024-09-16T01:01:50.866 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2024-09-16T01:01:51.533 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:51 smithi053 ceph-mon[77492]: pgmap v327: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:51.533 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:51 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3127799993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-16T01:01:51.556 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-16T01:01:51.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-16T01:01:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:51 smithi152 ceph-mon[63606]: pgmap v327: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:51.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:51 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3127799993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-16T01:01:51.810 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 -- 172.21.15.53:0/2385055866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 msgr2=0x7fb3500ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 --2- 172.21.15.53:0/2385055866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb3500ff790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb34000b0a0 tx=0x7fb34000b3b0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 -- 172.21.15.53:0/2385055866 shutdown_connections 2024-09-16T01:01:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 --2- 172.21.15.53:0/2385055866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 --2- 172.21.15.53:0/2385055866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb3500ff790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 -- 172.21.15.53:0/2385055866 >> 172.21.15.53:0/2385055866 conn(0x7fb3500fac80 msgr2=0x7fb3500fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 -- 172.21.15.53:0/2385055866 shutdown_connections 2024-09-16T01:01:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.433+0000 7fb3561ee700 1 -- 172.21.15.53:0/2385055866 wait complete. 2024-09-16T01:01:53.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 Processor -- start 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 -- start start 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350196bf0 con 0x7fb3500ff3c0 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb3561ee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35019a980 con 0x7fb3500ffd60 2024-09-16T01:01:53.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb34f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb34f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39676/0 (socket says 172.21.15.53:39676) 2024-09-16T01:01:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb34f7fe700 1 -- 172.21.15.53:0/1129642485 learned_addr learned my addr 172.21.15.53:0/1129642485 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.434+0000 7fb34effd700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34f7fe700 1 -- 172.21.15.53:0/1129642485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 msgr2=0x7fb350196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34f7fe700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34f7fe700 1 -- 172.21.15.53:0/1129642485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009d00 con 0x7fb3500ff3c0 2024-09-16T01:01:53.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34effd700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:01:53.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34f7fe700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34000b070 tx=0x7fb34000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:53.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34000e040 con 0x7fb3500ff3c0 2024-09-16T01:01:53.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35019ac00 con 0x7fb3500ff3c0 2024-09-16T01:01:53.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb340003e60 con 0x7fb3500ff3c0 2024-09-16T01:01:53.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34001d910 con 0x7fb3500ff3c0 2024-09-16T01:01:53.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.435+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35019b0f0 con 0x7fb3500ff3c0 2024-09-16T01:01:53.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.436+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3501076d0 con 0x7fb3500ff3c0 2024-09-16T01:01:53.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.436+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb340004820 con 0x7fb3500ff3c0 2024-09-16T01:01:53.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.437+0000 7fb34cff9700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 0x7fb33c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:53.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.437+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb340090070 con 0x7fb3500ff3c0 2024-09-16T01:01:53.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.437+0000 7fb34effd700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 0x7fb33c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:53.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.438+0000 7fb34effd700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 0x7fb33c070b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb3501975f0 tx=0x7fb338008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:53.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.442+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb340059160 con 0x7fb3500ff3c0 2024-09-16T01:01:53.447 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:53 smithi053 ceph-mon[77492]: pgmap v328: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:53.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:53 smithi152 ceph-mon[63606]: pgmap v328: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:53.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.700+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fb35004f2a0 con 0x7fb3500ff3c0 2024-09-16T01:01:53.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.700+0000 7fb34cff9700 1 -- 172.21.15.53:0/1129642485 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v39) v1 ==== 107+0+4263 (secure 0 0 0) 0x7fb34005c820 con 0x7fb3500ff3c0 2024-09-16T01:01:53.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:53.701 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":29,"btime":"2024-09-16T00:57:28:267150+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:27.890550+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":146,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 msgr2=0x7fb33c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:53.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 0x7fb33c070b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb3501975f0 tx=0x7fb338008040 comp rx=0 tx=0).stop 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 msgr2=0x7fb350195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34000b070 tx=0x7fb34000cdd0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 shutdown_connections 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb33c06e680 0x7fb33c070b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500ff3c0 0x7fb350195fd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 --2- 172.21.15.53:0/1129642485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3500ffd60 0x7fb350196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.702+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 >> 172.21.15.53:0/1129642485 conn(0x7fb3500fac80 msgr2=0x7fb3500fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.703+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 shutdown_connections 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:53.703+0000 7fb3561ee700 1 -- 172.21.15.53:0/1129642485 wait complete. 2024-09-16T01:01:53.704 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 29 2024-09-16T01:01:54.447 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:54 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/1129642485' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-16T01:01:54.490 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-16T01:01:54.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-16T01:01:54.705 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:54.712 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:54 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/1129642485' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-16T01:01:55.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:55 smithi152 ceph-mon[63606]: pgmap v329: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:55.819 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:55 smithi053 ceph-mon[77492]: pgmap v329: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 -- 172.21.15.53:0/2310534573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff498100e80 msgr2=0x7ff498104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/2310534573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff498100e80 0x7ff498104e50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009910 tx=0x7ff48c009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 -- 172.21.15.53:0/2310534573 shutdown_connections 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/2310534573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff498100e80 0x7ff498104e50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/2310534573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4981004e0 0x7ff4981008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.497+0000 7ff49d3ef700 1 -- 172.21.15.53:0/2310534573 >> 172.21.15.53:0/2310534573 conn(0x7ff4980fbda0 msgr2=0x7ff4980fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.498+0000 7ff49d3ef700 1 -- 172.21.15.53:0/2310534573 shutdown_connections 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.498+0000 7ff49d3ef700 1 -- 172.21.15.53:0/2310534573 wait complete. 2024-09-16T01:01:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.498+0000 7ff49d3ef700 1 Processor -- start 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.498+0000 7ff49d3ef700 1 -- start start 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff49d3ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff49d3ef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff498100e80 0x7ff498073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff49d3ef700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498074d70 con 0x7ff4981004e0 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff49d3ef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498074ee0 con 0x7ff498100e80 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39694/0 (socket says 172.21.15.53:39694) 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 -- 172.21.15.53:0/4215978295 learned_addr learned my addr 172.21.15.53:0/4215978295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff4967fc700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff498100e80 0x7ff498073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 -- 172.21.15.53:0/4215978295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff498100e80 msgr2=0x7ff498073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff498100e80 0x7ff498073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 -- 172.21.15.53:0/4215978295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0095f0 con 0x7ff4981004e0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff496ffd700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff48800c930 tx=0x7ff48800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.499+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff488007ad0 con 0x7ff4981004e0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.500+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498073b30 con 0x7ff4981004e0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.500+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff488007c30 con 0x7ff4981004e0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.500+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff488018610 con 0x7ff4981004e0 2024-09-16T01:01:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.500+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981a68b0 con 0x7ff4981004e0 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.501+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff498108850 con 0x7ff4981004e0 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.501+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff48800f450 con 0x7ff4981004e0 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.502+0000 7ff47ffff700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 0x7ff480070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.502+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff48808e7f0 con 0x7ff4981004e0 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.502+0000 7ff4967fc700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 0x7ff480070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.502+0000 7ff4967fc700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 0x7ff480070b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4980fc560 tx=0x7ff48c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.506+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff4880579c0 con 0x7ff4981004e0 2024-09-16T01:01:56.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.770+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7ff49804f2a0 con 0x7ff4981004e0 2024-09-16T01:01:56.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.771+0000 7ff47ffff700 1 -- 172.21.15.53:0/4215978295 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v39) v1 ==== 107+0+4260 (secure 0 0 0) 0x7ff48805b080 con 0x7ff4981004e0 2024-09-16T01:01:56.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:56.772 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"btime":"2024-09-16T00:57:29:271362+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:28.273633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":147,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:01:56.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 msgr2=0x7ff480070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:56.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 0x7ff480070b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4980fc560 tx=0x7ff48c01a040 comp rx=0 tx=0).stop 2024-09-16T01:01:56.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 msgr2=0x7ff498073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:56.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff48800c930 tx=0x7ff48800ccf0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 shutdown_connections 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff48006e680 0x7ff480070b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4981004e0 0x7ff498073050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 --2- 172.21.15.53:0/4215978295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff498100e80 0x7ff498073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 >> 172.21.15.53:0/4215978295 conn(0x7ff4980fbda0 msgr2=0x7ff4980fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 shutdown_connections 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:56.773+0000 7ff49d3ef700 1 -- 172.21.15.53:0/4215978295 wait complete. 2024-09-16T01:01:56.775 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 30 2024-09-16T01:01:57.536 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:57 smithi053 ceph-mon[77492]: pgmap v330: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:57.536 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:57 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/4215978295' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-16T01:01:57.560 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-16T01:01:57.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-16T01:01:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:57 smithi152 ceph-mon[63606]: pgmap v330: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:01:57.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:57 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/4215978295' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-16T01:01:57.772 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 -- 172.21.15.53:0/947795255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 msgr2=0x7f0804104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 --2- 172.21.15.53:0/947795255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804104500 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0800009910 tx=0x7f0800009c20 comp rx=0 tx=0).stop 2024-09-16T01:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 -- 172.21.15.53:0/947795255 shutdown_connections 2024-09-16T01:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 --2- 172.21.15.53:0/947795255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 --2- 172.21.15.53:0/947795255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804104500 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 -- 172.21.15.53:0/947795255 >> 172.21.15.53:0/947795255 conn(0x7f0804075130 msgr2=0x7f0804075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 -- 172.21.15.53:0/947795255 shutdown_connections 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.369+0000 7f080bd00700 1 -- 172.21.15.53:0/947795255 wait complete. 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 Processor -- start 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 -- start start 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804198c60 con 0x7f0804104130 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080bd00700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080419c9f0 con 0x7f08040ffbd0 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080929b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080929b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39702/0 (socket says 172.21.15.53:39702) 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f080929b700 1 -- 172.21.15.53:0/443089216 learned_addr learned my addr 172.21.15.53:0/443089216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:01:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.370+0000 7f0809a9c700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080929b700 1 -- 172.21.15.53:0/443089216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 msgr2=0x7f0804198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080929b700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080929b700 1 -- 172.21.15.53:0/443089216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000095f0 con 0x7f0804104130 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f0809a9c700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080929b700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e920 tx=0x7f07f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f4009790 con 0x7f0804104130 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07f400cba0 con 0x7f0804104130 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080419ccd0 con 0x7f0804104130 2024-09-16T01:01:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f4018650 con 0x7f0804104130 2024-09-16T01:01:59.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.371+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080419d220 con 0x7f0804104130 2024-09-16T01:01:59.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.372+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080404f2a0 con 0x7f0804104130 2024-09-16T01:01:59.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.373+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f07f400cd10 con 0x7f0804104130 2024-09-16T01:01:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.373+0000 7f07faffd700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:01:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.373+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f07f4014070 con 0x7f0804104130 2024-09-16T01:01:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.373+0000 7f0809a9c700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:01:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.374+0000 7f0809a9c700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 0x7f07f0070b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0800000c00 tx=0x7f0800009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:01:59.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.378+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07f40541b0 con 0x7f0804104130 2024-09-16T01:01:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:59 smithi053 ceph-mon[77492]: pgmap v331: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:59.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:01:59 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:01:59.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.635+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f08041993a0 con 0x7f0804104130 2024-09-16T01:01:59.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.636+0000 7f07faffd700 1 -- 172.21.15.53:0/443089216 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v39) v1 ==== 107+0+4269 (secure 0 0 0) 0x7f07f405b6e0 con 0x7f0804104130 2024-09-16T01:01:59.637 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:01:59.637 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":31,"btime":"2024-09-16T00:57:30:276104+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:30.276102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":0,"incarnation":28,"state":"up:active","state_seq":148,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-09-16T01:01:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 msgr2=0x7f07f0070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 0x7f07f0070b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0800000c00 tx=0x7f0800009f70 comp rx=0 tx=0).stop 2024-09-16T01:01:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 msgr2=0x7f0804198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:01:59.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e920 tx=0x7f07f400ece0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 shutdown_connections 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f07f006e680 0x7f07f0070b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08040ffbd0 0x7f0804198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 --2- 172.21.15.53:0/443089216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0804104130 0x7f0804198580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 >> 172.21.15.53:0/443089216 conn(0x7f0804075130 msgr2=0x7f08040685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.638+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 shutdown_connections 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:01:59.639+0000 7f080bd00700 1 -- 172.21.15.53:0/443089216 wait complete. 2024-09-16T01:01:59.640 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 31 2024-09-16T01:01:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:59 smithi152 ceph-mon[63606]: pgmap v331: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:01:59.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:01:59 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:02:00.509 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-16T01:02:00.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-16T01:02:00.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:00 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/443089216' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-16T01:02:00.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:00 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/443089216' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-16T01:02:00.719 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:01.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:01 smithi053 ceph-mon[77492]: pgmap v332: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:01.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:01 smithi152 ceph-mon[63606]: pgmap v332: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 -- 172.21.15.53:0/3655489999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 msgr2=0x7fe8141008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 --2- 172.21.15.53:0/3655489999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe8141008b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe804009910 tx=0x7fe804009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 -- 172.21.15.53:0/3655489999 shutdown_connections 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 --2- 172.21.15.53:0/3655489999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 --2- 172.21.15.53:0/3655489999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe8141008b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 -- 172.21.15.53:0/3655489999 >> 172.21.15.53:0/3655489999 conn(0x7fe8140fbda0 msgr2=0x7fe8140fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 -- 172.21.15.53:0/3655489999 shutdown_connections 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.527+0000 7fe81a67d700 1 -- 172.21.15.53:0/3655489999 wait complete. 2024-09-16T01:02:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.528+0000 7fe81a67d700 1 Processor -- start 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.528+0000 7fe81a67d700 1 -- start start 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe81a67d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe81a67d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe81a67d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe814196b10 con 0x7fe8141004e0 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe81a67d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81419a8a0 con 0x7fe814100e80 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44742/0 (socket says 172.21.15.53:44742) 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 -- 172.21.15.53:0/2546656707 learned_addr learned my addr 172.21.15.53:0/2546656707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe8137fe700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 -- 172.21.15.53:0/2546656707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 msgr2=0x7fe814196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 -- 172.21.15.53:0/2546656707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040095f0 con 0x7fe8141004e0 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe8137fe700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.529+0000 7fe813fff700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe804005f50 tx=0x7fe80400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.530+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe80401d070 con 0x7fe8141004e0 2024-09-16T01:02:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.530+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe80400b610 con 0x7fe8141004e0 2024-09-16T01:02:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.530+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81419ab20 con 0x7fe8141004e0 2024-09-16T01:02:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.530+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe804022470 con 0x7fe8141004e0 2024-09-16T01:02:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.530+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81419b010 con 0x7fe8141004e0 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.531+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8141087f0 con 0x7fe8141004e0 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.531+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe80400fca0 con 0x7fe8141004e0 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.532+0000 7fe8117fa700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 0x7fe800070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.532+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe80408fb70 con 0x7fe8141004e0 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.532+0000 7fe8137fe700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 0x7fe800070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.532+0000 7fe8137fe700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 0x7fe800070b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe814197510 tx=0x7fe7fc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.536+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe804058cc0 con 0x7fe8141004e0 2024-09-16T01:02:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.797+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fe81404f2a0 con 0x7fe8141004e0 2024-09-16T01:02:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.798+0000 7fe8117fa700 1 -- 172.21.15.53:0/2546656707 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v39) v1 ==== 107+0+5119 (secure 0 0 0) 0x7fe80405c380 con 0x7fe8141004e0 2024-09-16T01:02:02.798 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:02.799 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"btime":"2024-09-16T00:57:32:283127+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:30.276102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24299":{"gid":24299,"name":"cephfs.smithi152.ocdywv","rank":0,"incarnation":28,"state":"up:active","state_seq":148,"addr":"172.21.15.152:6827/2059330716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2059330716},{"type":"v1","addr":"172.21.15.152:6827","nonce":2059330716}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24299,"qdb_cluster":[24299]},"id":1}]} 2024-09-16T01:02:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.800+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 msgr2=0x7fe800070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.800+0000 7fe81a67d700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 0x7fe800070b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe814197510 tx=0x7fe7fc009260 comp rx=0 tx=0).stop 2024-09-16T01:02:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.800+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 msgr2=0x7fe814195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.800+0000 7fe81a67d700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe804005f50 tx=0x7fe80400f740 comp rx=0 tx=0).stop 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 shutdown_connections 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe80006e680 0x7fe800070b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8141004e0 0x7fe814195ef0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 --2- 172.21.15.53:0/2546656707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe814100e80 0x7fe814196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 >> 172.21.15.53:0/2546656707 conn(0x7fe8140fbda0 msgr2=0x7fe8140fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 shutdown_connections 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:02.801+0000 7fe81a67d700 1 -- 172.21.15.53:0/2546656707 wait complete. 2024-09-16T01:02:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 32 2024-09-16T01:02:03.489 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-16T01:02:03.489 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-16T01:02:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:03 smithi152 ceph-mon[63606]: pgmap v333: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:03.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:03 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2546656707' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-16T01:02:03.721 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:03.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:03 smithi053 ceph-mon[77492]: pgmap v333: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:03.787 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:03 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2546656707' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 -- 172.21.15.53:0/1786638672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100ed0 msgr2=0x7f6c88104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 --2- 172.21.15.53:0/1786638672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100ed0 0x7f6c88104ea0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009910 tx=0x7f6c70009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 -- 172.21.15.53:0/1786638672 shutdown_connections 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 --2- 172.21.15.53:0/1786638672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100ed0 0x7f6c88104ea0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 --2- 172.21.15.53:0/1786638672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100530 0x7f6c88100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 -- 172.21.15.53:0/1786638672 >> 172.21.15.53:0/1786638672 conn(0x7f6c880fbe10 msgr2=0x7f6c880fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 -- 172.21.15.53:0/1786638672 shutdown_connections 2024-09-16T01:02:05.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.432+0000 7f6c8d008700 1 -- 172.21.15.53:0/1786638672 wait complete. 2024-09-16T01:02:05.435 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:05 smithi053 ceph-mon[77492]: pgmap v334: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 Processor -- start 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 -- start start 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100ed0 0x7f6c88196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88196b10 con 0x7f6c88100530 2024-09-16T01:02:05.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.433+0000 7f6c8d008700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819a8a0 con 0x7f6c88100ed0 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44756/0 (socket says 172.21.15.53:44756) 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 -- 172.21.15.53:0/195437651 learned_addr learned my addr 172.21.15.53:0/195437651 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c8659c700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100ed0 0x7f6c88196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 -- 172.21.15.53:0/195437651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100ed0 msgr2=0x7f6c88196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100ed0 0x7f6c88196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 -- 172.21.15.53:0/195437651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c700095f0 con 0x7f6c88100530 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.434+0000 7f6c86d9d700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d900 tx=0x7f6c7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:05.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.435+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c780041f0 con 0x7f6c88100530 2024-09-16T01:02:05.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.435+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8819ab80 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.435+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c78004cf0 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.435+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c7800b750 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.435+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8819b0d0 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.436+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c881088a0 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.437+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c78004750 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.437+0000 7f6c7ffff700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 0x7f6c74070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.438+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6c7808e5a0 con 0x7f6c88100530 2024-09-16T01:02:05.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.438+0000 7f6c8659c700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 0x7f6c74070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:05.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.438+0000 7f6c8659c700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 0x7f6c74070b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c88197510 tx=0x7f6c7001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:05.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.442+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c780576f0 con 0x7f6c88100530 2024-09-16T01:02:05.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:05 smithi152 ceph-mon[63606]: pgmap v334: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.710+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f6c8804f2a0 con 0x7f6c88100530 2024-09-16T01:02:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.711+0000 7f6c7ffff700 1 -- 172.21.15.53:0/195437651 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v39) v1 ==== 107+0+4315 (secure 0 0 0) 0x7f6c8804f2a0 con 0x7f6c88100530 2024-09-16T01:02:05.712 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:05.712 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"btime":"2024-09-16T00:57:43:332812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:43.332809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 msgr2=0x7f6c74070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 0x7f6c74070b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c88197510 tx=0x7f6c7001a040 comp rx=0 tx=0).stop 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 msgr2=0x7f6c88195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d900 tx=0x7f6c7800dc10 comp rx=0 tx=0).stop 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 shutdown_connections 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f6c7406e680 0x7f6c74070b30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88100530 0x7f6c88195ef0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 --2- 172.21.15.53:0/195437651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c88100ed0 0x7f6c88196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:05.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 >> 172.21.15.53:0/195437651 conn(0x7f6c880fbe10 msgr2=0x7f6c880fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:05.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 shutdown_connections 2024-09-16T01:02:05.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:05.713+0000 7f6c8d008700 1 -- 172.21.15.53:0/195437651 wait complete. 2024-09-16T01:02:05.715 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 33 2024-09-16T01:02:06.469 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-16T01:02:06.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-16T01:02:06.681 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:06.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:06 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/195437651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-16T01:02:06.803 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:06 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/195437651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-16T01:02:07.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:07 smithi152 ceph-mon[63606]: pgmap v335: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:07.801 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:07 smithi053 ceph-mon[77492]: pgmap v335: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:08.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 -- 172.21.15.53:0/3780262830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ff3c0 msgr2=0x7ff3500ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 --2- 172.21.15.53:0/3780262830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ff3c0 0x7ff3500ff790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff340009910 tx=0x7ff340009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 -- 172.21.15.53:0/3780262830 shutdown_connections 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 --2- 172.21.15.53:0/3780262830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ffd60 0x7ff350103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 --2- 172.21.15.53:0/3780262830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ff3c0 0x7ff3500ff790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 -- 172.21.15.53:0/3780262830 >> 172.21.15.53:0/3780262830 conn(0x7ff3500fac80 msgr2=0x7ff3500fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 -- 172.21.15.53:0/3780262830 shutdown_connections 2024-09-16T01:02:08.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.356+0000 7ff357134700 1 -- 172.21.15.53:0/3780262830 wait complete. 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 Processor -- start 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 -- start start 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ff3c0 0x7ff350195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350196b90 con 0x7ff3500ffd60 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff357134700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35019a920 con 0x7ff3500ff3c0 2024-09-16T01:02:08.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff34ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff34ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44766/0 (socket says 172.21.15.53:44766) 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff34ffff700 1 -- 172.21.15.53:0/713822657 learned_addr learned my addr 172.21.15.53:0/713822657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.357+0000 7ff354ed0700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ff3c0 0x7ff350195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34ffff700 1 -- 172.21.15.53:0/713822657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ff3c0 msgr2=0x7ff350195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34ffff700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ff3c0 0x7ff350195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34ffff700 1 -- 172.21.15.53:0/713822657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400095f0 con 0x7ff3500ffd60 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34ffff700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff34400b480 tx=0x7ff34400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff344011800 con 0x7ff3500ffd60 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35019ac00 con 0x7ff3500ffd60 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff344011e20 con 0x7ff3500ffd60 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff344010ea0 con 0x7ff3500ffd60 2024-09-16T01:02:08.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.358+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35019b150 con 0x7ff3500ffd60 2024-09-16T01:02:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.360+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3501086e0 con 0x7ff3500ffd60 2024-09-16T01:02:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.360+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff344010380 con 0x7ff3500ffd60 2024-09-16T01:02:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.360+0000 7ff34dffb700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 0x7ff338070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:08.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.361+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff34408e0f0 con 0x7ff3500ffd60 2024-09-16T01:02:08.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.361+0000 7ff354ed0700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 0x7ff338070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:08.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.361+0000 7ff354ed0700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 0x7ff338070b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff340006010 tx=0x7ff34001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:08.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.365+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3440572c0 con 0x7ff3500ffd60 2024-09-16T01:02:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.629+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7ff35019b3d0 con 0x7ff3500ffd60 2024-09-16T01:02:08.630 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:08 smithi053 ceph-mon[77492]: pgmap v336: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:08.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.629+0000 7ff34dffb700 1 -- 172.21.15.53:0/713822657 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v39) v1 ==== 107+0+4394 (secure 0 0 0) 0x7ff34405a980 con 0x7ff3500ffd60 2024-09-16T01:02:08.631 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:08.631 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"btime":"2024-09-16T00:57:43:338343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:43.338328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 msgr2=0x7ff338070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 0x7ff338070b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff340006010 tx=0x7ff34001a040 comp rx=0 tx=0).stop 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 msgr2=0x7ff3501964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff34400b480 tx=0x7ff34400b790 comp rx=0 tx=0).stop 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 shutdown_connections 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7ff33806e680 0x7ff338070b30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3500ff3c0 0x7ff350195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 --2- 172.21.15.53:0/713822657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3500ffd60 0x7ff3501964b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 >> 172.21.15.53:0/713822657 conn(0x7ff3500fac80 msgr2=0x7ff350069150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:08.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 shutdown_connections 2024-09-16T01:02:08.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:08.632+0000 7ff357134700 1 -- 172.21.15.53:0/713822657 wait complete. 2024-09-16T01:02:08.634 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 34 2024-09-16T01:02:08.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:08 smithi152 ceph-mon[63606]: pgmap v336: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:09.310 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-16T01:02:09.310 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-16T01:02:09.528 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:09.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:09 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/713822657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-16T01:02:09.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:09 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/713822657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-16T01:02:10.682 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:10 smithi053 ceph-mon[77492]: pgmap v337: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:10.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:10 smithi152 ceph-mon[63606]: pgmap v337: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 -- 172.21.15.53:0/802974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 msgr2=0x7f702c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 --2- 172.21.15.53:0/802974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c103d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7014009910 tx=0x7f7014009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 -- 172.21.15.53:0/802974461 shutdown_connections 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 --2- 172.21.15.53:0/802974461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c103d30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 --2- 172.21.15.53:0/802974461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 0x7f702c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 -- 172.21.15.53:0/802974461 >> 172.21.15.53:0/802974461 conn(0x7f702c0fac80 msgr2=0x7f702c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 -- 172.21.15.53:0/802974461 shutdown_connections 2024-09-16T01:02:11.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.215+0000 7f7030938700 1 -- 172.21.15.53:0/802974461 wait complete. 2024-09-16T01:02:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 Processor -- start 2024-09-16T01:02:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 -- start start 2024-09-16T01:02:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 0x7f702c195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c196b00 con 0x7f702c0ffd60 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7030938700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c19a890 con 0x7f702c0ff3c0 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7029d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7029d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44794/0 (socket says 172.21.15.53:44794) 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.216+0000 7f7029d9b700 1 -- 172.21.15.53:0/3211387756 learned_addr learned my addr 172.21.15.53:0/3211387756 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f702a59c700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 0x7f702c195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7029d9b700 1 -- 172.21.15.53:0/3211387756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 msgr2=0x7f702c195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7029d9b700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 0x7f702c195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7029d9b700 1 -- 172.21.15.53:0/3211387756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140095f0 con 0x7f702c0ffd60 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7029d9b700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f701400bda0 tx=0x7f701400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701401d070 con 0x7f702c0ffd60 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7014004fb0 con 0x7f702c0ffd60 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c19ab10 con 0x7f702c0ffd60 2024-09-16T01:02:11.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701400f480 con 0x7f702c0ffd60 2024-09-16T01:02:11.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.217+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c19b000 con 0x7f702c0ffd60 2024-09-16T01:02:11.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.218+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c108640 con 0x7f702c0ffd60 2024-09-16T01:02:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.219+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7014022870 con 0x7f702c0ffd60 2024-09-16T01:02:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.219+0000 7f70237fe700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 0x7f7018070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.219+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f701408fb30 con 0x7f702c0ffd60 2024-09-16T01:02:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.219+0000 7f702a59c700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 0x7f7018070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.220+0000 7f702a59c700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 0x7f7018070b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70240060b0 tx=0x7f7024007790 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:11.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.224+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7014058db0 con 0x7f702c0ffd60 2024-09-16T01:02:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.491+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f702c197310 con 0x7f702c0ffd60 2024-09-16T01:02:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.492+0000 7f70237fe700 1 -- 172.21.15.53:0/3211387756 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v39) v1 ==== 107+0+4398 (secure 0 0 0) 0x7f701405c470 con 0x7f702c0ffd60 2024-09-16T01:02:11.493 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:11.493 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":35,"btime":"2024-09-16T00:57:51:270185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:50.488865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 msgr2=0x7f7018070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 0x7f7018070b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70240060b0 tx=0x7f7024007790 comp rx=0 tx=0).stop 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 msgr2=0x7f702c196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f701400bda0 tx=0x7f701400be80 comp rx=0 tx=0).stop 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 shutdown_connections 2024-09-16T01:02:11.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f701806e680 0x7f7018070b30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0ff3c0 0x7f702c195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 --2- 172.21.15.53:0/3211387756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f702c0ffd60 0x7f702c196420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 >> 172.21.15.53:0/3211387756 conn(0x7f702c0fac80 msgr2=0x7f702c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 shutdown_connections 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:11.494+0000 7f7030938700 1 -- 172.21.15.53:0/3211387756 wait complete. 2024-09-16T01:02:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 35 2024-09-16T01:02:11.817 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:11 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3211387756' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-16T01:02:11.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:11 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3211387756' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-16T01:02:12.130 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-16T01:02:12.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-16T01:02:12.343 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:12.725 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:12 smithi053 ceph-mon[77492]: pgmap v338: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:12.947 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:12 smithi152 ceph-mon[63606]: pgmap v338: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.062+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3522747648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 msgr2=0x7f83ec1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.062+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3522747648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec1008b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009910 tx=0x7f83dc009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3522747648 shutdown_connections 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3522747648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 0x7f83ec104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3522747648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec1008b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3522747648 >> 172.21.15.53:0/3522747648 conn(0x7f83ec0fbda0 msgr2=0x7f83ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3522747648 shutdown_connections 2024-09-16T01:02:14.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3522747648 wait complete. 2024-09-16T01:02:14.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 Processor -- start 2024-09-16T01:02:14.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.063+0000 7f83f0ae4700 1 -- start start 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83f0ae4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83f0ae4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 0x7f83ec073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83f0ae4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec073ad0 con 0x7f83ec1004e0 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83f0ae4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec073c10 con 0x7f83ec100e80 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57534/0 (socket says 172.21.15.53:57534) 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 -- 172.21.15.53:0/3294224719 learned_addr learned my addr 172.21.15.53:0/3294224719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83e9d9b700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 0x7f83ec073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 -- 172.21.15.53:0/3294224719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 msgr2=0x7f83ec073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 0x7f83ec073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 -- 172.21.15.53:0/3294224719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0095f0 con 0x7f83ec1004e0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83ea59c700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83dc006010 tx=0x7f83dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83dc01d070 con 0x7f83ec1004e0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83dc004fb0 con 0x7f83ec1004e0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec073e90 con 0x7f83ec1004e0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.064+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83dc022ea0 con 0x7f83ec1004e0 2024-09-16T01:02:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.065+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec1a23f0 con 0x7f83ec1004e0 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.066+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec1087f0 con 0x7f83ec1004e0 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.066+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f83dc00f690 con 0x7f83ec1004e0 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.066+0000 7f83e37fe700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 0x7f83d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.067+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f83dc08fc70 con 0x7f83ec1004e0 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.067+0000 7f83e9d9b700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 0x7f83d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.067+0000 7f83e9d9b700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 0x7f83d8070b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83ec074840 tx=0x7f83d4005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.071+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f83dc058e70 con 0x7f83ec1004e0 2024-09-16T01:02:14.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.351+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f83ec04f2a0 con 0x7f83ec1004e0 2024-09-16T01:02:14.352 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:14 smithi053 ceph-mon[77492]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:02:14.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.352+0000 7f83e37fe700 1 -- 172.21.15.53:0/3294224719 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v39) v1 ==== 107+0+5242 (secure 0 0 0) 0x7f83dc027090 con 0x7f83ec1004e0 2024-09-16T01:02:14.353 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:14.353 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"btime":"2024-09-16T00:57:52:275487+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44345,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/219767319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":219767319},{"type":"v1","addr":"172.21.15.152:6827","nonce":219767319}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:51.278061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 msgr2=0x7f83d8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 0x7f83d8070b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83ec074840 tx=0x7f83d4005cf0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 msgr2=0x7f83ec073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83dc006010 tx=0x7f83dc00be20 comp rx=0 tx=0).stop 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 shutdown_connections 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7f83d806e680 0x7f83d8070b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ec1004e0 0x7f83ec073050 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 --2- 172.21.15.53:0/3294224719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83ec100e80 0x7f83ec073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:14.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 >> 172.21.15.53:0/3294224719 conn(0x7f83ec0fbda0 msgr2=0x7f83ec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:14.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 shutdown_connections 2024-09-16T01:02:14.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:14.354+0000 7f83f0ae4700 1 -- 172.21.15.53:0/3294224719 wait complete. 2024-09-16T01:02:14.356 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 36 2024-09-16T01:02:14.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:14 smithi152 ceph-mon[63606]: from='mgr.34104 172.21.15.53:0/1473394666' entity='mgr.smithi053.cjiiek' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T01:02:15.049 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-16T01:02:15.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-16T01:02:15.257 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:15.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:15 smithi053 ceph-mon[77492]: pgmap v339: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:15.319 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:15 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3294224719' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-16T01:02:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:15 smithi152 ceph-mon[63606]: pgmap v339: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:15.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:15 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3294224719' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-16T01:02:17.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 -- 172.21.15.53:0/2051334646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 msgr2=0x7fb86410a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 --2- 172.21.15.53:0/2051334646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb86410a220 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb850009910 tx=0x7fb850009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:17.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 -- 172.21.15.53:0/2051334646 shutdown_connections 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 --2- 172.21.15.53:0/2051334646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb86410a220 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 --2- 172.21.15.53:0/2051334646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 0x7fb8641017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 -- 172.21.15.53:0/2051334646 >> 172.21.15.53:0/2051334646 conn(0x7fb8640fac90 msgr2=0x7fb8640fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 -- 172.21.15.53:0/2051334646 shutdown_connections 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.168+0000 7fb86acd8700 1 -- 172.21.15.53:0/2051334646 wait complete. 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 Processor -- start 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 -- start start 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 0x7fb864195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864196a60 con 0x7fb864101d20 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb86acd8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86419a7f0 con 0x7fb864101410 2024-09-16T01:02:17.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57552/0 (socket says 172.21.15.53:57552) 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 -- 172.21.15.53:0/3359976993 learned_addr learned my addr 172.21.15.53:0/3359976993 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb868a74700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 0x7fb864195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 -- 172.21.15.53:0/3359976993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 msgr2=0x7fb864195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 0x7fb864195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 -- 172.21.15.53:0/3359976993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500095f0 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.169+0000 7fb863fff700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb850006010 tx=0x7fb85000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.170+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85001d070 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.170+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb850005dc0 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.170+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86419aa70 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.170+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb850017400 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.170+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86419af60 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.171+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864107890 con 0x7fb864101d20 2024-09-16T01:02:17.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.172+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb850003a60 con 0x7fb864101d20 2024-09-16T01:02:17.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.172+0000 7fb861ffb700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 0x7fb854070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:17.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.172+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb85008fa50 con 0x7fb864101d20 2024-09-16T01:02:17.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.172+0000 7fb868a74700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 0x7fb854070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:17.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.173+0000 7fb868a74700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 0x7fb854070b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb858005950 tx=0x7fb85800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:17.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.177+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb850058c20 con 0x7fb864101d20 2024-09-16T01:02:17.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.440+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fb86404f2a0 con 0x7fb864101d20 2024-09-16T01:02:17.441 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:17 smithi053 ceph-mon[77492]: pgmap v340: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.441+0000 7fb861ffb700 1 -- 172.21.15.53:0/3359976993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v39) v1 ==== 107+0+5251 (secure 0 0 0) 0x7fb85005c2e0 con 0x7fb864101d20 2024-09-16T01:02:17.443 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:17.443 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"btime":"2024-09-16T00:57:53:282625+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44345,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/219767319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":219767319},{"type":"v1","addr":"172.21.15.152:6827","nonce":219767319}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:53.282622+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:active","state_seq":19,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34382,"qdb_cluster":[34382]},"id":1}]} 2024-09-16T01:02:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 msgr2=0x7fb854070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 0x7fb854070b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb858005950 tx=0x7fb85800b410 comp rx=0 tx=0).stop 2024-09-16T01:02:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 msgr2=0x7fb864196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb850006010 tx=0x7fb85000bd70 comp rx=0 tx=0).stop 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 shutdown_connections 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fb85406e680 0x7fb854070b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb864101410 0x7fb864195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 --2- 172.21.15.53:0/3359976993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb864101d20 0x7fb864196380 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 >> 172.21.15.53:0/3359976993 conn(0x7fb8640fac90 msgr2=0x7fb8641049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.443+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 shutdown_connections 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:17.444+0000 7fb86acd8700 1 -- 172.21.15.53:0/3359976993 wait complete. 2024-09-16T01:02:17.445 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 37 2024-09-16T01:02:17.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:17 smithi152 ceph-mon[63606]: pgmap v340: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:18.141 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-16T01:02:18.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-16T01:02:18.356 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:18.477 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:18 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3359976993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-16T01:02:18.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:18 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3359976993' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-16T01:02:19.481 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:19 smithi053 ceph-mon[77492]: pgmap v341: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:19.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:19 smithi152 ceph-mon[63606]: pgmap v341: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:20.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 -- 172.21.15.53:0/3866132140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 msgr2=0x7fe77c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 --2- 172.21.15.53:0/3866132140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c104e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009910 tx=0x7fe76c009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 -- 172.21.15.53:0/3866132140 shutdown_connections 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 --2- 172.21.15.53:0/3866132140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c104e50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 --2- 172.21.15.53:0/3866132140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 0x7fe77c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 -- 172.21.15.53:0/3866132140 >> 172.21.15.53:0/3866132140 conn(0x7fe77c0fbda0 msgr2=0x7fe77c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 -- 172.21.15.53:0/3866132140 shutdown_connections 2024-09-16T01:02:20.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.050+0000 7fe78117d700 1 -- 172.21.15.53:0/3866132140 wait complete. 2024-09-16T01:02:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.051+0000 7fe78117d700 1 Processor -- start 2024-09-16T01:02:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.051+0000 7fe78117d700 1 -- start start 2024-09-16T01:02:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe78117d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 0x7fe77c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe78117d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe78117d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c196b30 con 0x7fe77c100e80 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe78117d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c19a8c0 con 0x7fe77c1004e0 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57564/0 (socket says 172.21.15.53:57564) 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 0x7fe77c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 -- 172.21.15.53:0/3826950443 learned_addr learned my addr 172.21.15.53:0/3826950443 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 -- 172.21.15.53:0/3826950443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 msgr2=0x7fe77c195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 0x7fe77c195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 -- 172.21.15.53:0/3826950443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0095f0 con 0x7fe77c100e80 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.052+0000 7fe77a59c700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0092e0 tx=0x7fe76c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.053+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c01d070 con 0x7fe77c100e80 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.053+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c19ab40 con 0x7fe77c100e80 2024-09-16T01:02:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.053+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe76c005dc0 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.053+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c19b030 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.053+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c017400 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.054+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c005320 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.055+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe76c003a60 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.055+0000 7fe773fff700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 0x7fe768070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.055+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe76c08f9b0 con 0x7fe77c100e80 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.055+0000 7fe77ad9d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 0x7fe768070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:20.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.056+0000 7fe77ad9d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 0x7fe768070b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe764005950 tx=0x7fe76400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.059+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe76c058b00 con 0x7fe77c100e80 2024-09-16T01:02:20.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.320+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fe75c005190 con 0x7fe77c100e80 2024-09-16T01:02:20.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.321+0000 7fe773fff700 1 -- 172.21.15.53:0/3826950443 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v39) v1 ==== 107+0+5250 (secure 0 0 0) 0x7fe76c05c1c0 con 0x7fe77c100e80 2024-09-16T01:02:20.323 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-16T01:02:20.324 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"btime":"2024-09-16T00:57:59:579319+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34414,"name":"cephfs.smithi053.jsdknu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6829/953088818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":953088818},{"type":"v1","addr":"172.21.15.53:6829","nonce":953088818}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44341,"name":"cephfs.smithi152.gatezw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1770820177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1770820177},{"type":"v1","addr":"172.21.15.152:6825","nonce":1770820177}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44345,"name":"cephfs.smithi152.ocdywv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/219767319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":219767319},{"type":"v1","addr":"172.21.15.152:6827","nonce":219767319}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T00:47:35.714216+0000","modified":"2024-09-16T00:57:58.582835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34382":{"gid":34382,"name":"cephfs.smithi053.cdsuag","rank":0,"incarnation":34,"state":"up:active","state_seq":19,"addr":"172.21.15.53:6827/1815483431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1815483431},{"type":"v1","addr":"172.21.15.53:6827","nonce":1815483431}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34382,"qdb_cluster":[34382]},"id":1}]} 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 msgr2=0x7fe768070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 0x7fe768070b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe764005950 tx=0x7fe76400b410 comp rx=0 tx=0).stop 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 msgr2=0x7fe77c196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0092e0 tx=0x7fe76c00bd70 comp rx=0 tx=0).stop 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 shutdown_connections 2024-09-16T01:02:20.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe76806e680 0x7fe768070b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c1004e0 0x7fe77c195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 --2- 172.21.15.53:0/3826950443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe77c100e80 0x7fe77c196450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 >> 172.21.15.53:0/3826950443 conn(0x7fe77c0fbda0 msgr2=0x7fe77c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 shutdown_connections 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:20.323+0000 7fe78117d700 1 -- 172.21.15.53:0/3826950443 wait complete. 2024-09-16T01:02:20.327 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2024-09-16T01:02:20.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:20 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/3826950443' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-16T01:02:20.710 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:20 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/3826950443' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-16T01:02:21.153 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T01:02:21.163 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T01:02:21.164 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T01:02:21.164 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:02:21.182 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-16T01:02:21.182 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:02:21.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:02:21.493 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:21.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:21 smithi053 ceph-mon[77492]: pgmap v342: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:21.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:21 smithi152 ceph-mon[63606]: pgmap v342: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 -- 172.21.15.53:0/1411850051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ffd60 msgr2=0x7fe078103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/1411850051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ffd60 0x7fe078103d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009910 tx=0x7fe06c009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 -- 172.21.15.53:0/1411850051 shutdown_connections 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/1411850051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ffd60 0x7fe078103d30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/1411850051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ff3c0 0x7fe0780ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 -- 172.21.15.53:0/1411850051 >> 172.21.15.53:0/1411850051 conn(0x7fe0780fac80 msgr2=0x7fe0780fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 -- 172.21.15.53:0/1411850051 shutdown_connections 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.163+0000 7fe07ca7d700 1 -- 172.21.15.53:0/1411850051 wait complete. 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 Processor -- start 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 -- start start 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 0x7fe0781972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781978c0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07ca7d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078197a30 con 0x7fe0780ffd60 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58618/0 (socket says 172.21.15.53:58618) 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 -- 172.21.15.53:0/2883746842 learned_addr learned my addr 172.21.15.53:0/2883746842 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe075d9b700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 0x7fe0781972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 -- 172.21.15.53:0/2883746842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 msgr2=0x7fe0781972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 0x7fe0781972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe07659c700 1 -- 172.21.15.53:0/2883746842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0095f0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.164+0000 7fe075d9b700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 0x7fe0781972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe07659c700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d8d0 tx=0x7fe06800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe068009940 con 0x7fe0780ff3c0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe068010460 con 0x7fe0780ff3c0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07819fdd0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06800f5f0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.165+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0781a0290 con 0x7fe0780ff3c0 2024-09-16T01:02:23.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.166+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe078107730 con 0x7fe0780ff3c0 2024-09-16T01:02:23.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.166+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe0680105d0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.167+0000 7fe0677fe700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 0x7fe060070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.167+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe06808e6a0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.167+0000 7fe075d9b700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 0x7fe060070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.167+0000 7fe075d9b700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 0x7fe060070b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006010 tx=0x7fe06c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:23.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.172+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe0680577f0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.400+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe07804f2a0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.401+0000 7fe0677fe700 1 -- 172.21.15.53:0/2883746842 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v85) v1 ==== 81+0+2170 (secure 0 0 0) 0x7fe06805aeb0 con 0x7fe0780ff3c0 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6827/2059330716 2024-09-17T00:57:43.332485+0000 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6826/2059330716 2024-09-17T00:57:43.332485+0000 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6825/3120948580 2024-09-17T00:57:19.507531+0000 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6826/239552761 2024-09-17T00:56:37.112539+0000 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/3494092676 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.402 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2799825029 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2239443060 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/1070054548 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/1183207171 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2962488065 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2791398459 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2640944843 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2847731489 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2403024149 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/2 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/2 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3622055572 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/134588470 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2704105110 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:23.403 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1233292445 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2656819359 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6827/239552761 2024-09-17T00:56:37.112539+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/937962924 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/4137071784 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2434528936 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2889850801 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1610550310 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3768938866 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1711068346 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6829/3166645188 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/3494092676 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.404 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3331100244 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6828/3166645188 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/16131959 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6824/3120948580 2024-09-17T00:57:19.507531+0000 2024-09-16T01:02:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/3143542051 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2131653498 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 msgr2=0x7fe060070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 0x7fe060070b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe06c006010 tx=0x7fe06c01a040 comp rx=0 tx=0).stop 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 msgr2=0x7fe078196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d8d0 tx=0x7fe06800dc90 comp rx=0 tx=0).stop 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 shutdown_connections 2024-09-16T01:02:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fe06006e680 0x7fe060070b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0780ff3c0 0x7fe078196d60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 --2- 172.21.15.53:0/2883746842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0780ffd60 0x7fe0781972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 >> 172.21.15.53:0/2883746842 conn(0x7fe0780fac80 msgr2=0x7fe0780fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 shutdown_connections 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:23.404+0000 7fe07ca7d700 1 -- 172.21.15.53:0/2883746842 wait complete. 2024-09-16T01:02:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:listed 37 entries 2024-09-16T01:02:23.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:23 smithi152 ceph-mon[63606]: pgmap v343: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:23.760 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:23 smithi053 ceph-mon[77492]: pgmap v343: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-16T01:02:24.084 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:02:24.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:24.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:02:24.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T01:02:24.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:24.116 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:02:24.180 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T01:02:24.180 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:02:24.203 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-16T01:02:24.203 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:02:24.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:02:24.473 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/mon.smithi053/config 2024-09-16T01:02:24.604 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:24 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/2883746842' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:02:24.613 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:24 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/2883746842' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:02:25.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:25 smithi053 ceph-mon[77492]: pgmap v344: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:25.697 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:25 smithi152 ceph-mon[63606]: pgmap v344: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:26.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 -- 172.21.15.53:0/395271167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ff3c0 msgr2=0x7fdda80ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 --2- 172.21.15.53:0/395271167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ff3c0 0x7fdda80ff790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009910 tx=0x7fdd98009c20 comp rx=0 tx=0).stop 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 -- 172.21.15.53:0/395271167 shutdown_connections 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 --2- 172.21.15.53:0/395271167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ffd60 0x7fdda8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 --2- 172.21.15.53:0/395271167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ff3c0 0x7fdda80ff790 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 -- 172.21.15.53:0/395271167 >> 172.21.15.53:0/395271167 conn(0x7fdda80fac80 msgr2=0x7fdda80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 -- 172.21.15.53:0/395271167 shutdown_connections 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.219+0000 7fddacbf1700 1 -- 172.21.15.53:0/395271167 wait complete. 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 Processor -- start 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 -- start start 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 0x7fdda8195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8196a90 con 0x7fdda80ffd60 2024-09-16T01:02:26.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fddacbf1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda819a820 con 0x7fdda80ff3c0 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fdda5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fdda5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58634/0 (socket says 172.21.15.53:58634) 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.220+0000 7fdda5d9b700 1 -- 172.21.15.53:0/4116655882 learned_addr learned my addr 172.21.15.53:0/4116655882 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda659c700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 0x7fdda8195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda5d9b700 1 -- 172.21.15.53:0/4116655882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 msgr2=0x7fdda8195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda5d9b700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 0x7fdda8195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda5d9b700 1 -- 172.21.15.53:0/4116655882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980095f0 con 0x7fdda80ffd60 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda659c700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 0x7fdda8195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdda5d9b700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00d8d0 tx=0x7fdd9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c0041f0 con 0x7fdda80ffd60 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd9c007620 con 0x7fdda80ffd60 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda819ab00 con 0x7fdda80ffd60 2024-09-16T01:02:26.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c003c50 con 0x7fdda80ffd60 2024-09-16T01:02:26.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.221+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda819b050 con 0x7fdda80ffd60 2024-09-16T01:02:26.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.222+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda81076d0 con 0x7fdda80ffd60 2024-09-16T01:02:26.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.223+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdd9c00b750 con 0x7fdda80ffd60 2024-09-16T01:02:26.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.223+0000 7fdd977fe700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 0x7fdd90070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:02:26.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.223+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdd9c08e1c0 con 0x7fdda80ffd60 2024-09-16T01:02:26.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.223+0000 7fdda659c700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 0x7fdd90070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:02:26.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.224+0000 7fdda659c700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 0x7fdd90070b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005b40 tx=0x7fdd9801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:02:26.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.228+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd9c057390 con 0x7fdda80ffd60 2024-09-16T01:02:26.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.456+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdda819b2c0 con 0x7fdda80ffd60 2024-09-16T01:02:26.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.456+0000 7fdd977fe700 1 -- 172.21.15.53:0/4116655882 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v85) v1 ==== 81+0+2170 (secure 0 0 0) 0x7fdd9c01f890 con 0x7fdda80ffd60 2024-09-16T01:02:26.457 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6827/2059330716 2024-09-17T00:57:43.332485+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6826/2059330716 2024-09-17T00:57:43.332485+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6825/3120948580 2024-09-17T00:57:19.507531+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6826/239552761 2024-09-17T00:56:37.112539+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/3494092676 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2799825029 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2239443060 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/1070054548 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/1183207171 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2962488065 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2791398459 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2640944843 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.458 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2847731489 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2403024149 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6801/2 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/2 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3622055572 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/134588470 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2704105110 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1233292445 2024-09-17T00:41:32.995408+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2656819359 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6827/239552761 2024-09-17T00:56:37.112539+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/937962924 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/4137071784 2024-09-17T00:50:04.570948+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2434528936 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:26.459 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/2889850801 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1610550310 2024-09-17T00:40:58.741023+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3768938866 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/1711068346 2024-09-17T00:42:40.312465+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6829/3166645188 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6800/3494092676 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/3331100244 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6828/3166645188 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/16131959 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:6824/3120948580 2024-09-17T00:57:19.507531+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.152:0/3143542051 2024-09-17T00:50:59.445778+0000 2024-09-16T01:02:26.460 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:0/2131653498 2024-09-17T00:52:14.122700+0000 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 msgr2=0x7fdd90070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 0x7fdd90070b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005b40 tx=0x7fdd9801a040 comp rx=0 tx=0).stop 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 msgr2=0x7fdda81963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00d8d0 tx=0x7fdd9c00dc90 comp rx=0 tx=0).stop 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 shutdown_connections 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:6800/1189751573,v1:172.21.15.53:6801/1189751573] conn(0x7fdd9006e680 0x7fdd90070b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda80ff3c0 0x7fdda8195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 --2- 172.21.15.53:0/4116655882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda80ffd60 0x7fdda81963b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:02:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 >> 172.21.15.53:0/4116655882 conn(0x7fdda80fac80 msgr2=0x7fdda80fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:02:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 shutdown_connections 2024-09-16T01:02:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-16T01:02:26.459+0000 7fddacbf1700 1 -- 172.21.15.53:0/4116655882 wait complete. 2024-09-16T01:02:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:listed 37 entries 2024-09-16T01:02:27.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:02:27.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:02:27.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-09-16T01:02:27.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.306 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:02:27.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.378 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-16T01:02:27.399 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:02:27.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:02:27.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-09-16T01:02:27.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:27 smithi053 ceph-mon[77492]: pgmap v345: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:27.540 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:27 smithi053 ceph-mon[77492]: from='client.? 172.21.15.53:0/4116655882' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:02:27.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.572 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-16T01:02:27.590 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:02:27.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:02:27.655 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:27 smithi152 ceph-mon[63606]: pgmap v345: 65 pgs: 65 active+clean; 196 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-16T01:02:27.656 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:27 smithi152 ceph-mon[63606]: from='client.? 172.21.15.53:0/4116655882' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:02:27.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:02:27.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-16T01:02:27.766 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T01:02:27.777 INFO:tasks.cephadm:Teardown begin 2024-09-16T01:02:27.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:27.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:02:27.835 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T01:02:27.836 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:02:27.866 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:02:27.892 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T01:02:27.892 INFO:tasks.cephadm.mon.smithi053:Stopping mon.smithi053... 2024-09-16T01:02:27.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053 2024-09-16T01:02:28.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:27 smithi053 systemd[1]: Stopping Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:28 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[77488]: 2024-09-16T01:02:28.212+0000 7fafdb8f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi053 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:28 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053[77488]: 2024-09-16T01:02:28.212+0000 7fafdb8f9640 -1 mon.smithi053@0(leader) e3 *** Got Signal Terminated *** 2024-09-16T01:02:28.569 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:28 smithi053 podman[129810]: 2024-09-16 01:02:28.456681918 +0000 UTC m=+0.359030959 container died e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:02:29.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:28 smithi053 podman[129810]: 2024-09-16 01:02:28.870499062 +0000 UTC m=+0.772848102 container cleanup e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T01:02:29.069 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:28 smithi053 bash[129810]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053 2024-09-16T01:02:29.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service' 2024-09-16T01:02:29.392 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:29 smithi053 podman[129895]: 2024-09-16 01:02:29.124751845 +0000 UTC m=+0.665317571 container remove e4bf16c85251450c92cad95d51173aae5d956b9a755da4779ba95766f55f0191 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi053, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-16T01:02:29.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:29 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Deactivated successfully. 2024-09-16T01:02:29.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:29 smithi053 systemd[1]: Stopped Ceph mon.smithi053 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T01:02:29.393 INFO:journalctl@ceph.mon.smithi053.smithi053.stdout:Sep 16 01:02:29 smithi053 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi053.service: Consumed 9.899s CPU time. 2024-09-16T01:02:29.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:02:29.423 INFO:tasks.cephadm.mon.smithi053:Stopped mon.smithi053 2024-09-16T01:02:29.423 INFO:tasks.cephadm.mon.smithi152:Stopping mon.smithi152... 2024-09-16T01:02:29.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152 2024-09-16T01:02:29.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:29 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:29.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:29 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152[63602]: 2024-09-16T01:02:29.704+0000 7fd42b275640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:29.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:29 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152[63602]: 2024-09-16T01:02:29.704+0000 7fd42b275640 -1 mon.smithi152@1(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:02:30.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:29 smithi152 podman[92321]: 2024-09-16 01:02:29.969023851 +0000 UTC m=+0.356621430 container died 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T01:02:30.598 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 podman[92321]: 2024-09-16 01:02:30.396480665 +0000 UTC m=+0.784078246 container cleanup 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-16T01:02:30.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 bash[92321]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152 2024-09-16T01:02:30.837 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service' 2024-09-16T01:02:30.860 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 podman[92341]: 2024-09-16 01:02:30.598065298 +0000 UTC m=+0.629490955 container remove 2521499d6cab1d298f4b1ff4353c1f48d2a95992c8229ff82d3755579ccb7c31 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-mon-smithi152, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-16T01:02:30.860 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service: Deactivated successfully. 2024-09-16T01:02:30.860 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T01:02:30.860 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 16 01:02:30 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@mon.smithi152.service: Consumed 5.624s CPU time. 2024-09-16T01:02:30.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:02:30.902 INFO:tasks.cephadm.mon.smithi152:Stopped mon.smithi152 2024-09-16T01:02:30.902 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T01:02:30.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.0 2024-09-16T01:02:31.216 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:30 smithi053 systemd[1]: Stopping Ceph osd.0 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:31.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:31 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T01:02:31.215+0000 7fce486d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:31.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:31 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T01:02:31.215+0000 7fce486d3640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-16T01:02:31.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:31 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0[83732]: 2024-09-16T01:02:31.215+0000 7fce486d3640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:02:36.820 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:36 smithi053 podman[130027]: 2024-09-16 01:02:36.575326026 +0000 UTC m=+5.464674298 container died b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:02:37.260 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 podman[130027]: 2024-09-16 01:02:37.033792498 +0000 UTC m=+5.923140802 container cleanup b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:02:37.260 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 bash[130027]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0 2024-09-16T01:02:37.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 podman[130054]: 2024-09-16 01:02:37.260042096 +0000 UTC m=+0.684394859 container remove b2f531c703f71c1da99181460dffec3b83eeaaab7c4bca8e5b8a1ebeb49b01bd (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-16T01:02:37.873 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 podman[130145]: 2024-09-16 01:02:37.606194399 +0000 UTC m=+0.016636682 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:02:37.873 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 podman[130145]: 2024-09-16 01:02:37.727467445 +0000 UTC m=+0.137909715 container create b3446e83badf1f9dd9e7952082eb0e943edc96db6b67e58fb725deaf24055d70 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T01:02:38.193 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:37 smithi053 podman[130145]: 2024-09-16 01:02:37.996853328 +0000 UTC m=+0.407295599 container init b3446e83badf1f9dd9e7952082eb0e943edc96db6b67e58fb725deaf24055d70 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-16T01:02:38.193 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:38 smithi053 podman[130145]: 2024-09-16 01:02:38.000868518 +0000 UTC m=+0.411310805 container start b3446e83badf1f9dd9e7952082eb0e943edc96db6b67e58fb725deaf24055d70 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:02:38.193 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:38 smithi053 podman[130145]: 2024-09-16 01:02:38.05515063 +0000 UTC m=+0.465592901 container attach b3446e83badf1f9dd9e7952082eb0e943edc96db6b67e58fb725deaf24055d70 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:02:38.559 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 16 01:02:38 smithi053 podman[130145]: 2024-09-16 01:02:38.193356925 +0000 UTC m=+0.603799206 container died b3446e83badf1f9dd9e7952082eb0e943edc96db6b67e58fb725deaf24055d70 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-16T01:02:38.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T01:02:38.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:02:38.907 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T01:02:38.907 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T01:02:38.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.1 2024-09-16T01:02:39.230 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:38 smithi053 systemd[1]: Stopping Ceph osd.1 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:39.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:39 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T01:02:39.228+0000 7f065d8bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:39.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:39 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T01:02:39.228+0000 7f065d8bb640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-16T01:02:39.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:39 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1[87276]: 2024-09-16T01:02:39.228+0000 7f065d8bb640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:02:44.873 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:44 smithi053 podman[130248]: 2024-09-16 01:02:44.590968089 +0000 UTC m=+5.484350924 container died 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T01:02:45.271 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:44 smithi053 podman[130248]: 2024-09-16 01:02:44.970230672 +0000 UTC m=+5.863613506 container cleanup 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:02:45.271 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:44 smithi053 bash[130248]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1 2024-09-16T01:02:45.569 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130262]: 2024-09-16 01:02:45.271429976 +0000 UTC m=+0.682574559 container remove 4bfbceabcb0ce47124c45c976fa2af31b948d1f26704d5d877c329b74bd09114 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-16T01:02:45.891 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130354]: 2024-09-16 01:02:45.501842561 +0000 UTC m=+0.016787099 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:02:45.891 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130354]: 2024-09-16 01:02:45.605515555 +0000 UTC m=+0.120460083 container create 5f00ec278ea913716cc9cbb023086f2020c13647b94603499fbc469ea69646f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-16T01:02:45.891 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130354]: 2024-09-16 01:02:45.891336792 +0000 UTC m=+0.406281317 container init 5f00ec278ea913716cc9cbb023086f2020c13647b94603499fbc469ea69646f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T01:02:46.319 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130354]: 2024-09-16 01:02:45.894981187 +0000 UTC m=+0.409925717 container start 5f00ec278ea913716cc9cbb023086f2020c13647b94603499fbc469ea69646f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:02:46.319 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:45 smithi053 podman[130354]: 2024-09-16 01:02:45.974518063 +0000 UTC m=+0.489462588 container attach 5f00ec278ea913716cc9cbb023086f2020c13647b94603499fbc469ea69646f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T01:02:46.320 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 16 01:02:46 smithi053 podman[130354]: 2024-09-16 01:02:46.087243299 +0000 UTC m=+0.602187834 container died 5f00ec278ea913716cc9cbb023086f2020c13647b94603499fbc469ea69646f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T01:02:46.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T01:02:46.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:02:46.784 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T01:02:46.785 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T01:02:46.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.2 2024-09-16T01:02:47.069 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:46 smithi053 systemd[1]: Stopping Ceph osd.2 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:47.569 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:47 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T01:02:47.156+0000 7f085e3c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:47.570 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:47 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T01:02:47.156+0000 7f085e3c9640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-16T01:02:47.570 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:47 smithi053 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2[90564]: 2024-09-16T01:02:47.156+0000 7f085e3c9640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:02:53.050 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:52 smithi053 podman[130456]: 2024-09-16 01:02:52.709788744 +0000 UTC m=+5.692212108 container died d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:02:53.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:53 smithi053 podman[130456]: 2024-09-16 01:02:53.147698248 +0000 UTC m=+6.130121611 container cleanup d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:02:53.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:53 smithi053 bash[130456]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2 2024-09-16T01:02:53.777 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:53 smithi053 podman[130471]: 2024-09-16 01:02:53.357320044 +0000 UTC m=+0.645527973 container remove d1d60bda6021aa85c2e1afe6d5690250bfdc568cc685014f4ba61486d4906b16 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:02:54.030 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:53 smithi053 podman[130559]: 2024-09-16 01:02:53.68044634 +0000 UTC m=+0.016306073 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:02:54.030 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:53 smithi053 podman[130559]: 2024-09-16 01:02:53.816363309 +0000 UTC m=+0.152223086 container create 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:02:54.030 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:54 smithi053 podman[130559]: 2024-09-16 01:02:54.027060756 +0000 UTC m=+0.362920489 container init 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T01:02:54.031 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:54 smithi053 podman[130559]: 2024-09-16 01:02:54.030447849 +0000 UTC m=+0.366307590 container start 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T01:02:54.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:54 smithi053 podman[130559]: 2024-09-16 01:02:54.118875276 +0000 UTC m=+0.454735021 container attach 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:02:54.319 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:54 smithi053 podman[130559]: 2024-09-16 01:02:54.22623337 +0000 UTC m=+0.562093103 container died 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T01:02:54.859 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 16 01:02:54 smithi053 podman[130583]: 2024-09-16 01:02:54.838758863 +0000 UTC m=+0.604754408 container remove 8d5152666579aacc4bd1d654e8067d0cf42690085b361e4353b2f6e3cc8d4ed0 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:02:54.865 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T01:02:54.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:02:54.905 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T01:02:54.906 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T01:02:54.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.3 2024-09-16T01:02:55.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:54 smithi152 systemd[1]: Stopping Ceph osd.3 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:02:55.697 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:55 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T01:02:55.225+0000 7f7a48fa9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:02:55.697 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:55 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T01:02:55.225+0000 7f7a48fa9640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-16T01:02:55.697 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:55 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T01:02:55.225+0000 7f7a48fa9640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:02:58.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:02:57 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:02:57.761+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:02:58.697 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:58 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T01:02:58.424+0000 7f7a415a6640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.902630+0000 front 2024-09-16T01:02:33.902525+0000 (oldest deadline 2024-09-16T01:02:57.402457+0000) 2024-09-16T01:02:59.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:02:58 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:02:58.758+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:02:59.765 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:02:59 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3[68819]: 2024-09-16T01:02:59.474+0000 7f7a415a6640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.902630+0000 front 2024-09-16T01:02:33.902525+0000 (oldest deadline 2024-09-16T01:02:57.402457+0000) 2024-09-16T01:02:59.765 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:02:59 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:02:59.577+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:00.112 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:02:59 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:02:59.764+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:00.944 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:00 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:00.619+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:00.944 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:00 smithi152 podman[92465]: 2024-09-16 01:03:00.713504567 +0000 UTC m=+5.600007760 container died f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-16T01:03:00.945 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:00 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:00.805+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:01.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92465]: 2024-09-16 01:03:01.125643593 +0000 UTC m=+6.012146830 container cleanup f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:03:01.197 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 bash[92465]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3 2024-09-16T01:03:01.636 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92481]: 2024-09-16 01:03:01.327201152 +0000 UTC m=+0.612093410 container remove f67a3bbb671d7bfdb5fc9c639ba8c1cbef26cd05ee52f8b3babe2b14c088bf57 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-16T01:03:01.888 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:01 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:01.635+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:01.888 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:01 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:01.837+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:01.888 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92573]: 2024-09-16 01:03:01.645239077 +0000 UTC m=+0.015983467 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:03:01.888 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92573]: 2024-09-16 01:03:01.761832394 +0000 UTC m=+0.132576832 container create 185b09e9dc5f3523cc9652f45dfa074717003807104e8f833048c73c02a19b3b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:03:02.183 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92573]: 2024-09-16 01:03:01.981448041 +0000 UTC m=+0.352192427 container init 185b09e9dc5f3523cc9652f45dfa074717003807104e8f833048c73c02a19b3b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-16T01:03:02.183 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:01 smithi152 podman[92573]: 2024-09-16 01:03:01.984809531 +0000 UTC m=+0.355553916 container start 185b09e9dc5f3523cc9652f45dfa074717003807104e8f833048c73c02a19b3b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-16T01:03:02.183 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:02 smithi152 podman[92573]: 2024-09-16 01:03:02.056422125 +0000 UTC m=+0.427166518 container attach 185b09e9dc5f3523cc9652f45dfa074717003807104e8f833048c73c02a19b3b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T01:03:02.447 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 16 01:03:02 smithi152 podman[92573]: 2024-09-16 01:03:02.182698039 +0000 UTC m=+0.553442425 container died 185b09e9dc5f3523cc9652f45dfa074717003807104e8f833048c73c02a19b3b (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T01:03:02.769 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:02 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:02.586+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:02.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T01:03:02.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:03:02.830 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T01:03:02.830 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T01:03:02.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4 2024-09-16T01:03:03.189 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:02 smithi152 systemd[1]: Stopping Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:03:03.190 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:02 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:02.802+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:03.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:03 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:03.188+0000 7faaab6b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:03:03.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:03 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:03.188+0000 7faaab6b8640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-16T01:03:03.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:03 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:03.188+0000 7faaab6b8640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:03:03.802 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:03 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:03.619+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:04.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:03 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:03.801+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:04.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:04 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:04.640+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:04.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:04 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:04.809+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:05.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:05 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:05.644+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:05.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:05 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:05.796+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:05.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:05 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:05.796+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:06.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:06 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:06.615+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:06.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:06 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:06.775+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:06.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:06 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:06.775+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:07.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:07 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:07.821+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:07.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:07 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:07.821+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:07.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:07 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:07.653+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.230749+0000 front 2024-09-16T01:02:33.230831+0000 (oldest deadline 2024-09-16T01:02:59.130804+0000) 2024-09-16T01:03:07.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:07 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4[71754]: 2024-09-16T01:03:07.653+0000 7faaa3cb5640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:39.131242+0000 front 2024-09-16T01:02:39.131298+0000 (oldest deadline 2024-09-16T01:03:06.731608+0000) 2024-09-16T01:03:08.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:08 smithi152 podman[92684]: 2024-09-16 01:03:08.64485982 +0000 UTC m=+5.584241188 container died 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T01:03:08.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:08 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:08.776+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:08.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:08 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:08.776+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:09.375 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92684]: 2024-09-16 01:03:09.122600034 +0000 UTC m=+6.061981428 container cleanup 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T01:03:09.375 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 bash[92684]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4 2024-09-16T01:03:09.697 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92704]: 2024-09-16 01:03:09.374200348 +0000 UTC m=+0.722455767 container remove 872bbbf946b9f6a9d62320e98e9d497ade125c0a5625295a4e522091af860bfc (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-16T01:03:10.003 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:09 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:09.810+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:10.003 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:09 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:09.810+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:10.003 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92790]: 2024-09-16 01:03:09.601936157 +0000 UTC m=+0.015901804 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:03:10.003 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92790]: 2024-09-16 01:03:09.716727188 +0000 UTC m=+0.130692821 container create cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:03:10.003 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92790]: 2024-09-16 01:03:09.927902456 +0000 UTC m=+0.341868087 container init cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:03:10.004 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:09 smithi152 podman[92790]: 2024-09-16 01:03:09.931279102 +0000 UTC m=+0.345244746 container start cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T01:03:10.004 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 podman[92790]: 2024-09-16 01:03:10.002743843 +0000 UTC m=+0.416709486 container attach cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-16T01:03:10.447 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 podman[92790]: 2024-09-16 01:03:10.12422473 +0000 UTC m=+0.538190362 container died cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e) 2024-09-16T01:03:10.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T01:03:10.712 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 podman[92812]: 2024-09-16 01:03:10.664947723 +0000 UTC m=+0.535333087 container remove cf8e7cef8f2cc70d9f59921b3174e6024775979b6d47058cdb12bd613b92fd79 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T01:03:10.713 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-16T01:03:10.713 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 systemd[1]: Stopped Ceph osd.4 for 31d96aac-73c4-11ef-bceb-c7b262605968. 2024-09-16T01:03:10.713 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 16 01:03:10 smithi152 systemd[1]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.4.service: Consumed 8.038s CPU time. 2024-09-16T01:03:10.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:03:10.728 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T01:03:10.728 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T01:03:10.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.5 2024-09-16T01:03:11.052 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:10 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:10.761+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:11.052 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:10 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:10.761+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:11.052 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:10 smithi152 systemd[1]: Stopping Ceph osd.5 for 31d96aac-73c4-11ef-bceb-c7b262605968... 2024-09-16T01:03:11.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:11 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:11.051+0000 7f02c408f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:03:11.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:11 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:11.051+0000 7f02c408f640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-16T01:03:11.447 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:11 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:11.051+0000 7f02c408f640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:03:12.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:11 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:11.729+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:12.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:11 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:11.729+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:13.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:12 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:12.758+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:13.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:12 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:12.758+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:14.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:13 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:13.788+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:14.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:13 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:13.788+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:15.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:14 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:14.808+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:15.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:14 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:14.808+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:15.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:14 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:14.808+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-16T01:02:49.433481+0000 front 2024-09-16T01:02:49.433598+0000 (oldest deadline 2024-09-16T01:03:14.133324+0000) 2024-09-16T01:03:16.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:15 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:15.773+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-16T01:02:33.231119+0000 front 2024-09-16T01:02:33.231242+0000 (oldest deadline 2024-09-16T01:02:57.331260+0000) 2024-09-16T01:03:16.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:15 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:15.773+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-16T01:02:41.432245+0000 front 2024-09-16T01:02:41.432319+0000 (oldest deadline 2024-09-16T01:03:04.832445+0000) 2024-09-16T01:03:16.198 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:15 smithi152 ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5[74688]: 2024-09-16T01:03:15.773+0000 7f02c0694640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-16T01:02:49.433481+0000 front 2024-09-16T01:02:49.433598+0000 (oldest deadline 2024-09-16T01:03:14.133324+0000) 2024-09-16T01:03:16.852 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:16 smithi152 podman[92892]: 2024-09-16 01:03:16.455384665 +0000 UTC m=+5.505912846 container died b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:03:16.852 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:16 smithi152 podman[92892]: 2024-09-16 01:03:16.851447387 +0000 UTC m=+5.901975567 container cleanup b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-16T01:03:17.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:16 smithi152 bash[92892]: ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5 2024-09-16T01:03:17.197 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92907]: 2024-09-16 01:03:17.053051889 +0000 UTC m=+0.598401589 container remove b153302d1456adfb0b0ae1704b87ff0b782c3a0a1f5e81e13f0b0e104ff71a47 (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:03:17.665 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.26946885 +0000 UTC m=+0.015569418 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:03:17.665 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.387350026 +0000 UTC m=+0.133450638 container create 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-16T01:03:17.665 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.589943294 +0000 UTC m=+0.336043861 container init 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T01:03:17.665 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.593145425 +0000 UTC m=+0.339245992 container start 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T01:03:17.665 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.664784476 +0000 UTC m=+0.410885043 container attach 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:03:17.947 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:17 smithi152 podman[92994]: 2024-09-16 01:03:17.788784523 +0000 UTC m=+0.534885097 container died 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-16T01:03:18.323 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 16 01:03:18 smithi152 podman[93017]: 2024-09-16 01:03:18.301868612 +0000 UTC m=+0.507867868 container remove 872ee327698a2100b666f723ad9d0207a50993671e0abbad3ab58b2b63edb5fe (image=quay.ceph.io/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-31d96aac-73c4-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-16T01:03:18.328 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-31d96aac-73c4-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T01:03:18.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:03:18.367 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T01:03:18.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:03:18.531 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T01:03:44.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:03:44.820 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T01:03:57.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:03:57.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:03:57.310 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T01:03:57.312 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi053/crash 2024-09-16T01:03:57.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:03:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:tar: /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:03:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:03:57.354 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi152/crash 2024-09-16T01:03:57.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:03:57.379 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:03:57.379 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:03:57.380 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T01:03:57.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-16T01:03:57.435 INFO:tasks.cephadm:Compressing logs... 2024-09-16T01:03:57.435 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:03:57.477 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:03:57.503 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.ocdywv.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi152.nlmwrx.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.ocdywv.log: /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.gatezw.log 2024-09-16T01:03:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi152.nlmwrx.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi053.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:03:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.cdsuag.log 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi053.log: /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi053.log 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.cdsuag.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi053.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log: 94.0% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi053.log.gz 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:03:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi053.cjiiek.log 2024-09-16T01:03:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.4% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:03:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.jsdknu.log 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi053.cjiiek.log: 88.2% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.gatezw.log: 85.8% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi152.log 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log: 91.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:03:57.513 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T01:03:57.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi152.log: gzip -5 --verbose -- /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi152.log 2024-09-16T01:03:57.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.3.log: 91.9% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:03:57.514 INFO:teuthology.orchestra.run.smithi053.stderr: 91.7% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:03:57.521 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:03:57.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:03:57.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi152.log: 94.0% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi152.log.gz 2024-09-16T01:03:57.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:03:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.jsdknu.log: /var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:03:57.551 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi152.nlmwrx.log.gz 2024-09-16T01:03:57.780 INFO:teuthology.orchestra.run.smithi152.stderr: 92.5% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi152.log.gz 2024-09-16T01:03:57.909 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mgr.smithi053.cjiiek.log.gz 2024-09-16T01:03:58.381 INFO:teuthology.orchestra.run.smithi053.stderr: 90.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mon.smithi053.log.gz 2024-09-16T01:04:02.588 INFO:teuthology.orchestra.run.smithi152.stderr: 94.8% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.gatezw.log.gz 2024-09-16T01:04:02.690 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T01:04:03.763 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T01:04:03.815 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T01:04:03.945 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T01:04:04.481 INFO:teuthology.orchestra.run.smithi152.stderr: 94.8% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.ocdywv.log.gz 2024-09-16T01:04:04.516 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T01:04:04.518 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-16T01:04:04.518 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m7.026s 2024-09-16T01:04:04.518 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m30.885s 2024-09-16T01:04:04.518 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.062s 2024-09-16T01:04:04.853 INFO:teuthology.orchestra.run.smithi053.stderr: 93.5% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T01:04:10.708 INFO:teuthology.orchestra.run.smithi053.stderr: 94.9% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.jsdknu.log.gz 2024-09-16T01:05:41.093 INFO:teuthology.orchestra.run.smithi053.stderr: 92.6% -- replaced with /var/log/ceph/31d96aac-73c4-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi053.cdsuag.log.gz 2024-09-16T01:05:41.094 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-16T01:05:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:real 1m43.604s 2024-09-16T01:05:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:user 2m12.995s 2024-09-16T01:05:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m3.864s 2024-09-16T01:05:41.095 INFO:tasks.cephadm:Archiving logs... 2024-09-16T01:05:41.095 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi053/log 2024-09-16T01:05:41.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:06:00.339 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi152/log 2024-09-16T01:06:00.340 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:06:05.482 INFO:tasks.cephadm:Removing cluster... 2024-09-16T01:06:05.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 --force 2024-09-16T01:06:05.643 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T01:06:06.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 31d96aac-73c4-11ef-bceb-c7b262605968 --force 2024-09-16T01:06:06.219 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 31d96aac-73c4-11ef-bceb-c7b262605968 2024-09-16T01:06:06.520 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T01:06:06.520 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:06:06.537 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:06:06.552 INFO:tasks.cephadm:Teardown complete 2024-09-16T01:06:06.553 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:06:06.562 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:06:06.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:06:06.580 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:06:06.665 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:06:06.675 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:06:06.675 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:06:06.677 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:06:06.690 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:06:06.691 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -297us[ -281us] +/- 50ms 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -505us[ -505us] +/- 41ms 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 +1334us[+1334us] +/- 88ms 2024-09-16T01:06:06.695 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -287us[ -275us] +/- 50ms 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -537us[ -526us] +/- 57ms 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +1363us[+1363us] +/- 88ms 2024-09-16T01:06:06.697 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:06:06.697 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:06:06.707 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:06:06.708 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:06:06.718 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:06:06.822 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:06:06.898 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:06:06.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:06:06.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:06:06.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:06:06.957 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:06:06.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:06:06.980 INFO:teuthology.task.internal:Duration was 1921.230310 seconds 2024-09-16T01:06:06.980 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:06:06.991 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:06:06.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:06:06.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:06:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:06:07.036 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:06:07.486 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:06:07.486 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-16T01:06:07.487 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:06:07.508 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-16T01:06:07.508 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:06:07.556 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:06:07.556 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:06:07.559 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:06:07.622 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:06:07.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:06:07.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:06:08.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:06:08.338 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:06:08.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:06:08.365 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:06:08.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:06:08.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:06:08.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:06:08.429 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-16T01:06:08.454 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-16T01:06:08.467 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:06:08.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:06:08.499 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:06:08.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:06:08.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:06:08.534 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:06:08.535 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi053 2024-09-16T01:06:08.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:06:08.591 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906414/remote/smithi152 2024-09-16T01:06:08.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:06:08.629 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:06:08.629 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:06:08.631 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:06:08.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:06:08.689 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:06:08.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:06:08.701 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:06:08.701 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:06:08.703 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:06:08.716 INFO:teuthology.orchestra.run.smithi053.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:06 /home/ubuntu/cephtest 2024-09-16T01:06:08.732 INFO:teuthology.orchestra.run.smithi152.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:06 /home/ubuntu/cephtest 2024-09-16T01:06:08.733 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:06:08.745 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:06:08.772 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1921.2303104400635 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T01:06:08.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:06:08.853 INFO:teuthology.run:pass